Cannot import underthesea 6.2.0 on macOS 10.11 with Python 3.9.16

[BLKSerene]

Hi, when trying to import underthesea 6.2.0 on macOS 10.11 with Python 3.9.16, it shows the following errors:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/underthesea/__init__.py", line 37, in <module>
    from .pipeline.text_normalize import text_normalize
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/underthesea/pipeline/text_normalize/__init__.py", line 2, in <module>
    from underthesea.pipeline.word_tokenize.regex_tokenize import tokenize
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/underthesea/pipeline/word_tokenize/__init__.py", line 3, in <module>
    from .model import CRFModel
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/underthesea/pipeline/word_tokenize/model.py", line 4, in <module>
    from underthesea_core import CRFFeaturizer
ImportError: dlopen(/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/underthesea_core.cpython-39-darwin.so, 2): no suitable image found.  Did find:
	/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/underthesea_core.cpython-39-darwin.so: cannot load 'underthesea_core.cpython-39-darwin.so' (load command 0x80000034 is unknown)

If downgrade to underthesea 6.1.1, everything is OK.

[rain1024]

@BLKSerene Please show me how you install and the commands you used.

I can run underthese 6.2.0 on MacOS 12.6.3 with Python 3.9.16 normally.

My environement

(test39) anhv:~ anhv$ sw_vers
ProductName:	macOS
ProductVersion:	12.6.3
BuildVersion:	21G419

[BLKSerene]

@rain1024 I simply run pip3 install --upgrade underthesea to upgrade underthesea to the latest version (currently 6.2.0) on OS X 10.11 (uninstalling underthesea first and then reinstalling it does not fix the issue, downgrading to 6.1.1 works).

The errors occurred upon:
import underthesea
which means no functions could be used with underthesea 6.2.0 / Python 3.9.16 on OS X 10.11.

I did not test it on newer macOSes. This issue might be related to old macOS/OS X only.

[rain1024]

@BLKSerene

...
underthesea_core.cpython-39-darwin.so: cannot load 'underthesea_core.cpython-39-darwin.so'

I simply run pip3 install --upgrade underthesea

I think this issue is related with underthsea_core, I upgrade underthesea_core to 1.0.0 in underthesea==6.2.0

Can you give me the result when you run pip freeze in your environement

[BLKSerene]

@rain1024

altgraph==0.17.3
beautifulsoup4==4.11.2
blis==0.7.9
botok==0.8.10
ca-core-news-sm @ file:///Users/blkserene/Desktop/spacy_models/ca_core_news_sm-3.5.0-py3-none-any.whl
catalogue==2.0.8
certifi==2022.12.7
charset-normalizer==3.1.0
click==8.1.3
confection==0.0.4
contourpy==1.0.7
cycler==0.11.0
cymem==2.0.7
da-core-news-sm @ file:///Users/blkserene/Desktop/spacy_models/da_core_news_sm-3.5.0-py3-none-any.whl
DAWG-Python==0.7.2
de-core-news-sm @ file:///Users/blkserene/Desktop/spacy_models/de_core_news_sm-3.5.0-py3-none-any.whl
docopt==0.6.2
el-core-news-sm @ file:///Users/blkserene/Desktop/spacy_models/el_core_news_sm-3.5.0-py3-none-any.whl
en-core-web-sm @ file:///Users/blkserene/Desktop/spacy_models/en_core_web_sm-3.5.0-py3-none-any.whl
es-core-news-sm @ file:///Users/blkserene/Desktop/spacy_models/es_core_news_sm-3.5.0-py3-none-any.whl
et-xmlfile==1.1.0
fi-core-news-sm @ file:///Users/blkserene/Desktop/spacy_models/fi_core_news_sm-3.5.0-py3-none-any.whl
fonttools==4.39.2
fr-core-news-sm @ file:///Users/blkserene/Desktop/spacy_models/fr_core_news_sm-3.5.0-py3-none-any.whl
hr-core-news-sm @ file:///Users/blkserene/Desktop/spacy_models/hr_core_news_sm-3.5.0-py3-none-any.whl
idna==3.4
install==1.3.5
it-core-news-sm @ file:///Users/blkserene/Desktop/spacy_models/it_core_news_sm-3.5.0-py3-none-any.whl
ja-core-news-sm @ file:///Users/blkserene/Desktop/spacy_models/ja_core_news_sm-3.5.0-py3-none-any.whl
jieba==0.42.1
Jinja2==3.1.2
joblib==1.2.0
kiwisolver==1.4.4
langcodes==3.3.0
lingua-language-detector==1.3.2
lt-core-news-sm @ file:///Users/blkserene/Desktop/spacy_models/lt_core_news_sm-3.5.0-py3-none-any.whl
lxml==4.9.2
macholib==1.16.2
MarkupSafe==2.1.2
matplotlib==3.5.3
mk-core-news-sm @ file:///Users/blkserene/Desktop/spacy_models/mk_core_news_sm-3.5.0-py3-none-any.whl
murmurhash==1.0.9
nb-core-news-sm @ file:///Users/blkserene/Desktop/spacy_models/nb_core_news_sm-3.5.0-py3-none-any.whl
networkx==3.0
nl-core-news-sm @ file:///Users/blkserene/Desktop/spacy_models/nl_core_news_sm-3.5.0-py3-none-any.whl
nltk==3.8.1
numpy==1.24.2
opencc-python-reimplemented==0.1.7
openpyxl==3.1.2
packaging==23.0
pathy==0.10.1
Pillow==9.4.0
pl-core-news-sm @ file:///Users/blkserene/Desktop/spacy_models/pl_core_news_sm-3.5.0-py3-none-any.whl
preshed==3.0.8
pt-core-news-sm @ file:///Users/blkserene/Desktop/spacy_models/pt_core_news_sm-3.5.0-py3-none-any.whl
pydantic==1.10.6
pyinstaller @ file:///Users/blkserene/Desktop/Wordless/utils/pyinstaller-5.9.0_modified.zip
pyinstaller-hooks-contrib==2023.1
pymorphy3==1.2.0
pymorphy3-dicts-ru==2.4.417150.4580142
pymorphy3-dicts-uk==2.4.1.1.1663094765
pyparsing==3.0.9
pypdf==3.6.0
pyphen==0.14.0
PyQt5==5.10
pythainlp==3.1.1
python-crfsuite==0.9.9
python-dateutil==2.8.2
python-docx==0.8.11
python-mecab-ko==1.3.3
python-mecab-ko-dic==2.1.1.post2
PyYAML==6.0
regex==2022.10.31
requests==2.28.2
ro-core-news-sm @ file:///Users/blkserene/Desktop/spacy_models/ro_core_news_sm-3.5.0-py3-none-any.whl
ru-core-news-sm @ file:///Users/blkserene/Desktop/spacy_models/ru_core_news_sm-3.5.0-py3-none-any.whl
sacremoses==0.0.53
scikit-learn==1.2.2
scipy==1.10.1
simplemma==0.9.1
sip==4.19.25
six==1.16.0
smart-open==6.3.0
soupsieve==2.4
spacy==3.5.1
spacy-legacy==3.0.12
spacy-loggers==1.0.4
spacy-lookups-data==1.0.3
spacy-pkuseg==0.0.32
srsly==2.4.6
SudachiDict-core==20230110
SudachiPy==0.6.7
sv-core-news-sm @ file:///Users/blkserene/Desktop/spacy_models/sv_core_news_sm-3.5.0-py3-none-any.whl
textblob==0.17.1
thinc==8.1.9
threadpoolctl==3.1.0
tqdm==4.65.0
typer==0.7.0
typing_extensions==4.5.0
uk-core-news-sm @ file:///Users/blkserene/Desktop/spacy_models/uk_core_news_sm-3.5.0-py3-none-any.whl
underthesea==6.1.1
underthesea_core==0.0.5a2
urllib3==1.26.15
wasabi==1.1.1
wordcloud==1.8.2.2
zh-core-web-sm @ file:///Users/blkserene/Desktop/spacy_models/zh_core_web_sm-3.5.0-py3-none-any.whl

[rain1024]

@BLKSerene Please run

pip3 install --upgrade underthesea
pip3 install --upgrade underthesea_core

and make sure your package will be

underthesea==6.2.0
underthesea_core==1.0.0

I think it will works well.

On way to test it is you can create new seperated environement (with venv or conda) and install underthesea with

pip install underthesea==6.2.0

[BLKSerene]

@rain1024 I tried setting up a clean virtual environment and install only the latest version of underthesea and underthesea_core. All installations are OK, but it does not work on import.

BLKSerenes-Mac:1 blkserene$ python3 -m venv .venv
BLKSerenes-Mac:1 blkserene$ source .venv/bin/activate

(.venv) BLKSerenes-Mac:1 blkserene$ python3 -m pip install --upgrade pip
Requirement already satisfied: pip in ./.venv/lib/python3.9/site-packages (22.0.4)
Collecting pip
  Downloading pip-23.0.1-py3-none-any.whl (2.1 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.1/2.1 MB 5.7 MB/s eta 0:00:00
Installing collected packages: pip
  Attempting uninstall: pip
    Found existing installation: pip 22.0.4
    Uninstalling pip-22.0.4:
      Successfully uninstalled pip-22.0.4
Successfully installed pip-23.0.1
(.venv) BLKSerenes-Mac:1 blkserene$ pip3 install --upgrade setuptools
Requirement already satisfied: setuptools in ./.venv/lib/python3.9/site-packages (58.1.0)
Collecting setuptools
  Downloading setuptools-67.6.0-py3-none-any.whl (1.1 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 1.7 MB/s eta 0:00:00
Installing collected packages: setuptools
  Attempting uninstall: setuptools
    Found existing installation: setuptools 58.1.0
    Uninstalling setuptools-58.1.0:
      Successfully uninstalled setuptools-58.1.0
Successfully installed setuptools-67.6.0

(.venv) BLKSerenes-Mac:1 blkserene$ pip3 list
Package    Version
---------- -------
pip        23.0.1
setuptools 67.6.0

(.venv) BLKSerenes-Mac:1 blkserene$ pip3 install underthesea
Collecting underthesea
  Downloading underthesea-6.2.0-py3-none-any.whl (19.2 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19.2/19.2 MB 7.1 MB/s eta 0:00:00
Collecting python-crfsuite>=0.9.6
  Downloading python_crfsuite-0.9.9-cp39-cp39-macosx_10_9_x86_64.whl (183 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 183.6/183.6 kB 22.2 MB/s eta 0:00:00
Collecting joblib
  Downloading joblib-1.2.0-py3-none-any.whl (297 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 298.0/298.0 kB 8.7 MB/s eta 0:00:00
Collecting PyYAML
  Downloading PyYAML-6.0-cp39-cp39-macosx_10_9_x86_64.whl (197 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 197.6/197.6 kB 7.9 MB/s eta 0:00:00
Collecting Click>=6.0
  Downloading click-8.1.3-py3-none-any.whl (96 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 96.6/96.6 kB 6.5 MB/s eta 0:00:00
Collecting tqdm
  Downloading tqdm-4.65.0-py3-none-any.whl (77 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 77.1/77.1 kB 5.4 MB/s eta 0:00:00
Collecting scikit-learn
  Downloading scikit_learn-1.2.2-cp39-cp39-macosx_10_9_x86_64.whl (9.1 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.1/9.1 MB 6.0 MB/s eta 0:00:00
Collecting underthesea-core==1.0.0
  Downloading underthesea_core-1.0.0-cp39-cp39-macosx_10_7_x86_64.whl (542 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 542.1/542.1 kB 6.8 MB/s eta 0:00:00
Collecting requests
  Downloading requests-2.28.2-py3-none-any.whl (62 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.8/62.8 kB 6.3 MB/s eta 0:00:00
Collecting nltk
  Downloading nltk-3.8.1-py3-none-any.whl (1.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.5/1.5 MB 6.8 MB/s eta 0:00:00
Collecting regex>=2021.8.3
  Downloading regex-2022.10.31-cp39-cp39-macosx_10_9_x86_64.whl (293 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 293.9/293.9 kB 6.3 MB/s eta 0:00:00
Collecting charset-normalizer<4,>=2
  Downloading charset_normalizer-3.1.0-cp39-cp39-macosx_10_9_x86_64.whl (124 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 124.7/124.7 kB 8.7 MB/s eta 0:00:00
Collecting idna<4,>=2.5
  Downloading idna-3.4-py3-none-any.whl (61 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.5/61.5 kB 6.4 MB/s eta 0:00:00
Collecting certifi>=2017.4.17
  Downloading certifi-2022.12.7-py3-none-any.whl (155 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 155.3/155.3 kB 7.9 MB/s eta 0:00:00
Collecting urllib3<1.27,>=1.21.1
  Downloading urllib3-1.26.15-py2.py3-none-any.whl (140 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 140.9/140.9 kB 7.0 MB/s eta 0:00:00
Collecting scipy>=1.3.2
  Downloading scipy-1.10.1-cp39-cp39-macosx_10_9_x86_64.whl (35.2 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35.2/35.2 MB 4.9 MB/s eta 0:00:00
Collecting numpy>=1.17.3
  Downloading numpy-1.24.2-cp39-cp39-macosx_10_9_x86_64.whl (19.8 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19.8/19.8 MB 7.4 MB/s eta 0:00:00
Collecting threadpoolctl>=2.0.0
  Downloading threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Installing collected packages: underthesea-core, python-crfsuite, urllib3, tqdm, threadpoolctl, regex, PyYAML, numpy, joblib, idna, Click, charset-normalizer, certifi, scipy, requests, nltk, scikit-learn, underthesea
Successfully installed Click-8.1.3 PyYAML-6.0 certifi-2022.12.7 charset-normalizer-3.1.0 idna-3.4 joblib-1.2.0 nltk-3.8.1 numpy-1.24.2 python-crfsuite-0.9.9 regex-2022.10.31 requests-2.28.2 scikit-learn-1.2.2 scipy-1.10.1 threadpoolctl-3.1.0 tqdm-4.65.0 underthesea-6.2.0 underthesea-core-1.0.0 urllib3-1.26.15

(.venv) BLKSerenes-Mac:1 blkserene$ pip3 install --upgrade underthesea_core
Requirement already satisfied: underthesea_core in ./.venv/lib/python3.9/site-packages (1.0.0)
(.venv) BLKSerenes-Mac:1 blkserene$ pip3 install --upgrade underthesea
Requirement already satisfied: underthesea in ./.venv/lib/python3.9/site-packages (6.2.0)
Requirement already satisfied: nltk in ./.venv/lib/python3.9/site-packages (from underthesea) (3.8.1)
Requirement already satisfied: PyYAML in ./.venv/lib/python3.9/site-packages (from underthesea) (6.0)
Requirement already satisfied: python-crfsuite>=0.9.6 in ./.venv/lib/python3.9/site-packages (from underthesea) (0.9.9)
Requirement already satisfied: underthesea-core==1.0.0 in ./.venv/lib/python3.9/site-packages (from underthesea) (1.0.0)
Requirement already satisfied: joblib in ./.venv/lib/python3.9/site-packages (from underthesea) (1.2.0)
Requirement already satisfied: tqdm in ./.venv/lib/python3.9/site-packages (from underthesea) (4.65.0)
Requirement already satisfied: scikit-learn in ./.venv/lib/python3.9/site-packages (from underthesea) (1.2.2)
Requirement already satisfied: requests in ./.venv/lib/python3.9/site-packages (from underthesea) (2.28.2)
Requirement already satisfied: Click>=6.0 in ./.venv/lib/python3.9/site-packages (from underthesea) (8.1.3)
Requirement already satisfied: regex>=2021.8.3 in ./.venv/lib/python3.9/site-packages (from nltk->underthesea) (2022.10.31)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in ./.venv/lib/python3.9/site-packages (from requests->underthesea) (1.26.15)
Requirement already satisfied: idna<4,>=2.5 in ./.venv/lib/python3.9/site-packages (from requests->underthesea) (3.4)
Requirement already satisfied: certifi>=2017.4.17 in ./.venv/lib/python3.9/site-packages (from requests->underthesea) (2022.12.7)
Requirement already satisfied: charset-normalizer<4,>=2 in ./.venv/lib/python3.9/site-packages (from requests->underthesea) (3.1.0)
Requirement already satisfied: threadpoolctl>=2.0.0 in ./.venv/lib/python3.9/site-packages (from scikit-learn->underthesea) (3.1.0)
Requirement already satisfied: numpy>=1.17.3 in ./.venv/lib/python3.9/site-packages (from scikit-learn->underthesea) (1.24.2)
Requirement already satisfied: scipy>=1.3.2 in ./.venv/lib/python3.9/site-packages (from scikit-learn->underthesea) (1.10.1)

(.venv) BLKSerenes-Mac:1 blkserene$ pip3 freeze
certifi==2022.12.7
charset-normalizer==3.1.0
click==8.1.3
idna==3.4
joblib==1.2.0
nltk==3.8.1
numpy==1.24.2
python-crfsuite==0.9.9
PyYAML==6.0
regex==2022.10.31
requests==2.28.2
scikit-learn==1.2.2
scipy==1.10.1
threadpoolctl==3.1.0
tqdm==4.65.0
underthesea==6.2.0
underthesea_core==1.0.0
urllib3==1.26.15

(.venv) BLKSerenes-Mac:1 blkserene$ python3
Python 3.9.13 (v3.9.13:6de2ca5339, May 17 2022, 11:37:23) 
[Clang 13.0.0 (clang-1300.0.29.30)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import underthesea
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/blkserene/Desktop/1/.venv/lib/python3.9/site-packages/underthesea/__init__.py", line 37, in <module>
    from .pipeline.text_normalize import text_normalize
  File "/Users/blkserene/Desktop/1/.venv/lib/python3.9/site-packages/underthesea/pipeline/text_normalize/__init__.py", line 2, in <module>
    from underthesea.pipeline.word_tokenize.regex_tokenize import tokenize
  File "/Users/blkserene/Desktop/1/.venv/lib/python3.9/site-packages/underthesea/pipeline/word_tokenize/__init__.py", line 3, in <module>
    from .model import CRFModel
  File "/Users/blkserene/Desktop/1/.venv/lib/python3.9/site-packages/underthesea/pipeline/word_tokenize/model.py", line 4, in <module>
    from underthesea_core import CRFFeaturizer
ImportError: dlopen(/Users/blkserene/Desktop/1/.venv/lib/python3.9/site-packages/underthesea_core.cpython-39-darwin.so, 2): no suitable image found.  Did find:
	/Users/blkserene/Desktop/1/.venv/lib/python3.9/site-packages/underthesea_core.cpython-39-darwin.so: cannot load 'underthesea_core.cpython-39-darwin.so' (load command 0x80000034 is unknown)

[rain1024]

@BLKSerene

Thanks for submitting your report.

After taking a look at the error log, it seems like the issue is with underthesea_core.cpython-39-darwin.so. I think it might be similar to the problem discussed in this link: huggingface/tokenizers#712 and home-assistant/core#74632 (ijl/orjson#276).
By the way, I use Rust to build underthesea_core too.

In my machine, site-packages folder has underthesea_core.cpython-39-darwin.so file

$ ls /Users/anhv/anaconda3/envs/test39/lib/python3.9/site-packages/ | grep underthesea_core
underthesea_core-1.0.0.dist-info
underthesea_core.cpython-39-darwin.so

I will conduct further investigation into this issue at a later time.

[rain1024]

@BLKSerene may be it related to #685

Please check with our latest version 6.5.0

[BLKSerene]

@rain1024 Unfortunely, after upgrading to Underthesea 6.5.0, it still does not work on OS X 10.11:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/underthesea/__init__.py", line 37, in <module>
    from .pipeline.text_normalize import text_normalize
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/underthesea/pipeline/text_normalize/__init__.py", line 2, in <module>
    from underthesea.pipeline.word_tokenize.regex_tokenize import tokenize
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/underthesea/pipeline/word_tokenize/__init__.py", line 3, in <module>
    from .model import CRFModel
  File "/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/underthesea/pipeline/word_tokenize/model.py", line 4, in <module>
    from underthesea_core import CRFFeaturizer
ImportError: dlopen(/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/underthesea_core.cpython-39-darwin.so, 2): no suitable image found.  Did find:
	/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/underthesea_core.cpython-39-darwin.so: cannot load 'underthesea_core.cpython-39-darwin.so' (load command 0x80000034 is unknown)

Note: I ran macOS 10.11 on my x64-based computer, so it has nothing to do with ARM.

[BLKSerene]

@rain1024 Here are some updates after my investigation and hope it would help a bit.
I suspect the problem lies in the fact that the Rust version you've used to build underthesea_core does not fully support macOS far back to El Capitan 10.11, since I've met the same issue with pydantic v2 which introduced pydantic_core that is also written in Rust.

Although the official documentation lists macOS 10.7+ as the tier-1 support and "guaranteed to work", it seems that the development team does not have the CI resource to test them actively, as discussed in rust-lang/release-team#2 and rust-lang/compiler-team#556.

So, is it possible for you to use an older version of Rust to build underthesea_core which might work properly on older macOSes such as El Capitan 10.11, though there are no information about exactly which version would work?...

Or, is it possible to cross-compile Rust libraries to target at older macOSes (I don't use Rust, so I'm not sure)?

[rain1024]

@BLKSerene Thank you for looking into this. It's quite the tale!

It reminds me to same issue #530 (when I try to support old version of CentOS)

I'll certainly look into it later.

[BLKSerene]

More updates:

I downloaded the source codes of underthesea-core 1.0.4 from PyPI and installed maturin to build wheel from source on OS X 10.11 with Python 3.10.11, then installed the compiled wheel of underthesea-core manually and upgrade underthesea via pip3 install --upgrade underthesea. Now no errors on importing underthesea and everything seem to work.

Since compiling from source works, I suppose that the codes are fine and the issue lies in the way the wheel targeting macOS 10.7 is built.

BLKSerenes-Mac:underthesea_core-1.0.4 blkserene$ maturin build
    Updating crates.io index
  Downloaded array-init v2.1.0
  Downloaded atty v0.2.14
  Downloaded aho-corasick v1.1.1
  Downloaded bstr v1.6.2
  Downloaded bstr v0.2.17
  Downloaded bumpalo v3.14.0
  Downloaded cast v0.3.0
  Downloaded clap v2.34.0
  Downloaded cqdb v0.5.8
  Downloaded crfs v0.1.3
  Downloaded criterion v0.3.6
  Downloaded criterion-plot v0.4.5
  Downloaded crossbeam-deque v0.8.3
  Downloaded crossbeam-epoch v0.9.15
  Downloaded crossbeam-utils v0.8.16
  Downloaded half v1.8.2
  Downloaded hermit-abi v0.1.19
  Downloaded indoc v0.3.6
  Downloaded indoc-impl v0.3.6
  Downloaded instant v0.1.12
  Downloaded js-sys v0.3.64
  Downloaded jhash v0.1.1
  Downloaded libc v0.2.148
  Downloaded log v0.4.20
  Downloaded memchr v2.6.3
  Downloaded memoffset v0.9.0
  Downloaded num-traits v0.2.16
  Downloaded oorandom v11.1.3
  Downloaded parking_lot v0.11.2
  Downloaded parking_lot_core v0.8.6
  Downloaded paste v0.1.18
  Downloaded paste-impl v0.1.18
  Downloaded plotters v0.3.5
  Downloaded plotters-backend v0.3.5
  Downloaded plotters-svg v0.3.5
  Downloaded proc-macro2 v1.0.67
  Downloaded proc-macro-hack v0.5.20+deprecated
  Downloaded pyo3 v0.15.2
  Downloaded pyo3-build-config v0.15.2
  Downloaded pyo3-macros v0.15.2
  Downloaded pyo3-macros-backend v0.15.2
  Downloaded rayon v1.8.0
  Downloaded rayon-core v1.12.0
  Downloaded redox_syscall v0.2.16
  Downloaded regex v1.9.5
  Downloaded regex-automata v0.1.10
  Downloaded regex-automata v0.3.8
  Downloaded regex-syntax v0.7.5
  Downloaded same-file v1.0.6
  Downloaded serde v1.0.188
  Downloaded serde_derive v1.0.188
  Downloaded serde_cbor v0.11.2
  Downloaded serde_json v1.0.107
  Downloaded smallvec v1.11.1
  Downloaded syn v2.0.37
  Downloaded textwrap v0.11.0
  Downloaded tinytemplate v1.2.1
  Downloaded unicode-ident v1.0.12
  Downloaded unicode-width v0.1.11
  Downloaded walkdir v2.4.0
  Downloaded wasm-bindgen v0.2.87
  Downloaded wasm-bindgen-backend v0.2.87
  Downloaded wasm-bindgen-macro v0.2.87
  Downloaded wasm-bindgen-macro-support v0.2.87
  Downloaded wasm-bindgen-shared v0.2.87
  Downloaded winapi-util v0.1.6
  Downloaded web-sys v0.3.64
  Downloaded 67 crates (6.6 MB) in 16.92s
🔗 Found pyo3 bindings
🐍 Found CPython 3.10 at /Library/Frameworks/Python.framework/Versions/3.10/bin/python3
💻 Using `MACOSX_DEPLOYMENT_TARGET=10.7` for x86_64-apple-darwin by default
   Compiling autocfg v1.1.0
   Compiling proc-macro2 v1.0.67
   Compiling unicode-ident v1.0.12
   Compiling cfg-if v1.0.0
   Compiling scopeguard v1.2.0
   Compiling proc-macro-hack v0.5.20+deprecated
   Compiling pyo3-build-config v0.15.2
   Compiling quote v1.0.33
   Compiling memchr v2.6.3
   Compiling syn v1.0.109
   Compiling memoffset v0.9.0
   Compiling crossbeam-utils v0.8.16
   Compiling once_cell v1.18.0
   Compiling crossbeam-epoch v0.9.15
   Compiling libc v0.2.148
   Compiling lock_api v0.4.10
   Compiling parking_lot_core v0.8.6
   Compiling instant v0.1.12
   Compiling smallvec v1.11.1
   Compiling rayon-core v1.12.0
   Compiling unindent v0.1.11
   Compiling pyo3-macros-backend v0.15.2
   Compiling indoc-impl v0.3.6
   Compiling crossbeam-deque v0.8.3
   Compiling paste-impl v0.1.18
   Compiling pyo3 v0.15.2
   Compiling aho-corasick v1.1.1
   Compiling bstr v1.6.2
   Compiling syn v2.0.37
   Compiling jhash v0.1.1
   Compiling bitflags v1.3.2
   Compiling regex-syntax v0.7.5
   Compiling array-init v2.1.0
   Compiling serde v1.0.188
   Compiling lazy_static v1.4.0
   Compiling regex-automata v0.1.10
   Compiling bstr v0.2.17
   Compiling cqdb v0.5.8
   Compiling serde_derive v1.0.188
   Compiling regex-automata v0.3.8
   Compiling paste v0.1.18
   Compiling parking_lot v0.11.2
   Compiling indoc v0.3.6
   Compiling pyo3-macros v0.15.2
   Compiling either v1.9.0
   Compiling rayon v1.8.0
   Compiling regex v1.9.5
   Compiling crfs v0.1.3
   Compiling underthesea_core v1.0.4 (/Users/blkserene/Desktop/underthesea_core-1.0.4)
    Finished dev [unoptimized + debuginfo] target(s) in 34.82s
📦 Built wheel for CPython 3.10 to /Users/blkserene/Desktop/underthesea_core-1.0.4/target/wheels/underthesea_core-1.0.4-cp310-cp310-macosx_10_7_x86_64.whl
BLKSerenes-Mac:underthesea_core-1.0.4 blkserene$ pip3 install /Users/blkserene/Desktop/underthesea_core-1.0.4/target/wheels/underthesea_core-1.0.4-cp310-cp310-macosx_10_7_x86_64.whl

Processing ./target/wheels/underthesea_core-1.0.4-cp310-cp310-macosx_10_7_x86_64.whl
Installing collected packages: underthesea-core
  Attempting uninstall: underthesea-core
    Found existing installation: underthesea_core 0.0.5a2
    Uninstalling underthesea_core-0.0.5a2:
      Successfully uninstalled underthesea_core-0.0.5a2
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
underthesea 6.1.1 requires underthesea-core==0.0.5a2, but you have underthesea-core 1.0.4 which is incompatible.
Successfully installed underthesea-core-1.0.4

BLKSerenes-Mac:underthesea_core-1.0.4 blkserene$ pip3 install underthesea --upgrade
Requirement already satisfied: underthesea in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (6.1.1)
Collecting underthesea
  Obtaining dependency information for underthesea from https://files.pythonhosted.org/packages/c2/08/f8827734caf4fee1642bb08129afca92579633d8f72fbf0bc2f9a73aa69c/underthesea-6.7.0-py3-none-any.whl.metadata
  Downloading underthesea-6.7.0-py3-none-any.whl.metadata (14 kB)
Requirement already satisfied: Click>=6.0 in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from underthesea) (8.1.7)
Requirement already satisfied: python-crfsuite>=0.9.6 in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from underthesea) (0.9.9)
Requirement already satisfied: nltk in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from underthesea) (3.8.1)
Requirement already satisfied: tqdm in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from underthesea) (4.66.1)
Requirement already satisfied: requests in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from underthesea) (2.31.0)
Requirement already satisfied: joblib in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from underthesea) (1.3.2)
Requirement already satisfied: scikit-learn in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from underthesea) (1.3.1)
Requirement already satisfied: PyYAML in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from underthesea) (6.0.1)
Requirement already satisfied: underthesea-core==1.0.4 in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from underthesea) (1.0.4)
Requirement already satisfied: regex>=2021.8.3 in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from nltk->underthesea) (2023.8.8)
Requirement already satisfied: charset-normalizer<4,>=2 in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from requests->underthesea) (3.2.0)
Requirement already satisfied: idna<4,>=2.5 in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from requests->underthesea) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from requests->underthesea) (2.0.5)
Requirement already satisfied: certifi>=2017.4.17 in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from requests->underthesea) (2023.7.22)
Requirement already satisfied: numpy<2.0,>=1.17.3 in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from scikit-learn->underthesea) (1.26.0)
Requirement already satisfied: scipy>=1.5.0 in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from scikit-learn->underthesea) (1.11.1)
Requirement already satisfied: threadpoolctl>=2.0.0 in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from scikit-learn->underthesea) (3.2.0)
Downloading underthesea-6.7.0-py3-none-any.whl (20.9 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20.9/20.9 MB 6.3 MB/s eta 0:00:00
Installing collected packages: underthesea
  Attempting uninstall: underthesea
    Found existing installation: underthesea 6.1.1
    Uninstalling underthesea-6.1.1:
      Successfully uninstalled underthesea-6.1.1
Successfully installed underthesea-6.7.0

BLKSerenes-Mac:underthesea_core-1.0.4 blkserene$ python3
Python 3.10.11 (v3.10.11:7d4cc5aa85, Apr  4 2023, 19:05:19) [Clang 13.0.0 (clang-1300.0.29.30)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> from underthesea import sentiment
>>> sentiment('hàng kém chất lg,chăn đắp lên dính lông lá khắp người. thất vọng')
'negative'