File tree Expand file tree Collapse file tree 1 file changed +1
-2
lines changed Expand file tree Collapse file tree 1 file changed +1
-2
lines changed Original file line number Diff line number Diff line change @@ -31,13 +31,12 @@ huggingface-cli login
31
31
```
32
32
33
33
It's also possible to provide your Hugging Face token with the ` HF_TOKEN ` environment variable or passing the ` token ` option to the reader.
34
- If ` pyspark_huggingface ` is installed, PySpark (>=4) auto-imports it and enables the "huggingface" Data Source.
35
34
For more details about authentication, check out [ this guide] ( https://huggingface.co/docs/huggingface_hub/quick-start#authentication ) .
36
35
37
36
### Enable the "huggingface" Data Source
38
37
39
38
PySpark 4 came with a new Data Source API which allows to use datasets from custom sources.
40
- If ` pyspark_huggingface ` is installed, PySpark auto-imports it and enables the "huggingface" Data Dource .
39
+ If ` pyspark_huggingface ` is installed, PySpark auto-imports it and enables the "huggingface" Data Source .
41
40
42
41
The library also backports the Data Source API for the "huggingface" Data Source for PySpark 3.5, 3.4 and 3.3.
43
42
However in this case ` pyspark_huggingface ` should be imported explicitly to activate the backport and enable the "huggingface" Data Dource:
You can’t perform that action at this time.
0 commit comments