Implementation of iteration over values of a column in an IterableDataset object

[TopCoder2K]

Refers to this issue.

[TopCoder2K]

A couple of questions:

1. I've noticed two strange things: 1) "Around 80% of the final dataset is made of the en_dataset" in https://huggingface.co/docs/datasets/stream, 2) "Click on "Pull request" to send your to the project maintainers" in https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md Are en_dataset and "your [???]" typos? If so, I can fix them in this PR.
2. Should I update https://huggingface.co/docs/datasets/stream or https://huggingface.co/docs/datasets/access#iterabledataset to include the new feature?

[lhoestq]

Great ! and chained indexing was easy indeed, thanks :)

regarding your questions:

I've noticed two strange things: 1) "Around 80% of the final dataset is made of the en_dataset" in https://huggingface.co/docs/datasets/stream, 2) "Click on "Pull request" to send your to the project maintainers" in https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md Are en_dataset and "your [???]" typos? If so, I can fix them in this PR.

Oh good catch, both should be fixed indeed. Feel free to open a new PR for those docs fixes

Should I update https://huggingface.co/docs/datasets/stream or https://huggingface.co/docs/datasets/access#iterabledataset to include the new feature?

Yep good idea, I think in both places, since /stream is supposed to be exhaustive, and /access already mentions accessing a specific column for Dataset

[TopCoder2K]

@lhoestq, thank you for the answers!

Yep good idea, I think in both places, since /stream is supposed to be exhaustive, and /access already mentions accessing a specific column for Dataset

👍, I'll try to add something.

By the way, do you have any ideas about why the CI pipelines have failed? Essentially, I've already encountered these problems here.
I think check_code_quality has failed due to the usage of pre-commit. The problem seems to be the old version of the ruff hook. I've tried v0.11.8 (the one that was installed with pip install -e ".[quality]") and pre-commit seems to work like make style now. However, I don't have any ideas about pyav since I don't know what it is...

[TopCoder2K]

I've updated /stream and /access, please check the style and clarity. By the way, I would like to add IterableDataset.skip near IterableDataset.take to mimic slicing. What do you think?

[lhoestq]

LGTM :)

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.