Skip to content

Training data in a sequential order, without shuffle #3977

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
kyrie-maker opened this issue Apr 24, 2025 · 1 comment
Open

Training data in a sequential order, without shuffle #3977

kyrie-maker opened this issue Apr 24, 2025 · 1 comment

Comments

@kyrie-maker
Copy link

I'm currently using the Swift framework for model training and have encountered a scenario where I need to process training data in a sequential order, without shuffling. I understand that the default behavior is to shuffle data during training, and the documentation suggests that disabling this requires modifying the source code.

Before proceeding with source code modifications, I wanted to inquire if there's an existing method or recommended approach within the Swift framework to disable data shuffling during training. Specifically, is there a configuration parameter, command-line argument, or a way to customize the data loader to achieve this behavior?

@Jintao-Huang
Copy link
Collaborator

Please try: --dataset_shuffle false --train_dataloader_shuffle false

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants