support MiMo-7B #4067

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merged

Jintao-Huang merged 2 commits into modelscope:main from Jintao-Huang:support_mimo

May 2, 2025

Collaborator

Jintao-Huang commented May 2, 2025

No description provided.


          update

e2288d0

Jintao-Huang linked an issue

that may be closed by this pull request

是否计划支持XiaomiMiMo/MiMo-7B模型的微调？ #4064

Closed


          update

7c705fe

Jintao-Huang merged commit 118d45e into modelscope:main

1 of 2 checks passed

tastelikefeet added a commit to tastelikefeet/swift that referenced this pull request


          Merge branch 'main' into feat/update_liger

73683aa

* main:
  fix enable_cache (modelscope#4091)
  Support ulysses for llm/mllm,dpo/sft (modelscope#4085)
  update docs (modelscope#4078)
  feat: support megatron wandb (modelscope#4074)
  feat: add run name support (modelscope#4072)
  fix padding_side left (modelscope#4069)
  bump version
  support MiMo-7B (modelscope#4067)
  fix packing eval streaming (modelscope#4066)
  Support empty think loss scale (modelscope#4065)
  support qwen3-moe awq (modelscope#4059)
  Fix grpo eval when gas > 1 (modelscope#4057)
  fix rollout(modelscope#4055)
  updates GRPOTrainer compatible with trl 0.17 (modelscope#3969)
  support Qwen2.5-Omni-3B (modelscope#4052)
  update wechat (modelscope#4047)

# Conflicts:
#	swift/llm/train/tuner.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet