Skip to content

feat: support ascend qwen2 and qwen2_moe #6

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Aug 12, 2024
Merged

Conversation

yao-fengchen
Copy link
Collaborator

No description provided.

@yao-fengchen yao-fengchen merged commit 83a1105 into infer_ext Aug 12, 2024
zhaochaoxing pushed a commit that referenced this pull request Aug 20, 2024
* feat: support ascend qwen2 and qwen2_moe

* fix: fix ascend mixtral
jinminxi104 pushed a commit that referenced this pull request Aug 20, 2024
* feat: support ascend qwen2 and qwen2_moe

* fix: fix ascend mixtral
jinminxi104 pushed a commit that referenced this pull request Aug 22, 2024
* feat: support ascend qwen2 and qwen2_moe

* fix: fix ascend mixtral
pdx1989 added a commit that referenced this pull request Aug 23, 2024
Optimize cogvlm performance.

Patch cogvlm language part.

Remove some redundant code.

Remove some changes.

Remove some variables.

feat: change infer_ext ops function param order (#2)

feat: support ascend qwen2 and qwen2_moe (#6)

* feat: support ascend qwen2 and qwen2_moe

* fix: fix ascend mixtral

ascend: align attention mask to 32bytes (#7)

fix attn args (#9)

fix: expand shape of attn_mask (#10)

Fix list.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant