support triton optimizer

[lugimzzz]

PR types

New features

PR changes

APIs

Description

支持triton版本adamw

• 启用方式"optim": "adamw_custom"
• "use_lowprecision_moment": "true"则moment1/moment2 为bf16

padldle使用triton方式：

pip install triton==3.2.0
python -m pip install git+https://github.com/zhoutianzi666/UseTritonInPaddle.git
python -c "import use_triton_in_paddle; use_triton_in_paddle.make_triton_compatible_with_paddle()"

[paddle-bot]

Thanks for your contribution!

[codecov]

Codecov Report

Attention: Patch coverage is 13.04348% with 80 lines in your changes missing coverage. Please review.

Project coverage is 48.68%. Comparing base (759ae99) to head (b476bea).
Report is 1 commits behind head on develop.

Files with missing lines	Patch %	Lines
paddlenlp/utils/optimizer.py	6.52%	43 Missing ⚠️
paddlenlp/utils/adamw_triton.py	16.27%	36 Missing ⚠️
paddlenlp/trainer/trainer.py	50.00%	1 Missing ⚠️

❌ Your patch check has failed because the patch coverage (13.04%) is below the target coverage (80.00%). You can increase the patch coverage or adjust the target coverage.
❌ Your project check has failed because the head coverage (48.68%) is below the target coverage (58.00%). You can increase the head coverage or adjust the target coverage.

Additional details and impacted files

@@             Coverage Diff             @@
##           develop   #10575      +/-   ##
===========================================
+ Coverage    48.66%   48.68%   +0.01%     
===========================================
  Files          768      769       +1     
  Lines       127103   127048      -55     
===========================================
- Hits         61860    61857       -3     
+ Misses       65243    65191      -52     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.