Update ppo_model_utils.py

[ZHUI]

Before submitting

• Lint code. If there are lint issues, please format the code first.

# Install and register `pre-commit` in the project folder
pip install pre-commit && pre-commit install

# Process previous code files separately
pre-commit run --file XXXX.py

• Add test cases into tests folder. If there are codecov issues, please add tests cases first.

PR types

PR changes

Description

[paddle-bot]

Thanks for your contribution!

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

[codecov]

Codecov Report

Attention: Patch coverage is 0% with 3 lines in your changes missing coverage. Please review.

Project coverage is 46.98%. Comparing base (cd2d2dc) to head (f1a82de).
Report is 6 commits behind head on develop.

Files with missing lines	Patch %	Lines
paddlenlp/rl/models/pp_model_utils.py	0.00%	2 Missing ⚠️
paddlenlp/rl/models/ppo_model_utils.py	0.00%	1 Missing ⚠️

Additional details and impacted files

@@           Coverage Diff            @@
##           develop   #10593   +/-   ##
========================================
  Coverage    46.98%   46.98%           
========================================
  Files          799      799           
  Lines       132255   132255           
========================================
+ Hits         62136    62141    +5     
+ Misses       70119    70114    -5     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.