[AutoParallel] Add test for PIR refined recompute

[waliwali777]

PR types

Others

PR changes

Others

Description

Judge refined_ops_patterns training args.
Add test for PIR refined recompute.

在 yaml 文件中的调用举例：

 enable_auto_parallel: 1
 to_static: 1
 recompute: 1
 refined_ops_patterns:
        - {main_ops: [flash_attn], num: -1, pre_ops: [], suf_ops: []}
        - {main_ops: [matmul], num: 2, pre_ops: [], suf_ops: [add]}

在python命令行参数中的调用举例

python -u -m paddle.distributed.launch \
                    --gpus "0,1,2,3" \
                    --log_dir $case_log_dir \
                    run_pretrain_auto.py \
                    --to_static \
                    --enable_auto_parallel 1 \ 
                    --recompute 1 \
                    --refined_ops_patterns '[{"main_ops":["matmul"],"num":-1,"pre_ops":["softmax"],"suf_ops":[]}]' \
                   ...

[paddle-bot]

Thanks for your contribution!

[codecov]

Codecov Report

Attention: Patch coverage is 57.14286% with 3 lines in your changes missing coverage. Please review.

Project coverage is 52.77%. Comparing base (b53f7eb) to head (f8f96ea).
Report is 3 commits behind head on develop.

Files with missing lines	Patch %	Lines
paddlenlp/trainer/training_args.py	50.00%	3 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #9679      +/-   ##
===========================================
- Coverage    53.39%   52.77%   -0.63%     
===========================================
  Files          720      718       -2     
  Lines       115809   112372    -3437     
===========================================
- Hits         61837    59304    -2533     
+ Misses       53972    53068     -904     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.