2.0.0 stable version,FlagData supports the following features
- Realize the high-quality content extraction of various original format data, and greatly reduce the processing cost.
- Provide the function of fine-tuning data perspective for large models.
- One-stop efficient distributed data processing function.