Integrate support for Transformers models

[pelikhan]

Add support for the Hugging Face Transformers model, enabling text generation capabilities within the application. This includes necessary imports, model handling, and configuration updates.

---

Pull Request Description

Summary of Changes

• 🚀 Introduced Hugging Face Transformers.js: Added experimental support for Hugging Face Transformers.js, enabling on-device model execution. This includes new documentation and configuration options.
• 📦 Dependencies Update: Added @huggingface/transformers as an optional dependency in both cli and core packages to support the new Transformers feature.
• 🔧 Code Refactoring: Removed unused code related to encoding messages for Llama, streamlining the chat processing logic.
• 🌐 Model Provider Enhancements: Integrated a new model provider transformers into the system, including constants and model resolution logic.
• 🆕 New Sample Script: Added a sample script transformers.genai.mjs to demonstrate the usage of the new Transformers feature.
• 🛠️ Build Script Adjustments: Updated build scripts to include @huggingface/transformers as an external dependency where necessary.

Notes

• The Hugging Face Transformers.js provider is experimental and may not work with all models.

generated by prd