AI Toolkit is your one-stop solution for integrating, training, and utilizing large language models and AI agents. Tailored to facilitate seamless workflows, it leverages the prowess of artificial intelligence to amplify your productivity and innovation.
AI Toolkit is open for collaboration! Join us to enhance AI Toolkit by participating in discussions, opening issues, or submitting PRs.
- Load Multiple Models ⚙️ Easily load various models from Huggingface and OpenAI, integrating the power of AI seamlessly.
- Train Your Models 🧠 Train your models with diverse file formats seamlessly integrated into the application.
- Chat with LLMs 💬 Engage with Large Language Models via the intuitive Chainlit Chatbot UI.
- Web Surfing to Train Capacity 🌐 (Under Development): Extract training data from the web for more nuanced model training.
- AI Agents for Task Automation 🤖 (Under Development): Utilize AI agents to automate specific tasks and workflows.
To get started with AI Toolkit, ensure you have Python 3.11 installed. Follow the steps below to install all the necessary dependencies:
pip install -r requirements.txt# To load the vector database
ai_toolkit load --db-path <path_to_vector_database>
# To train the model with the specified dataset
ai_toolkit train --dataset-path <path_to_dataset> --db-path <path_to_vector_database>DB_FAISS_PATH: Path to the vector database.DATASET_PATH: Path to the dataset.
We warmly welcome community contributions! Feel free to enhance AI Toolkit's capabilities through issues and pull requests.
This project is licensed under the MIT License - see the LICENSE file for details.