llamacpp
Here are 324 public repositories matching this topic...
AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.
-
Updated
Jul 5, 2024 - Python
FreeGenius AI, an advanced AI assistant that can talk and take multi-step actions. Supports numerous open-source LLMs via Llama.cpp or Ollama or Groq Cloud API, with optional integration with AutoGen agents, OpenAI API, Google Gemini Pro and unlimited plugins.
-
Updated
Jul 5, 2024 - Python
Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
-
Updated
Jul 5, 2024 - Python
APIs for inference, fine-tuning ML tasks
-
Updated
Jul 5, 2024 - Python
Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM, ONNX). Powers 👋 Jan
-
Updated
Jul 5, 2024 - C++
PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation
-
Updated
Jul 5, 2024 - C++
Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.
-
Updated
Jul 5, 2024 - Dart
Completion After Prompt Probability. Make your LLM make a choice
-
Updated
Jul 5, 2024 - Python
Unified framework for building enterprise RAG pipelines with small, specialized models
-
Updated
Jul 4, 2024 - Python
LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.
-
Updated
Jul 4, 2024 - Rust
This project offers a versatile platform for hand-related tasks, including dataset generation and custom hand gesture detection using Google's MediaPipe library and accelerated real-time sign language translation with LLMs on edge devices.
-
Updated
Jul 4, 2024 - Python
Private & local AI personal knowledge management app.
-
Updated
Jul 4, 2024 - TypeScript
Improve this page
Add a description, image, and links to the llamacpp topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the llamacpp topic, visit your repo's landing page and select "manage topics."