Learning AI

This repository contains notes and code examples related to AI.

In-progress

• kv-cache llama kv-cache exploration
• llava llava exploration
• llama.cpp server llama.cpp server exploration

Topics

• Tokenization
• Architectures
• GGML
• Llama.cpp
• Position Embeddings
• GPUs
• Vector Databases

Examples/Exploration code

• GGML GGML C library exploration code
• Llama.cpp Llama.cpp library exploration code
• GPU CUDA, Kompute, Metal, OpenCL, ROCm, and Vulkan exploration code
• Embeddings Word embeddings examples in Rust and Python
• Huggingface API Huggingface API example written in Python
• Qdrant Vector Database Examples in Python and Rust
• LanceDB Vector Database Examples in Python and Rust