Popular repositories Loading

1. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 1 2

2. neural-compressor neural-compressor Public

   Forked from intel/neural-compressor

   Intel® Neural Compressor (formerly known as Intel® Low Precision Optimization Tool), targeting to provide unified APIs for network compression technologies, such as low precision quantization, spar…

   Python

3. accelerate accelerate Public

   Forked from huggingface/accelerate

   🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision

   Python

4. tau tau Public

   Forked from pytorch/PiPPy

   Pipeline Parallelism for PyTorch

   Python

5. optimum-intel optimum-intel Public

   Forked from huggingface/optimum-intel

   Accelerate inference of 🤗 Transformers with Intel optimization tools

   Jupyter Notebook 1

6. transformers transformers Public

   Forked from huggingface/transformers

   🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

   Python 3