SqueezeAILab

Popular repositories Loading

1. LLMCompiler LLMCompiler Public

   [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

   Python 1.9k 138

2. SqueezeLLM SqueezeLLM Public

   [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

   Python 724 54

3. TinyAgent TinyAgent Public

   [EMNLP 2024 Demo] TinyAgent: Function Calling at the Edge!

   Python 500 75

4. KVQuant KVQuant Public

   [NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

   Python 436 49

5. LLM2LLM LLM2LLM Public

   [ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement

   Python 196 15

6. SqueezedAttention SqueezedAttention Public

   [ACL 2025] Squeezed Attention: Accelerating Long Prompt LLM Inference

   Python 58 7