Related Articles

A selection of related articles published in my other newsletter, The Kaitchup:

Fast Speculative Decoding with Llama 3.2 and vLLM

Train and Serve an AI Chatbot Based on Llama 3.2

QLoRA with AutoRound: Cheaper and Better LLM Fine-tuning on Your GPU

Run Llama 3.1 70B Instruct on Your GPU with ExLlamaV2 (2.2, 2.5, 3.0, and 4.0-bit)

How to Set Up a PEFT LoraConfig

DoRA vs. LoRA: Better and Faster than LoRA?

Google's Gemma: Fine-tuning, Quantization, and Inference on Your Computer

Run Llama 3 70B on Your GPU with ExLlamaV2

SqueezeLLM: Better 3-bit and 4-bit Quantization for Large Language Models

QLoRA: Fine-Tune a Large Language Model on Your GPU