Fine-Tuning from First Principles: LoRA, QLoRA, and Serverless Fine-Tuning on Crusoe

debnsuma.github.io · 2026-08-01 · by Long Nguyen ·generic
A ground-up journey into fine-tuning LLMs, where we build quantization and LoRA from scratch in plain PyTorch, combine them into QLoRA, and finally fine-tune Qwen3-8B into a PII redaction engine that outperforms a 70B model, using Crusoe’s Serverless Fine-Tuning.

Fine-Tuning from First Principles: LoRA, QLoRA, and Serverless Fine-Tuning on Crusoe

debnsuma.github.io · 22 images · 40 links

Comments (0)

No comments yet