fine-tuning
Latest stories covering fine-tuning, with summaries and links to related coverage.
3 articles · page 1 of 1
Connected topics
LoRA Speedrun – a public wall-clock leaderboard for fine-tuning techniques
tool
6 min read
GitHub repository Saivineeth147/lora-speedrun enables speedrunning LoRA fine-tuning for the Qwen2.5-1.5B model on a single L40S GPU, aiming for ≥ 57% accuracy on GSM8K. The project features a frozen task and hardware setup, with a public leaderboard that requires independent verification of timing runs conducted on Modal's sandbox using free compute credits.
Fine-tuning an LLM to write docs like it's 1995
opinion
11 min read
Fine-tuning an LLM can enable it to generate documentation in a style reminiscent of 1995. Local deployment of specialized LLMs is anticipated to become more common among tech writers by 2030, although current powerful connected models dominate.
Qwen3.5 Fine-Tuning Guide – Unsloth Documentation
tool
4 min read
Qwen3.5 can be fine-tuned locally with Unsloth, supporting both vision and text fine-tuning for model sizes ranging from 0.8B to 122B. Unsloth enables Qwen3.5 to train 1.5× faster and use 50% less VRAM compared to FA2 setups, with specific VRAM requirements for bf16 LoRA across different model sizes.