top of page

Profile

Join date: Feb 18, 2023

Posts (303)

Sep 26, 2026 ∙ 3 min
The Quiet Engine Behind Cheap AI: AI Distillation
On 27 January 2025, Nvidia lost roughly $589 billion in market value in a single trading session. The trigger was DeepSeek-R1, a reasoning model from a Chinese lab that matched far more expensive systems at a fraction of the price. Two days later, OpenAI said it had seen evidence that DeepSeek had used its models to train its own, through a technique called distillation. Most people had never heard the word. Within weeks, it was a question for markets, regulators, and courts. When I went...

10
0
Sep 13, 2026 ∙ 2 min
Global Distillation
Inspiration On 27 January 2025, DeepSeek-R1 wiped $589B off Nvidia's market capitalization in a single session — the largest one-day loss in stock-market history. Two days later, OpenAI accused DeepSeek of distilling its models. Within weeks, distillation became an export-control question, a Senate-hearing question, and an EU AI Act question. Distillation is the quiet engine behind most models people actually pay for — GPT-4o-mini, Gemini Flash, Claude Haiku, Llama 3.2, the entire R1-Distill...

5
0
Sep 5, 2026 ∙ 2 min
How Small AI Models Get So Good
Most people who use an AI assistant every day have never heard the word "distillation," and yet it shapes nearly everything they pay for. The fast, affordable models that answer customer emails, draft code, and summarize documents are rarely the giant frontier systems that make headlines. They are smaller students, trained to imitate a much larger teacher. That handoff of capability from big to small is knowledge distillation, and until recently there was no single place to understand it as a...

8
0
2
H Peter Alesso

H Peter Alesso

Admin
More actions
bottom of page