5. Apple: Embarrassingly Simple Self-Distillation Improves Code Generation (arxiv.org)

Can a large language model (LLM) improve at code generation using only its own raw outputs, without a verifier, a teacher model, or reinforcement learning? We answer in the affirmative with simple self-distillation (SSD): sample solutions from the model with certain temperature and truncation configurations, then fine-tune on those samples with standard supervised fine-tuning. SSD improves Qwen3-30B-Instruct from 42.4% to 55.3% pass@1 on LiveCodeBench v6, with gains concentrating on harder problems, and it generalizes across Qwen and Llama models at 4B, 8B, and 30B scale, including both instruct and thinking variants. To understand why such a simple method can work, we trace these gains to a precision-exploration conflict in LLM decoding and show that SSD reshapes token distributions in a context-dependent way, suppressing distractor tails where precision matters while preserving useful diversity where exploration matters. Taken together, SSD offers a complementary post-training direction for improving LLM code generation.

7. Apple approves driver that lets Nvidia eGPUs work with Arm Macs (www.theverge.com)

Did hell freeze over? Not quite: the driver belongs to Tiny Corp, not Nvidia, you’ll have to compile it with Docker rather than plug-and-play, and it’s designed for LLMs. But you no longer need to disable Apple’s System Integrity Protection (SIP), because Apple is letting that driver get signed, Tiny says.
[Image: Apple finally approved our driver for both AMD and NVIDIA,” Tiny writes. https://platform.theverge.com/wp-content/uploads/sites/2/2026/04/HEy9-blbAAABy-J.jpg?quality=90&strip=all]

28. The CMS is dead. Long live the CMS (next.jazzsequence.com)

I saw a post on LinkedIn the other day from a self-proclaimed 20 year agency veteran of WordPress saying that was it, they’re moving the entire agency off of WordPress and onto AI. Now, because I, too, am a 20 year veteran of WordPress, this kind of story catches my attention. He posted that they […]

Article Details

Browse by Date

Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open