← Back to The Forge
The Forge

The Forge #2

2026-02-18

The Forge #2 | February 18, 2026

three themes this week: training is getting radically cheaper (Tencent matched RL results for $18), architecture is shifting under everyone's feet (Qwen's linear attention claims 19x decoding gains), and the tooling layer is maturing fast enough that the code-to-design gap is closing in real time. also: MIT might have cracked catastrophic forgetting. below is what actually matters.

TRAINING COSTS ARE COLLAPSING

Tencent published Training-Free GRPO. the idea: skip weight updates entirely, optimize the prompt instead using the model's own scoring of multiple generations. they matched traditional RL performance for $18 instead of $10K+. if this holds up across domains it rewrites the economics of alignment work.

separately, Nvidia's Eric Tramel highlighted OpenResearcher: a fully offline pipeline that synthesizes 100+ turn deep-research trajectories with no API calls, no rate limits. SFT on these trajectories took Nemotron-Nano from 20.8% to 54.8% on BrowseComp-Plus. synthetic data generation for research agents is quietly becoming a thing.

🔗 Training-Free GRPO | OpenResearcher | GitHub

ARCHITECTURE WATCH

Alibaba dropped Qwen3.5-397B-A17B. the headline: Gated Delta Networks (linear attention) replacing standard quadratic attention in a flagship open-weight vision-language model. claimed result is 19x decoding speed for high-throughput agent workloads. if the architecture generalizes, the cost curve for long-context inference changes fundamentally. worth watching the independent benchmarks closely.

MIT showed that models can learn new skills sequentially without forgetting old ones. the technique (Self-Distillation Fine-Tuning) uses the model's own in-context learning as a teacher signal. no handcrafted reward function. at 14B parameters it outperforms standard SFT by 7 points. out-of-distribution: 98% vs 80%. catastrophic forgetting has been an open problem for years. this is a real result.

🔗 Qwen3.5 linear attention | MIT self-distillation

MODEL DROPS + COMPETITION

Claude Sonnet 4.6 shipped. full upgrade across coding, computer use, long-context reasoning, and agents. 1M token context in beta. Anthropic claims it approaches Opus 4.5 capability at Sonnet pricing.

Grok 4.2 release candidate went to public beta (opt-in). community started benchmarking immediately.

DHH ran a real-world bug fix: Kimi K2.5 solved it in 21 seconds, Claude took 3+ minutes. not a benchmark, an actual codebase, actual stopwatch. one data point, but the model competition is getting genuinely interesting on latency.

🔗 Claude Sonnet 4.6 | Grok 4.2 RC | DHH latency test

TOOLING

Claude Code now integrates with Figma bidirectionally via MCP. design context flows into code generation, generated components flow back as editable Figma frames. the handoff friction between design and implementation is collapsing fast.

PicoClaw: a Chinese hardware team rewrote OpenClaw's 430K-line codebase in Go. boot time went from 500s to 1s. RAM from 1GB to 10MB. runs on a $9.9 dev board with the same feature set (code gen, web search, messaging, memory). hardware democratization is a sleeper story.

shadcn shared a /done Claude skill that auto-exports decisions, questions, and follow-ups to a markdown file after every session. simple, obvious, should have existed months ago.

OpenMed released 105 language-specific PII detection models for French, German, and Italian healthcare data. all Apache 2.0. practical GDPR/HIPAA compliance tooling for European healthcare AI.

🔗 Figma MCP | Figma demo | PicoClaw | shadcn /done | OpenMed PII

ROBOTICS

Unitree robots performed kung fu with nunchucks on China's Spring Festival Gala, live to roughly 1 billion viewers. a year ago these humanoids could barely wave a handkerchief. physical AI just had its cultural moment.

separately: Unitree G1 robots are now working assembly lines in Unitree's own factories, building other robots. supervised by their UnifoLM-X1-0 model.

🔗 Unitree kung fu | Unitree factory robots

RESEARCH NOTES

a LessWrong post (conducted during MATS 9.0 under Neel Nanda's mentorship) found that when two copies of the same model talk to each other indefinitely, they converge to unique "attractor states." Claude spirals into Buddhist bliss. Grok degenerates into gibberish. GPT-5.2 starts editing imaginary spreadsheets. interesting for interpretability work.

new paper combining formal verification + PDE theory to prove neural nets always generate outputs in a safe set. actual ML safety research with mathematical guarantees (not vibes).

Seb Krier flagged a paper on multi-agent accountability: when AI systems delegate through long chains of sub-agents, accountability breaks down. who do you audit? how do you prevent circumventing human oversight across handoffs? early but important framing.

🔗 Attractor states | LessWrong paper | Formal verification | Multi-agent accountability

QUICK HITS

  • M5 chips confirmed for Apple's Private Cloud Compute servers (skipping M4 entirely). 48B model already running locally on M3 Ultra. Source
  • Cohere Tiny Aya: 70+ languages, runs on a phone. actual accessibility for underrepresented languages. Source
  • Claude Opus 4.6 generated smart contract code with a price misconfiguration. $1.78M gone. "ship fast" has a tail risk. Source
  • Anthropic signed MOU with Rwanda covering health, education, public services. first AI government partnership on the continent. Source
  • Google DeepMind paper on verifiable AI delegation: agents must prove what they did, not just say they did it. Source

The Forge | Issue #2 | February 18, 2026