Most “self-improving” model releases improve the policy and leave the scaffold — the search loop, the retry logic, the tool-call harness — hand-built and frozen. Ornith-1.0 does the more interesting thing: it uses RL to generate the scaffold and the solution rollouts, then optimizes them jointly.

That’s the part worth your attention if you build agentic coding systems. The scaffold is usually what we tune by hand once and never touch again.

In production agent work the scaffold is where most of the reliability — and most of the cost — actually lives. If RL can learn a better one than the one I hand-wrote, that’s a quiet shift in who owns the orchestration layer. The HN discussion is mostly arguing benchmarks, but the training framing is the real signal.

If the model ships its own search loop, does your agent framework become a thin host — or a fight over who controls the trajectory?