Show HN: Meta-agent: self-improving agent harnesses from live traces
Continual harness optimization. Contribute to canvas-org/meta-agent development by creating an account on GitHub.
Summary not yet generated for this article.
Original Text
We built meta-agent: an open-source library that automatically and continuously improves agent harnesses from production traces.
Point it at an existing agent, a stream of unlabeled production traces, and a small labeled holdout set.
An LLM judge scores unlabeled production traces as they stream.
A proposer reads failed traces and writes one targeted harness update at a time, such as changes to prompts, hooks, tools, or subagents. The update is kept only if it improves holdout accuracy.
On tau-bench v3 airline, meta-agent improved holdout accuracy from 67% to 87%.
We open-sourced meta-agent. It currently supports Claude Agent SDK, with more frameworks coming soon.
Try it here: https://github.com/canvas-org/meta-agent
Comments (0 of ) ⌛