Agent Reliability
-
Ten Projects, One Foundation, and the Gaps That Now Have Numbers
The Agentic AI Foundation went from three hosted projects to ten in its first year, and OpenAI contributed the multi-provider request format. Four preprints from 3 and 4 November put numbers on what the gaps between those projects still cost.
-
The Trace Is Not a Record. Agent Telemetry Has No Released Standard.
OpenTelemetry evicted every gen_ai convention from core in June, and the repository that inherited them has never cut a release: 278 stability markers, all development, a manifest still declaring 1.42.0-dev. Two new datasets show what that costs, including one where 48.1% of transcript bytes fall outside a 2 MiB replay bound.
-
The Agent Checked Its Own Work and Called It Done
Six preprints from October and November measured agent reliability instead of asserting it. Chained coding tasks drop from 95% completion to 51%, 11.5% of tool calls return success without doing the work, and swapping durable-execution hosts changed nothing.