← Back to archive
Signals for 2026-08-02
Published 2026-08-02T08:16+02:00
10 geselecteerde signalen uit de lokale hybride Daily Signal Brief pipeline.
Simon Willison
A few days ago it was Anthropic discovering cryptographic weaknesses with Claude using Mythos Preview, spending $100,000 on tokens and with prompts that included "again we are not looking for low hanging fruit, we want proper research to find genuinly hard findings." Now it's OpenAI's turn to flex.
#evals #research-evals
The Decoder
A field report from OpenAI and academic partners shows coding agents can modernize neglected research software, with speedups of up to 60x. But the systems are "eloquent, convincing, and confidently wrong in ways that are easy to miss," participants say.
#agent #agentic-workflows #evals
Simon Willison
Tool: Slack Emoji Maker I wanted to create a new Slack emoji, and their tool recommends a square that's 128x128 and has a transparent background... so I had Fable build me this simple image editor against those requirements.
#tooling-runtime
The Decoder
OpenAI is building a new model family called "Astra" that would let multiple agents tackle complex problems together for hours or even days. CEO Sam Altman has already demoed Astra to policymakers in Washington.
#agent #agentic-workflows
Simon Willison
I wrote this summary of the past few weeks of open letters as a section of my sponsors-only newsletter but I've decided to share it here as well. Open Weights and American AI Leadership was shepherded by Microsoft, dated July 24th, and signed by 235 AI-adjacent companies including NVIDIA, Amazon, Y Combinator, The Linux Foundation and (a later signer) OpenAI.
#evals #models-architecture
The Decoder
A security researcher has demonstrated a worm-like attack on Microsoft Copilot for Word: invisible prompt injections hidden in documents spread automatically into new files every time they're reused. Microsoft confirmed the issue but failed to fix it after 144 days and two attempts.
#evals #research-evals
arXiv reasoning / agents / evals
Chemistry literature synthesis often requires assembling specific findings scattered across many publications, yet existing literature-search systems primarily return ranked document lists. As a result, scientists and AI agents need to locate relevant information, verify their provenance, and assemble cross-paper answers manually.
#agent #evals #research-evals
arXiv reasoning / agents / evals
While Multimodal Retrieval-Augmented Generation (MM-RAG) has shown promising results, it still struggles with complex multi-hop reasoning tasks. Existing methods primarily focus on independent instance-level matching, which often fails to capture explicit relationships across modalities and documents.
#builder #evals #research-evals
arXiv reasoning / agents / evals
Large language model-based multi-agent systems improve complex problem solving through task decomposition, agent specialization, information exchange, and intermediate validation. However, existing systems typically treat communication topology as a fixed design choice or an offline optimization target.
#agent #evals #research-evals
Google News AI Lab Watch
Supabase Open-Sources Evals to Grade Claude Code, Codex and OpenCode Startup Fortune
#builder #evals #tooling-runtime