← Back to archive

Signals for 2026-08-02

Published 2026-08-02T08:16+02:00

10 geselecteerde signalen uit de lokale hybride Daily Signal Brief pipeline.

Ten advances in mathematics and theoretical computer science

Simon Willison

A few days ago it was Anthropic discovering cryptographic weaknesses with Claude using Mythos Preview, spending $100,000 on tokens and with prompts that included "again we are not looking for low hanging fruit, we want proper research to find genuinly hard findings." Now it's OpenAI's turn to flex.

#evals #research-evals

AI coding agents can modernize research software but can't judge if the science is right

The Decoder

A field report from OpenAI and academic partners shows coding agents can modernize neglected research software, with speedups of up to 60x. But the systems are "eloquent, convincing, and confidently wrong in ways that are easy to miss," participants say.

#agent #agentic-workflows #evals

Slack Emoji Maker

Simon Willison

Tool: Slack Emoji Maker I wanted to create a new Slack emoji, and their tool recommends a square that's 128x128 and has a transparent background... so I had Fable build me this simple image editor against those requirements.

#tooling-runtime

OpenAI announces its "next major model" Astra by dropping ten previously unsolved math solutions

The Decoder

OpenAI is building a new model family called "Astra" that would let multiple agents tackle complex problems together for hours or even days. CEO Sam Altman has already demoed Astra to policymakers in Washington.

#agent #agentic-workflows

Open letters about AI development

Simon Willison

I wrote this summary of the past few weeks of open letters as a section of my sponsors-only newsletter but I've decided to share it here as well. Open Weights and American AI Leadership was shepherded by Microsoft, dated July 24th, and signed by 235 AI-adjacent companies including NVIDIA, Amazon, Y Combinator, The Linux Foundation and (a later signer) OpenAI.

#evals #models-architecture

A security researcher built a self-spreading worm that hides inside Word docs and hijacks Microsoft Copilot

The Decoder

A security researcher has demonstrated a worm-like attack on Microsoft Copilot for Word: invisible prompt injections hidden in documents spread automatically into new files every time they're reused. Microsoft confirmed the issue but failed to fix it after 144 days and two attempts.

#evals #research-evals

AskChem: Claim-Centered Infrastructure for Chemistry Literature Synthesis

arXiv reasoning / agents / evals

Chemistry literature synthesis often requires assembling specific findings scattered across many publications, yet existing literature-search systems primarily return ranked document lists. As a result, scientists and AI agents need to locate relevant information, verify their provenance, and assemble cross-paper answers manually.

#agent #evals #research-evals

DualG-MRAG: Decoupling Macro-Reasoning and Micro-Matching for Multimodal Retrieval-Augmented Generation

arXiv reasoning / agents / evals

While Multimodal Retrieval-Augmented Generation (MM-RAG) has shown promising results, it still struggles with complex multi-hop reasoning tasks. Existing methods primarily focus on independent instance-level matching, which often fails to capture explicit relationships across modalities and documents.

#builder #evals #research-evals

MANTA: Multi-Agent Network Topology Adaptation for Self-Evolving Multi-Agent Systems

arXiv reasoning / agents / evals

Large language model-based multi-agent systems improve complex problem solving through task decomposition, agent specialization, information exchange, and intermediate validation. However, existing systems typically treat communication topology as a fixed design choice or an offline optimization target.

#agent #evals #research-evals

Supabase Open-Sources Evals to Grade Claude Code, Codex and OpenCode - Startup Fortune

Google News AI Lab Watch

Supabase Open-Sources Evals to Grade Claude Code, Codex and OpenCode Startup Fortune

#builder #evals #tooling-runtime