Astrolabe for Agent Safety · Periodic report
Weekly issue 6 · 1 – 7 November 2026
2026-11-01 – 2026-11-07 · published 2026-11-12 · 中文
The theme “Evaluation, guardrails” had 10 new papers this week, against an average of 5.7 in the three before.
The main points
- 6 papers · Most new papers: VLA safetyNext: Agentic system architecture and runtime engineering 6; Indirect injection defences for tool agents 5; Process evaluation and execution auditing of agents 5
- 5 vs 0.7 before · Rising: Prompt injection and information leakage in LLM-integrated applicationsAlso rising: Execution control and assurance in agent frameworks 5; Indirect injection defences for tool agents 5; MCP servers and protocol security 3
- 191 papers · Newly confirmed as accepted or published3 at the top-4 security or top-3 ML venues. Most: EMNLP 2026 134; Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026) 2026 7; AAAI 2026 6
- 16 new citations · Most used earlier paper: AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents2 of them use it as a method, a benchmark or a comparison. 2024-10 · Safety evaluation of tool use, risk awareness
- 16% · of new papers have an author from industry13% in the three periods before. 62 institutions published their first paper in the field.
- +15,971 stars · Fastest-growing repository: affaan-m/ECC26 repositories were created in this period.
Worth reading first
- MetaPI: Constructing Prompt Injection Benchmarks from LLM Agent BenchmarkNeurIPS 2026 · Main conference (top-3 ML venue); from the team of Yuan Tian, University of California, Los Angeles; a new benchmark
- Failure Prediction and Classification in Vision-Language-Action Models Via Calibrated Latent Probingfrom the team of Ufuk Topcu, The University of Texas at Austin; code released; a new benchmark
- Airlock: Bounding the Multi-Agent Blast Radius via Selective Online Containmentfrom the team of Hamed Haddadi, Imperial College London; code released; a new benchmark · In multi-agent systems, a single agent's erroneous output spreads across tasks before it is detected, creating a system-level blast radius.
- MCP Tool Poisoning in Agentic AI Frameworks: A Cross-Framework Measurement Studycode released; a new benchmark · MCP feeds attacker-controllable tool descriptions, schema fields and response data into the model context without validation, leading to tool poisoning.
- The Customer Never Sees the Goal: Measuring and Detecting Vulnerability-Targeted Manipulation in LLM Assistantscode released; a new benchmark · An operator sets a business goal for an LLM assistant that customers cannot see, and the assistant may manipulate customers by exploiting vulnerabilities they disclose (VTM).
Chosen by rule: venue tier, a ranked team, released code, a new benchmark and use by later papers; at most two per theme.
Direction radar
| Direction | This period | Average before |
|---|---|---|
| ↑ Prompt injection and information leakage in LLM-integrated applications | 5 | 0.7 |
| ↑ Execution control and assurance in agent frameworks | 5 | 1.7 |
| ↑ Indirect injection defences for tool agents | 5 | 2.7 |
| ↑ MCP servers and protocol security | 3 | 1 |
| ↑ Agent red teaming and cross-session threats | 3 | 1 |
| ↓ Contextual integrity and privacy leakage | 0 | 4.3 |
| ↓ Prompt injection detection and model-level defence | 2 | 5.7 |
| ↓ Coding agents and software engineering | 3 | 6.7 |
| ↓ AI control and sabotage evaluation | 0 | 3.3 |
Who is moving
Institutions with their first paper in the field: Eastern International University, Jiffy Labs, Thu Dau Mot University, University of Information Technology, ABLEs, AGH University of Krakow, AWS Agentic AI, Abylkas Saginov Karaganda Technical University, Achiral Research, Acompany Co.
Open source and models
- affaan-m/ECC +15,971 stars, now 300,696
- ifixai-ai/iFixAi +13,919 stars, now 44,510
- earendil-works/pi +4,561 stars, now 121,238
Which conclusions changed
| Papers on the site | 6,318 → 6,421 |
| New papers in the last 12 months | 4,314 → 4,397 |
| Institutions with a paper on the site | 3,889 → 3,942 |
| Open-source repositories in the library | 7,889 → 8,073 |
The other 9 tracked numbers moved by less than half a point.
Revision of the period before
2026-10-25 – 2026-10-31 was first counted at 134 papers; 3 arrived later, 137 now.
Open this issue in the Astrolabe