Morning Singularity Digest - 2026-07-12

Estimated total read • ~21 min

Skim fast, dive deep only where it matters.

2-minute skim 10-minute read Deep dive optional
Contents

Front Page

~7 min

affaan-m/ECC: The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.

Signal 10.0 Novelty 6.2 Impact 8.3 Confidence 7.0 Actionability 6.5

Summary: The agent harness performance optimization system.

  • What happened: The agent harness performance optimization system.
  • Why it matters: The agent harness performance optimization system.
  • What to do: Validate with one small internal benchmark and compare against your current baseline this week.
Deep

Context

The agent harness performance optimization system.

What's new

Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.

Key details

  • Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
  • Language: English | Português (Brasil) | 简体中文 | 繁體中文 | 日本語 | 한국어 | Türkçe | Русский | Tiếng Việt | ไทย | Deutsch | Español Warning Official sources only.
  • Install ECC only from verified channels: the GitHub repository github.com/affaan-m/ECC, the npm packages ecc-universal and ecc-agentshield, the GitHub App, the plugin slug ecc@ecc, and the project website ecc.tools.
  • Third-party re-uploads and unofficial mirrors are not maintained or reviewed by the project and may contain malware.

Results & evidence

  • 211.9K+ stars | 32.5K+ forks | 230+ contributors | 12+ language ecosystems | Cross-harness agent workflows Language / 语言 / 語言 / Dil / Язык / Ngôn ngữ / Idioma English | Português (Brasil) | 简体中文 | 繁體中文 | 日本語 | 한국어 | Türkçe | Русский | Tiếng Việt | ไทย | Deu...
  • Production-ready agents, skills, hooks, rules, MCP configurations, and legacy command shims evolved over 10+ months of intensive daily use building real products.
  • ECC v2.0.0 adds the public Hermes operator story on top of that reusable layer: start with the Hermes setup guide, then review the 2.0.0 release notes and cross-harness architecture.

Limitations / unknowns

  • Generalization outside curated tasks is still unclear.

Next-step validation checks

  • Reproduce one claim with a public baseline and fixed evaluation settings.
  • Check robustness on out-of-distribution or long-context cases.
  • Track whether independent teams report matching results.

paperclipai/paperclip: The open-source app everyone uses to manage agents at work

Signal 10.0 Novelty 6.2 Impact 7.7 Confidence 7.0 Actionability 6.5

Summary: The open-source app everyone uses to manage agents at work Quickstart · Docs · GitHub · Discord · Twitter · Website full-tour.webm Open-source orchestration for teams of AI agents.

  • What happened: The open-source app everyone uses to manage agents at work Quickstart · Docs · GitHub · Discord · Twitter · Website full-tour.webm Open-source orchestration for teams of.
  • Why it matters: The open-source app everyone uses to manage agents at work Quickstart · Docs · GitHub · Discord · Twitter · Website full-tour.webm Open-source orchestration for teams of.
  • What to do: Validate with one small internal benchmark and compare against your current baseline this week.
Deep

Context

The open-source app everyone uses to manage agents at work Quickstart · Docs · GitHub · Discord · Twitter · Website full-tour.webm Open-source orchestration for teams of AI agents.

What's new

The open-source app everyone uses to manage agents at work Quickstart · Docs · GitHub · Discord · Twitter · Website full-tour.webm Open-source orchestration for teams of AI agents.

Key details

  • If OpenClaw is an employee, Paperclip is the company.
  • Paperclip is a Node.js server and React UI that orchestrates a team of AI agents to run a business.
  • Bring your own agents, assign goals, and track work and costs from one dashboard.
  • Under the hood: org charts, budgets, governance, goal alignment, and agent coordination.

Results & evidence

  • | Step | Example | | |---|---|---| | 01 | Define the goal | "Build the #1 AI note-taking app to $1M MRR." | | 02 | Hire the team | CEO, CTO, engineers, designers, marketers — any bot, any provider.
  • | | 03 | Approve and run | Review strategy.
  • | - ✅ You want to build autonomous AI companies - ✅ You coordinate many different agents (OpenClaw, Codex, Claude, Cursor) toward a common goal - ✅ You have 20 simultaneous Claude Code terminals open and lose track of what everyone is doing - ✅ You want age...

Limitations / unknowns

  • When they hit the limit, they stop.

Next-step validation checks

  • Reproduce one claim with a public baseline and fixed evaluation settings.
  • Check robustness on out-of-distribution or long-context cases.
  • Track whether independent teams report matching results.

Show HN: Zero Trust Boundary for Agents

Signal 8.4 Novelty 5.1 Impact 2.7 Confidence 7.5 Actionability 3.5

Summary: Hi HN, I’ve been working on Attestor, an open-source execution boundary for autonomous AI agents.

  • What happened: Hi HN, I’ve been working on Attestor, an open-source execution boundary for autonomous AI agents.
  • Why it matters: Hi HN, I’ve been working on Attestor, an open-source execution boundary for autonomous AI agents.
  • What to do: Track for corroboration and benchmark data before adopting.
Deep

Context

Unsafe requests can come from hallucination, stale context, poisoned tool output, replay, missing approval, or hostile content.

What's new

The trail records what was proposed, what was checked, and why it was held or allowed.

Key details

  • 📄 Read the Technical Whitepaper Badges point to repository evidence.
  • How Attestor connects to existing systems Control infrastructure for high-risk AI-driven operations.
  • Attestor sits between an AI-prepared operation and the system that would execute it.
  • Prompts can guide behavior, but they cannot enforce it or stop an unsafe, unauthorized, or out-of-scope service call.

Results & evidence

  • No hard numbers surfaced in the source text; treat claims as directional until benchmarks appear.

Limitations / unknowns

  • How Attestor connects to existing systems Control infrastructure for high-risk AI-driven operations.
  • Context anchors: EU AI Act, NIST AI Risk Management Framework, and DORA.

Next-step validation checks

  • Reproduce one claim with a public baseline and fixed evaluation settings.
  • Check robustness on out-of-distribution or long-context cases.
  • Track whether independent teams report matching results.

Mnema: A local, encrypted memory layer for AI agents

Signal 8.4 Novelty 5.1 Impact 2.4 Confidence 7.5 Actionability 3.5

Summary: Mnema: A local, encrypted memory layer for AI agents

  • What happened: Mnema: A local, encrypted memory layer for AI agents
  • Why it matters: Could materially affect near-term AI workflows.
  • What to do: Track for corroboration and benchmark data before adopting.
Deep

Context

Mnema: A local, encrypted memory layer for AI agents

What's new

Mnema: A local, encrypted memory layer for AI agents

Key details

  • Mnema: A local, encrypted memory layer for AI agents

Results & evidence

  • No hard numbers surfaced in the source text; treat claims as directional until benchmarks appear.

Limitations / unknowns

  • Generalization outside curated tasks is still unclear.

Next-step validation checks

  • Reproduce one claim with a public baseline and fixed evaluation settings.
  • Check robustness on out-of-distribution or long-context cases.
  • Track whether independent teams report matching results.

ultraworkers/claw-code: An agent-managed museum exhibit, built in Rust with Gajae-Code / LazyCodex — developed and maintained with no human intervention.

Signal 10.0 Novelty 5.1 Impact 8.2 Confidence 7.0 Actionability 6.5

Summary: An agent-managed museum exhibit, built in Rust with Gajae-Code / LazyCodex — developed and maintained with no human intervention.

  • What happened: An agent-managed museum exhibit, built in Rust with Gajae-Code / LazyCodex — developed and maintained with no human intervention.
  • Why it matters: An agent-managed museum exhibit, built in Rust with Gajae-Code / LazyCodex — developed and maintained with no human intervention.
  • What to do: Validate with one small internal benchmark and compare against your current baseline this week.
Deep

Context

For file submission/navigation questions, see Navigation and file context.

What's new

Windows users can jump to the PowerShell-first Windows install and release quickstart.

Key details

  • github.com/code-yeongyu/lazycodex github.com/Yeachan-Heo/gajae-code Join the Discords: ultraworkers discord · gajae-code discord Important Claw Code is not the serious production project here.
  • This repository is closer to a museum exhibit than a product pitch, a crustacean-run artifact kept alive by clawed gajaes, swept and labeled by agents, and automatically maintained according to the harnesses above.
  • As already described in the project philosophy, this is not meant to be hand-operated like a normal product repo.
  • It is an agent-managed exhibit: the harnesses plan, execute, verify, label, and preserve the artifact while the crabs keep the tank running.

Results & evidence

  • No hard numbers surfaced in the source text; treat claims as directional until benchmarks appear.

Limitations / unknowns

  • Generalization outside curated tasks is still unclear.

Next-step validation checks

  • Reproduce one claim with a public baseline and fixed evaluation settings.
  • Check robustness on out-of-distribution or long-context cases.
  • Track whether independent teams report matching results.

What Changed Overnight

~1 min
  • New: addyosmani/agent-skills: Production-grade engineering skills for AI coding agents.
  • New: Under federal rule, colleges must leave grads better off or lose financial aid
  • New: Show HN: Zero Trust Boundary for Agents
  • New: Political Neutrality Benchmark of popular AI models
  • New: Mnema: A local, encrypted memory layer for AI agents
  • New: Show HN: Runeward: Sandboxing AI agents with policy gates
  • Removed: nexu-io/open-design: 🎨 The open-source Claude Design alternative. 🖥️ Local-first desktop app. 🖼️ Your coding agent becomes the design engine: prototypes, landing pages, dashboards, slides, images & video — real files, HTML/PDF/PPTX/MP4 export. 🤖 Claude Code / Codex / Cursor / Gemini / OpenCode / Qwen & 20+ CLIs via BYOK. (fell below rank threshold)
  • Removed: ProjAgent: Procedural Similarity Retrieval for Repository-Level Code Generation (fell below rank threshold)
  • Removed: ASMR: Agentic Schema Generation for Ship Maintenance Report Writing (fell below rank threshold)
  • Removed: Infinity-Parser2 Technical Report (fell below rank threshold)
  • What to do now:
  • Validate with one small internal benchmark and compare against your current baseline this week.
  • Track for corroboration and benchmark data before adopting.

Deep Dives

~5 min

paperclipai/paperclip: The open-source app everyone uses to manage agents at work

Signal 10.0 Novelty 6.2 Impact 7.7 Confidence 7.0 Actionability 6.5

Summary: The open-source app everyone uses to manage agents at work Quickstart · Docs · GitHub · Discord · Twitter · Website full-tour.webm Open-source orchestration for teams of AI agents.

  • What happened: The open-source app everyone uses to manage agents at work Quickstart · Docs · GitHub · Discord · Twitter · Website full-tour.webm Open-source orchestration for teams of.
  • Why it matters: The open-source app everyone uses to manage agents at work Quickstart · Docs · GitHub · Discord · Twitter · Website full-tour.webm Open-source orchestration for teams of.
  • What to do: Validate with one small internal benchmark and compare against your current baseline this week.
Deep

Context

The open-source app everyone uses to manage agents at work Quickstart · Docs · GitHub · Discord · Twitter · Website full-tour.webm Open-source orchestration for teams of AI agents.

What's new

The open-source app everyone uses to manage agents at work Quickstart · Docs · GitHub · Discord · Twitter · Website full-tour.webm Open-source orchestration for teams of AI agents.

Key details

  • If OpenClaw is an employee, Paperclip is the company.
  • Paperclip is a Node.js server and React UI that orchestrates a team of AI agents to run a business.
  • Bring your own agents, assign goals, and track work and costs from one dashboard.
  • Under the hood: org charts, budgets, governance, goal alignment, and agent coordination.

Results & evidence

  • | Step | Example | | |---|---|---| | 01 | Define the goal | "Build the #1 AI note-taking app to $1M MRR." | | 02 | Hire the team | CEO, CTO, engineers, designers, marketers — any bot, any provider.
  • | | 03 | Approve and run | Review strategy.
  • | - ✅ You want to build autonomous AI companies - ✅ You coordinate many different agents (OpenClaw, Codex, Claude, Cursor) toward a common goal - ✅ You have 20 simultaneous Claude Code terminals open and lose track of what everyone is doing - ✅ You want age...

Limitations / unknowns

  • When they hit the limit, they stop.

Next-step validation checks

  • Reproduce one claim with a public baseline and fixed evaluation settings.
  • Check robustness on out-of-distribution or long-context cases.
  • Track whether independent teams report matching results.

Show HN: Zero Trust Boundary for Agents

Signal 8.4 Novelty 5.1 Impact 2.7 Confidence 7.5 Actionability 3.5

Summary: Hi HN, I’ve been working on Attestor, an open-source execution boundary for autonomous AI agents.

  • What happened: Hi HN, I’ve been working on Attestor, an open-source execution boundary for autonomous AI agents.
  • Why it matters: Hi HN, I’ve been working on Attestor, an open-source execution boundary for autonomous AI agents.
  • What to do: Track for corroboration and benchmark data before adopting.
Deep

Context

Unsafe requests can come from hallucination, stale context, poisoned tool output, replay, missing approval, or hostile content.

What's new

The trail records what was proposed, what was checked, and why it was held or allowed.

Key details

  • 📄 Read the Technical Whitepaper Badges point to repository evidence.
  • How Attestor connects to existing systems Control infrastructure for high-risk AI-driven operations.
  • Attestor sits between an AI-prepared operation and the system that would execute it.
  • Prompts can guide behavior, but they cannot enforce it or stop an unsafe, unauthorized, or out-of-scope service call.

Results & evidence

  • No hard numbers surfaced in the source text; treat claims as directional until benchmarks appear.

Limitations / unknowns

  • How Attestor connects to existing systems Control infrastructure for high-risk AI-driven operations.
  • Context anchors: EU AI Act, NIST AI Risk Management Framework, and DORA.

Next-step validation checks

  • Reproduce one claim with a public baseline and fixed evaluation settings.
  • Check robustness on out-of-distribution or long-context cases.
  • Track whether independent teams report matching results.

karpathy/autoresearch: AI agents running research on single-GPU nanochat training automatically

Signal 10.0 Novelty 5.1 Impact 7.8 Confidence 7.0 Actionability 6.5

Summary: AI agents running research on single-GPU nanochat training automatically One day, frontier AI research used to be done by meat computers in between eating, sleeping, having other.

  • What happened: AI agents running research on single-GPU nanochat training automatically One day, frontier AI research used to be done by meat computers in between eating, sleeping.
  • Why it matters: It modifies the code, trains for 5 minutes, checks if the result improved, keeps or discards, and repeats.
  • What to do: Validate with one small internal benchmark and compare against your current baseline this week.
Deep

Context

Instead, you are programming the program.md Markdown files that provide context to the AI agents and set up your autonomous research org.

What's new

AI agents running research on single-GPU nanochat training automatically One day, frontier AI research used to be done by meat computers in between eating, sleeping, having other fun, and synchronizing once in a while using sound wave interconnect in the ri...

Key details

  • Research is now entirely the domain of autonomous swarms of AI agents running across compute cluster megastructures in the skies.
  • The agents claim that we are now in the 10,205th generation of the code base, in any case no one could tell if that's right or wrong as the "code" is now a self-modifying binary that has grown beyond human comprehension.
  • This repo is the story of how it all began.
  • The idea: give an AI agent a small but real LLM training setup and let it experiment autonomously overnight.

Results & evidence

  • The agents claim that we are now in the 10,205th generation of the code base, in any case no one could tell if that's right or wrong as the "code" is now a self-modifying binary that has grown beyond human comprehension.
  • It modifies the code, trains for 5 minutes, checks if the result improved, keeps or discards, and repeats.

Limitations / unknowns

  • Generalization outside curated tasks is still unclear.

Next-step validation checks

  • Reproduce one claim with a public baseline and fixed evaluation settings.
  • Check robustness on out-of-distribution or long-context cases.
  • Track whether independent teams report matching results.

Reality Check

~1 min
  • affaan-m/ECC: The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
  • Primary source: yes
  • Demo available: no
  • Benchmarks/evals: no
  • Baselines/ablations: no
  • Third-party corroboration: no
  • Reproducibility details: yes
  • What would change my mind:
  • Independent replication with comparable or better results.
  • Public benchmark numbers with clear baseline comparisons.
  • Likely failure mode: Performance may collapse outside curated demos or narrow tasks.
  • paperclipai/paperclip: The open-source app everyone uses to manage agents at work
  • Primary source: yes
  • Demo available: no
  • Benchmarks/evals: no
  • Baselines/ablations: no
  • Third-party corroboration: no
  • Reproducibility details: yes
  • What would change my mind:
  • Independent replication with comparable or better results.
  • Public benchmark numbers with clear baseline comparisons.
  • Likely failure mode: Performance may collapse outside curated demos or narrow tasks.
  • Show HN: Zero Trust Boundary for Agents
  • Primary source: yes
  • Demo available: no
  • Benchmarks/evals: no
  • Baselines/ablations: no
  • Third-party corroboration: no
  • Reproducibility details: yes
  • What would change my mind:
  • Independent replication with comparable or better results.
  • Public benchmark numbers with clear baseline comparisons.
  • Likely failure mode: Performance may collapse outside curated demos or narrow tasks.
  • Mnema: A local, encrypted memory layer for AI agents
  • Primary source: yes
  • Demo available: no
  • Benchmarks/evals: no
  • Baselines/ablations: no
  • Third-party corroboration: no
  • Reproducibility details: yes
  • What would change my mind:
  • Independent replication with comparable or better results.
  • Public benchmark numbers with clear baseline comparisons.
  • Likely failure mode: Performance may collapse outside curated demos or narrow tasks.

Lab Notes

~1 min
  • Tool/Repo of the day: affaan-m/ECC: The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond. (https://github.com/affaan-m/ECC)
  • Prompt/Workflow of the day: summarize claim -> evidence -> risk in three passes before acting.
  • Tiny snippet: `uv run python -m msd.run --scheduled`

Research Radar

~1 min

Forecast & Watchlist

~1 min
  • Watch: agent
  • Watch: llm
  • Watch: cs.ai
  • Watch: cs.lg
  • Watch: rss
  • Watch: cs.cl
  • Watch: python
  • Watch: benchmark

Save for Later

~4 min

VoltAgent/awesome-design-md: A collection of DESIGN.md files analysis by popular brand design systems. Drop one into your project and let coding agents generate a matching UI.

Signal 10.0 Novelty 5.1 Impact 7.9 Confidence 7.0 Actionability 6.5

Summary: A collection of DESIGN.md files analysis by popular brand design systems.

  • What happened: DESIGN.md is a new concept introduced by Google Stitch.
  • Why it matters: A collection of DESIGN.md files analysis by popular brand design systems.
  • What to do: Validate with one small internal benchmark and compare against your current baseline this week.
Deep

Context

A collection of DESIGN.md files analysis by popular brand design systems.

What's new

DESIGN.md is a new concept introduced by Google Stitch.

Key details

  • Drop one into your project and let coding agents generate a matching UI.
  • Copy a DESIGN.md into your project, tell your AI agent “build me a page that looks like this,” and generate high-quality UI that stays visually consistent with the design language.
  • Built with real design depth — including analyzed patterns, tokens, and rules — for high-quality UI generation, not surface-level outputs.
  • DESIGN.md is a new concept introduced by Google Stitch.

Results & evidence

  • No hard numbers surfaced in the source text; treat claims as directional until benchmarks appear.

Limitations / unknowns

  • Generalization outside curated tasks is still unclear.

Next-step validation checks

  • Reproduce one claim with a public baseline and fixed evaluation settings.
  • Check robustness on out-of-distribution or long-context cases.
  • Track whether independent teams report matching results.

Agent Service – promptable AI agents with guardrails and downloadable packages

Signal 8.4 Novelty 5.1 Impact 2.4 Confidence 6.2 Actionability 5.2

Summary: You need to enable JavaScript to run this app.

  • What happened: You need to enable JavaScript to run this app.
  • Why it matters: You need to enable JavaScript to run this app.
  • What to do: Track for corroboration and benchmark data before adopting.
Deep

Context

You need to enable JavaScript to run this app.

What's new

You need to enable JavaScript to run this app.

Key details

  • You need to enable JavaScript to run this app.

Results & evidence

  • No hard numbers surfaced in the source text; treat claims as directional until benchmarks appear.

Limitations / unknowns

  • Generalization outside curated tasks is still unclear.

Next-step validation checks

  • Reproduce one claim with a public baseline and fixed evaluation settings.
  • Check robustness on out-of-distribution or long-context cases.
  • Track whether independent teams report matching results.

Guide to the circular deals underpinning the AI Boom

Signal 8.4 Novelty 4.0 Impact 2.6 Confidence 6.2 Actionability 5.2

Summary: Guide to the circular deals underpinning the AI Boom

  • What happened: Guide to the circular deals underpinning the AI Boom
  • Why it matters: Could materially affect near-term AI workflows.
  • What to do: Track for corroboration and benchmark data before adopting.
Deep

Context

Guide to the circular deals underpinning the AI Boom

What's new

Guide to the circular deals underpinning the AI Boom

Key details

  • Guide to the circular deals underpinning the AI Boom

Results & evidence

  • No hard numbers surfaced in the source text; treat claims as directional until benchmarks appear.

Limitations / unknowns

  • Generalization outside curated tasks is still unclear.

Next-step validation checks

  • Reproduce one claim with a public baseline and fixed evaluation settings.
  • Check robustness on out-of-distribution or long-context cases.
  • Track whether independent teams report matching results.

We got local models to triage the OpenClaw repo for FREE!*

Signal 7.3 Novelty 4.0 Impact 2.0 Confidence 4.2 Actionability 6.5

Summary: We got local models to triage the OpenClaw repo for FREE!*

  • What happened: We got local models to triage the OpenClaw repo for FREE!*
  • Why it matters: Could materially affect near-term AI workflows.
  • What to do: Validate with one small internal benchmark and compare against your current baseline this week.
Deep

Context

We got local models to triage the OpenClaw repo for FREE!*

What's new

We got local models to triage the OpenClaw repo for FREE!*

Key details

  • We got local models to triage the OpenClaw repo for FREE!*

Results & evidence

  • No hard numbers surfaced in the source text; treat claims as directional until benchmarks appear.

Limitations / unknowns

  • Generalization outside curated tasks is still unclear.

Next-step validation checks

  • Reproduce one claim with a public baseline and fixed evaluation settings.
  • Check robustness on out-of-distribution or long-context cases.
  • Track whether independent teams report matching results.

ScarfBench: Benchmarking AI Agents for Enterprise Java Framework Migration

Signal 7.3 Novelty 6.2 Impact 2.0 Confidence 3.8 Actionability 3.5

Summary: ScarfBench: Benchmarking AI Agents for Enterprise Java Framework Migration

  • What happened: ScarfBench: Benchmarking AI Agents for Enterprise Java Framework Migration
  • Why it matters: Could materially affect near-term AI workflows.
  • What to do: Track for corroboration and benchmark data before adopting.
Deep

Context

ScarfBench: Benchmarking AI Agents for Enterprise Java Framework Migration

What's new

ScarfBench: Benchmarking AI Agents for Enterprise Java Framework Migration

Key details

  • ScarfBench: Benchmarking AI Agents for Enterprise Java Framework Migration

Results & evidence

  • No hard numbers surfaced in the source text; treat claims as directional until benchmarks appear.

Limitations / unknowns

  • Generalization outside curated tasks is still unclear.

Next-step validation checks

  • Reproduce one claim with a public baseline and fixed evaluation settings.
  • Check robustness on out-of-distribution or long-context cases.
  • Track whether independent teams report matching results.

Is it agentic enough? Benchmarking open models on your own tooling

Signal 7.3 Novelty 6.2 Impact 2.0 Confidence 3.8 Actionability 3.5

Summary: Is it agentic enough? Benchmarking open models on your own tooling

  • What happened: Is it agentic enough? Benchmarking open models on your own tooling
  • Why it matters: Could materially affect near-term AI workflows.
  • What to do: Track for corroboration and benchmark data before adopting.
Deep

Context

Is it agentic enough? Benchmarking open models on your own tooling

What's new

Is it agentic enough? Benchmarking open models on your own tooling

Key details

  • Is it agentic enough? Benchmarking open models on your own tooling

Results & evidence

  • No hard numbers surfaced in the source text; treat claims as directional until benchmarks appear.

Limitations / unknowns

  • Generalization outside curated tasks is still unclear.

Next-step validation checks

  • Reproduce one claim with a public baseline and fixed evaluation settings.
  • Check robustness on out-of-distribution or long-context cases.
  • Track whether independent teams report matching results.