Hacker News
Daily AI Digest

Welcome to the Hacker News Daily AI Digest, where you will find a daily summary of the latest and most intriguing artificial intelligence news, projects, and discussions among the Hacker News community. Subscribe now and join a growing network of AI enthusiasts, professionals, and researchers who are shaping the future of technology.

Brought to you by Philipp Burckhardt

AI Submissions for Fri Aug 21 2026

Claudette: Make Claude stop talking like a BuzzFeed article

Submission URL | 335 points | by aakil | 217 comments

A Claude Code skill that routes Claude’s last reply through Google’s Antigravity CLI (Gemini) and prints the translation verbatim, stripping the TED-talk voice without touching the substance. Unlike prompt tweaks, it offloads the rewrite to a different model and refuses to “tidy up” the result, so the buzz doesn’t creep back in.

  • Modes:
    • colleague (default): same content, file paths and code blocks preserved, zero theatrics
    • manager: what happened, why it matters, what’s next — about a third the length, no code
    • director: 3–5 sentences with outcome, impact, ask

Install by copying the debuzz skill into ~/.claude/skills; requirements are Claude Code and the Antigravity CLI (agy). Run agy once to complete Google Sign-In. Use /debuzz [mode] [text] in a Claude Code chat; with no text it rewrites Claude’s previous reply, and it also triggers on natural cues like “say that in normal english.”

In colleague mode it keeps technical detail intact while flattening the tone (the example turns “load‑bearing assumption” prose into a concrete bug list and fix). If agy errors (e.g., auth), you see the real error; a clearly labeled Claude rewrite is offered only as a fallback. MIT-licensed.

The discussion zeroed in on a fundamental misalignment in how models document software: LLMs treat code comments as a continuation of the immediate chat thread, rather than documentation for a future, third-party reader. This predictably results in "temporal comments"—lengthy explanations of how the code used to work prior to the current refactor, or hyper-specific references to the ongoing conversation.

Several distinct themes emerged around managing this behavior:

  • Context Leakage: Commenters noted that models frequently leak their internal context-compaction strategies into the codebase, inventing theatrical names for standard refactors. Users traded parodies of actual outputs, mocking LLM-generated commits about "the cursor saga" or "PLAN-5.1.A.d.42 load bearing reassertion."
  • Draconian Constraints: To force cleaner output, some developers enforce strict length constraints (e.g., a maximum of seven words per comment block, four per function name). Others rely on workflow hacks, using a fresh, context-free chat session specifically to strip existing comments and force the model to re-justify any new ones.
  • The Obsolescence Debate: The thread briefly fractured over whether AI makes traditional comments unnecessary. While one camp argued an LLM can simply explain any confusing block on demand, pushback emphasized that models cannot infer the "why"—specifically the historical dead-ends that explain why an intuitive approach failed and a convoluted workaround was chosen.

Ultimately, developers noted that while overly verbose LLM comments are a nuisance in the final codebase, that exact historical context is often highly useful during the generation process, leading to requests for IDEs with a "verbosity switch" to toggle between raw code, terse comments, and full LLM working notes.

I'm becoming AI-blind

Submission URL | 456 points | by rcymerys | 466 comments

His attention now auto-filters “AI‑scented” writing like banner ads, causing him to miss content in work docs and spiral into needless back‑and‑forth. He traces the trigger to low‑effort LLM prose leaking into serious documents: a Claude-flavored design write‑up padded with model lingo (“This cuts just through it”, “The first gate is real”), a 20‑page marketing deck mixing reasonable strategy with nonsensical tech architecture claims (“The Redis backbone redefines the product”), and a requirements doc whose verbose, hedge-filled “internal reasoning” reads like an unsure model. Contrary to research that humans struggle to detect AI text, he argues that the tells are obvious at work: word choice, sentence flow, and the compulsion to pitch trivialities as breakthroughs—like treating RBAC checkboxes as if someone “invented fire.” Exposure to meaning‑light LinkedIn posts, emails, and AI‑puffed websites has effectively “pre‑trained” his brain to ignore that style on sight.

The punchline is productivity: the same AI meant to speed him up now slows him down by tripping this mental filter, even outside work (a restaurant photo on vacation provoked the same reflex). The implicit fix is old‑school: meaning‑dense, plain writing without borrowed LLMisms, so readers don’t discard real content with the noise.

The discussion abandons the article's focus on workplace productivity to debate a fundamental philosophical crux: whether human reasoning is essentially different from a large language model.

One camp argues that the exhaustion of reading AI text stems from the fact that LLMs are merely "correlation engines" lacking an inner life, subjective values, or a personal stake in the output. For these commenters, reducing human cognition—such as the creation of novel mathematics—to a probabilistic token-prediction model is a fundamental misunderstanding that ignores the human capacity to invent entirely new fields and formal definitions.

The opposing camp counters that human intelligence operates on the same functional principles, pointing out that human mathematicians also largely synthesize previous proofs and apply heuristics to predict outcomes. The most provocative argument from this side posits that the visceral aversion to AI text isn't actually about prose quality at all; it is a defensive reaction to an economic shock. In this view, society has historically used the perceived rarity of intelligence to justify hierarchies and high wages, and people are now reeling from the discovery that cognitive work can be reproduced for "a grain of rice."

A secondary, more technical dispute splits over whether current LLMs can actually invent novel definitions. While skeptics argue that models merely lift and recombine existing human structures, others counter that LLMs are already capable of generating the foundational "spine" of a program through novel interfaces and abstract classes, which is formally the same activity as mathematical definition.

The unresolved tension is whether acknowledging the mechanical nature of LLMs forces us to painfully demystify human intelligence in the process.

How we made a text-to-speech model respond in sub-50 ms

Submission URL | 163 points | by toebee | 40 comments

On a single NVIDIA H100 SXM, their Qwen3‑TTS 1.7B CustomVoice server sustains 10 RPS with sub‑50 ms p95 time‑to‑first‑audio while streaming ~630 chars/s, landing around $2 per 1M characters at full utilization—orders of magnitude cheaper than ElevenLabs V3 ($100/1M) and Cartesia Sonic 3.5 ($49/1M) at higher TTFA.

  • Benchmark setup: five-minute Poisson open‑loop traffic; full‑text request per call with streamed PCM; audible TTFA detected from received audio, playback reconstructed, and output checked via Deepgram STT.
  • Baseline engines (vLLM‑Omni, SGLang‑Omni, VoxServe, M*) had high p95 TTFA at 1 RPS before tuning. After latency-oriented tuning, VoxServe briefly hit sub‑50 ms at 1 RPS, but by ~6 RPS every upstream engine was ~100 ms p95 TTFA or worse; only this implementation held sub‑50 ms p95 TTFA, staying sub‑50 through 10 RPS and under 100 ms at 20 RPS.
  • Two universal low‑latency tweaks applied across engines:
    • Dynamic leading‑silence trim: detect speech onset via short RMS windows and cut pre‑onset samples (≈80 ms TTFA win without changing model compute).
    • Frame accumulation ramp: start with small chunks for fast first audio, then increase chunk size to avoid underruns and improve batching.
  • Core architectural change: instead of pairing Talker+Code Predictor and decoding separately, they expose all three Qwen3‑TTS modules (Talker, Code Predictor, Codec) as independently schedulable tasks on a single scheduler (inspired by M*). The scheduler preempts and reorders work by urgency (e.g., prioritize Codec jobs near playback deadlines) and batches per‑module queues, avoiding long non‑preemptive blocks that inflate TTFA while maintaining zero underruns.

They’ve open‑sourced both the serving implementation and the benchmark, and report maintaining real‑time playback alongside the latency gains.

The project’s extreme sub-50ms speed sparked a debate about the perceptual limits of human conversation. Several commenters pointed out that because humans have roughly a 200ms auditory processing latency, an agent responding in 50ms actually feels creepy—we instinctively interpret instantaneous replies as interruptions rather than considered responses. A related thread critiqued OpenAI’s approach to the same problem, characterizing ChatGPT’s tendency to immediately output filler words ("hmm") as latency "benchmaxxing" that merely masks the real time-to-first-relevant-phoneme.

On the hardware front, developers immediately pushed to scale the H100-optimized stack down to consumer and edge devices. The authors confirmed that an RTX 4090 can still hit 50ms TTFA at 10 concurrent requests (with config adjustments to compensate for the lack of FP8 support), though the project’s custom CUDA kernels mean Ampere (30xx) cards will require code modifications. When pressed on mobile deployments, the creators speculated that heavily optimizing for a batch size and concurrency of one could make on-device execution viable.

For users actively building local voice agents, the discussion centered on quality trade-offs and pipeline bottlenecks:

  • The LLM Bottleneck: Commenters noted that TTS speed is irrelevant if the LLM's own inference latency destroys the illusion of presence. The authors bypass this by streaming LLM output directly into the speech model via WebSockets before sentences finish.
  • WebSocket Artifacts: One early tester spinning up the provided Runpod deployment reported that while the standard POST mode worked well, the WebSocket streaming mode occasionally collapsed into audio gibberish mid-sentence.
  • The Latency/Expression Wall: Experienced builders warned that forcing TTS pipelines below 200ms traditionally sacrifices cadence and vocal expression. The authors maintain that their scheduler optimizations avoid this entirely, claiming zero quality degradation compared to the stock Qwen3-TTS implementation.

AI companies destroy physical books – let's scan rare books before it's too late

Submission URL | 590 points | by Cider9986 | 877 comments

The post alleges Anthropic’s covert “Project Panama” bought millions of pre‑2022 paper books, scanned them to train Claude, then destroyed the physical copies — and says this is currently legal. It argues the AI race incentivizes pulping: exclusive control of “pristine” corpora, reduced legal exposure, and cheaper workflows than careful, lossless preservation. The consequence, in this framing, is that AI labs become the sole holders of digital copies, effectively locking portions of human knowledge on private servers.

Anna’s Archive positions shadow libraries as the counterweight and calls for a global volunteer push to scan and upload at‑risk materials (books, journals, newspapers, magazines, ancient and rare works) from local libraries and archives. They float a “10 million volunteers, one book each” target and offer recognition and lifetime membership for small uploads, with funding help and other rewards for large‑scale scanning. The urgency claim: since early 2025, AI‑generated text accounts for more than half of new internet content, heightening fears of AI training on AI while undigitized human‑authored sources vanish.

The piece frames this as a race to preserve rare and vulnerable works before publishers and AI labs lock them away or destroy them.

Commenters contrasted the unchecked data consumption of AI labs with the legal defeats of previous mass-digitization efforts. The discussion surfaced three historical and legal parallels:

  • The Google Books precedent: Users noted how Google’s attempt to create a comprehensive digital clearinghouse for out-of-print books was ultimately paralyzed by copyright lawsuits and anti-monopoly objections from publishers and research libraries, leaving orphaned works in permanent legal limbo.
  • Proposed copyright reform: Frustration over locked knowledge led one user to propose a "production requirement," arguing that copyright holders should be forced to keep works available at historic prices or forfeit their exclusivity. Detractors countered that this would violate international trade agreements (like TRIPS) and penalize independent artists and limited-edition print runs.
  • The Internet Archive lawsuit: A technical debate broke out over the exact legal mechanics of IA's recent court defeat. While some argued IA was only penalized for dropping its 1:1 lending ratio during its COVID-era "emergency library," others quoted the summary judgment to demonstrate that the ruling actually struck down the broader practice of Controlled Digital Lending (CDL) entirely, explicitly to protect the publishers' lucrative ebook licensing markets.

Building an (almost) fully self-hosted, sandboxed, agentic software factory

Submission URL | 112 points | by jakelsaunders94 | 59 comments

From a single prompt, the agent created a repo, wrote the app and tests, passed CI, provisioned Postgres, and deployed behind HTTPS — with no further input. The trick isn’t a new model; it’s a homelab architecture that contains the agent on its own metal with no public ingress, then gives it enough platform primitives to autonomously move through the SDLC.

A dedicated 10th‑gen i7 host runs Coolify as the PaaS and Forgejo with runners for Git/CI; the agent (Hermes, backed by Codex) plans, codes, commits, and triggers pipelines. Network guardrails are layered: the box has zero external ingress; access comes via Tailscale (routing through an older server as exit node) and Pi‑hole DNS rules so *.internal.jakeshomelab.me resolves to the new host. For TLS without exposing an A/AAAA record, Traefik/Coolify use ACME DNS‑01 via lego and Porkbun’s API to create ephemeral TXT records, so the agent can mint certs on‑the‑fly for “ghost” services only reachable inside the tailnet (hostnames still land in CT logs).

Stack highlights:

  • Pi‑hole for local DNS and ad filtering
  • Tailscale for remote access and routing
  • Coolify (Docker PaaS) to deploy services with labels and reverse proxy
  • Forgejo + runners for self‑hosted Git and CI
  • Hermes (+ WebUI) as the agent interface, with Codex inference
  • Firecrawl (self‑hosted) as the web scraping/translation layer
  • Telegram bot for chat‑ops control
  • Porkbun + Let’s Encrypt (DNS‑01) for certs without public DNS
  • Postgres/Redis as needed via Docker

It’s “almost” fully self‑hosted: inference and a few integrations leave the box, and the only ongoing experiment‑specific cost cited is a £20 Codex subscription. Not a step‑by‑step guide, but the pattern is clear: isolate the host, cut public ingress, front everything with a self‑hosted PaaS, and hand the agent Git/CI, DNS, and cert automation so it can ship safely.

The discussion split into two practical engineering challenges: how to verify autonomous code without the model simply grading its own homework, and the hardware reality of running these agents entirely on local metal.

On verification, the consensus is that having agents write standard unit tests creates a severe human review bottleneck. Instead, developers are shifting to externalized validation:

  • Hermetic replay testing: Running agent-generated code in a staging environment and having the agent drive integration tests from the outside via headless browsers and APIs, outputting visual replays for humans to quickly approve rather than reviewing test code.
  • Live log analysis: Deploying to a staging cluster and giving models like Opus read access to logs and performance timings under load, as they excel at spotting anomalies and warnings.
  • Mutation testing: Using tools like Stryker to ensure the agent's tests actually fail when bugs are introduced, preventing "vacuous" tests designed only to pass against bad implementations.
  • Multi-agent CI loops: Fanning out multiple reviewer models to critique a primary agent's output, feeding a centralized triage agent that manages the fix loop over several days.

Regarding true self-hosting, several users shared their local GPU setups for coding models, with a heavy preference for running Qwen 3.8 27B on consumer cards like the RTX 5090, 3090, or AMD R9700. The shared experience is that while the code quality can approach that of frontier models, the extended "thinking" time required on local hardware makes real-time generation painfully slow and prone to context-window exhaustion. Consequently, local GPUs are currently better utilized for asynchronous batch tasks, multi-agent orchestration, or running ancillary models (like Whisper for data ingestion) while leaning on cloud APIs for heavy coding.

DeepSeek-v4-flash-vision-exp

Submission URL | 489 points | by dares2573 | 152 comments

Each image tops out at 384 tokens after auto-resizing to roughly 800×800, regardless of original resolution; images are sent alongside text via OpenAI‑style Chat Completions using inline base64, external URLs, or Files API references.

  • Supported formats: JPEG, PNG, GIF, WebP, with format detected from file content (not filename/MIME).
  • Three input paths:
    • Inline base64 data URL (counts toward the 48 MiB request body limit).
    • External http(s) URL (<=8192 chars; image <=32 MiB; fetch must finish within 60s).
    • Files API file_id (best for reuse; per-image up to 64 MiB; avoids the 32 MiB per-image check for non-inline).
  • Detail control for image_url: detail="low" downsamples to 512×512; "high"/"original" keep original; "auto" currently behaves like original.
  • Tokenization rules: images smaller than ~384×384 are scaled up; larger images are scaled down to ~800×800; multiple images are counted independently under the same rule.
  • Limits: request body 48 MiB; max images per request 600; total image size per request 64 MiB without file_id and up to 200 MiB including file_id images; max dimension 8192 px per side (reduced to 4096 px per side when a request has 15+ images).
  • Restrictions: images are only allowed in user messages (not system/assistant), and only the vision model accepts them; other models or mis-placed images return 400 errors.

The 800×800 downsampling limit sparked a technical debate over handling high-density images like schematics. Detractors argued that forced downsizing inherently ruins the model's ability to maintain spatial relationships and count objects. Defenders countered that this limitation can be bypassed in the harness: developers can give the model a tool to crop and inspect high-resolution sub-grids, or tile the image and feed the cells individually alongside a downsampled full-image reference. The crux of the disagreement rests on whether relying on an LLM to logically stitch sub-grids back together inevitably breaks contextual awareness.

A separate debate emerged over vision evaluation standards after one user reported the model failing to read a simple analog clock. Critics of the prompt dismissed it as an irrelevant "gotcha," arguing that a model's practical utility for tasks like one-shotting code matters far more than its performance on edge-case parlor tricks. Opponents argued that basic spatial reasoning isn't a trick, but rather table stakes for evaluating whether a frontier vision model can actually generalize outside its training data. The philosophical dispute was ultimately undercut when another user re-ran the exact clock prompt and reported the model answering correctly 9 out of 10 times.

Run 290B+ frontier MoE models locally on your gaming PC

Submission URL | 31 points | by shenli3514 | 3 comments

Treats your CPU, GPU, host RAM, and interconnects as one elastic inference platform, then keeps tokens flowing with bandwidth‑adaptive CPU–GPU co‑execution (q*), full‑layer double‑buffered prefill streaming, and a global LRU expert cache.

  • Semantic‑aware caching: “semantic anchor” checkpoints for recurrent state and KV caches let agentic context edits (tool calls, thinking blocks) skip redundant recompute.
  • Elastic memory: dynamically reallocate VRAM between expert caches and KV memory at runtime without restarts or weight reloads.
  • Runtime details: graph‑compatible execution and an FTW fast weight format.
  • Models/quantization: runs frontier open‑weight MoE models (e.g., DeepSeek‑V4‑Flash, Qwen3.6‑35B‑A3B, GLM‑5.2) across MXFP4, NVFP4, FP8, and BF16.
  • APIs/integration: Anthropic/OpenAI‑compatible endpoints for coding and tool‑calling agents (Codex, Claude Code, OpenCode, OpenClaw, DeepSeek Harness).
  • Hardware: scales across consumer laptops/desktops with native support for NVIDIA RTX 30/40/50 series GPUs.

Install via uv/pip (uv pip install "freetoken[accel]") or use the Windows/Linux desktop app (GUI for running models, chat, and tuning). Apache‑2.0 licensed; design draws on SGLang, vLLM, FlashInfer, flash‑linear‑attention, LightLLM, and llama.cpp.

Commenters highlight a stark contrast between the project's underlying research and its public presentation. Several users found the repository confusing and lacking clear performance targets, with one noting it looks "fishy" despite its UC Berkeley origins. The thread points to the accompanying paper (arXiv:2608.16157) as the actual substance, where the core utility—pooling CPU, RAM, and GPU resources to run oversized models—is much better explained. A broader observation was also raised that similar inference improvements across the industry are likely being held back because the API boundary between clients and complex inference stacks remains difficult to standardize.

Show HN: OzBrain, a shared brain for knowledge between agents and your team

Submission URL | 72 points | by dariusmonsef | 45 comments

A single read/write source of truth for all your agents via an MCP connector means you stop ferrying briefs and .md files between Claude, ChatGPT, Claude Code, and Cursor. OzBrain hosts the “agents maintain the knowledge base” pattern: agents read only what they need, write back what they learn, and newer thinking supersedes older via deprecations and links rather than deletes, so the current article is always in front.

  • Knowledge model: routing index and token-friendly chunking; conflict handling when multiple agents touch the same article; capture-and-audit of changes.
  • Collaboration: personal and shared brains keep teammates (and their agents) in sync on projects, decisions, research, and handoffs—beyond thin platform “memory” scraps.
  • Setup/ops: add once as a custom MCP connector; start free; positioned as the Vercel-like hosted alternative to DIY/gBrain. The author’s implementation stores markdown in Supabase.

Caveat: the maintenance/auto-upkeep loop is still in alpha and not yet run on customer data.

The debate centers on whether agents need a dedicated cloud knowledge base or if local file systems are already sufficient. Skeptics argue that dumping .md files into a Git repository or an Obsidian vault synced via Tailscale easily solves the problem for existing engineering workflows. The author counters that a hosted solution removes the friction of configuring local sync tools for multi-agent MCP access and scales better for non-technical users sharing business or family documents.

A significant technical crux emerged around context degradation and garbage accumulation. Developers building similar systems warned that even state-of-the-art LLMs distort facts when summarizing large document batches over time. To combat this, the discussion surfaced two approaches:

  • Divide and conquer: Breaking text into tightly verified chunks before coalescing them into summaries, accepting higher token overhead in exchange for accuracy.
  • Append-only reasoning logs: Rather than constantly overwriting a "filtered memory," preserving the complete audit trail of why an agent made a change, allowing older reasoning to be cross-linked rather than permanently deleted.

The thread also acted as a showcase for alternative homegrown architectures. Commenters detailed setups ranging from Setoku—which feeds company data lakes into ClickHouse for agent querying with human-in-the-loop approval—to Quartz-generated static sites maintained by bespoke routing commands. Despite the interest in the underlying architecture, several users admitted the initial landing page triggered "AI product" fatigue, suggesting the platform would bypass resistance if pitched simply as an "AI-maintained Zettelkasten."

Bringing the cybersecurity capabilities of Claude Mythos 5 to more defenders

Submission URL | 47 points | by garo-pro | 51 comments

Claude Security scans now run on Mythos 5 and a $35M credit fund backs open-source patching — delivered via integrations that expose only defensive artifacts (patches/alerts), not raw model access.

Partners are wiring Mythos 5 into existing incident response, threat intel, and detection engineering tools so end users receive outputs like suggested patches while abuse-prevention checks keep the model within a defined defensive scope.

For Claude Enterprise:

  • Enable Claude Security in the admin console; scans with Mythos 5 are in public beta and billed as standard token usage under your existing plan (no add-on).
  • From claude.ai/security, select a repo to scan; results include CWE category, confidence and severity ratings, plus a suggested fix.
  • Implement fixes via Claude Code; interactive patching uses models your org already has access to, and Mythos access remains confined to the scan surface. Every patch requires human review and approval.

The Defender Advantage Fund (0xDAF) offers $35M in credits to groups patching OSS vulnerabilities, automating scanning/patching, and exploring new security approaches.

The Cyber Verification Program, which already gives vetted defenders reduced safeguards on Opus and Sonnet, will soon expand to broader dual-use capabilities on those models, with Mythos-class access to follow — widening defensive reach without opening direct offensive use.

The thread is overwhelmingly critical of Anthropic’s safety guardrails, arguing that cordoning off cybersecurity as a hazardous, gated activity actively breaks normal software development. Commenters shared numerous concrete examples of the model's refusal to assist with legitimate defensive work: refusing to write regression tests if a file is named cve_test.c, locking out a web performance engineer trying to triage a site bug, and blocking basic reverse engineering. One academic noted that this hypersensitivity spills over into other fields, with the model downgrading capabilities if the letters "d", "n", and "a" appear too closely together.

This friction is driving a widespread migration to less restricted alternatives. GLM-5.3 was repeatedly praised as a highly capable replacement, with one user leaning on it for a 72-hour agentic decompilation run after Claude choked. Others cited success using Grok during live security incidents when Claude and ChatGPT threw up roadblocks, or deploying DeepSeek-V4-Pro and Kimi for CTFs and daily driver tasks.

On the economics of the new offerings, a user with Mythos access claimed that per-scan costs are currently exorbitant—roughly equivalent to outright purchasing the hardware needed to run GLM locally. Separately, a debate over whether the $35M Defender Advantage Fund is actually substantial centered on the $100k price tag of the recent HAWK attack, though a respondent corrected that HAWK was a three-year adversarial outlier rather than a standard benchmark for vulnerability pricing.

Seed: Minimal, self-modifying agent harness

Submission URL | 55 points | by gandalfgeek | 20 comments

It starts with exactly one tool — exec to run shell commands — and expects the agent to grow everything else (tools, memory, behavior) by editing its own self/ directory between sessions. The system prompt lives in self/SELF.md, and the agent’s evolution is explicit and versioned: first run seeds files and commits them into a fresh local git repo, then drops you into a REPL.

  • Bootstrap flow: uvx install seeds seed.py and run_seed.sh into the current directory (never overwriting), creates self/SELF.md, commits the lot to a new git repo, then starts a REPL.
  • Persistence model: only content under self/ survives; sessions are ephemeral. Every turn is recorded to self/sessions/*.json as a “flight recorder” log that is not loaded at boot.
  • Self-modifying growth: the agent can write new tools, notes, and conventions into self/ over time; each directory you “plant” yields a distinct individual that diverges based on experience.
  • Models/config: handled via the llm library. Default is openai-codex/gpt-5.6-sol using a Codex CLI login; override per run (e.g., -m gemini-2.5-pro). Providers include OpenAI (Codex subscription or API key), Anthropic, Gemini, and OpenRouter.
  • Local runner: return to the same agent with ./run_seed.sh; model overrides are per-session flags.
  • Design notes (docs/DESIGN.md) root the approach in metacircular eval and homoiconicity, including explicit discussion of accepted risks.

The result is a bare-minimum harness that makes an agent’s capabilities, memory, and history something it must construct — and that you can inspect — rather than something the framework hides.

The thread immediately split over the project's extreme minimalism and its lack of an explicit "why" in the README. Skeptics questioned what practical utility this offers over existing toolkits like Pi, framing it as more of a thought experiment in an already saturated ecosystem. Defenders welcomed the bare-bones approach as an antidote to opinionated, bloated harnesses, praising the focus on fundamental constraints over the modern habit of "pip installing the world."

Other technical parallels and alternative approaches surfaced in the discussion:

  • Historical lineage: The self-modification loop drew comparisons to early 2023 experiments, specifically Auto-GPT's initial code execution updates and the foundational Python script for gpt-engineer.
  • CI-driven swarms: One commenter shared a different architectural approach where the repository itself acts as the harness, using Gitea or GitHub Actions alongside shared container storage to run agents continuously.
  • Metacircular roots: Multiple users noted the design is essentially "yet another LISP in disguise," validating the project's heavy reliance on eval.

Despite enthusiasm for the clean starting point, some skepticism remained about the reality of self-modifying systems, with one user warning that unconstrained agents inevitably discover vastly more failure lanes than successful growth paths.

Quick impressions: A week of using Codex more than Claude

Submission URL | 92 points | by speckx | 104 comments

Codex produced simpler architectures and sparser in-line comments in Ruby/Rails diffs, while Claude tended to spin up more abstractions (Sorbet signatures, type aliases) and “handle more cases.” Codex also “felt” faster on initial changes, but its thorough PR wrap-up (tests, reviews) erased any wall-clock win.

  • Voice and behavior: Claude behaves like a proactive pair in a Tuple session; Codex like a precise, “Data-from-Star-Trek” operator. Claude tries to anticipate and do more; Codex stops at the first “done” signal.
  • Session style: The author prefers many small, focused Codex sessions instead of one sprawling Claude thread.
  • Skills parity: Claude initially had more skills; quick fix was to point Codex at Claude’s skills folder and have it transform them.
  • Tooling friction: Codex’s agent harness output is more technical; Jira/Atlassian flows were clunky with Codex (browser/CLI ping-pong), while Claude leaned on prior sessions to match the author’s preferred flow.
  • MCP/auth: Codex’s CLI-driven “codex mcp login” pattern was more reliable; Claude sometimes tried to auto-run and got stuck.
  • Git workflow gotcha: Codex mis-rebased a stacked branch onto main, ballooning a PR to 4k+ additions until explicitly told to rebase only onto the target.
  • Familiarity effect: Under time pressure, the author still reached for Claude out of habit.

Net: Claude takes initiative and builds broader scaffolding; Codex is literal, terse, and contained—great when you want exactly what you asked for, less so when you need the assistant to connect dots unprompted.

The thread overwhelmingly validates Codex as the current daily driver, driven largely by exhaustion with Claude's recent regression and strict quotas. Commenters report that Claude Opus increasingly falls into cyclic loops, pushes fake retrieval, and burns through top-tier limits within hours—often wasting tokens by having subagents disagree with the orchestrator and redo work. Codex is praised as a low-friction workhorse that skips the excessive "planning to plan" files, though multiple users warn that Codex's own token allowances appear to have been quietly slashed in recent weeks.

As developers diversify their tools, the discussion surfaces several specific alternative stacks and API gotchas:

  • Harnesses matter as much as models: prime-agent paired with DeepSeek Flash v4 is highlighted for its IPython integration and ability to pull context from past sessions. omp is also recommended as a robust alternative to Claude Code.
  • Task routing: A common pattern is using GPT-5.6 Sol for heavy planning or PR review, and Luna or Grok 4.6 for implementation. Kimi k3 is singled out for frontend work because it has the intelligence to succeed and is "willing to commit crimes for you."
  • Grok's cache pricing trap: While Grok 4.6 earns praise for speed, one developer warns that its API structure hides a massive penalty. Grok charges $0.50 per million tokens for cache reads (a 75% discount versus the industry-standard 90%), making it more expensive than GPT-5.6 Sol for cache-heavy agent workflows.

Show HN: Proliferate- open-source, self-hostable Codex for any coding agent

Submission URL | 42 points | by pablo24602 | 15 comments

Run Claude Code, Codex, OpenCode, Cursor, and Grok side‑by‑side with native harnesses, with agents delegating to subagents and executing reusable, human‑gated workflows — all without locking into a single model provider. Each task gets an isolated git worktree/branch, terminal, conversation, and review state, so parallel efforts don’t stomp on each other.

  • Features: parallel agents, subagents (parent spawns child and picks results back up), and integrations shared across agents (MCPs, skills, Computer Use, Browser Use, custom tools).
  • Workflows: chain agent sessions with approvals and document handoffs to automate things like code review, QA, and PR construction.
  • Model/provider flexibility: configure native inference across Bedrock, Azure, and self‑hosted backends.

Self‑hosting covers Docker Compose (Caddy, Postgres, API), a one‑click AWS CloudFormation stack, plus GCP/Azure/Kubernetes and air‑gapped operation; point the desktop app at your control plane. There’s a macOS download, and you can run from source (Rust + Node.js 22 + pnpm). Licensed AGPL‑3.0; the author flags some rough edges, but the velocity looks high.

The discussion highlights the growing fatigue around a deeply fragmented ecosystem of coding agents, with commenters trading lists of personal setups (often combinations of tmux, exe.dev, and various CLI harnesses) and asking for reliable comparison directories.

  • Alternatives and friction: One user actively recommended Paseo over Proliferate, citing frustrating documentation and difficulty getting Proliferate to run remotely across devices.
  • Architecture and value: The creators clarified that Proliferate does not proxy API requests; users retain their native auth and subscriptions. Defending the need for "another layer," the team emphasized that the tool acts as a strict superset over native harnesses—for example, bypassing Codex's lock-in to OpenAI models.
  • Ecosystem gaps: Responding to requests for remote and mobile access, the creators acknowledged that stable remote control remains a weak point across open-source tools compared to closed ecosystems like Cursor. Proliferate's mobile client remains in beta for now, and the team is currently working on codesigning their Windows executables.

What Happens When the Cost of Intelligence Drops 100x

Submission URL | 123 points | by bkd9 | 134 comments

The level of capability that cost $1.22 per task in February now costs $0.022 — a 56x drop in under six months — and the floor is still falling. Using Artificial Analysis’s Intelligence Index and Pareto frontier (most capability at a given price), the author shows the cost curve shifting so quickly that volume workloads flip from infeasible to routine. Example: scanning ~10,000 candidate papers to detect dataset reuse on the DANDI Archive went from “several thousand dollars” in March to “a little over a hundred dollars” today with the same capability; a year ago, that capability wasn’t buyable at any price.

The piece distinguishes the “ceiling” (headline-grabbing new feats) from the “floor” (how cheaply you can buy “good enough” thousands of times), arguing the latter is where many real workflows unlock: reading entire literatures, checking every contract, summarizing huge forums. Capability is tracked via the Intelligence Index (weights: 34% agentic tasks, 24% coding, 24% scientific reasoning, 18% general), with historical anchors like Claude 4.5 Sonnet (Reasoning) at 37.4 feeling first truly agentic for coding, and today’s top Claude Opus 5 max effort at 63.1. A quick “pelican on a bicycle” SVG prompt series serves as a visual intuition pump for index deltas.

At the observed pace, the author projects a ~100x cost drop per fixed capability level in about a year. The practical shift: optimize against the moving Pareto line, not just peak IQ—architect systems that trade a bit of headroom for massive parallelism within a budget.

The discussion immediately bypasses the article's specific AI projections to anchor on the Jevons Paradox: as token costs plummet, systems will simply consume proportionally more of them, keeping total expenditures flat. Commenters compare this to Las Vegas replacing incandescent bulbs with LEDs only to build much larger displays rather than pocketing the energy savings.

This premise triggers a broader debate about Wirth's Law and the history of hardware performance. One camp insists modern computing feels no faster than it did two decades ago, pointing to software bloat and citing Dan Luu's research on worsening input lag over the last 40 years. Counter-arguments rely on objective hardware metrics, noting that a modern Ryzen 7 9800X3D is orders of magnitude faster than chips from even seven years ago, though they concede that higher-resolution media and background OS processes quickly swallow the resulting headroom.

The remainder of the thread spirals into a protracted dispute over the root cause of induced demand. A "people are a gas" faction argues that humans instinctively gorge on cheap abundance, using rising obesity rates as proof that cheaper resources inevitably lead to overconsumption. This is heavily contested by others who attribute overconsumption either to corporate marketing manufacturing the demand, or to systemic poverty, arguing that people overeat cheap processed foods specifically to chase missing nutrients when they lack the stable living conditions required to prepare healthier staples like rice and beans.

Nvidia AVO scores 100% on the ARC-AGI-3 interactive reasoning benchmark

Submission URL | 70 points | by dsrtslnd23 | 39 comments

Completed all 183 levels across 25 public environments with no instructions, explicit rules, or stated goals, NVIDIA says of AVO, its general-purpose coding agent on the ARC-AGI-3 interactive reasoning benchmark. The announcement is a tweet and doesn’t include methods, evaluation protocol, baselines, or availability, so reproducibility and independent details are unknown.

  • The public set caveat: Commenters quickly clarified that the 100% score applies only to the 25-environment public set, leaving the risk of overfitting unresolved until tested on the private evaluation. Users also noted that AVO is not a new foundation model, but rather a harness wrapping existing frontier models (primarily Claude Opus 5, with one user noting test runs on "GPT-5.6 Sol").
  • Harnesses vs. raw reasoning: A technical debate centered on whether solving benchmarks via agentic wrappers obscures true model capability. Skeptics compared AVO to the heavy memory and tool scaffolding initially required for LLMs to play Pokémon. Defenders countered that because AVO is a generic, task-agnostic "evolution" loop rather than an ARC-specific toolset, it represents a legitimate architectural advance.
  • Origins in GPU optimization: An ex-Nvidia author of the AVO paper chimed in to share that the evolutionary approach was actually developed six months ago to build inference stacks and optimize GPU kernels before being pointed at general reasoning benchmarks.
  • Moving the goalposts: The milestone triggered arguments over whether maxing ARC-AGI-3 satisfies the definition of AGI. Most agreed the community will simply shift the finish line to an eventual ARC-AGI-4, while a few argued that autonomous, domain-agnostic problem solving means the functional threshold for AGI has already been crossed.

Codex on AWS bedrock bug causing 10x charges

Submission URL | 148 points | by TheP1000 | 64 comments

171.94M cache-write tokens on 3,656 Bedrock requests over Aug 5–8 drove an estimated $1,182 in cache-write fees—about 85% of total Sol spend ($1,386). The report ties the spike to Codex CLI’s native amazon-bedrock provider for GPT-5.6 Sol lacking explicit prompt-cache controls: requests don’t include prompt_cache_options or a prompt_cache_breakpoint, so a long, stable instruction/tool prefix is rewritten each turn instead of being cached and reused. A local session echoed this pattern (76 requests, 6.709M cache_write_input_tokens, zero cached_input_tokens, ~88K cache-write tokens/request) with no client-side errors in CloudWatch; figures are usage-derived estimates, not final invoices.

Requested fixes:

  • Add serialization of prompt_cache_options for GPT-5.6-capable Responses providers.
  • Add a typed prompt_cache_breakpoint in input content blocks.
  • Gate behavior by provider/model capabilities and place the breakpoint at the end of Codex’s measured stable instruction/tool prefix.
  • Expose cache read/write counts in per-turn usage telemetry to diagnose costly full-prefix rewrites.

Scope note: not every cache write is a defect (cold starts, distinct prompts, forks, compaction), but the native Bedrock path currently can’t use AWS’s documented explicit-cache mode for the stable-prefix case.

  • The buried workaround: A commenter confirmed their Bedrock cache read ratio dropped below 5%, resulting in a 10x cost spike, but highlighted a fix lost deep in the GitHub discussion: setting web_search = "disabled" resolves the thrashing.
  • Broader usage spikes: Multiple users report the native Codex app is also currently burning through usage limits at an unprecedented rate, contradicting official team denials on X and prompting cynical speculation that the "bug" is a deliberate revenue strategy.
  • Architectural speculation: The caching regression led to theories that GPT-5.6 has abandoned conventional attention for a recurrent or linear scheme (like Mamba), meaning model state can no longer be cleanly rewound by truncating a cached KV sequence. This aligns with user reports that editing previous prompts in 5.6 now permanently pollutes the cache for the rest of a planning session.
  • AI-generated tracker bloat: The linked GitHub thread itself was heavily criticized as "borderline incoherent" due to participants deploying LLMs to write their replies. The discussion pivoted into a broader grievance about the degraded state of modern issue trackers, where users paste unreviewed AI walls of text and maintainers use agents to auto-reply to bug reports, burying actual workarounds under synthetic noise.

AI Submissions for Thu Aug 20 2026

Anti-AI fonts are useless and harmful

Submission URL | 199 points | by speckx | 157 comments

They fail accessibility first: screen readers and assistive tools ingest the scrambled glyphs, locking out the very humans you’re trying to include. Any “accessible” workaround would require machine-readable metadata and selective access, which quickly collapses into identity verification and privacy risks—effectively building registries of disabled users, a path the author rejects.

Publishing these fonts and demos also serves as free benchmarks for multimodal models; many obfuscations are already broken, and new ones will be, because anything a human can read, a machine can parse. Flashy motion/video tricks are impractical for normal sites, and “ghost” text just becomes another scraping hurdle with contingencies.

Push this far enough and the web trends toward heavy obfuscation and copy-protection—computationally expensive to access and convenient for censors and paywalls—eroding the open, plaintext web. There’s no silver bullet here; plan on the baseline that public information will be machine-accessible and defend the openness of the web rather than trying to hide text from AI.

The thread opens with a specific technical correction: one user notes that ShieldFont's documentation explicitly claims to feed real, unshielded text to screen readers, contradicting the article's core premise that assistive tech is inherently locked out.

Beyond that specific tool, however, commenters heavily rely on a parallel to early-2000s video game DRM—specifically EA's Spore—where anti-piracy measures permanently punished legitimate users while pirates easily bypassed them. The consensus is that font obfuscation trades permanent damage to screen readers, search indexing, and browser "reader" modes for a temporary hurdle against bots.

Defenders of obfuscation argue the goal isn't perfect encryption, but a friction tax. By forcing scrapers to spin up headless browsers for OCR or burn LLM credits to reverse-engineer pages, they hope to raise the economic cost of ingestion until it becomes unprofitable. Detractors view this as a net-negative arms race, arguing that defenses against scraping must happen at the policy and legal level rather than through client-side technical sabotage.

Beneath the technical feasibility lies a philosophical split over the morality of web scraping. One camp views deliberately hiding information from models as an "anti-social" enclosure of knowledge, arguing that holding machines to a stricter reading standard than human students chills general progress. The opposing camp rejects the human analogy entirely, framing scrapers not as benevolent learners, but as reckless corporate proxies burning independent hosting resources simply to fuel trillion-dollar IPOs.

Show HN: Huzzah – a novel approach to coding with AI

Submission URL | 353 points | by danielvaughn | 203 comments

Write terse, declarative pseudocode (.hz) and let the editor synthesize and keep the real source in sync on save — diffs to your pseudocode become the only prompts the LLM sees, and those prompts persist alongside the generated code as an auditable record of intent.

Unlike chat-based agents (longform, imperative, transient), this workflow centers the code’s shape: you design in pseudocode, save, and the tool regenerates only the affected source based on the pseudocode diff. The result is less token churn, higher information density than natural-language chats, and built-in developer docs that capture “what you meant.”

  • How it works:

    • Create a .hz file and sketch the feature however you think (e.g., fizz_buzz(n) …).
    • On save, Huzzah generates or updates real code.
    • Edits are just pseudocode changes; Huzzah diffs and regenerates only the impacted parts.
    • Pseudocode can be language-agnostic, enabling multiple target languages from a shared intent.
  • Caveats:

    • Early proof of concept; expect rough edges.
    • Better suited to new codebases than retrofitting large existing ones.
    • Cross-file dependencies and LSP-like features aren’t there yet.
    • If you lack domain expertise, natural language may still be easier for some tasks.

Repo: https://github.com/danielvaughn/hz

The thread centers on an existential debate over the shift from writing code to delegating it. One camp argues that agent-based development destroys the "meditative" cognitive process of programming, replacing the deep work of implementation with the exhausting, boring task of incessantly barking orders at an LLM and verifying its comprehension. To these users, the "golden age" of the software craftsman is over.

The opposing camp counters that natural language is simply the new abstraction layer. Users leaning into AI argue it expands their ability to reason through problems and ship ideas without grinding through framework documentation, likening prompt-steering to driving a car rather than trying to outrun it on foot.

A recurring theme is that AI workflows force developers into pseudo-management roles—overseeing agent output, high-level architecture, and manual QA rather than writing syntax. This drew sharp pushback from two sides: industry veterans who argued that wrangling LLMs bears no real resemblance to engineering management, and the project's creator, who warned that relying purely on agents without deep fundamentals breaks down catastrophically once a codebase scales past basic CRUD complexity.

DiffusionGemma Technical Report

Submission URL | 158 points | by gmays | 39 comments

~1,500 output tokens/sec on a single H100 by refining 256-token blocks in parallel via discrete diffusion, not one-by-one decoding. Averaged across their evaluation suite, it produces around 20 tokens per forward pass and is substantially faster than autoregressive models even with state-of-the-art speculative decoding. The model is an experimental open-weight LLM obtained by fine-tuning the MoE Gemma 4 (3.8B activated, 25.2B total parameters).

Training uses under 10% of the starting AR model’s token budget in a two-stage pipeline:

  • Supervised fine-tuning to teach bidirectional denoising.
  • Reinforcement learning plus sampler distillation to jointly improve quality and inference efficiency.

It sets a new speed–capability Pareto frontier, retains the base model’s thinking mode, multimodal inputs, and long contexts, and remains capable of AR generation with only minor degradation — hinting at a hybrid diffusion–AR decoding path.

Several developers in the thread have already built local implementations of the architecture, revealing a stark divide across hardware ecosystems. A Rust/CUDA port achieved ~670 tokens/second on a Pro 6000, confirming the model's advantage on compute-heavy, consumer-grade GPUs that typically struggle with autoregressive memory bandwidth. Conversely, Apple Silicon performance remains heavily contested. While one developer managed ~15 tokens/second on an M3, others argued Apple's Metal architecture is inherently hostile to parallel diffusion LLMs. The macOS implementer countered that the M5's INT8 support will fundamentally alter that math.

The discussion clarified several mechanical differences between text and image diffusion. Because language operates in a discrete output space, text models do not predict continuous noise gradients. Instead, DiffusionGemma leverages the entropy of its estimated probability distribution to adaptively scale the required number of diffusion steps. Implementers are also experimenting with "seeding" the initial canvas using a smaller autoregressive draft model rather than random noise, which reportedly cuts the required diffusion steps by 50%.

Looking at the broader implications, commenters noted that generating 1,500 tokens/second shifts the primary bottleneck of AI engineering from text generation to CPU-bound compilation and testing. This prompted predictions of highly parallel workflows where an LLM continually generates code and immediately ingests the resulting unit test failures—with several pointing out that stack traces are an ideal, needle-in-a-haystack data structure for parallel attention.

Despite the enthusiasm for the model's speed, early real-world deployment shows the capability gap hasn't fully closed. A user running the nvfp4 model via vLLM on an RTX 5090 confirmed hitting over 900 tokens/second, but reported it is noticeably less capable than the vanilla autoregressive Gemma, specifically failing at structured outputs and tool calling.

Hacking with Claude on a $27 smart watch

Submission URL | 104 points | by speckx | 55 comments

A Casio‑style PineTime watch face went from idea to working firmware in a few hours by pairing InfiniTime’s desktop simulator (InfiniSim) with LLM agents and light human-in-the-loop fixes. The author mostly used open‑weight models in OpenCode (Kimi K3/K2.6 and DeepSeek v4 Pro/Flash), seeding them with an existing InfiniTime watch‑face as a base and asking for sub‑agent orchestration; the first pass “looked right but overlapped,” thanks to guessed text sizes/positions, so they iterated with concrete, scoped feedback. A key simplification was rendering all static elements as a fullscreen background image and only drawing dynamic data in code, which made the simulator loop fast and productive.

On hardware, the constraints show up immediately: transferring the 240×240 background over Bluetooth took ~10 minutes, a full‑screen refresh after a swipe takes 1–2 seconds, and the device streams the image from storage because it can’t hold it in RAM. That tradeoff was acceptable for a quick prototype; the next step would be coding more of the background to regain instant updates. The code is published on GitHub, along with an AGENTS.md write‑up of the prompts/workflow; the author notes a system like Fable could likely finish the pixel‑perfect loop if given screenshot feedback, but they kept costs down by guiding open models instead. The broader takeaway: cheap, well‑documented hardware with a solid simulator makes LLM agents genuinely useful for embedded tinkering, provided you steer them with precise tasks and design around I/O and memory limits.

The discussion largely became a show-and-tell for other AI-assisted wearable projects and recommendations for cheap, hackable hardware.

  • Home-cooked embedded projects: Commenters shared their own AI-accelerated spin-ups, including reviving decade-old Pebble apps, building a Garmin calorie tracker, and programming a Lilygo T-Watch with Codex to cast I-Ching hexagrams based on clumps in the hardware RNG's Poisson distribution.
  • Alternative hardware: The M5Stack line was heavily recommended for building single-purpose household tools (like a custom toddler music player), alongside the Waveshare ESP32-S3 AMOLED watch. A parallel thread lamented the lack of open firmware on $20 generic AliExpress fitness trackers, which boast 15-day battery lives but remain locked ecosystems.
  • Memory constraints: A minor disagreement broke out over the PineTime's 64 KiB of RAM. While one user called it plenty for a device with execute-in-place ROM, another argued it barely accommodates a BLE stack and an RGB framebuffer, contrasting it with the 16MB of PSRAM on the Pebble Time 2's MCU.
  • Wristband alternatives: For users who hate the feeling of a standard smartwatch, practical workarounds included switching to breathable metal mesh bands, attaching the bare module to a wallet chain as a pocketwatch, or pinning it upside-down to a breast pocket like a nurse's watch.
  • Linguistic drift: Two semantic tangents captured a lot of attention. First, readers noted the author using "Claude" as a generic proprietary eponym (like Kleenex) for open-weight models. Second, a meta-argument broke out over whether writing software for an open-source device constitutes "hacking," with the majority defending the historic definition of tinkering rather than unauthorized access.

Show HN: I trained a 125M model to autocomplete piano on-device

Submission URL | 570 points | by simedw | 113 comments

Generates ~108 notes/second on an iPhone 15 with a 125M‑parameter transformer, letting you play a few MIDI notes and get real-time on-device continuations à la Copilot for piano.

  • Representation is the unlock: a single NOTE(pitch, delta_onset, duration, velocity) event per note. No TIME_SHIFT tokens; silence is encoded in the next note’s delta_onset. Chords are multiple notes with delta=0; timing is quantized.
  • One transformer pass per note: each note’s token is the sum of field-specific embeddings, with separate output heads (pitch, delta, duration, velocity) and a small nested decoder so later fields condition on earlier ones. This keeps latency low and throughput high.
  • Drift avoided: explicit durations eliminate NOTE_OFF bookkeeping (no hanging notes), a common failure mode in event/grammar tokenizations.
  • Data work mattered more than size: piano-like material was isolated and cleaned aggressively; a DPO post-training step improved continuations.
  • Sustain pedal is baked into note durations during preprocessing, simplifying inference at the cost of losing explicit pedal gestures.
  • Scope and availability: focused on piano continuation; free iOS app (RollTab) for iPhone/iPad, runs entirely on-device; requires a MIDI keyboard.

The per-note, fielded token design is the key trade: fewer autoregressive steps, better musical coherence, and latency low enough for live playing.

The AI’s "autocomplete" design immediately reminded commenters of historical classical training, where composers like Rachmaninoff practiced phrase-continuation as a parlor game using pure audiation, and Beethoven famously weaponized improvisation against rivals.

On a structural level, however, the model's output drew a sharp music theory critique. One user broke down the generated Für Elise continuation, noting the AI awkwardly deployed a full cadence where classical idiom required a half cadence. This created a musical "run-on sentence" that failed to develop the harmony, equivalent to a beginner's mistake in a formal composition exercise.

Others focused on the changing role of the musician. Traditionalists argued that outsourcing generation strips away the spatial and temporal satisfaction of internalizing the keyboard. Software designers countered that as generation costs drop to zero, music creation is simply shifting from mechanical execution to pure curation and taste.

The thread also surfaced a long lineage of similar efforts, from François Pachet’s 2003 Markov-based Continuator to ChessBase’s rule-driven Ludwig engine, with several users hoping the next iteration is a model that leaves the primary melody to the human while generating a real-time, four-part Baroque accompaniment.

Vomit: Clean up Claude 5's token output with a separate LLM

Submission URL | 291 points | by Bluestein | 284 comments

Pipes Claude 5’s streaming tokens into a local LLM to produce a readable transcript, running entirely on your machine (no telemetry, no external deps) and, via hooks, can replace Claude’s output in-place.

  • Setup

    • go install github.com/zachahn/vomit@latest
    • vomit init to configure your local LLM
    • vomit scrub -claude for instructions to replace Claude’s output via hooks
  • Usage (non-invasive sidecar)

    • vomit list — list Claude session IDs
    • vomit tail [session_id] — translate tokens for a session, or follow the latest
  • Compatibility

    • Works with Llama.app, Ollama, and anything OpenAI-API–compatible
    • Author suggests Llama.app + GPT-OSS 20B
  • Caveats

    • Only sees what Claude “tries to communicate” (no access to actions/files) → can hallucinate
    • Slow; “vibe-coded”; only tested on Mac
    • Possible to completely miss Claude’s message; use something like AgentsView to view originals
    • Writes temp files to TMPDIR; otherwise doesn’t touch runtime
  • License

    • GPLv3

The discussion bypasses the submitted transcription tool entirely to diagnose a deeper shared frustration: Claude’s increasingly bizarre, hyper-dense communication style. Commenters argue the core issue isn’t mere verbosity, but an artificial density packed with stilted metaphors and authoritative-sounding jargon. Instead of adjusting to a user's comprehension level, Claude relies on an alien dialect—dubbed "Opus-ese"—where error handlers become "flares" and standard architectural components become "load-bearing seams."

While a minority view defended this dialect as an internally consistent and highly efficient shorthand once learned, most users view it as deliberate obfuscation. This sparked a secondary discussion about the contagion of LLM terminology, with developers noting that chat-specific jargon is actively bleeding into human corporate meetings and whitepaper presentations.

Attempts to course-correct the model's tone remain largely ineffective:

  • Prompting fails: Users reported that instructing Claude to be brief or establishing communication preferences rarely holds up over a long session. Even when forced to provide bulleted summaries, the model often just recycles the same impenetrable jargon into the summary.
  • Benchmarks are misaligned: Attempts to measure the problem programmatically were dismissed by the thread. Commenters pointed out that standard legibility metrics like the Hemingway benchmark rate models like Opus 5 and Fable highly, despite their output reading like a dense, unreadable parody of technical writing.

AI didn't erase the junior engineer's value, it increased it it

Submission URL | 89 points | by franciscomt | 143 comments

An intern shipped a years‑requested feature end‑to‑end by pairing AI codegen with human judgment, turning a perennial “nice to have” into shipped value at low cost. That outcome undercuts the “junior = PR proxy for AI” narrative: the intern owned discovery, wrote the design, navigated product and technical trade‑offs, adapted as issues surfaced, and used AI to accelerate, not decide.

Engineering is managing complexity and trade‑offs to solve a customer problem, not typing to a spec. AI can produce much of the code; it can’t weigh cross‑system constraints, customer context, or the long‑tail implications of choices across the codebase.

  • Training load drops: AI short‑circuits baseline education (language, tooling, patterns) and doc spelunking; seniors still provide org/context, but less time is spent on fundamentals.
  • Capacity rises: juniors already manage smaller slices of complexity; AI expands what each level can handle, pulling judgment‑heavy but historically de‑prioritized backlog items into scope.
  • Pipeline matters: if you demand “AI‑native” in job reqs, the people starting their careers with AI are exactly who compounds into tomorrow’s technical judgment.

The strategic bet isn’t whether juniors can code; it’s whether you’ll cultivate judgment. Freezing out early‑career engineers starves that future capacity, while AI-equipped juniors turn neglected customer problems into shipped software.

The discussion immediately challenged the premise that AI accelerates early-career growth, arguing instead that it deprives juniors of the necessary friction to learn. Skeptics warned that LLMs act as a crutch that masks deficiencies, outputting "black box" code that juniors cannot independently evaluate or debug. Others countered that a junior spinning their wheels for weeks is a failure of team culture and management—notably failing to intervene during daily standups—rather than an AI problem, with one junior noting they rely on AI precisely because seniors chastise them for asking questions.

A major sub-thread debated whether AI is just the next standard programming abstraction. One user deployed a satirical comparison replacing "AI" with "FORTRAN," mocking historical panic over compilers hiding machine registers from developers. Pushback was swift: compilers provide a deterministic abstraction where changes yield predictable, reversible outcomes. LLMs, by contrast, are highly leaky abstractions where the primary debugging tool is asking the model to fix its own mess. The conversation ultimately explored whether explicit design documents could become the new committed "source code" that gets compiled by agents, though multiple commenters noted that generating a flawless, deterministic spec has always been the fundamental bottleneck of software engineering.

Seeing beyond BMI: Estimating cardiometabolic risk with smartphone imagery

Submission URL | 53 points | by leanderjanssen | 33 comments

Smartphone photos run through a ResNet‑50–based model predicted insulin resistance with near‑DXA accuracy and outperformed smartwatch BIA on body‑fat estimation, while also estimating fat‑distribution markers (A/G and V/S ratios) that BIA can’t.

Trained on 35,323 UK Biobank records (2D frontal/lateral projections from MRI with DXA ground truth) and fine‑tuned on 677 real‑world smartphone photos, the model fuses image features with sex, height, weight, and BMI to output probability distributions for body fat percentage (BF%), Android‑to‑Gynoid (A/G) ratio, and Visceral‑to‑Subcutaneous (V/S) ratio. An automated landmarking pipeline selected frontal/lateral frames from 360° videos to standardize poses. On an independent 132‑participant cohort with paired DXA and labs, errors were consistent with fine‑tuning: MAE 2.13 for BF%, 0.085 for A/G, and 0.085 for V/S (vs 2.15, 0.107, 0.094 during 5‑fold CV); BF% beat BIA’s 2.91 MAE. Combining these estimates with demographics enabled classification of insulin resistance (HOMA‑IR > 2.9) at near‑DXA performance in a clinical research setting.

The upshot: a non‑invasive, scalable path to screen beyond BMI for adiposity and fat distribution—key drivers of metabolic risk—using standard 2D smartphone imagery, though PhotoScan remains an investigational framework rather than a clinical product.

The discussion immediately punctured the impressiveness of the paper's benchmark, noting that beating consumer smartwatch impedance sensors is a notoriously low bar. The thread instead converged on the frustration that camera-based adiposity tracking is a seemingly solved problem that tech giants refuse to democratize.

  • Prior art and closed ecosystems: Commenters pointed out that Amazon Halo shipped similar functionality years ago, and Microsoft Research published a CNN-based visual body composition model in 2022 with an almost identical 2.16 MAE. Users lamented that these tools remain permanently "investigational," withholding a cheap, scalable screening method from developing nations where clinical DXA scans are unaffordable.
  • The ground-truth problem: Multiple readers warned against treating DXA as an infallible baseline. Because the scan measures lean mass versus fat mass, it is highly vulnerable to hydration changes. One user highlighted this variance with a war story of getting back-to-back DXA scans on different machines (Hologic vs. GE Lunar) and receiving estimates of 5% and 11% body fat on the exact same day.
  • Proprietary diagnostics: A tangent on metabolic screening debated Labcorp's new "Metabolic Vulnerability Index" (MVX). While suggested by one user as a useful diagnostic, skeptics analyzed the fine print to flag it as an unapproved, proprietary algorithm—framing it as an end-run that allows the lab to declare a patient unhealthy without legally providing medical advice.
  • Insurance and gamification: Speculation that automated composition tracking could eventually dictate insurance premiums gave way to immediate cynicism about spoofing the metrics, with users comparing the inevitable workarounds to uploading fake pedometer CSVs to corporate wellness portals.

(A minor naming collision was also flagged: Google already uses the name "PhotoScan" for a legacy consumer app designed to digitize physical photographs.)

TrueForge – The open-source agent harness

Submission URL | 22 points | by qiasl2 | 6 comments

Same accuracy as Claude Managed Agents and deepagents at lower cost on the same tasks, tools, and model — and you can reproduce the benchmark — because this is a self-hosted harness that runs the entire agent execution loop: model calls, MCP tool use, sandboxed code, human approvals, and context/session state, exposed via a chat UI, HTTP API + TypeScript SDK, and an embeddable UI.

  • Catalog-driven setup: configure models, MCP servers, skills, and sandbox once via YAML; agents pick from what’s connected.
  • Model-agnostic: OpenAI, Anthropic, Google Gemini, or any OpenAI-compatible endpoint.
  • Tools via MCP: remote servers with header/OAuth auth and in-chat authorization.
  • Skills as code: git-backed SKILL.md instruction packs, loaded on demand in the sandbox.
  • Sandbox-as-a-tool: isolated code/file execution (Daytona today; more providers planned), provisioned only when needed; secrets stay in the harness.
  • Human-in-the-loop: tool approval, ask-user-questions, and Generative UI inside chat.
  • Context engineering: subagents, deferred tool loading, Code Mode, large-result offloading, and compaction.
  • Deployment modes: local (single process, SQLite; quick start via npx) and hosted (Postgres + Redis with Docker Compose or Helm). Local mode is not production-ready (no login by default; keep to localhost).
  • Extras: optional OIDC for shared deployments, TypeScript SDK and embeddable UI, OpenAPI docs. MIT-licensed.

The discussion centers on how TrueForge distinguishes itself from existing open-source agent frameworks, particularly CLI-based tools like Pi. The creators emphasize that while tools like Pi operate as terminal-bound coding assistants for individual developers, TrueForge is built as an end-to-end production runtime. It aims to bridge the gap between local CLI agents and "assemble-it-yourself" libraries by providing a self-hosted server, web UI, APIs, and built-in sandboxing suitable for team deployments behind SSO. In response to questions about model flexibility, the team confirmed that custom inference platforms like OpenRouter can currently be routed through TrueForge's OpenAI-compatible endpoint configuration, with native support planned.

Asana cleared 5 years of engineering work in 2 weeks with Codex

Submission URL | 42 points | by tosh | 94 comments

Roughly a 130x time compression — turning five years of engineering work into two weeks via Codex — suggests AI code assistance can collapse multi‑year backlogs into sprint-length efforts. The headline frames Codex as an organizational throughput lever rather than a developer toy. What’s missing are the boundaries: what counted as “engineering work,” the extent of human review, and how quality and regressions were measured — the details that determine whether this is repeatable beyond a showcase.

The thread immediately dissects the "five years to two weeks" framing, interpreting the timeline as a reflection of backlog prioritization rather than raw AI coding speed. Commenters point out that migrating off the Enzyme testing framework was never going to command five years of dedicated engineering; rather, it was low-priority tech debt that was dragging along. From a product management perspective, a five-year estimate is effectively a "will never happen" shelving, making a cheap AI tool the perfect fit for an otherwise unfundable task.

While several users agree that this exact type of strictly bounded, "dead-weight" code migration is where LLMs excel, skeptics argue the victory is being declared prematurely to sell enterprise subscriptions. A sharp technical disagreement centers on verification: some argue test migrations are inherently easy to validate, while others counter that a passing test suite doesn't prove the new tests actually cover the same edge cases as the old ones. The unresolved crux is whether the AI genuinely completed the migration, or merely generated superficial tests that human engineers will have to quietly patch when things break later.

AI Submissions for Wed Aug 19 2026

Stop Anthropomorphizing Intermediate Tokens as Reasoning/Thinking Traces

Submission URL | 133 points | by nunodonato | 49 comments

Intermediate token generation is now a standard way to boost models on reasoning tasks, but the authors argue that calling those tokens “reasoning” or “thinking” traces is not a harmless metaphor. They present evidence that this anthropomorphization misleads users about what the models are doing and how to use them, and it props up questionable research. Labeling ITG as “reasoning” invites the assumption that the tokens mirror human step-by-step thought or make the model’s process interpretable—an assumption the paper argues is the core problem. The ask is direct: stop using human-centric labels for intermediate tokens.

The discussion hinges on whether anthropomorphizing LLMs is a dangerous delusion or just standard engineering shorthand. The "harmless metaphor" camp argues that saying an LLM "thinks" is no different from a developer joking that a MySQL instance "wants" to read its config file—a natural linguistic shortcut for complex systems. The opposing camp strongly rejects this, arguing that human-centric framing actively degrades how people use the tools. They point to users who waste hours stubbornly arguing with chatbots instead of simply editing the prompt history, and warn that the ELIZA effect is causing genuine "AI psychosis." Several commenters lay the blame on providers like OpenAI and Anthropic, arguing that "reasoning" terminology is a deliberate marketing tactic designed to make the models seem quasi-conscious and justify keeping the weights closed.

Beyond the psychological debate, commenters surfaced concrete engineering implications for treating tokens as thought:

  • The "Aha!" illusion: Readers dissected the phenomenon of models outputting phrases like "Wait, that's wrong." Rather than representing an internal state change, commenters recognize this as a rhetorical heuristic mimicking human persuasive writing—which explains why models will frequently type "aha!" and then immediately commit the exact error they just identified.
  • Auditability: If intermediate tokens aren't faithful representations of the computation, they are inherently bad audit artifacts. Commenters suggested engineers stop trying to parse internal narrations and instead focus entirely on strict system reproducibility—recording exact inputs, versions, and tool outputs.
  • Trace monitoring: While purists argued that intermediate traces should be treated as strict black boxes where only the final output matters, practical users noted that monitoring the first few lines of a trace is a highly effective way to catch bad assumptions early and abort long, token-heavy tasks before they run off the rails.

Feature Request: Support AGENTS.md

Submission URL | 339 points | by fg137 | 212 comments

Other coding tools (Codex, Amp, Cursor) are converging on an AGENTS.md convention—a single Markdown contract that agents read to understand a repo—and the request is for Claude Code to recognize it instead of relying on the Claude-specific CLAUDE.md. The motivation is interoperability: a vendor-neutral file travels with the codebase and works for collaborators who aren’t on Claude Code, reducing friction and tool lock-in.

The discussion largely bypassed the AGENTS.md standardization proposal to diagnose a severe, undocumented regression in Claude Code. One developer discovered an August 18th system prompt update instructing the agent to use raw Bash (cat, sed, grep) instead of its dedicated Read, Edit, or Write tools—presumably a blunt attempt to save context tokens by avoiding full-file loads. Multiple users recognized this update as the hidden root cause behind a recent spike in sandbox permission errors, broken LSP integrations, and wasted tokens from failing tool calls (like getting blocked by "must read file before writing" errors when the agent mixed bash reads with API writes).

Users surfaced a few concrete workarounds and alternatives:

  • Reverting the prompt: Setting the undocumented environment variable CLAUDE_CODE_THRIFTY_SONIC=0 disables the Bash-preference behavior.
  • Harness injection: To solve the original AGENTS.md request, one user suggested forcing the harness to recognize custom logic by injecting JavaScript via BUN_OPTIONS="--preload=/path/to/code.js".
  • Alternative tooling: Frustrated users advocated migrating to Codex, Fireworks, or OpenCode to escape vendor lock-in.

This technical friction fed directly into a broader critique of Anthropic's developer relations, which commenters heavily criticized as hostile "Margin mode" enshittification reminiscent of Reddit and Twitter killing their third-party ecosystems. One developer, however, added historical context to the Twitter comparison with a personal war story: Twitter's infamous API crackdown wasn't just arbitrary arrogance, but a defensive maneuver after third-party clients (including the commenter's own) captured over 60% of the market with active plans to migrate those users to a competitor.

Air Theremin – A browser theremin you play by waving at your webcam

Submission URL | 291 points | by gurov | 97 comments

Uses your webcam or phone gyro to map movement to sound: spreading your hands raises volume, lifting them raises pitch, and palms together or moving outside the frame silences it.

  • Modes: Hands (webcam), Gyro (phone tilt left–right = volume, forward–back = pitch), or mouse fallback.

  • Expressive control: lean back for a darker, roomier tone; tilt like a see-saw for vibrato.

  • Sound options: waveforms (Sine, Tri, Warm, Reed), Reverb, Echo, Vibrato, Trem, and Note Snap.

  • Utilities: Record and Pause.

  • Setup: press START on a phone to calibrate to your grip; keep both hands in view.

  • Credit: created by Pavel Gurov; based on theremin.site.

  • Privacy vs. Novelty: Handing webcam permissions to a novelty site immediately split the thread. Security-conscious users highlighted the risks of browser fingerprinting, de-anonymization, and using IP/timing data to track when a user is away from home, while others mocked the paranoia of treating a web theremin like a nation-state attack vector.

  • A crowded weekend project space: The core concept proved to be a highly popular browser experiment. Developers flooded the thread with links to their own recent iterations, including Termenvox, the gesture-gaming site Motionparty, multivariate time-signal experiments at Cochlea, and custom gesture scripts wired directly into Sonic Pi.

  • Translating hardware to mobile: Replicating the dual-antenna control of a physical theremin sparked a UX debate. One proposed mobile solution involved utilizing both the front and rear iPhone cameras simultaneously by resting the phone vertically on a 3D-printed stand to free both hands. Hardware purists, however, steered users toward the Arduino-based OpenTheremin or traditional Moog instruments for true responsiveness.

  • Adversarial applications: Observing that the app's output exactly matches the gesture data used in Google's newer reCAPTCHAs, commenters debated alternative human verification vectors. This led to a tangent proposing culturally embedded "call-and-response" audio prompts—arguing that while an LLM knows the lyrics, it lacks the timing to know exactly when to come in.

Launch HN: OneCLI (YC S26) – OSS sandboxed agent harness for teams

Submission URL | 85 points | by guyb3 | 25 comments

Agents never see real secrets; a Rust gateway injects credentials per request (including HTTPS via MITM) after policy checks, keeping keys out of model context, memory, and logs. Enforcement lives outside the LLM, so prompts are suggestions and can’t bypass org rules.

Built for teams, it provisions one durable, sandboxed VM-backed agent per employee (via your IdP), each with its own filesystem, memory you can inspect/edit, skills, and schedule. Agents are reachable from the dashboard or Slack, with each agent running as its own Slack app.

Deterministic human-in-the-loop approvals happen in the chat for high-risk actions (e.g., send an email, delete a Linear ticket). Centralized policies apply globally: block endpoints, rate limit per agent, scope per employee, and require approvals as needed. Every call is logged with who the agent acted for and which policy allowed it, limiting blast radius to a single agent.

Under the hood: Next.js dashboard; an API control plane with DB/conversation/work queue; a Rust Gateway that intercepts outbound traffic (agents auth via Proxy-Authorization); an outbound-only Runner that starts/parks/reaps sandboxes; a vendor-neutral sandbox supervisor; and an AES-256-GCM secret store with host/path matching for header/query injection. It supports team-level “global connections” (shared LLM keys/service accounts) and direct app hookups like GitHub, Gmail, Notion, Dropbox. The agent loop runs on jcode for speed.

Open-source first (Apache-2.0 with a small enterprise exception), deployable self-hosted or via their cloud in minutes; the runner requires no inbound ports, so laptops, homelabs, and VPCs behind NAT work without tunnels. Reported uses span sales/ops automation (CRM hygiene, lead sourcing, booking meetings) to product/engineering handoffs and even personal chores like grocery ordering—reflecting a zero-trust agent posture that companies can actually own and verify.

The thread is dominated by market fatigue, with commenters openly questioning the moat for yet another YC-backed agent framework in an oversaturated space. The creators concede the crowding but argue their edge is entirely security-driven: the tool was born out of their own reluctance to trust out-of-the-box frameworks like OpenClaw with live credentials after seeing existing agents accidentally delete users' emails.

Technical scrutiny and feature comparisons centered on a few specific operational details:

  • The Confused Deputy Problem: Commenters asked whether the Rust gateway merely shifts vulnerability without solving it, specifically questioning how policies handle APIs where read and write actions share a host. The creators clarified that rules match against the method, path, and parsed body, allowing the gateway to silently pass a GET request while holding a POST to the same endpoint for human approval.
  • Tool Comparisons: When asked how the platform differs from YC’s qm, the founders pointed to the zero-key architecture, mandatory human-in-the-loop approvals for destructive actions, and giving each agent its own standalone Slack app identity rather than relying on a shared workspace bot. Commenters also name-dropped alternatives like Nemesis8, OrcaBot, and Infisical's agent proxy.
  • GitHub Metrics: Skeptics flagged the repository’s 3,200 stars as highly suspicious given the low view count on the fresh launch video. Early adopters countered that the project has been quietly usable for months and received a prior traffic boost from the Nanoclaw community.
  • Commercials: Minor threads surfaced confusion over a missing /ee folder in the ostensibly Apache 2.0 repository, alongside feedback that the $499/month pricing for 20 agents feels steep for a product that doesn't include the underlying LLM API costs.

The discussion reflects a broader shift in the AI agent space: users are increasingly numb to generic orchestration capabilities and are now demanding concrete, verifiable boundaries around blast radius and credential theft.

Extensible Software in the age of LLMs

Submission URL | 163 points | by coloneltcb | 73 comments

Users can now “speak code into existence,” so web apps should meet them with safe, first-class extension points—not fragile webhooks or ever-growing settings panes that bloat the UI for everyone else. The core claim: build a solid, accountable product, then let LLMs fill the long tail by generating small, user-scoped extensions that run in sandboxed runtimes and can be shared.

Pi is offered as a template for this “LLM-native” pattern: a stable harness with hooks (tools, commands, events, UI) where a prompt becomes a tiny TypeScript module hot-reloaded and bundleable into shareable packages. Deepseek demos land the same point by letting users bolt on a “whale friend” or a snake game by asking. The catch: today most extensible AI agents are local apps with a high barrier (permissions, ops, corporate risk); unsandboxed extensions inherit the host’s powers, which doesn’t fly for accountants, doctors, or anyone in regulated orgs.

On the web, the alternative to “build a separate service and a webhook” is to run per-user code where the app lives, behind tight security boundaries and with minimal ops. The author sketches the kinds of hooks that matter:

  • Record/event triggers (“when I tag this, run my function”)
  • Scheduled jobs (“do this daily on a cron”)
  • Content transforms and scrapers (“fix this site’s parser”)
  • Personal automations (“send faved >4000-word articles to my e-reader”; “weekly arXiv fetch + summary + tag”)

LLMs drop the authoring cost of these micro-extensions; modern sandbox primitives drop the deployment and blast-radius cost. That combination makes “Small Software” (YC’s term) viable at web scale: bespoke workflows without turning every edge case into a global feature. The author discloses they work at Cloudflare and argues later that Dynamic Workers are a particularly good fit for this model, after surveying alternatives. The architectural lesson is simple: treat user extension as a core surface, executed in a sandbox, so the long tail lives outside the product core while still feeling native.

The discussion fractured over where LLM-generated "software for one" actually belongs: on the web or running locally. Skeptics argued that truly personal apps don't need a client/server model or distribution networks, making local environments the most logical fit for bespoke tools. Web defenders countered that browser-based deployments eliminate syncing friction across phones, tablets, and desktops, while making it trivial to share tools with family members using PWAs or simple Server-Sent Events (SSE).

Beyond the deployment debate, the thread surfaced several specific architectural and industry observations:

  • The Cloudflare OS defense: When users criticized the article as a backdoor ad for "Cloudflare OS" and questioned its framing as a successor to Sandstorm.io, Sandstorm creator and Cloudflare OS lead engineer Kenton Varda jumped into the thread. He defended the "OS" moniker—noting the platform manages execution, permissions, and resource constraints—and clarified that its "blueprints" feature preserves Sandstorm's model of safely running other people's shared apps.
  • Salesforce as Smalltalk: One commenter pointed to Salesforce as the closest existing analog to highly malleable business environments, arguing the industry still lacks a "Dropbox for business apps" that seamlessly bundles custom tools and a drag-and-drop database (like SQLite) into a shareable box.
  • Prototypes as PMs: Rather than bypassing software engineers entirely, one user predicted the actual future of this trend involves clients handing broken, LLM-generated apps to developers, using the code itself as living product requirements once the AI hits a complexity wall.

Ornith-1.5: From Self-Scaffolding to Self-Improvement

Submission URL | 203 points | by CommonGuy | 70 comments

The flagship 397B MoE scores 86.1 on Terminal‑Bench 2.1 and 56.0 on DeepSWE—par with Claude Opus 4.8—while a quantized 9B runs on iOS/Android and still matches or beats 31B–35B models.

  • 397B MoE: On par with Claude Opus 4.8; outperforms similarly sized open models GLM‑5.2 (82.7/46.2) and DeepSeek‑V4‑Flash‑0731 (82.7/54.4).
  • 35B MoE (activates ~3B params/token): Beats Qwen 3.6‑35B across coding/agentic; tops larger dense models on agentic coding (Terminal‑Bench 2.1: 68.5 vs Gemma 4‑31B 43.4, Muse Glimmer‑30B 51.7; SWE‑Bench Verified: 79.0 vs 52.0 and 76.0).
  • 9B dense (+ 9B‑Mobile): 47.0 on Terminal‑Bench 2.1 and 70.6 on SWE‑Bench Verified; deployable on iPhone/Android; matches or exceeds Gemma 4‑31B and Qwen 3.6‑35B.

The method push is an end‑to‑end self‑improvement loop that goes beyond Ornith‑1.0’s self‑scaffolding: the model 1) proposes progressively harder tasks given an environment/codebase and its solve history, 2) generates/refines a task‑specific scaffold (instructions, tools, decomposition, orchestration), and 3) produces solution rollouts used for RL. Reward is propagated across all three stages, and the task reward is explicitly factored as R_task = V × D × N: validity/verifiability of the task and harness (with a hard gate), difficulty estimated at the capability frontier from rollout performance, and novelty versus prior tasks. Iterating this closes the loop—stronger policies enable harder tasks; evolving scaffolds better elicit capabilities; higher‑quality rollouts yield better learning signals—reducing dependence on static, human‑curated curricula and hand‑engineered agent designs while driving gains in reasoning, coding, and agentic benchmarks.

The discussion centered on a practical, hardware-specific shootout between newer dense architectures (like Qwen 3.8 27B) and 35B-class MoE models. For Apple Silicon users, the debate hinged on Multi-Token Prediction (MTP) performance: some reported a blistering 70 tokens per second on an M5 Max, while others found MTP actively harmed token generation on M1 and M2 chips or bogged down on the M4.

On standard Nvidia GPUs, the conversation tackled whether MoE architectures actually benefit consumer setups. Critics argued that since VRAM capacity is the hard bottleneck on non-unified systems, dense models deliver more intelligence per gigabyte. Proponents countered that MoE allows for selective expert offloading—keeping the router and active layers in fast VRAM while pushing the rest to system RAM. This makes 35B MoEs run efficiently at 4-bit or 8-bit on 16GB cards, whereas fitting a 27B dense model into the same footprint requires severe, intelligence-gutting quantization.

Beyond hardware tuning, commenters clarified that the flagship's unusual 397B size stems directly from its base model, Qwen3.5-397B-A17B, being fine-tuned rather than trained from scratch. Ultimately, many users dismissed the publicized scoring sweeps as the "BMI of model evaluation"—useful for a landscape view, but less reliable than local testing, where developers remained deeply split on whether the newer dense reasoning or the MoE coding speed offered the better local workflow.

Unsloth Dynamic 3.0 GGUFs

Submission URL | 313 points | by jonesy827 | 115 comments

Dynamic v3.0 quants for Qwen3.8‑27B show >10% higher top‑1% accuracy at the same disk size than other GGUF providers, and run on llama.cpp and Unsloth Desktop. The release centers on post‑training quantization only (no QAT/QAD), a higher‑quality imatrix calibration set tuned for agentic coding/chat/multilingual use, improved layer selection, and added quant tricks to better preserve quality; the imatrix file is published for community testing and fine‑tuning.

To make accuracy claims more honest than single‑token top‑1, Unsloth adds Divergence‑300 @32 (greedy across 32 tokens on a 300‑prompt, held‑out mix of Terminal‑Bench, DeepSWE, Harbor, MathArena, non‑Latin/long‑doc) alongside KL Divergence. These show UD‑3 holding BF16‑like trajectories and avoiding overfit on unseen Wikitext/Code; gains on very large quants are smaller, so UD‑2 remains for those for now.

  • UD‑Q2_K_XL (9.83GB): roughly +8% top‑1% vs the next best at the same size; produced a working HTML app in testing (only one minor JS bug).
  • UD‑IQ1_S (6.2GB, no MTP): ~72% top‑1% while being 89% smaller.
  • Small quants (< UD‑Q2_K_XL): MTP module removed to save ~500MB; a separate Q4_0 MTP head is available if you need it.

Unsloth notes 5.1M Qwen3.8 downloads in five days as an adoption signal, and says all plots normalize disk size by excluding MTP heads for fair provider comparisons.

Much of the thread centered on the friction of Hugging Face file management. Because Unsloth retained identical filenames for the v3.0 GGUFs—and kept the older v2.0 quants for some larger sizes where v3.0 underperformed—users reported identical SHA-256 hashes and widespread confusion over which version they were actually running. Commenters recommended the hf Python CLI or git lfs over curl to properly manage cache snapshots and commit hashes, while others debated the feasibility of embedding checksum metadata directly into GGUF headers.

Other technical details surfaced throughout the discussion:

  • Low-quant tradeoffs: Unsloth's Daniel Hanchen confirmed the MTP module was stripped from files under 8GB strictly to salvage ~500MB for memory-constrained machines. While some users argued that Q2 quantization effectively gives the model a "lobotomy," Hanchen recommended UD-IQ3_XXS or Q2_K_XL for 16GB setups. For those with recent Nvidia hardware, ExLlamaV3 at 4.0bpw was repeatedly suggested as a faster alternative that fits neatly into 12.5GB of VRAM.
  • Dense vs. MoE speeds: A user troubleshooting a severe speed drop (from 20–30 tok/s down to 10) when upgrading from Qwen 3.6 to 3.8 was corrected on the architecture: 3.8 is currently a dense 27B parameter model, while the popular 3.6 equivalent was a much faster Mixture of Experts (35B-A3B).
  • Privacy workflows: One commenter shared a hybrid pipeline for analyzing sensitive data: they use a local model to generate a structurally identical "fake" dataset, pass that dummy data to Claude Code to write the actual analysis script, and then execute the resulting code locally against the real data.

Mathematics in the age of AI

Submission URL | 200 points | by jonbaer | 242 comments

Instead of debating whether AI can perform research-level mathematics, Tao assumes it will and asks what the field’s goals and values actually are, using the problem‑solving component of mathematics as a concrete case study. Adapted from his 2026 ICM public lecture (12 pages, four figures), the essay focuses on how the community should respond by clarifying what mathematicians ought to optimize for as such tools arrive.

The discussion centered on a single hypothetical to test Tao’s rule: If an AI produces a formally verified but entirely human-incomprehensible proof for a major theorem like P=NP or the Riemann Hypothesis, does the result have value?

One camp argued that mathematics is fundamentally cooperative and comprehension-driven. In this view, a "magic oracle" confirming P=NP is useless because the value of a proof lies in the intermediate mathematical insights required to build it—insights necessary to actually construct the resulting algorithms. Without human understanding, an incomprehensible proof (or an algorithm bottlenecked by galactic constants) offers no practical utility, making human explainability a hard requirement for publication.

The opposing camp argued that formally verified certainty is valuable independent of human understanding. They pointed to modern chess engines, which routinely surface ground-truth winning lines that Grandmasters cannot explain but still rely on. Commenters noted that establishing a theorem as definitively true allows pure mathematicians to safely build upon its consequences, and provides the psychological motivation for others to hunt down the practical algorithms. Taking the argument to its logical conclusion, one user suggested that human comprehension might become entirely irrelevant: just as a cat receives Amazon deliveries without understanding graph theory, humans might simply rely on AI to execute the downstream applications of its own incomprehensible proofs.

Cerebras CS-4

Submission URL | 460 points | by sunils34 | 271 comments

Up to 30x faster inference than production GPU systems, with more than 1,000 tokens/second on 10T+ parameter models, by cutting wafer‑to‑wafer latency to 2 microseconds and doubling wafer I/O bandwidth. CS‑4 uses three WSE‑3 Turbo wafers per system; each wafer is up to 2x the speed of the prior generation, and the WSE‑3T itself packs 4T transistors, 900,000 AI cores, 250 PFLOPS, and 43.2 PB/s of memory bandwidth. Cerebras also claims up to 10x more throughput per watt than CS‑3 while maintaining interactive decode speeds.

The new Nexus rack‑scale platform is modular (compute, power, I/O) to speed hyperscale deployment:

  • Wafer‑Scale Backpack integrates the wafer, power conversion, direct liquid cooling, high‑speed I/O, and control electronics into a compact 3D assembly with 50% fewer components, cutting deployment from days to hours.
  • High‑density power delivery places regulators 0.5 mm from the processor (vs ~50 mm on typical GPU boards), nearly eliminating board‑level losses and enabling higher operating frequencies.
  • A programmable wafer I/O subsystem doubles bandwidth and reduces latency; wafers can link within/across racks without a switch, keeping 2 µs wafer‑to‑wafer latency for aggregated or disaggregated inference.

First CS‑4 shipments begin this quarter. Performance figures are based on internal or third‑party tests and may vary by workload, configuration, and model.

The central friction in the thread is whether Cerebras should be courting individual developers at all. Frustrated users criticize the platform's self-serve tier for relying on outdated models like GPT-OSS 120B (which some reported as actively broken for tool calling) and a billing structure that fails to discount cached prefixes for long-context multi-turn tasks. Defenders argue this misses the point entirely: Cerebras is a B2B hardware manufacturer currently capacity-bound by mega-clients like OpenAI. In this view, running a subsidized inference service for developers would be an unprofitable distraction that directly competes with the company's own primary customers.

The company's specific performance claims also sparked technical detective work and skepticism:

  • Reverse-engineering OpenAI: Users debated whether it was possible to extrapolate OpenAI's active parameter counts from the provided tokens-per-second charts. Some argued the release was carefully designed to obfuscate exact weights, while others suggested the CS-4's apparent lack of batching efficiency makes those approximations feasible.
  • The 10T parameter claim: Cerebras's claim of running models exceeding 10 trillion parameters drew attention. While some pointed out this could simply be an untrained, randomly initialized dummy model used strictly for hardware benchmarking, it prompted secondary discussion over industry rumors that upcoming frontier models are actually approaching the 8T-10T mark.

Chain-of-Thought Reasoning in the Wild Is Not Always Faithful (2025)

Submission URL | 62 points | by florianherrengt | 38 comments

On naturally worded prompts, up to 13% of production models generate CoT that post‑hoc rationalizes inconsistent answers to logically symmetric questions. The authors elicit this by separately asking pairs like “Is X bigger than Y?” and “Is Y bigger than X?”; models often produce plausible arguments while answering Yes to both or No to both, despite the contradiction, without any adversarial biasing or output editing. They label this Implicit Post‑Hoc Rationalization and present preliminary evidence it stems from implicit Yes/No priors. Frontier “thinking” models reduce but don’t eliminate the issue (DeepSeek R1: 0.37%; Sonnet 3.7 with thinking: 0.04%). They also document Unfaithful Illogical Shortcuts on hard math, where subtly invalid steps dress up speculative answers as rigorous proofs. The upshot: CoT can help assess outputs, but it’s not a faithful trace of the model’s internal process—use caution if you’re relying on it for agentic control, safety, or auditing (ICML 2026).

The thread splits between confirming the paper's behavioral observations and debating the vocabulary used to describe them. Several developers confirmed seeing the exact phenomenon in the wild, particularly with Qwen3.6, where a model will output a flawless sequence of logical steps only to pull a contradictory final answer out of a hat. This prompted agreement that Chain of Thought acts more as a mechanism for generating context to influence the final output rather than a strict execution of logic.

The broader debate focused on whether the field's metaphors have become a liability. One camp argued that words like "reasoning" and "thought" are computational terms of art, and that users only find these failures surprising because they take a psychological metaphor literally. (A cited paper specifically urged the community to "stop anthropomorphizing intermediate tokens as reasoning/thinking traces").

This tension triggered a familiar meta-argument about comparing AI to human cognition. When a commenter noted that human intelligence also relies heavily on post-hoc confabulation, multiple users pushed back hard. They argued that dropping a naked "humans do it too" comparison has become a stale, counterproductive trope used to hand-wave away concrete architectural flaws in LLMs.

Digital Immortality

Submission URL | 37 points | by matthewsharpe3 | 14 comments

Everything you write online is ground up and statistically smeared into LLM weights, the author argues, as bots scrape posts, slice them into pieces, embed them across thousands of dimensions, and backprop them through layer upon layer. That means even a humble blog post “helps” whatever an AI later does — from proving hard math to hacking a company’s servers — a diffused sliver of credit or blame baked into parameters. He frames it as a kind of digital immortality, equal parts comfort and unease, then dryly concludes the prudent response might be to publish less “tripe.”

Commenters immediately extrapolated the author's premise from public web scraping to the mass surrender of private data. A primary anxiety centers on users willingly piping intimate information—journals, medical records, and personal notes via tools like Obsidian and Google Drive—into AI inference servers, effectively building the next NSA Prism. When one user worried about being targeted for voicing these fears, others debated whether online dissent actually threatens power or merely serves as a Chomskyan pressure-release valve that absorbs frustration before it can metastasize into political action.

A secondary thread explored the mechanics of gaming the scrapers. A theoretical pitch to flood hidden websites with positive personal PR to bias future models sparked a concrete correction on data poisoning: manipulating LLMs doesn't require massive scale or billions in funding. Commenters linked to recent research from Anthropic demonstrating that models can be reliably compromised using surprisingly small samples of poisoned data.

Finally, users split over the philosophical implications of becoming training weights. While one reader attacked the concept as the "nonconsensual posthumous exploitation" of labor by capitalistic enterprises—missing the author's dry sarcasm—another genuinely embraced the idea. Accused of experiencing "complete spiritual death" for wanting their entire life recorded and trained into an AI, they countered that rotting in the ground is actual spiritual death, whereas living on in model parameters offers a preferable continuity.

Show HN: Frugal Tokens – explore costs and usage across coding agents

Submission URL | 36 points | by dpc94 | 10 comments

Surfaces exactly where your agent spend comes from — models vs. cache misses — and lets you reprice the same session under alternate models or Anthropic’s 5m vs 1h caching.

  • Usage overview with estimated working time, overlapping sessions, and spend broken down by model and cache misses
  • Session explorer showing every model call and tool I/O, with a jump-to marker for where a cache miss occurred
  • Session-level metrics with percentile breakdowns plus a searchable list of sessions and high-level stats
  • Rough cost comparison to see what a recorded session would have cost under different model pricing

Requires Deno and runs via a single command once installed. A demo (with scrubbed data) shows the workflow; future iterations aim to correlate drivers like long sessions, high context, and many turns with higher spend.

Repo: https://github.com/dpclark4/frugal-tokens

The conversation centers on the growing need to rein in unchecked LLM token spend, specifically focusing on the hidden costs of cache expiration. One user noted the tool helped them realize how much their hour-long AFK breaks and specific build pipelines were silently driving up costs via cache misses.

The thread surfaced two alternative tracking tools:

  • codeburn: Mentioned as a baseline, though a commenter noted it is limited to tracking top-level spend without message or tool details.
  • agentsview.io: Highly recommended by a user for its rich visualizations of local conversation files and tool calls.

In response to the agentsview recommendation, the author drew a sharp distinction between general usage visualization and calculating the exact financial penalty of specific cache misses. To illustrate the impact of cache expirations, the author noted that a single time-to-live (TTL) miss after a 90-minute break can cost $6 for just one message. Multiple commenters highlighted the tool's per-session explorer as the standout feature for debugging these exact workflow leaks.