Machine Learning
14 articles on machine learning from the NeuroGenesys Research Desk, newest first. Every claim is linked to its source.
• 5 min readAgents still have the right skill. They stop picking it as the library grows
Two papers from October and November 2026 measure what happens to LLM agents as their skill libraries grow into the hundreds and thousands. The skills keep working; the agents stop choosing them. That is the failure our forgetting-as-selection results predict, and both papers fix it without touching the skills.
• 7 min readSuperintelligence has many definitions and no test. Here is what a test would need.
Labs now say superintelligence is in sight, but their definitions compare AI with different humans, and none comes with a way to check. Benchmarks saturate, ceilings are set by label errors, and the best long-task metric stops working at 16 hours.
• 8 min readWhere AI already beats the best humans in 2026, and where it still doesn't
AI now matches or beats top humans on olympiad maths, contest programming and most reasoning benchmarks, and has disproved a famous conjecture. It still fails on long reliable work, learning after deployment and the physical world, and many of the strongest claims are graded by the companies themselves.
• 8 min readThe case for a 2027 intelligence explosion now rests on evidence the public can't see
Forecasters moved their dates for automated AI research back to 2027 this week, on the strength of METR's finding that Anthropic is improving about twice as fast as a year ago. Most of the evidence behind that finding is redacted, and the gains may be limited to tasks that grade themselves.
• 5 min readPenalising wrong answers only works if someone else is grading
Experts that never saw a task still vote on it with near-certainty. We ran ten pre-registered fixes. Penalties inside the expert failed; a selector that ignores expert confidence reached 0.926 on Split-MNIST.
• 6 min readTo stop a model forgetting, rehearse what it knew. New context won't do it.
We tested whether bridging knowledge added alongside new facts protects old ones. It doesn't, on a toy model or on Qwen 1.5B. Re-expressed old knowledge does, and outdated facts need pruning.
• 6 min readInvestors are paying for agents that learn on the job. The hard part is knowing what they forgot.
Trajectory just raised $45M at a $300M valuation to make deployed models keep learning. But on CL-Bench, the best system gained only 25.4% over a stateless baseline, and plain long context beat dedicated memory.
• 6 min readTokens keep getting cheaper and AI bills keep binding. Count verified tasks instead.
Apple cut some engineers' daily AI budget from $300 to $200 and Revolut moved coding to self-hosted GLM at about $0.30 per million tokens. Agentic workloads multiply tokens faster than prices fall. The unit that matters is cost per verified task.
• 6 min readWhat a model lets into long-term memory matters more than how it learns
In our experiments, a per-example trust gate cut a poisoning attack from 94% to 4%, where a sleep phase added only 3.6 points. The leverage is in what gets consolidated.
• 6 min readCan a guardian chip stop a learning model from forgetting? Only partly.
A protected core model on its own silicon can watch a continually learning model for drift. The hardware is ready; the judgment about what to keep is not.
• 5 min readTo keep what a model knows, control what it is allowed to move
Meta cut forgetting from 89% to 11% by updating 500 memory slots. Across continual learning, the methods that hold up limit what moves and keep old data in play.
• 4 min readA model rewrote another model's weights. Read what it took away.
An MIT agent edited 0.016% of a small Qwen model and its math scores jumped. Across weight editing in 2026, subtraction works and addition still lags.
• 3 min readMore thinking isn't more evidence: test-time compute meets correlated error.
Sampling a reasoning model sixteen times does not give you sixteen opinions. New preprints put numbers on an old statistical warning.
• 7 min readDecoders that generalize: the case for brain foundation models.
Speech neuroprostheses crossed the usefulness threshold by borrowing the modern ML playbook — and the next leap is models that transfer across sessions, subjects, and tasks.
