Continual Learning
2 articles on continual learning from the NeuroGenesys Research Desk, newest first. Every claim is linked to its source.
• 5 min readA better router helps, but on CIFAR-100 the experts were the weak link
We pre-registered six predictions about how to route inputs among frozen experts and tested them on 30 cached expert libraries. A router in a shared feature space beat the experts' own confidence, by a little without pretraining and by a lot with it. But once routing was good, a plain readout of the shared features beat the experts themselves by 13 points.
• 6 min readA new model generation should earn authority, not win a contest
When new models or new knowledge replace old ones, the usual picture is competition: old and new fight, the winner takes over. Our synthesis argues for graded succession instead. The successor gains authority step by step as independent evidence shows it is better, the old generation stays recoverable, and a protected constitution changes only by explicit amendment.
