NeuroGenesys.
Back to ToolsResearch Tools • emergence-audit

Did it emerge, or did you put it in?

A harness that runs four controls against your own training script and prints the differential. Every control is owned in some field — this is tooling, not a method, so cite the owners. What it adds is the bundle: one plugin interface, all four controls, one verdict.

The four controls

C1

Stateless generator

Does the same X come out of data with the physics removed?

Owners: Elsayed & Cunningham 2017; Touboul & Destexhe 2017; Hewitt & Liang 2019; Adebayo et al. 2018

C2

Non-solution generator

Does data that violates the claimed law fit as well, with the violation reproduced?

Owners: Lipsitch–Tchetgen–Cohen 2010; Vafa et al. 2025; Krishnapriyan et al. 2021

C3

Prior swap at fixed fit

How much of X moves when only the regulariser changes, at equal loss?

Owners: Rashomon sets (Breiman 2001; Fisher–Rudin–Dominici 2019); Kallioinen et al. 2023; Gruver et al. 2022

C4

Family distance + conditioning

How far is X from any member of the claimed solution family vs. from its generator; is the parametrisation ill-conditioned?

Owners: Gutenkunst et al. 2007; Transtrum–Machta–Sethna 2010/11; Raue et al. 2009

Plugin interface

generators = {"real": f(seed)->data, "stateless": ..., "nonsolution": ...}   # 'real' required
  priors     = {"paper": spec, "alternative": spec}                              # first = the paper's
  def fit(data, prior, seed) -> (output, fit_quality)      # lower fit_quality = better
  def feature(output) -> np.ndarray                        # the summary of X
  def family_distance(output) -> float                     # optional
  def generator_distance(output, data) -> float            # optional
  condition_number = float | callable                      # optional
  fit_tolerance = 0.25                                     # "equal fit" tolerance for C3
python emergence_audit.py --plugin my_plugin.py --seeds 5 --out audit.json
Run the paper's full training recipe. On the AdS/deep-learning reproduction, cutting 60 epochs to 20 flipped the C2 and C3 verdicts — under-trained seeds are noisy and the equal-fit tests lose power. A quick audit is an unreliable audit.

It trains models, so it runs locally rather than in the browser.

Worked example · the AdS/deep-learning reproduction

The --demoflag audits a faithful reproduction of Hashimoto et al. (2018), where a network's layer weights are read as a bulk spacetime metric. Download the files below into one folder, keeping adsdl_plugin.py in a plugins/ subfolder, or fetch them in one go:

mkdir -p emergence-audit/plugins && cd emergence-audit
  base=https://neurogenesys.ai/tools/emergence-audit
  for f in emergence_audit.py adsdl_lib.py einstein_residual.py demo_adsdl_audit.json README.md plugins/adsdl_plugin.py; do
    curl -fsSL "$base/$f" -o "$f"
  done
  pip install numpy torch
  python emergence_audit.py --demo     # 3 seeds, full recipe, ~4 min

What the reference run found:

  • C1 passes — data with the bulk removed give a different metric (7.1 seed SDs apart).
  • C2 fails — non-solution data fit as well; the pipeline does not forbid the alternative.
  • C3 fails— swapping the smoothness prior for an Einstein-residual prior at equal fit moves the metric toward the solution family: the moved part is the prior's, not the data's.
  • C4 fails — the output is closer to another family member than to its generator, under a condition number of 3.4 × 10⁶.
Overall: the emergence claim is not supported by these controls.

Download

Leadership

A word from the founder — on why the brain is the blueprint, and why the next decade of intelligence will be built here.

"The brain is the universe's only proof that general intelligence is possible. We treat it as the blueprint."

From cortical interfaces to photonic silicon, every program at NeuroGenesys exists to answer one question: how does intelligence arise — and how do we build it safely.

Will Schulz

Will Schulz

Founder, NeuroGenesys • AW3 Technology