Skip to content

Add categorized experiment log: 100 ideas, 300 trials, and recorded failures #477

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Mister-Meeseeks merged 32 commits into from
Oct 12, 2026
Merged

Add categorized experiment log: 100 ideas, 300 trials, and recorded failures #477

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
32 commits
Select commit Hold shift + click to select a range
9d62871
Add categorized research experiment log with unsuccessful trials and …
rohanarun Oct 11, 2026
20521d1
Include text-normalization policy in experiment-log inventory
rohanarun Oct 11, 2026
bfc3dc1
Bind recent trial batches to saved input hashes and public evidence
rohanarun Oct 11, 2026
8f5c573
Record target-factor gain and manifest/compiler failures with retry g…
rohanarun Oct 11, 2026
1619e6b
Record vacuous inherited mutation test and non-vacuous retry requirement
rohanarun Oct 11, 2026
eb05d2b
Archive all 100 factored-kernel trials including the losing search
rohanarun Oct 11, 2026
2e08258
Validate all 300 recent trials and append completed supplier receipts
rohanarun Oct 11, 2026
aa9b5e1
Record exact complex79 composition and pending combined verification …
rohanarun Oct 11, 2026
116a446
Preserve ten replica-count screens and assignments without claiming p…
rohanarun Oct 11, 2026
1a15214
Record incorrect stage-reference wiring and independently checked repair
rohanarun Oct 11, 2026
be92282
Record terminal verification outcomes and unresolved template hash fa…
rohanarun Oct 11, 2026
6f65f62
Record compression-header diagnosis and manifest retry failure
rohanarun Oct 11, 2026
9dd23c9
Record three post-factor no-gain searches and complete replica64 check
rohanarun Oct 11, 2026
229c093
Record full replica64 verification and exact rational replica84 candi…
rohanarun Oct 11, 2026
f0ac40d
Record twenty nested-donor reselections and complete84-replica check
rohanarun Oct 11, 2026
196fac3
Record native checked cancellations, no-gain retiming and full84 replay
rohanarun Oct 11, 2026
c4dff23
Record all 424 hierarchy rewrites and failed baseline comparison
rohanarun Oct 11, 2026
04d0c2f
Retain R714 kernel trials and replica28 initial verification failures
rohanarun Oct 11, 2026
39d49b9
Record PR485 composition negatives and both full replica28 receipts
rohanarun Oct 11, 2026
9a3cce7
Record fixed-role negatives and 20000 nested kernel basis-exchange at…
rohanarun Oct 11, 2026
c8bd36e
Retain entrance-demotion negatives and terminal rank139 verification
rohanarun Oct 11, 2026
491ae81
Record PR496 complex packing, entrance, basis and retiming no-gain se…
rohanarun Oct 11, 2026
300d9f1
Record fresh complex provider and pooled-owner component replay receipts
rohanarun Oct 11, 2026
2235a81
Record coordinated gauges and retimed frontier searches with all losi…
rohanarun Oct 11, 2026
2d2ecff
Retain rejected adjacent commutations and propagated frame repairs
rohanarun Oct 11, 2026
2ecb026
Preserve gauge and kernel trade failures plus stage-dependent composi…
rohanarun Oct 11, 2026
1c761fb
Record completed stage4 followup and asynchronous retry boundary
rohanarun Oct 11, 2026
2f23f46
Archive asynchronous no-gain searches, matching failure and repaired …
rohanarun Oct 11, 2026
01ad6ae
Record exact finite-menu inventory wall and new no-gain kernel searches
rohanarun Oct 11, 2026
6b76039
Archive partial-own async composition and unverified coordinated-gaug…
rohanarun Oct 11, 2026
61dcaf1
Record coordinated partial-own local checks and infeasible aggregate …
rohanarun Oct 11, 2026
a5b588d
Preserve joint allocation timeout repair and completed coordinated co…
rohanarun Oct 11, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
1 change: 1 addition & 0 deletions research/experiment-log/.gitattributes
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
** -text
18 changes: 18 additions & 0 deletions research/experiment-log/COUNTS.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
{
"original_ideas": 100,
"original_idea_statuses": {
"partial_gain": 10,
"bounded_no_gain": 20,
"not_evidenced": 40,
"analysis_only": 14,
"blocked": 1,
"partial_experiment": 11,
"bounded_infeasible": 3,
"implemented": 1
},
"recent_search_trials": 300,
"negative_search_records": 14,
"failure_artifact_files": 31,
"failure_attempt_groups": 16,
"completed_receipts": 9
}
25 changes: 25 additions & 0 deletions research/experiment-log/ENTRY-TEMPLATE.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,25 @@
{
"id": "",
"category": "",
"date_utc": "",
"source_commit": "",
"source_word_sha256": "",
"baseline": {
"name": "",
"value": "",
"scope": ""
},
"hypothesis": "",
"command_or_script": "",
"parameters": {},
"seeds": [],
"status": "pending",
"result": null,
"failure_kind": null,
"failure_reason": null,
"verification_scope": "",
"evidence": [],
"do_not_repeat_scope": "",
"retry_when": "",
"supersedes": null
}
1,430 changes: 1,430 additions & 0 deletions research/experiment-log/MANIFEST.json
View file
Open in desktop

Large diffs are not rendered by default.

Loading
Loading