Skip to content

random seed: every outcome class does not enter three owner-kill states (seed -1851858881), on main too #180

Open

Description

@KyleAMathews

Counterexample (main's; found on #99)

Found in CI on #99 at cb1de4f (run 44462540755, random seed 1/4):

ORACLE_SEED=-1851858881 ORACLE_PATH=0 ORACLE_PROPERTY='oracle-gaps.report' ORACLE_UNIT='random seed: every outcome class' GAP_E2E_SHRINKS=0 vitest run --config oracle-gaps/vitest.config.mjs gap-report-oracle -t '^oracle-gaps\.report(?: | > )random seed: every outcome class$'

constructed history "every outcome class" did not enter killed by a second owner, a kill in one owner after a gap in another, each owner's value change killed its own mutant. The outcomes agree with the model; only the reach is missed.

Attribution: main has it

I replayed the exact history (printed by the driver at cb1de4f) on main 6d05f05 as a scratch constructed history with the same three states (scratch/fix99c-attr2-main, c91bbcb2). #99's fields take their neutral values; one of this history's tests had pulse: true and slowMs 16000, which main lacks.

Ref Runs Result
main 6d05f05 3 on the pool does not enter the three states, 3 of 3
#99 cb1de4f (scratch/fix99c-attr2-head, d38050e7) 1 the same

It is main's, so it does not block #99. The cause is probably this base's drawn fields, which keep those witness-module states from being reached: for example stability: insertGuard, secondAuthored, and flaky tests in files b and c. That is not confirmed.

Full history
{"functions":[[{"kind":"call","target":1},{"kind":"helperCall","helper":"reportTwice"}],[{"kind":"factoryCall","target":0},{"kind":"valueCall","target":0},{"kind":"probeIf","op":"!==","k":0},{"kind":"loop","quote":"`"},{"kind":"probeBlock","op":">=","k":0}]],"containers":["C1","free","free"],"overloads":[false,false],"owners":["a"],"library":[[{"kind":"push","quote":"'"},{"kind":"if","op":">","k":3,"not":true,"quote":"'"}]],"libraryOwners":["none"],"runes":[[{"kind":"runeDerived"},{"kind":"runeState","op":">=","k":8},{"kind":"runeStateRaw"}]],"derived":{"params":"plain","field":false,"before":[],"form":"arrow","after":[]},"sourceSpelling":"dot","dotGen":false,"ownsSpelling":"plain","wholeFile":"none","template":true,"tests":[{"file":"c","route":"random seed","registered":false,"name":"route","fn":0,"input":6,"judges":false,"law":"reach agreement","channel":"observe","flaky":true,"judgeBy":"verdict","hangs":false,"slow":false,"shrinks":false,"draws":false,"ioWait":false,"stops":false,"rawImport":false,"cleanupThrows":false,"asProp":false,"then":{"route":"fixed history","input":1},"work":null,"timed":false,"slowMs":3000,"loops":0,"timerWait":null,"pulse":false,"pendingIo":null},{"file":"b","route":"calibration","registered":false,"name":"route","fn":6,"input":3,"judges":false,"law":"L","channel":"observe","flaky":true,"judgeBy":"soft","hangs":true,"slow":false,"shrinks":false,"draws":false,"ioWait":false,"stops":false,"rawImport":false,"cleanupThrows":false,"asProp":false,"then":{"route":"probe calibration","input":1},"work":null,"timed":false,"slowMs":3000,"loops":0,"timerWait":null,"pulse":true,"pendingIo":null},{"file":"c","route":"fixed seed","registered":true,"name":"plain","fn":1,"input":2,"judges":false,"law":"L","channel":"observe","flaky":true,"judgeBy":"soft","hangs":false,"slow":false,"shrinks":false,"draws":false,"ioWait":false,"stops":false,"rawImport":false,"cleanupThrows":false,"asProp":false,"then":{"route":"fixed seed","input":4},"work":null,"timed":false,"slowMs":16000,"loops":0,"timerWait":null,"pulse":false,"pendingIo":null},{"file":"a","route":"enumerated","registered":false,"name":"route","fn":0,"input":3,"judges":false,"law":"reach agreement","channel":"observe","flaky":false,"judgeBy":"soft","hangs":false,"slow":false,"shrinks":false,"draws":false,"ioWait":false,"stops":false,"rawImport":false,"cleanupThrows":false,"asProp":false,"then":{"route":"fixed history","input":3},"work":null,"timed":false,"slowMs":16000,"loops":0,"timerWait":null,"pulse":false,"pendingIo":null}],"witness":"capture","authored":{"stmt":0,"kind":"apply"},"declaration":"wrapper","ownerless":false,"fault":"none","stability":"insertGuard","ordinary":true,"lazyGate":false,"secondAuthored":true,"consoleOutput":true,"config":"async","configEnv":true,"setupGlobal":true,"native":"gyp","depSubpath":true,"unbuiltDep":true,"boot":false,"budget":"two","stopRuns":[{"signal":"SIGTERM","pool":"forks","when":"run"},{"signal":"SIGINT","pool":"threads","when":"run"},{"signal":"SIGINT","pool":"threads","when":"after"}],"onlyRun":false,"pragma":true,"cliPath":"spaced","concurrentStart":false,"configFile":"vitest.config.ts","configPlace":"discovered","packageType":"module","configAwait":false,"configRequire":true,"contexts":4,"steps":null,"dataOwners":["b","b"],"exportOwners":[],"importer":"none","midrunBy":"a","midrunTarget":"data","prePlugin":true,"fsRead":"callback","laterSteps":[],"tornRows":false,"pauseEngages":true,"warmReplaced":true,"testRoot":"tests","loadPlugin":false,"rejectBatch":0,"outMode":"explicit","logBlocked":false,"overlap":false,"stopWitness":false,"spawnStop":false,"spawnSignal":"SIGTERM","spawnDelay":1,"spawnOnStart":false,"claimScenario":false,"logLost":false,"supervisorDeath":false,"unsupervised":false,"psMissing":false,"holdOverlap":false,"replyHeld":false,"spinData":true,"siblingDir":false,"hookStops":true,"spinThrows":false,"slowStart":false,"shortWait":false,"absentObjects":["undefined","undefined","undefined","null","null","null","null","null"],"optionalChains":[],"hangMs":null,"heavy":0}

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions