Conformance inc2: fold the 355 inline conformance cases into the corpus
The corpus only ever saw test/spec/*-spec.janet; the 355 hand-written cases in test/integration/conformance-test.janet (inline Janet, the lazy-seq / IFn / destructuring / transducer essentials) were invisible to it and to any non-Janet runtime. extract-corpus.janet now also pulls that (def cases ...) vector, deduped by :actual, organized into 41 'conformance / <section>' suites recovered from the file's ### headers. Corpus 2658 -> 2919 rows (+261 unique). JVM certification: only 1 new divergence ((/ 2) => 0.5 vs 1/2, the all-double numeric model) — classified. Chez gates: +1 known host gap (instance? Atom, atom class identity, Phase 4) allowlisted in both runners; parity rose 2295 -> 2533 on both, floors raised. Janet gate 155 files 0 failed; certifier green (0 new/stale). Deferred: 41 non-literal core-async spec rows ((a "src") async-harness wrapper) need harness context the corpus format doesn't carry — left for inc3.
This commit is contained in:
parent
b520eefa7a
commit
635bbbcc27
5 changed files with 317 additions and 3 deletions
|
|
@ -88,7 +88,10 @@
|
|||
# - (instance? clojure.lang.Atom (atom 0)): the fully-qualified host class name
|
||||
# clojure.lang.Atom isn't mapped to the atom predicate on Chez (host-class
|
||||
# interop, jolt-mn9o/avt6). Reachable now that the leading require is a no-op.
|
||||
"atom?" true})
|
||||
"atom?" true
|
||||
# Same atom-class gap, via the folded-in conformance case (jolt-ohtd):
|
||||
# (instance? clojure.lang.Atom (atom 1)).
|
||||
"instance? Atom" true})
|
||||
|
||||
(def ctx (d/make-ctx))
|
||||
|
||||
|
|
@ -286,7 +289,7 @@
|
|||
# (`(...)/`[...]/`{...}/`#{...} via __sqcat/__sqvec/__sqmap/__sqset) run at runtime.
|
||||
# 2280->2295, 0 new divergences.
|
||||
# Strided runs scale down.
|
||||
(def base-floor (scan-number (or (os/getenv "JOLT_CHEZ_PRELUDE_FLOOR") "2295")))
|
||||
(def base-floor (scan-number (or (os/getenv "JOLT_CHEZ_PRELUDE_FLOOR") "2533")))
|
||||
(def floor (if (os/getenv "JOLT_CORPUS_LIMIT") 0 base-floor))
|
||||
(when (or (> (length diverged) 0) (< pass floor))
|
||||
(printf "REGRESSION: pass %d < floor %d or %d new divergence(s)" pass floor (length diverged)))
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue