jolt/host/chez
Dmitri Sotnikov eacfa04e5b
Perf round 1: self-call, keyword interning, fast record field reads (#221)
* Make the benchmark harness build optimized binaries on Chez

bench/run.sh was Janet-era: it invoked a 'jolt' binary and set
JOLT_DIRECT_LINK/JOLT_WHOLE_PROGRAM, none of which exist on Chez, where
'joltc run -m' runs fully unoptimized (direct-link and inline default off). So
the suite was measuring jolt's unoptimized path.

run.sh now compiles each benchmark to an optimized AOT binary (joltc build
--direct-link --opt) and times it against JVM Clojure on the same portable
source, auto-detecting the Chez kernel dev files like build-smoke.sh. Adds
bench/deps.edn so joltc resolves the namespaces, NO_JVM to skip the reference.

mandelbrot.clj dropped its jolt.png require so the JVM reference can run it; the
picture demo moved to mandelbrot_png.clj (jolt-only). README scorecard refreshed
with current Chez numbers and the two-regime read (compute ~8-10x substrate floor;
dispatch/alloc ~120-330x architectural gaps the passes don't touch). Stale
'jolt -m' header lines point at bench/run.sh.

* Emit direct self-calls for named-fn self-recursion

A self-recursive call to a named fn compiled to (jolt-invoke fib ...) instead of
a direct (fib ...): emit-invoke handled a :local callee only when it was NOT a
known proc, so a :local that IS in *known-procs* (the letrec-bound self-name) fell
through to the :else jolt-invoke branch. Now a :local known proc emits a direct
Scheme call — no jolt-invoke, no per-call arg-list consing; case-lambda handles
arity.

fib 30: 63.3ms -> 4.7ms (faster than JVM Clojure's 7.1ms; was 9x slower). The win
is on every self-recursive non-loop fn, including the compiler's own. No semantic
change — selfhost holds, make test green, shakesmoke/buildsmoke byte-identical.

Re-mint (backend is seed). Corpus rows pin self-recursion across fixed/multi/
variadic arities.

* Intern no-ns keywords without per-call allocation

(keyword #f name) built a fresh combined-key string (string-append) on every
call just to do the intern-table lookup — ~80 bytes of garbage per (:kw x), map
literal, keyword arg, etc. A no-ns keyword now interns in a table keyed by the
name string directly, so a lookup of an already-interned keyword is one
hashtable-ref with no allocation. The ns table keeps the combined key; both share
the keyword-t khash (equal-hash of the combined key) so hash values are unchanged.

Small time win on its own (the field-read dispatch dominates hot record code —
see jolt-unx4) but removes per-call keyword allocation everywhere. Runtime .ss,
no re-mint; identity/=/hash unchanged, make test green.

* Fast record field reads: single eq? scan, skip the get-arm walk

(:field rec) / (get rec :field) lowers to (jolt-get rec kw), which walked the
get-arm list to reach the jrec arm, then did jrec-has? + jrec-lookup — TWO linear
scans, each comparing keys through the generic jolt=2 equality dispatcher. Field
keys are interned keywords, so:

- jrec-key=? compares a keyword query by eq? (jolt=2 only for non-keyword keys),
- jrec-ref does ONE scan (vs has?+lookup) and runs a deftype's ILookup valAt only
  when the field is genuinely absent (present-nil still returns nil, not default),
- jolt-get-dispatch checks jrec? first, skipping the get-arm walk for the hottest
  get target. jrec-lookup/jrec-has? (used by =, contains?, etc.) get the fast
  compare too.

binary-trees 135x->18.9x, dispatch 121x->26.4x, mono-dispatch 327x->108x vs JVM.
Runtime .ss (collections.ss + records.ss), no re-mint; make test + shakesmoke +
buildsmoke green, record get/assoc/keys/=/count semantics unchanged.

---------

Co-authored-by: Yogthos <yogthos@gmail.com>
2026-06-26 05:00:28 +00:00
..
java Add bigdec min/max (review follow-up) 2026-06-25 20:22:26 -04:00
seed Perf round 1: self-call, keyword interning, fast record field reads (#221) 2026-06-26 05:00:28 +00:00
atoms.ss Clean up codebase: rename stdlib layer, strip porting residue, fix tooling 2026-06-22 22:18:00 -04:00
bootstrap.ss Clean up codebase: rename stdlib layer, strip porting residue, fix tooling 2026-06-22 22:18:00 -04:00
build-smoke.sh Source locations: reader positions, error locations, native stack traces (#218) 2026-06-26 02:14:34 +00:00
build.ss Source locations: reader positions, error locations, native stack traces (#218) 2026-06-26 02:14:34 +00:00
cli.ss Source locations: reader positions, error locations, native stack traces (#218) 2026-06-26 02:14:34 +00:00
collections.ss Perf round 1: self-call, keyword interning, fast record field reads (#221) 2026-06-26 05:00:28 +00:00
compile-eval.ss Source locations: reader positions, error locations, native stack traces (#218) 2026-06-26 02:14:34 +00:00
converters.ss Replace str-render/instance-check set! chains with registries 2026-06-23 09:05:36 -04:00
dce.ss refactor: extract host/chez/dce.ss; tag the runtime manifest (tier 1) 2026-06-23 22:20:48 -04:00
dyn-binding.ss refactor: registry pattern for jolt-pr-str/pr-readable + remaining arms (jolt-lmot) 2026-06-23 23:22:25 -04:00
dynamic-var-defaults.ss Define *print-meta* as a bindable dynamic var 2026-06-24 10:22:10 -04:00
emit-image.ss Auto-resolve ::keywords; honor clojure.edn reader opts 2026-06-24 09:13:14 -04:00
host-contract.ss Source locations: reader positions, error locations, native stack traces (#218) 2026-06-26 02:14:34 +00:00
host-table.ss refactor: registry pattern for jolt-pr-str/pr-readable + remaining arms (jolt-lmot) 2026-06-23 23:22:25 -04:00
lazy-bridge.ss refactor: registry pattern for jolt-pr-str/pr-readable + remaining arms (jolt-lmot) 2026-06-23 23:22:25 -04:00
loader.ss Source locations: reader positions, error locations, native stack traces (#218) 2026-06-26 02:14:34 +00:00
multimethods.ss defmethod on a referred multifn resolves to its home ns 2026-06-24 09:13:28 -04:00
natives-coll.ss Clean up codebase: rename stdlib layer, strip porting residue, fix tooling 2026-06-22 22:18:00 -04:00
natives-format.ss read-string constructs sets; format %x lowercase; extend/extends? on nil 2026-06-24 14:03:47 -04:00
natives-meta.ss Make clojure.spec.alpha load and run 2026-06-24 19:46:22 -04:00
natives-misc.ss Tagged literals are value-equal 2026-06-24 11:03:33 -04:00
natives-num.ss Clean up codebase: rename stdlib layer, strip porting residue, fix tooling 2026-06-22 22:18:00 -04:00
natives-reader.ss refactor: consolidate transducers, dissolve natives-parity.ss (jolt-jcs7) 2026-06-23 23:50:42 -04:00
natives-seq.ss Collection fns: JVM-faithful return types + laziness (#219) 2026-06-26 03:01:36 +00:00
natives-transduce.ss Collection fns: JVM-faithful return types + laziness (#219) 2026-06-26 03:01:36 +00:00
ns.ss refactor: registry pattern for jolt-pr-str/pr-readable + remaining arms (jolt-lmot) 2026-06-23 23:22:25 -04:00
png.ss Clean up codebase: rename stdlib layer, strip porting residue, fix tooling 2026-06-22 22:18:00 -04:00
post-prelude.ss Auto-resolve ::keywords; honor clojure.edn reader opts 2026-06-24 09:13:14 -04:00
predicates.ss Clean up codebase: rename stdlib layer, strip porting residue, fix tooling 2026-06-22 22:18:00 -04:00
printing.ss Port real clojure.pprint (pretty-printer + cl-format) 2026-06-24 16:09:09 -04:00
reader.ss Source locations: reader positions, error locations, native stack traces (#218) 2026-06-26 02:14:34 +00:00
records.ss Perf round 1: self-call, keyword interning, fast record field reads (#221) 2026-06-26 05:00:28 +00:00
regex.ss Clean up codebase: rename stdlib layer, strip porting residue, fix tooling 2026-06-22 22:18:00 -04:00
remint.sh Pure-Chez test gates (no Janet) 2026-06-21 11:22:32 -04:00
rt.ss Source locations: reader positions, error locations, native stack traces (#218) 2026-06-26 02:14:34 +00:00
run-corpus.ss Clean up codebase: rename stdlib layer, strip porting residue, fix tooling 2026-06-22 22:18:00 -04:00
run-infer.ss infer gate: cover the run-inference / take-diags! checker path 2026-06-23 09:38:13 -04:00
run-sci.ss Run core.memoize's test suite on jolt 2026-06-25 13:23:05 -04:00
run-unit.ss Real Thread/yield + Thread/interrupted (jolt-l2gc) 2026-06-23 00:06:04 -04:00
selfcheck.sh Pure-Chez test gates (no Janet) 2026-06-21 11:22:32 -04:00
seq.ss Collection fns: JVM-faithful return types + laziness (#219) 2026-06-26 03:01:36 +00:00
smoke.sh Source locations: reader positions, error locations, native stack traces (#218) 2026-06-26 02:14:34 +00:00
source-registry.ss Source locations: reader positions, error locations, native stack traces (#218) 2026-06-26 02:14:34 +00:00
syntax-quote.ss Clean up codebase: rename stdlib layer, strip porting residue, fix tooling 2026-06-22 22:18:00 -04:00
transients.ss Collection ops carry the receiver's metadata 2026-06-24 13:46:58 -04:00
tree-shake-smoke.sh Tree-shake: count #'x references; multi-app soundness smoke 2026-06-23 20:27:21 -04:00
values.ss Perf round 1: self-call, keyword interning, fast record field reads (#221) 2026-06-26 05:00:28 +00:00
vars.ss refactor: consolidate transducers, dissolve natives-parity.ss (jolt-jcs7) 2026-06-23 23:50:42 -04:00