- reader.janet: rewrite read-anon-fn to handle % arg references % → gensym, %1/%2 → sorted gensyms, replaces all matching % refs - evaluator.janet: IFn protocol support in default invocation arm Before erroring "Cannot call X as a function", checks for: 1) type-registry IFn/-invoke method (extend-type protocols) 2) :jolt/protocol-methods :-invoke (reified objects) - test/phase13-test.janet: 4 test sections (28-31) 28: reify dispatch — protocol methods on reified objects 29: #() anon-fn — % and %1/%2 arg handling 30: extend-type — protocol method dispatch for deftypes 31: clojure.walk loading — keywordize-keys loads correctly - All pass: 316 ok, 1 fail (pre-existing, unchanged)
6.5 KiB
| name | description |
|---|---|
| jolt-dev | Jolt development workflow — build, test, special form patterns, Janet gotchas |
jolt-dev
Jolt development workflow — build, test, special form patterns, Janet gotchas
Jolt Development
Build & Test
cd /Users/yogthos/src/jolt
jpm build # produces build/jolt
jpm test # runs all tests
janet test/foo.janet # run a single test file from project root
Testing Patterns
# Single test file
janet test/compiler-test.janet
# Full suite
jpm test
# Phase-specific tests
janet test/phase5-test.janet # multimethods
janet test/phase8-test.janet # protocol system
janet test/phase10-test.janet # standard library
# REPL test — pipe expressions in
printf "(range 10)\n[1 2 3]\n{:a 1}\n" | janet src/jolt/main.janet
Test File Creation — Heredoc Workaround
The write tool's syntax checker rejects .janet files with complex string escaping (e.g., \" inside Janet strings). Workaround: Use bash with cat > file << 'EOF' ... EOF heredocs for any test file containing Clojure source strings.
Paren-counting boundary: Large single-file test suites (>6 sections) often hit a mysterious paren-counting parse error ("unexpected end of source") at section boundaries, even when parens are balanced. Workaround: Split into multiple files (e.g., cljs-port-1a.janet, cljs-port-1b.janet).
Loading .clj Files
.clj files are loaded via eval-form in the interpreter:
(def src (slurp "src/jolt/clojure/string.clj"))
(var remaining src)
(while (> (length (string/trim remaining)) 0)
(def [form rest] (parse-next remaining))
(set remaining rest)
(when form (eval-form ctx @{} form)))
Critical constraint: .clj files must NOT have docstrings on defn forms. Jolt's defn macro only handles 4-element forms: (defn name [params] body). A 5-element form (defn name "doc" [params] body) causes "macro arity mismatch".
To add a new special form to the evaluator:
- Add the name to
special-symbol?insrc/jolt/evaluator.janet - Add a match arm in
eval-list(the match onname) - Add tests
The match arm receives ctx, bindings, and form (the full list). Use (in form 1) for first arg, etc.
Non-symbol heads (keywords, etc.): eval-list first checks (and (struct? first-form) (= :symbol (...))) before extracting name. If not a symbol, falls through to default function application.
Current special forms (37):
quote, syntax-quote, unquote, unquote-splicing, do, if, def, defmacro, fn*, let*, loop*, recur, throw, try, set!, var, locking, instance?, defmulti, defmethod, deftype, new, ., var-get, var-set, var?, alter-var-root, find-var, intern, alter-meta!, reset-meta!, disj, set?, satisfies?, protocol-dispatch, register-method, make-reified
Compiler Architecture
Two-phase: analyze-form [form bindings ctx] → emit-ast (string) or emit-expr (data structures).
Why data structures: Janet's eval can't see use-imported symbols. Embed function VALUES directly via core-fn-values table.
eval-string dispatch (compile mode): stateful forms → interpreter; everything else → compile-and-eval. Macros expand at analyze time.
Protocol System
Protocols are maps with :jolt/type :jolt/protocol and :methods map.
Type registry in context env (:type-registry) maps type-tag → proto-name → method-name → fn.
Special forms:
protocol-dispatch [proto-sym method-sym obj rest-args]— resolves method via type registry or reified methodsregister-method [type-sym proto-sym method-sym fn-form]— stores impl in type registrymake-reified [proto-sym methods-map]— creates anonymous object with:jolt/protocol-methods
Critical rule: fn* form inside extend-type/extend-protocol MUST be @[...] (array) to trigger eval-list's special form dispatch. Tuples [...] hit (tuple? form) branch instead. Same for register-method, protocol-dispatch calls.
REPL Collection Rendering (Buffer-Based)
Use write-value + write-collection with a StringBuffer (@"") rather than prin/print directly. Build the entire output string in a buffer, then atomically (print (string buf)). Prevents Janet's C runtime (in jpm build executables) from interleaving its native <tuple 0x...> printer between incremental prin calls.
(var write-value nil) ; forward declaration
(defn- write-collection [v buf]
(cond (tuple? v) (do (buffer/push-string buf "[") ...)
(array? v) (do (buffer/push-string buf "(") ...) ...))
(set write-value (fn [v buf]
(cond (nil? v) (buffer/push-string buf "nil")
(number? v) (buffer/push-string buf (string v))
(tuple? v) (write-collection v buf)
true (buffer/push-string buf (string v))))) ; true REQUIRED
(defn print-value [v] (def buf @"") (write-value v buf) (print (string buf)))
Critical: Janet's cond treats a bare expression in the last position as a test clause, not a catch-all body. Use true as the guard.
PersistentHashMap Gotchas
core-map?:(if (and (table? x) (get x :jolt/deftype)) true false)—andreturns last truthy, not booleancore-count: subtract 1 for deftype tables (skip:jolt/deftypekey)- Equality: convert via
phm-to-structbeforedeep=
defrecord / deftype Patterns
- defrecord emits
(deftype TypeName [fields])+ arrow factory - Records are tables with
:jolt/deftype= type name string set!field mutation:(set! (.-x obj) val)parses as array with.-xsymbol head
Binding Macro
Uses array-map (plain Janet struct) not hash-map (PHM) to avoid PHM get() incompatibility with var-get.
Tagged Literals (#inst, #uuid)
Use dynamic table construction: (let [dr @{}] (put dr (keyword "#inst") fn) dr)
LazySeq Patterns
-
Use
indexed?nottuple?for realized sequences (may be arrays fromcons/concat) -
Avoid
val'(apostrophe in symbol names) — usevfinstead -
defcreates constants; use(var x nil)for mutable locals -
Bare tuples in
evalare function calls:[1 2 3]tries to call1 -
tryformat:(try body ([err] handler))NOT(try body (catch sym handler)) -
core-renames MUST match actual fn names:
"-"→"core-sub"(not"core--") -
(break val)breaks from loop returning val — useful in bucket search patterns -
booleandoesn't exist — use(if x true false) -
Janet doesn't support Clojure-style multi-arity defn — use
[& args]withcase (length args) -
Janet's
condtreats bare expression in last position as test, not catch-all — usetrueguard