jolt/.dirge/skills/jolt-dev/SKILL.md
Yogthos df1e836cda Phase 13: Protocol Completion — reify dispatch, #() reader, IFn protocol
- reader.janet: rewrite read-anon-fn to handle % arg references
  % → gensym, %1/%2 → sorted gensyms, replaces all matching % refs
- evaluator.janet: IFn protocol support in default invocation arm
  Before erroring "Cannot call X as a function", checks for:
  1) type-registry IFn/-invoke method (extend-type protocols)
  2) :jolt/protocol-methods :-invoke (reified objects)
- test/phase13-test.janet: 4 test sections (28-31)
  28: reify dispatch — protocol methods on reified objects
  29: #() anon-fn — % and %1/%2 arg handling
  30: extend-type — protocol method dispatch for deftypes
  31: clojure.walk loading — keywordize-keys loads correctly
- All pass: 316 ok, 1 fail (pre-existing, unchanged)
2026-06-03 13:19:56 -04:00

6.5 KiB

name description
jolt-dev Jolt development workflow — build, test, special form patterns, Janet gotchas

jolt-dev

Jolt development workflow — build, test, special form patterns, Janet gotchas

Jolt Development

Build & Test

cd /Users/yogthos/src/jolt
jpm build           # produces build/jolt
jpm test            # runs all tests
janet test/foo.janet  # run a single test file from project root

Testing Patterns

# Single test file
janet test/compiler-test.janet

# Full suite
jpm test

# Phase-specific tests
janet test/phase5-test.janet  # multimethods
janet test/phase8-test.janet  # protocol system
janet test/phase10-test.janet # standard library

# REPL test — pipe expressions in
printf "(range 10)\n[1 2 3]\n{:a 1}\n" | janet src/jolt/main.janet

Test File Creation — Heredoc Workaround

The write tool's syntax checker rejects .janet files with complex string escaping (e.g., \" inside Janet strings). Workaround: Use bash with cat > file << 'EOF' ... EOF heredocs for any test file containing Clojure source strings.

Paren-counting boundary: Large single-file test suites (>6 sections) often hit a mysterious paren-counting parse error ("unexpected end of source") at section boundaries, even when parens are balanced. Workaround: Split into multiple files (e.g., cljs-port-1a.janet, cljs-port-1b.janet).

Loading .clj Files

.clj files are loaded via eval-form in the interpreter:

(def src (slurp "src/jolt/clojure/string.clj"))
(var remaining src)
(while (> (length (string/trim remaining)) 0)
  (def [form rest] (parse-next remaining))
  (set remaining rest)
  (when form (eval-form ctx @{} form)))

Critical constraint: .clj files must NOT have docstrings on defn forms. Jolt's defn macro only handles 4-element forms: (defn name [params] body). A 5-element form (defn name "doc" [params] body) causes "macro arity mismatch".

To add a new special form to the evaluator:

  1. Add the name to special-symbol? in src/jolt/evaluator.janet
  2. Add a match arm in eval-list (the match on name)
  3. Add tests

The match arm receives ctx, bindings, and form (the full list). Use (in form 1) for first arg, etc.

Non-symbol heads (keywords, etc.): eval-list first checks (and (struct? first-form) (= :symbol (...))) before extracting name. If not a symbol, falls through to default function application.

Current special forms (37):

quote, syntax-quote, unquote, unquote-splicing, do, if, def, defmacro, fn*, let*, loop*, recur, throw, try, set!, var, locking, instance?, defmulti, defmethod, deftype, new, ., var-get, var-set, var?, alter-var-root, find-var, intern, alter-meta!, reset-meta!, disj, set?, satisfies?, protocol-dispatch, register-method, make-reified

Compiler Architecture

Two-phase: analyze-form [form bindings ctx]emit-ast (string) or emit-expr (data structures).

Why data structures: Janet's eval can't see use-imported symbols. Embed function VALUES directly via core-fn-values table.

eval-string dispatch (compile mode): stateful forms → interpreter; everything else → compile-and-eval. Macros expand at analyze time.

Protocol System

Protocols are maps with :jolt/type :jolt/protocol and :methods map. Type registry in context env (:type-registry) maps type-tag → proto-name → method-name → fn.

Special forms:

  • protocol-dispatch [proto-sym method-sym obj rest-args] — resolves method via type registry or reified methods
  • register-method [type-sym proto-sym method-sym fn-form] — stores impl in type registry
  • make-reified [proto-sym methods-map] — creates anonymous object with :jolt/protocol-methods

Critical rule: fn* form inside extend-type/extend-protocol MUST be @[...] (array) to trigger eval-list's special form dispatch. Tuples [...] hit (tuple? form) branch instead. Same for register-method, protocol-dispatch calls.

REPL Collection Rendering (Buffer-Based)

Use write-value + write-collection with a StringBuffer (@"") rather than prin/print directly. Build the entire output string in a buffer, then atomically (print (string buf)). Prevents Janet's C runtime (in jpm build executables) from interleaving its native <tuple 0x...> printer between incremental prin calls.

(var write-value nil)  ; forward declaration

(defn- write-collection [v buf]
  (cond (tuple? v) (do (buffer/push-string buf "[") ...)
        (array? v) (do (buffer/push-string buf "(") ...) ...))

(set write-value (fn [v buf]
  (cond (nil? v) (buffer/push-string buf "nil")
        (number? v) (buffer/push-string buf (string v))
        (tuple? v) (write-collection v buf)
        true (buffer/push-string buf (string v)))))  ; true REQUIRED

(defn print-value [v] (def buf @"") (write-value v buf) (print (string buf)))

Critical: Janet's cond treats a bare expression in the last position as a test clause, not a catch-all body. Use true as the guard.

PersistentHashMap Gotchas

  • core-map?: (if (and (table? x) (get x :jolt/deftype)) true false)and returns last truthy, not boolean
  • core-count: subtract 1 for deftype tables (skip :jolt/deftype key)
  • Equality: convert via phm-to-struct before deep=

defrecord / deftype Patterns

  • defrecord emits (deftype TypeName [fields]) + arrow factory
  • Records are tables with :jolt/deftype = type name string
  • set! field mutation: (set! (.-x obj) val) parses as array with .-x symbol head

Binding Macro

Uses array-map (plain Janet struct) not hash-map (PHM) to avoid PHM get() incompatibility with var-get.

Tagged Literals (#inst, #uuid)

Use dynamic table construction: (let [dr @{}] (put dr (keyword "#inst") fn) dr)

LazySeq Patterns

  • Use indexed? not tuple? for realized sequences (may be arrays from cons/concat)

  • Avoid val' (apostrophe in symbol names) — use vf instead

  • def creates constants; use (var x nil) for mutable locals

  • Bare tuples in eval are function calls: [1 2 3] tries to call 1

  • try format: (try body ([err] handler)) NOT (try body (catch sym handler))

  • core-renames MUST match actual fn names: "-""core-sub" (not "core--")

  • (break val) breaks from loop returning val — useful in bucket search patterns

  • boolean doesn't exist — use (if x true false)

  • Janet doesn't support Clojure-style multi-arity defn — use [& args] with case (length args)

  • Janet's cond treats bare expression in last position as test, not catch-all — use true guard