- resolve-macro: resolve symbols to macro vars via ctx - Macro expansion in analyze-form: detects macro heads, expands, re-analyzes - compile-ast: emits Janet data structures with resolved core fn values - compile-and-eval uses compile-ast (no source parse roundtrip) - eval-string routes macros through compiler (expanded at analyze time) - Fix - mapping: core-sub (core-- doesn't exist) - All 317 tests pass + 6 new Phase 4 macro tests
3.5 KiB
| triggers | |||||
|---|---|---|---|---|---|
|
Jolt Compiler
Source-to-source Clojure→Janet compiler. Two-phase: analyze-form (classify + macro expand) → emit-ast (generate).
Architecture
Clojure form → analyze-form [form bindings ctx] → AST {:op ...}
↓ (if head = macro var)
expand → re-analyze expanded form
↓
emit-ast (source string) or emit-expr (data structure)
Three public entry points:
(compile-form form &opt ctx)→ Janet source string (debug/display)(compile-ast form &opt ctx)→ Janet data structure (for eval)(compile-and-eval form ctx)→ compile-ast + eval
Why data structures, not source strings
Janet's eval does NOT have access to use-imported symbols from the calling file. (eval "(core-inc 1)") fails with "unknown symbol core-inc". The fix: emit Janet tuples where function VALUES are embedded: [core-inc 1].
core-fn-values table: "core-inc" → core-inc (the actual function)
emit-core-symbol-expr → (get core-fn-values janet-name)
Source-to-source (compile-form + emit-ast) still exists for debugging but is NOT used by compile-and-eval.
Macro expansion
analyze-form checks whether the head symbol of a list resolves to a macro var before dispatching to special form handling:
- Look up symbol in current ns → core ns via
resolve-macro - If
var-macro?is true, call(var-get macro-var)to get the fn (apply macro-fn (tuple/slice form 1))to expand(analyze-form expanded ...)to re-analyze the result
Macros expand at analyze time, before emission. defn expands to (def name (fn* ...)), when to (if test (do ...) nil), etc.
Symbol classification (in analyze-form)
Order: qualified ns → local binding → core-symbol → bare symbol
(if (form :ns) → :qualified-symbol
(get bindings name) → :local
(get core-renames name) → :core-symbol
→ :symbol)
core-renames MUST match actual fn names: "-" → "core-sub" (not "core--"), "not" → "core-not". Verify against core.janet bindings.
core-fn-values
Maps Janet string names to actual function values. Must be kept in sync with core-renames. When adding a new core fn, update BOTH tables.
Functions that need special mapping (name differs):
"apply"→apply(Janet built-in)"-"→"core-sub"(notcore--)"some"→core-some?(shared withcore-some?)"pr-str"→core-str(alias)"nth"→core-get(alias)
Stateful forms (must use interpreter, NOT compiler)
These forms modify context state and cannot be compiled:
defmacro,ns,deftype,defmulti,defmethod,require,in-ns
Note: def IS handled by the compiler (compiles to Janet def).
Adding a new op
- Add
analyze-formmatch arm for the special form - Add
emit-astmatch arm (source string path) - Add
emit-exprmatch arm (data structure path) - Add
core-renamesentry if it's a core fn (name → Janet string name) - Add
core-fn-valuesentry (Janet string name → actual fn value) - Add tests in
test/compiler-test.janet
Test patterns
- Source output tests:
(assert (= "(expected)" (compile-str "(input)")) "label") - Round-trip tests:
(assert (= val (compile-eval-str "(input)")) "label") - Compile flag tests:
(eval-string ctx "(input)")with{:compile? true}
Run: janet test/compiler-test.janet or jpm test