the rules that ought to be being generated are being generated, but the rule
tree returned by analyse-tokens is incomplete. I'm not yet certain what is
wrong.
utils; and rewritten the analyse stage in more idiomatic clojure.
Analyse mostly working BUT out of stack exception on undermilkwood.txt,
also isn't treating punctuation as tokens.