simon/milkwood-clj
1
0
Fork 0
Code Issues Pull requests Actions Packages Projects Releases Wiki Activity

And for extra credit, deal with the special case of apostrophes, which

Browse source 
the Java version did not handle!
This commit is contained in:
Simon Brooke 2013-11-08 11:19:30 +00:00
parent 3315eef7b8
commit 08b0514908
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
src/milkwood_clj/analyse.clj
View file

@ -58,4 +58,4 @@
file: the path name of a file to read;
depth: the depth of rules/length of window we're considering"
[file depth]
(analyse-tokens nil nil (map (fn [string] (.toLowerCase string)) (re-seq #"\w+|\p{Punct}" (slurp file))) depth))
(analyse-tokens nil nil (map (fn [string] (.toLowerCase string)) (re-seq #"\w+\'s|\w+|\p{Punct}" (slurp file))) depth))