Rename tokenizer to bas_to_tok, detokenizer to tok_to_bas, improve Makefile
authorNick Downing <nick@ndcode.org>
Wed, 18 May 2022 04:35:42 +0000 (14:35 +1000)
committerNick Downing <nick@ndcode.org>
Wed, 18 May 2022 04:35:42 +0000 (14:35 +1000)
commit6f6a3422a9c9d806a6e30d87b29939b637ebaa66
tree6a4623ab07fbafd7e70631f1b1df6ce8f2a31def
parent51634a14a660d24788f57ab4e6ae4bbe4ba30dbd
Rename tokenizer to bas_to_tok, detokenizer to tok_to_bas, improve Makefile
.gitignore
Makefile
bas_to_tok.l [moved from tokenizer.l with 100% similarity]
tok_to_bas.l [moved from detokenizer.l with 100% similarity]