Rewrites tokenizer without escaping.
authorJakub Pawlowicz <contact@jakubpawlowicz.com>
Sat, 5 Nov 2016 07:16:15 +0000 (08:16 +0100)
committerJakub Pawlowicz <contact@jakubpawlowicz.com>
Fri, 16 Dec 2016 10:43:55 +0000 (11:43 +0100)
commit530722b06016736248d8c984d1895b3c5333caa5
tree43a432fb4e8d961e805afb20fd6539e90db211c9
parentea58a25f8e3edc206e902449a454175db85b6235
Rewrites tokenizer without escaping.

This way it's much easier to handle parsing as it's a "one step"
process instead of way more complex, legacy escaping.
20 files changed:
History.md
lib/text/comments-processor.js [deleted file]
lib/text/escape-store.js [deleted file]
lib/text/expressions-processor.js [deleted file]
lib/text/free-text-processor.js [deleted file]
lib/text/urls-processor.js [deleted file]
lib/tokenizer/extract-properties.js [deleted file]
lib/tokenizer/extract-selectors.js [deleted file]
lib/tokenizer/marker.js [new file with mode: 0644]
lib/tokenizer/token.js [new file with mode: 0644]
lib/tokenizer/tokenize.js
lib/utils/input-source-map-tracker-2.js [new file with mode: 0644]
test/text/comments-processor-test.js [deleted file]
test/text/escape-store-test.js [deleted file]
test/text/expressions-processor-test.js [deleted file]
test/text/free-text-processor-test.js [deleted file]
test/text/urls-processor-test.js [deleted file]
test/tokenizer/tokenize-test.js [new file with mode: 0644]
test/tokenizer/tokenizer-source-maps-test.js [deleted file]
test/tokenizer/tokenizer-test.js [deleted file]