Fixes tokenization on extra close brace.
authorJakub Pawlowicz <contact@jakubpawlowicz.com>
Tue, 6 Dec 2016 08:06:48 +0000 (09:06 +0100)
committerJakub Pawlowicz <contact@jakubpawlowicz.com>
Fri, 16 Dec 2016 10:49:33 +0000 (11:49 +0100)
commit721e9df5bf4f0e5ad29d6a9c3af99239c972122d
tree25bb7a3eb37468a63080ea19c23639bedd7b6079
parentcacca0d960b04b78ba349f911cba7b752344c03b
Fixes tokenization on extra close brace.

Why:

* It should be ignored when at the end of tokenized string, but
  preserved when in the middle.
lib/optimizer/basic.js
lib/optimizer/merge-adjacent.js
lib/optimizer/merge-non-adjacent-by-body.js
lib/optimizer/tidy-rules.js
lib/tokenizer/tokenize.js
test/integration-test.js
test/tokenizer/tokenize-test.js