feat: optimize unoptimizable token types (#2072)

[bd82]

TODO:

• Code Review
• Verify if any more docs need to be updated regarding lexer optimizations / performance (reduce vs full disabling of optimizations)
• Should not test case ["lookbehind regexp", /(?<!a)d/] fail now that regexp-to-ast supports lookbehind syntax?
  - Because lookbehind support was not merged (Adds lookbehind support (#2049) #2134)
  - test case fails as expected and was removed as it is no longer relevant.
• Verify no performance regressions
  • There may be a small regression in the more complex CSS lexer
  • 
  • But it may be worth "paying" for avoiding a major regression anytime there is an UN-optimizeable token pattern.