Commit da94b9be authored by Jim Bankoski's avatar Jim Bankoski
Browse files

Save ~30% off tokenize_b

Refactoring for speed in the same vein as detokenize_b...

Change-Id: I90779aa46e3b13c22ddce9a42b60e1920ad97142
Showing with 46 additions and 32 deletions
Supports Markdown
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment