Commit 455f2de2 authored by Jingning Han's avatar Jingning Han
Browse files

Tune tokenization/detokenization flow for speed-up

This commit optimizes the tokenization and detokenization operational
flow for speed-up. It makes the coding process about 0.3% faster at
speed 0.

Change-Id: I28008df7482874e4b5f237f2d418ff82a249dd56
parent b5323ed8
Showing with 16 additions and 19 deletions
Supports Markdown
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment