Move test_tokenize to doctest.

Done as GHOP 238 by Josip Dzolonga.
4 files changed