bpo-25643: Refactor the C tokenizer into smaller, logical units (GH-25050)

4 files changed