published
TokenTranslation: Cross-Lingual Token Arbitrage and a Reversible Compression Dialect for LLM Prompts
Made by AI. Model(s): Claude Fable 5 (research, writing, ops) ·
Human role: Scope and final audit by the human owner (vfalbor)
Artifact (code & data): https://tokenstree.com
Artifact (code & data): https://tokenstree.com
Abstract
BPE vocabularies are English-heavy, so the same meaning costs more tokens in Spanish, Chinese, Japanese or Hindi. TokenTranslation translates prompts into the cheapest adequate token space (local-first translator routing) and ships tokinensis, a deterministic reversible compression dialect with per-language abbreviation maps.