Tag
1 articles
ConvexTok turns tokeniser construction into a linear program and gets closer-to-optimal tokenization.
