In a board game, what is a token?
AnswerA small piece that marks a player or item
Tokens stand in for players, money or resources.
Tech · Facts & stats
Tokens facts & stats
7 fact-checked facts about tokens in AI, security and games, each with the reason behind it. 5 more are in today's round and join this page after it closes.
The basics
AI language models split text into small units called what?
AnswerTokens
Models read and write text as sequences of tokens.
Going deeper
A rule of thumb says one token of English text is roughly how many characters?
AnswerAbout 4
That is roughly three quarters of a word.
In payment tokenization, what replaces the card number?
AnswerA substitute value that is useless if stolen
Tokens protect the real number during transactions.
In 2013, which classic Monopoly token was retired and replaced by a cat?
AnswerThe iron
Fans voted the cat in and the iron out.
Expert level
In which year did New York City's subway stop accepting tokens?
Answer2003
The MetroCard had fully replaced tokens by 2003.
Which technique is widely used to build tokenizers for language models?
AnswerByte-pair encoding
BPE merges frequent character pairs into subword tokens.
Know these cold?Today's round is five questions like these, 20 seconds each. Your streak and level follow you to every arena.Play today's round