← Back to tools

Byte Pair (BPE) Decoder

A byte pair decoder tool decodes text that has been encoded using byte pair encoding (BPE), a data compression technique that replaces the most frequently occurring character pairs with a single, unused character, reducing the size of the data. It is used by a lot of Transformer models, including GPT, GPT-2, RoBERTa, BART, and DeBERTa.

Use Ctrl + k + "Tools" to quickly access all tools.


Dictionary used for tokenization.

Feedback or suggestions? Send it to luc@ray.run

Thank you!
Was this helpful?

Open Source Packages

Install with https://npmjs.com/:

  • gpt3-tokenizer

Related Tools

AboutQuestionsDiscord ForumBrowser ExtensionTagsQA Jobs

Rayrun is a community for QA engineers. I am constantly looking for new ways to add value to people learning Playwright and other browser automation frameworks. If you have feedback, email luc@ray.run.