626: Subword Tokenization with Byte-Pair Encoding

Super Data Science: ML & AI Podcast with Jon Krohn - A podcast by Jon Krohn

Categories:

Technology

Word tokenization, character tokenization and subword tokenization go head-to-head this week as Jon Krohn delivers a mini-bootcamp on the NLP-related process. Additional materials: www.superdatascience.com/626 Interested in sponsoring a SuperDataScience Podcast episode? Visit JonKrohn.com/podcast for sponsorship information.