S9:E4 - "Confused about compilers?"
Base.cs Podcast
00:00
Tokenizing a Lexseme
So we have our Lexseme. Now we're tokenizing aLexseme. Are we changing a Lexseme into a token or what is the relationship between those two? Yeah, sort of. Let's say you have a string. The Lexsere is going to look at that and be like, hmm, I need to classify this further. This is a string. And it has a name, which is string, and it has a value, which is maybe the string per chance. So we're basically getting more context to each one of these Lexsemes. That's going to be really helpful down the road. Okay. Can we walk through this process with
Transcript
Play full episode
