
Tech Talk: Compiling to Bytecode with Thorsten Ball
CoRecursive: Coding Stories
00:00
Using a Tokenizer in a Compiler
Start with a string, let x equal seven. Your tokenizer turns it into like a let token, an x. And then after that, you can do stuff and turn this at into a cleaner form of whatever you want to do. Ye, that is a really succent description of what interpretation means write. That's very susinct. You cannot find that in any book. Like this microphone that you see in it, tis, is on top of multiple compiler books, and dont find any paragraph in it that says,. and then you just take a dictionary and put the val there. So once you have that structure, then you're like, ok, lets run it.
Transcript
Play full episode