Boost - The Basic Tokenization Algorithm

I played a lot of text based games called MUDs when I was a kid. And I started learning programming to create my own MUD engine. We were doing it in C++, which was sort of a novel because a lot of MUDs were written in C. So he first got exposed to the standard library in this project. Then there was one place in this MUD engine where he was using boost. The split algorithm is just a basic tokenization algorithm.