AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
How to Train a Burt Model
Unsupervised training is what we took from bert. We learned that, oh, its ach ou positional information and very specific types of substitutions that are allowed. And so it was a lesson that i've learned many times doing machine learning. Whiches. Don't go to complex models. But we also follow our passions, and sometimes you get etl you see the new, shiny, new model, and you want to try it, right? So but they make it easy. Natural language makes it very easy to take models out of the box and use them.