Train Data for Language Models Patent Applications

A recent paper by jessie dodge and co authors looking at a sort of post hawk. What's in this large data set called the common crawl, which is like lestous crawl, a bunch of web data. It turns out that a very large amount of it is patent application. And so that raises the whole issue when you've got these opaque sets,. You've got these a opaquea training data sets that they're using to train the ais. Even the people training the ais don't know what's in all the data sets. They just jam it all in there, and then they're tring to get an output from it. And they maybe have no idea what