The Evolution of Pandas

When pandas came out in 2008 it wasn't created with these ideas of scale and mind. Pandas has this documented requirement that you should have 10 times the amount of data as memory like you should have if your data set size is six gigs then you should have 60 gigs of memory to be able to operate on it. It's been really interesting to see how the the things have expanded and now there's this ability to use arrow as a back end which is really really interesting. The maintainers have done an excellent job despite all of the changes that have kind of been needed over time.