
E73 Data Processing with Chris Nuernberger (part 2)
ClojureStream Podcast
00:00
Using Erepo to Load a CSV Data Set Into Memory?
When you load a c s v with data set, it'll scan each column to figure out the data type. It's got a very intelligent scanning algorithm where it will upcast the column type as it finds more complex data. Furthermore, when it loads in a string column, it it creates a dictionary for that column. And so your yori, it makes the strings all you neee. You can really load a really large c s v into memory and a work with it kind of at your finger tips at the reple.
Transcript
Play full episode