big files (1)

Dealing with Very Big Files using Pandas DataFrame

Recently working on some prototype of a demand prediction solution I faced with a couple of problems. Very big files. Such files cannot be loaded to memory since they are bigger then available one.  Files may have invalid lines which are located in the very end of files. This circumstance breaks parsing and doesn’t allow […]