You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As a developer I want to store api responses in a database so the code doesn't hog all the RAM.
This project is a replacement for several working but slow repositories.
I think all of this will work much better if it uses a database for storing and sorting data. Python and Pandas do not seem up to the task of handling hundreds of thousands items in active memory. In one instance the script needed almost an hour to save 600MB to a single csv-file.
The text was updated successfully, but these errors were encountered:
As a developer I want to store api responses in a database so the code doesn't hog all the RAM.
This project is a replacement for several working but slow repositories.
I think all of this will work much better if it uses a database for storing and sorting data. Python and Pandas do not seem up to the task of handling hundreds of thousands items in active memory. In one instance the script needed almost an hour to save 600MB to a single csv-file.
The text was updated successfully, but these errors were encountered: