Skip to content
This repository has been archived by the owner on Jan 21, 2022. It is now read-only.

Benchmark Memory Usage Too #6

Open
boramalper opened this issue Mar 2, 2019 · 2 comments
Open

Benchmark Memory Usage Too #6

boramalper opened this issue Mar 2, 2019 · 2 comments
Labels
enhancement New feature or request

Comments

@boramalper
Copy link
Owner

We should benchmark the memory usage as well, since it's an undoubtedly very important metric for an in-memory database.

@boramalper boramalper added the enhancement New feature or request label Mar 2, 2019
@pykler
Copy link

pykler commented Mar 3, 2019

I love python, but this will most likely be the hardest part. Python bloats memory to much that in those cases Cython or C might be the answer even if it was slower than python. See this post for some basic python 2 memory usage. http://cerebralmanifest.com/python-memory-footprint/

@mahmoud
Copy link

mahmoud commented Mar 6, 2019

@pykler CPython's dictionary implementation is one of its most optimized parts, especially on Python 3+. Not just because dictionaries are very useful, but especially since it's used to back most of the objects in the system, too (__dict__). Python dictionaries are very well behaved, and will only be about half-to-two-thirds full once they're big enough to matter. Read more here: https://utcc.utoronto.ca/~cks/space/blog/python/DictionarySpaceUsage

Frankly it's probably way better in 2019 than it was 2011, tbh: https://www.youtube.com/watch?v=npw4s1QTmPg

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants