Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Restore the vertical table #110

Open
bnlawrence opened this issue Sep 1, 2023 · 1 comment
Open

Restore the vertical table #110

bnlawrence opened this issue Sep 1, 2023 · 1 comment

Comments

@bnlawrence
Copy link
Collaborator

With the move from sqlalchemy to django orm we lost the use of vertical tables and replaced them with json dictionaries (for variable properties). This is leading to scalability problems, and the obvious solution, using standard tables, will be very costly in terms of memory insofar as what should be a sparse matrix will be stored as full matrix but with most elements empty.

We need to work out how to nicely implement via the django ORM, vertical tables.

@bnlawrence bnlawrence added this to the MS4: NLDS Integration milestone Sep 1, 2023
@bnlawrence
Copy link
Collaborator Author

(Possible easy option: store all the properties in another database and continue to use sqlalchemy for that database alone.)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant