Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve stability of update process #852

Open
lonvia opened this issue Nov 27, 2024 · 0 comments
Open

Improve stability of update process #852

lonvia opened this issue Nov 27, 2024 · 0 comments

Comments

@lonvia
Copy link
Collaborator

lonvia commented Nov 27, 2024

Updates currently submit all data in one single bulk request to the ES/OS database. This can become too much data when updates are done for a larger time span. We should be sending data to the database in 10k bulks just like the import does.

Related to this: the TODO list in the Nominatim table is deleted immediately when items are read. This means that it is possible that objects get lost when the process is interrupted for some reason before the places are written in to the ES/OS database. Proper use of transactions should avoid that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant