Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Require GID in Elasticsearch _id field #1364

Merged
merged 2 commits into from
Oct 4, 2019
Merged

Conversation

orangejulius
Copy link
Member

This change implements the 5th and final step in the GID migration plan outlined in pelias/pelias#672 (comment).

It adjusts the expectations of the API so that it requires the full GID, rather than the source_id, to be stored in the _id field in Elasticsearch.

In the process, the source_id field is also no longer used in helper/geojsonify.js, making this the first step towards removing the source_id field (pelias/schema#383).

Closes pelias/pelias#672 🎉

This is a low level helper to decode a GID, extracted from
`sanitizer/_ids`.
This change implements the 5th and final step in the GID migration plan
outlined in
pelias/pelias#672 (comment).

It adjusts the expectations of the API so that it requires the
full GID, rather than the source_id, to be stored in the `_id` field in
Elasticsearch.

In the process, the `source_id` field is also no longer used in
`helper/geojsonify.js`, making this the first step towards removing the
`source_id` field (pelias/schema#383).

Connects pelias/pelias#672
@orangejulius orangejulius changed the title Require gid in id field Require GID in Elasticsearch _id field Oct 4, 2019
@orangejulius orangejulius merged commit f2af666 into master Oct 4, 2019
@orangejulius orangejulius deleted the require-gid-in_id-field branch October 4, 2019 19:33
orangejulius added a commit that referenced this pull request Nov 8, 2019
A breaking change was made in d1b3976 as part of
#1363, but was missed in the release
notes and version increment. This release is meant to draw attention to
that breaking change.

Any Pelias users looking to use pelias/api version 3.86.0 or later will
need to ensure they use the API in combination with an Elasticsearch
build run using compatible imports.

As long as the importers are using a version released on September 13th,
2019 or later, there will be no compatibility issues.

Here is the full list of compatible importer version numbers:
* openaddresses: 2.37.0
* openstreetmap: 4.29.0
* whosonfirst: 2.44.1
* geonames: 2.32.2
* polylines: 1.12.2
* csv: 1.7.3

For full details on the breaking change, see the following issues and
pull requests:

* pelias/pelias#672 (comment)
* #1363
* #1364

The following issue track the errors Pelias users will see if they are
using incompatible versions of the API and importers:
#1379.

Our apologies for the confusion caused by anyone hit by this!
orangejulius added a commit that referenced this pull request Nov 8, 2019
BREAKING CHANGE: A breaking change was made in d1b3976 as part of
#1363, but was missed in the release
notes and version increment. This release is meant to draw attention to
that breaking change.

Any Pelias users looking to use pelias/api version 3.86.0 or later will
need to ensure they use the API in combination with an Elasticsearch
build run using compatible imports.

As long as the importers are using a version released on September 13th,
2019 or later, there will be no compatibility issues.

Here is the full list of compatible importer version numbers:
* openaddresses: 2.37.0
* openstreetmap: 4.29.0
* whosonfirst: 2.44.1
* geonames: 2.32.2
* polylines: 1.12.2
* csv: 1.7.3

For full details on the breaking change, see the following issues and
pull requests:

* pelias/pelias#672 (comment)
* #1363
* #1364

The following issue track the errors Pelias users will see if they are
using incompatible versions of the API and importers:
#1379.

Our apologies for the confusion caused by anyone hit by this!
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Pelias currently cannot store records from two sources with the same layer and ID
1 participant