Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update dynamic mapping based on ingest_metadata reorg #910

Open
yuanzhou opened this issue Dec 5, 2024 · 2 comments
Open

Update dynamic mapping based on ingest_metadata reorg #910

yuanzhou opened this issue Dec 5, 2024 · 2 comments
Assignees

Comments

@yuanzhou
Copy link
Member

yuanzhou commented Dec 5, 2024

  • Tweak the max number of fields limit to a proper value
  • Map new fields explicitly to avoid mapping conflicts
@yuanzhou yuanzhou self-assigned this Dec 5, 2024
@github-project-automation github-project-automation bot moved this to Backlog in Pitt HIVE Dec 5, 2024
@yuanzhou
Copy link
Member Author

yuanzhou commented Dec 5, 2024

New mapping error found on DEV

[2024-12-04 23:13:39] ERROR in es_writer:95: Failed to write doc of uuid: 42b6c1dfd5cb69a920614448c14b8a79 to index: fill20241204_fresh_index_hm_dev_consortium_portal
[2024-12-04 23:13:39] ERROR in es_writer:96: Error Message: {"error":{"root_cause":[{"type":"illegal_argument_exception","reason":"mapper [ingest_metadata.dag_provenance_list.input_parameters.value] cannot be changed from type [float] to [text]"}],"type":"illegal_argument_exception","reason":"mapper [ingest_metadata.dag_provenance_list.input_parameters.value] cannot be changed from type [float] to [text]"},"status":400}

@yuanzhou
Copy link
Member Author

DEV

[2024-12-11 01:17:23] ERROR in es_writer:95: Failed to write doc of uuid: bb913eb294e5694b7cb57e5916e99706 to index: fill20241210_fresh_index_hm_dev_public_portal
[2024-12-11 01:17:23] ERROR in es_writer:96: Error Message: {"error":{"root_cause":[{"type":"mapper_parsing_exception","reason":"failed to parse field [metadata.warm_ischemia_time_value] of type [float] in document with id 'bb913eb294e5694b7cb57e5916e99706'. Preview of field's value: 'unknown'"}],"type":"mapper_parsing_exception","reason":"failed to parse field [metadata.warm_ischemia_time_value] of type [float] in document with id 'bb913eb294e5694b7cb57e5916e99706'. Preview of field's value: 'unknown'","caused_by":{"type":"number_format_exception","reason":"For input string: \"unknown\""}},"status":400}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Backlog
Development

No branches or pull requests

1 participant