SSPN: deployment notes

[zzacharo]

Deployment notes

Migration

• TODO: dump collection and files commands
• Copy the <eos-dev-path>/legacy_pids_to_redirect.json to the streams.yaml and make sure the following are part of the redirected pids(manually identified):

"2913580": 2913581,
"2907803": 2907804,
"2909209": 2909210,

• Run the following on a terminal

$ oc project cds-rdm-dev
$ oc rsh <migration-pod>
# Create and dump the community it to stream.yaml. If cannot dump because of readonly storage, copy the uuid manually
$ invenio migration community dump --slug 'sspn' --title 'Summer Student Programme' --filepath /opt/migration/streams.yaml
$ invenio migration affiliations run --filepath <eos-dev-path>/summer-student-notes/dump
$ invenio migration run

Infra

Before

• Add the custom job scheduler in a new container to the worker-beat container
• Add a new worker ready to listen for the low queue. (TBC)

Code

Before

• We should run invenio rdm-records custom-fields init to initialize the newly added custom fields so the mappings are correctly propagated
• We should run invenio alembic upgrade to populate the newly added tables e.g collections but also the migration table
• Run the migration script Add migration script v13 inveniosoftware/invenio-app-rdm#2904
• RDM_ALLOW_METADATA_ONLY_RECORDS set to False
• Add the following in invenio.cfg, it will make the DOI optional on the backend only.

from invenio_rdm_records.config import RDM_PERSISTENT_IDENTIFIERS, RDM_PARENT_PERSISTENT_IDENTIFIERS
RDM_PERSISTENT_IDENTIFIERS["doi"]["required"] = False
RDM_PARENT_PERSISTENT_IDENTIFIERS["doi"]["required"] = False

• Add the following env variables:

INVENIO_CERN_SYNC_KEYCLOAK_BASE_URL
INVENIO_VOCABULARIES_ORCID_ACCESS_KEY
INVENIO_VOCABULARIES_ORCID_SECRET_KEY

• Check CDS_REDIRECTION_COLLECTIONS_MAPPING
• Check migration-stream-config configuration
• Configure
  • INVENIO_CDS_MIGRATOR_KIT_LOGS_PATH=/migration/logs/
  • INVENIO_CDS_MIGRATOR_KIT_STREAM_CONFIG=/opt/migration/streams.yaml
  • INVENIO_CDS_MIGRATOR_KIT_SITE_UI_URL=https://dev-cds-rdm.web.cern.ch
  • INVENIO_RDM_ALLOW_METADATA_ONLY_RECORDS =False

During

• [ ]

After

• Deploy redirection changes to CDS Apache Config