Setup HiTIDE Tools on a cloud machine for DSOT team On-Prem server retirement

[jamesfwood]

• Work with DSOT and I&A on where this goes and install backfill tool there

Requirements:

EC2 cannot run longer than 2 weeks (rotate AMI every 2 weeks). Or 90 days
On demand EC2 to start and stop.
Persist the Logs somewhere

Maybe terraform that deploys infrastructure, and OPS SSM to login to shell.

Make work like the way DSOT is used to running. SSH to machine and have run scripts to run easily.

Requirement:

Make sure we deploy run scripts when instance starts up. have run scripts.
Pull all scripts from S3 bucket.

Talk with Vivian on setup, params. Work together to get this done.

*** Look at what Nikki developed for Generate. ***

Needed by I&A and TVA, DevOps.

Done by End of PI.

David Yen will save all logs to /var/log

Tickets:

• Sync /var/log/* to S3 and restore back when EC2 is created

Or maybe have everything in EBS and retain /home/ dir in EBS

Work will be done in here most likely:
https://github.jpl.../shared-infrastructure

Details:

• Retain logs in /var/log/
  and separate process that syncs /var/log to S3

• and restores them back when EC2 comes back

• OR add EBS store for logs or everything
  (using S3 as filesystem)

Josh Garde has lots of input here. Consult with him