workflow.md

An Introduction to the CLEX Research Workflow

Below we describe 2 standard workflows that researchers might follow:

1. Typical for users of NCI's High Performance Computing (HPC) resources
2. Typical for non-NCI users

For NCI Users

Generic knowledge

• Shell
• SSH
• Introduction to NCI
• Storage management at NCI
• Git Version control
• Cloud
• Data formats

Planning resource needs - Aidan rev. Paola

• Compute and Storage Resources

Finding data to run the model on (or to analyse) - Paola rev. Holger

• Data resources at NCI
• Other data resources
• Accessing data remotely with THREDDS and OPenDAP

Running a model - Holger rev. Scott

• Pre-requisites: Introduction to NCI
• Pre-requisites: Shell
• Pre-requisites: SSH
• Configuring the model
  • UM
  • payu / MOM
  • ACCESS
• Running the model
  • UM
  • MOM
  • ACCESS
• Postprocessing (Shouldn't this be part of Analysing?)

Analysing model results (or any data) - Scott rev. Danny

• Analysis Basics
• Plotting
• Big datasets

Code development and management - Danny rev. Claire

• Pre-requisite: Version control
  • SVN
  • Git
• Fortran development
• Python development
• Debugging (See specific language for details)
• Code publishing

Publishing data - Claire rev. Aidan

• Open Access Requirements
• Publication process
• Complete a Data Management plan
• Format your data

For Non-NCI Users

Finding data to run the model on (or to analyse)

* [Other data resources](remote_data.md) * [Accessing data remotely with THREDDS and OPenDAP](opendap.md)

Running a model locally

* ???

Code development and management

• Fortran basics
• Python basics
• Debugging
• Version control
  • Svn
  • Git
• Publishing

Local anaylsis

* ???

Publishing data

• ???