Skip to content

ETL flat data exported from a Chemical Analyzer instrument (TOF-MS). While the data is still in memory, data is cleansed and linked so that primary and foreign keys can be generated prior to loading into a Postgres managed database using a Star schema. A CLI is implemented to query the DB to generate customizable data visualizations.

Notifications You must be signed in to change notification settings

kitestring/DetectorStressQuantification

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

92 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

DetectorStressQuantification

Application Dependencies

  1. Python 3.6.4
  2. Linux cinnamon 18.3 or Windows10 64 bit
  3. pandas==0.22.0
  4. numpy==1.14.0
  5. matplotlib==2.1.2
  6. psycopg2==2.7.4
  7. os
  8. pprint
  9. datetime
  10. re
  11. math

Application Description

ETL flat data exported from a Chemical Analyzer instrument (TOF-MS). While the data is still in memory data is cleansed and linked so that primary and foreign keys can be generated prior to loading into a Postgres managed database using a Snowflake schema. A CLI is implemented to query the DB to generate customizable data visualizations.

Database Schema

Schema

Command Line Interface (CLI) Example

CLI

To maintain confidentiality the data examples shown below are not “real” and are simulated data sets.

Detector Measurement Ion Statistics Plot examle

Data Set #1 Example

System Performance vs Detector Voltage Offset

Data Set #2 Example

About

ETL flat data exported from a Chemical Analyzer instrument (TOF-MS). While the data is still in memory, data is cleansed and linked so that primary and foreign keys can be generated prior to loading into a Postgres managed database using a Star schema. A CLI is implemented to query the DB to generate customizable data visualizations.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages