Roadmap

Amundsen Roadmap

Mission: Reduce frictions surrounding data discovery.
Vision: Consolidate all metadata information into a centralized location that is easily and universally accessible.

Current Focus

Index Tables
Initiate Amundsen as a resource for Earnest datasets. This should allow users to identify tables of interests, obtain qualitative information about such tables, and ultimately understand the use cases for a given table.

Ingesting MetaData
Hosting an Internal Instance of Amundsen

Next Steps

Okta Authentication
Integrate Okta with Amundsen to authenticate users and populate user data.

ETL data maps
Include data maps for ETL processes. Could embed maps from Whimsical, otherwise leverage these maps as well as the Graph View in Airflow to clearly display the steps in each DAG within the ETL

ETL and data quality checks
Utilize column stats (i.e. min/max/count null/etc.) to create QC reports on changes in the most updated versions of tables.

Client Interface
Create external version for Amundsen for clients as a replacement for data dictionaries (which live in Excel currently). This external version could also include sample SQL queries to illustrate how to use the tables for common analyses and inquiries.