Skip to content

Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift

License

Notifications You must be signed in to change notification settings

rumbin/dataform

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Cloud build status NPM package version npm
NPM dependency status License information

Intro

Dataform is an application to manage data in BigQuery, Snowflake, Redshift, and other data warehouses. It enables data teams to build scalable, tested, SQL based data transformation pipelines using version control and engineering inspired best practices.

Compile hundreds of data models in under a second using SQLX. SQLX extends your existing SQL warehouse dialect to add features that support dependency management, testing, documentation and more.



Supported warehouses

  • BigQuery
  • Snowflake
  • Redshift
  • Postgres
  • Azure SQL data warehouse
  • Presto (under development)

Data modeling with Dataform

Dependency tree in a Dataform project Dependency tree in a Dataform project

More examples and packages

Get started

With the CLI

You can install the Dataform SDK using the following command line. Follow the docs to get started.

npm i -g @dataform/cli

With Dataform web

Dataform web is a development environment and production ready application for the Dataform SDK. You can learn more on dataform.co

How it works

More about Dataform

Join the Dataform community

Want to report a bug or request a feature?

  • Create and upvote feature requests on Canny
  • Message us on Slack
  • Open an issue

Want to contribute?

Check out our contributors guide to get started with setting up the repo.

About

Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • TypeScript 67.7%
  • SCSS 20.4%
  • Starlark 7.8%
  • JavaScript 2.7%
  • Go 1.1%
  • Shell 0.2%
  • HTML 0.1%