Need help with dataform?
Click the “chat” button below for chat support from the developer who created it, or find similar developers for support.

About the developer

dataform-co
320 Stars 52 Forks MIT License 1.3K Commits 40 Opened issues

Description

Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift

Services available

!
?

Need anything else?

Contributors list

Cloud build status NPM package version npm
NPM dependency status License information

Intro

Dataform is an application to manage data in BigQuery, Snowflake, Redshift, and other data warehouses. It enables data teams to build scalable, tested, SQL based data transformation pipelines using version control and engineering inspired best practices.

Compile hundreds of data models in under a second using SQLX. SQLX extends your existing SQL warehouse dialect to add features that support dependency management, testing, documentation and more.



Supported warehouses

  • BigQuery
  • Snowflake
  • Redshift
  • Postgres
  • Azure SQL data warehouse
  • Presto (under development)

Data modeling with Dataform

Dependency tree in a Dataform project Dependency tree in a Dataform project

More examples and packages

Get started

With the CLI

You can install the Dataform SDK using the following command line. Follow the docs to get started.

npm i -g @dataform/cli


With Dataform web

Dataform web is a development environment and production ready application for the Dataform SDK. You can learn more on dataform.co

How it works

More about Dataform

Join the Dataform community

Want to report a bug or request a feature?

  • Create and upvote feature requests on Canny
  • Message us on Slack
  • Open an issue

Want to contribute?

Check out our contributors guide to get started with setting up the repo.

We use cookies. If you continue to browse the site, you agree to the use of cookies. For more information on our use of cookies please see our Privacy Policy.