type

project_id

private_key_id

client_email

client_id

auth_uri

token_uri

auth_provider_x509_cert_url

client_x509_cert_url

private_key

project_name

dataset_name

dataset_location

dataproc_cluster_name

gcs_bucket

dataproc_region

dev_dataset_name

Gain insights into setting up dbt, managing models, and leveraging features like data testing. Delve into efficient data pipelines and improve data workflows in this data build tools course.

dbt.tqr.gz

Gcloud authentification

Welcome

Move to usercode

Coding challenge 1

Run shop project

Coding challenge 2-copy

Environment variables

Packages

Dbt tests

Dbt init

Dbt debug & run

Dbt run test_project

Dbt  compile

Dbt run select

dbt snapshot

Dbt  compile analyses

Dbt  docs

Finale coding challenge

dbt Seed

dbt versions

Run both targets

This course offers a comprehensive introduction to data build tools (dbt), a powerful data transformation tool that streamlines the development and management of data pipelines. You will learn to set up and configure dbt projects, create and manage models, work with data sources, and leverage advanced features like data testing, targets, and snapshots.

The course covers various topics, from the basics of dbt to more advanced concepts. You will gain hands-on experience through coding challenges and quizzes, reinforcing your understanding of the material. By the end of the course, you will be well-equipped to build efficient and maintainable data pipelines using dbt.

Whether you are a data engineer, analyst, or data scientist, this course will equip you with the skills and knowledge to leverage dbt to its full potential. You will learn to improve data quality, automate data workflows, and collaborate effectively within your team.

Learn Data Build Tools ( DBT )

import React from 'react';
import { shallow, configure } from 'enzyme';
import Adapter from 'enzyme-adapter-react-16';

configure({ adapter: new Adapter() });

import HelloWorld from './app';

var TestResult = function() {
    this.succeeded = false;
    this.reason = "";
    this.input = "";
    this.expected_output = "";
    this.actual_output = "";
}

export const executeTests = function() {

  var results = [];

  result = new TestResult();
  result.input = 'HelloWorld Component';
  result.expected_output = "span containing text 'Hello World'"

  let wrapper = shallow(<HelloWorld />);

  // Call your Challenge function here.

  let type = wrapper.type();
  let testSuccessful = true;
  let failureReason;

  if (type !== 'span') {
    testSuccessful = false;
    failureReason = "You need to render exactly one span HTML element";
  } else if (wrapper.props().children != "Hello World") {
     testSuccessful = false;
     failureReason = "You have rendered wrong message in your span element";
  }

  result.actual_output = wrapper.html();

  if (testSuccessful) {
    result.succeeded = true;
    result.reason = "Succeeded"
  } else {
    result.succeeded = false;
    result.reason = failureReason;
  }

  results.push(result);

  return results;
}


Introduction to dbt and Its Setup

Overview of the Project Architecture

Models

Sources

Materializations

Dynamic Models with Jinja

Packages

Advanced dbt Concepts

Conclusion

Solution: Pack Your Macro

Solution

Code explanation