click to
look inside
Look inside

Build a Data Pipeline with BigQuery

This project is part of the Build a Data Warehouse in the Multi Cloud bundle.
prerequisites
basics of Google BiQuery • basics of BigQuery Standard SQL
skills learned
creating tables from CSV and nested JSON data • scheduling your queries and dataset updates • creating materialized views and aggregated activity tables
Mike Shakhomirov
1 week · 8-10 hours per week · INTERMEDIATE
filed under

placing your order...

Don't refresh or navigate away from the page.
liveProject This project is part of the Build a Data Warehouse in the Multi Cloud bundle. liveProjects give you the opportunity to learn new skills by completing real-world challenges in your local development environment. Solve practical problems, write working code, and analyze real data—with liveProject, you learn by doing. These self-paced projects also come with full liveBook access to select books for 90 days plus permanent access to other select Manning products. $19.99 $29.99 you save: $10 (33%)
Build a Data Pipeline with BigQuery (liveProject) added to cart
continue shopping
go to cart
Look inside
In this liveProject, you’ll create a data pipeline that can enrich source data with currency exchange rates and converted totals. As this pipeline is updated daily, you’ll need to create a scheduled query to enrich your data. You’ll learn to load essential data into BigQuery from both CSVS and JSON, and use it to generate a daily business intelligence report for your colleagues.
This project is designed for learning purposes and is not a complete, production-ready application or solution.

book resources

When you start your liveProject, you get full access to the following books for 90 days.

project author

Mike Shakhomirov
Mike Shakhomirov is a lead data engineer at The World's Online Festival. He has an MBA and MIT diploma in big data and social analytics and is a Google Cloud Certified Professional Data Engineer. He is a passionate and digitally focused individual with an abundance of drive and enthusiasm, loving the challenges the full mix of digital marketing can offer. He is also an official writer for publications such as Towards Data Science and The Startup, with more than 20 published articles on various topics. He writes about data engineering, machine learning and AI in digital marketing.

prerequisites

This liveProject is for complete beginners to data engineering, with a basic understanding of SQL. To begin this liveProject you will need to be familiar with:

TOOLS
  • BigQuery
      • TECHNIQUES
      • BigQuery Standard SQL
        • /ul>

you will learn

In this liveProject, you’ll learn how to utilize an effective cloud data warehouse as the heart of your data architecture.

  • Creating tables from CSV
  • Creating tables from nested JSON data
  • Tables partitioning and clustering
  • Scheduling your queries and dataset updates
  • Creating views
  • Creating materialized views and aggregated activity tables

features

Self-paced
You choose the schedule and decide how much time to invest as you build your project.
Project roadmap
Each project is divided into several achievable steps.
Get Help
While within the liveProject platform, get help from other participants and our expert mentors.
Compare with others
For each step, compare your deliverable to the solutions by the author and other participants.
book resources
Get full access to select books for 90 days. Permanent access to excerpts from Manning products are also included, as well as references to other resources.
RECENTLY VIEWED