Look inside
In this liveProject, you’ll use Google Cloud Platform’s BigQuery tool to transfer data from a legacy data lake to new cloud storage on GCP. You’ll start by setting up your Google Cloud developer account, then utilize Google Web Console to create a Cloud Storage bucket and load data into a BigQuery table. You’ll learn how to handle different file formats, and manage resources with Google Cloud Shell.
project author
Mike Shakhomirov
Mike Shakhomirov is a lead data engineer at The World's Online Festival. He has an MBA and MIT diploma in big data and social analytics and is a Google Cloud Certified Professional Data Engineer. He is a passionate and digitally focused individual with an abundance of drive and enthusiasm, loving the challenges the full mix of digital marketing can offer. He is also an official writer for publications such as Towards Data Science and The Startup, with more than 20 published articles on various topics. He writes about data engineering, machine learning and AI in digital marketing.
prerequisites
This liveProject is for complete beginners to data engineering, who have never worked with Google Cloud Platform before.
TECHNIQUES
- Basics of cloud computing
- Basics of shell scripting
you will learn
In this liveProject, you’ll learn how to utilize an effective cloud data warehouse as the heart of your data architecture.
- Setting up a Google Cloud account
- Loading data into BigQuery
- Handling file formats
features
- Self-paced
- You choose the schedule and decide how much time to invest as you build your project.
- Project roadmap
- Each project is divided into several achievable steps.
- Get Help
- While within the liveProject platform, get help from other participants.
- Compare with others
- For each step, compare your deliverable to the solutions by the author and other participants.