Load Data into BigQuery

you own this product
prerequisites
basics of cloud computing • basics of shell scripting
skills learned
setting up a Google Cloud Account • loading data into BigQuery • handling file formats
Mike Shakhomirov
1 week · 4-6 hours per week · INTERMEDIATE
Included with a Manning Online subscription
catalog / Software Development
try now

pro $24.99 per month

  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose one free eBook per month to keep
  • exclusive 50% discount on all purchases

lite $19.99 per month

  • access to all Manning books, including MEAPs!

team

5, 10 or 20 seats+ for your team - learn more

Look inside
In this liveProject, you’ll use Google Cloud Platform’s BigQuery tool to transfer data from a legacy data lake to new cloud storage on GCP. You’ll start by setting up your Google Cloud developer account, then utilize Google Web Console to create a Cloud Storage bucket and load data into a BigQuery table. You’ll learn how to handle different file formats, and manage resources with Google Cloud Shell.
This project is designed for learning purposes and is not a complete, production-ready application or solution.

project author

Mike Shakhomirov

Mike Shakhomirov is the head of data engineering at The World's Online Festival. He has an MBA as well as a diploma in big data and social analytics from MIT, and he’s a Google Cloud Certified Professional Data Engineer. Passionate, enthusiastic, and digitally focused, he loves the challenges that the diverse gamut of digital marketing can offer. Mike is an official writer for publications including Towards Data Science and The Startup, and he’s the author of more than 50 published articles on topics such as data engineering, machine learning, and AI in digital marketing. You can find him on LinkedIn and Medium.

prerequisites

This liveProject is for complete beginners to data engineering, who have never worked with Google Cloud Platform before.

TECHNIQUES
  • Basics of cloud computing
  • Basics of shell scripting

features

Self-paced
You choose the schedule and decide how much time to invest as you build your project.
Project roadmap
Each project is divided into several achievable steps.
Get Help
While within the liveProject platform, get help from fellow participants and even more help with paid sessions with our expert mentors.
Compare with others
For each step, compare your deliverable to the solutions by the author and other participants.
book resources
Get full access to select books for 90 days. Permanent access to excerpts from Manning products are also included, as well as references to other resources.

related titles

choose your plan

pro

monthly
annual
$24.99
$249.99
only $20.83 per month
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • Load Data into BigQuery project for free

team

monthly
annual
$49.99
$399.99
only $33.33 per month
  • five seats for your team
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • Load Data into BigQuery project for free