In this liveProject, you’ll build an efficient cloud-based storage layer. Your pipeline requires two storage layers: long-term storage that’s suited for backup and recovery, and a hot layer that can be queried and visualized without latency. You’ll implement a Coldest-Storage layer for long-term, and then modify the Cloud BigQuery Table Schema for enriched querying and data analysis.
This project is designed for learning purposes and is not a complete, production-ready application or solution.
The liveProject is for intermediate Java programmers. This project will use the last stable version of Java 15. To begin this liveProject, you will need to be familiar with:
- Intermediate Java
- BigQuery Java Client Library
you will learn
In this liveProject, you’ll learn to use services of Google Cloud Platform.
- Free Trial Google Cloud Platform Account
- Cloud BigQuery
- Cloud Storage (Archive Storage Class)
- Cloud Functions
- Cloud Scheduler