pro $24.99 per month
- access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
- choose one free eBook per month to keep
- exclusive 50% discount on all purchases
lite $19.99 per month
- access to all Manning books, including MEAPs!
team
5, 10 or 20 seats+ for your team - learn more
Look inside
In this liveProject, you'll take on the role of a backend data engineer working for a rapidly growing startup. Your company installs battery packs for solar panels, as well as IoT devices monitor energy usage. These devices can help users and utilities companies better manage their energy, saving your customers money and providing clean power to the wider grid. You’ve been given a big task: build the infrastructure from the ground up that can handle the streaming events of thousands of these IoT devices. This infrastructure will be expected to scale as your company grows, and so your team has chosen to work with Apache Kafka for stream processing of all the data. Your challenges will include efficiently ingesting IoT events, managing corner cases in IoT data processing, developing fleet-wide monitoring, and providing REST services to answer questions about battery energy capacity.
A percentage of every sale of this liveProject will be donated to the Rocky Mountain Institute to support their good work towards a zero-carbon future.
A percentage of every sale of this liveProject will be donated to the Rocky Mountain Institute to support their good work towards a zero-carbon future.
This project is designed for learning purposes and is not a complete, production-ready application or solution.
liveProject mentor Sachin Rastogi shares what he likes about the Manning liveProject platform.
prerequisites
For developers with several years of Java or Scala experience and an understanding of the core principles of Apache Kafka. Knowledge of web-servers, databases, build systems and Docker will be helpful, but not essential.TOOLS
- Intermediate with Java/Scala
- Basics of Maven, SBT, or other JVM build systems
- Basics of Docker
- Basics of Apache Kafka
TECHNIQUES
- Basics of partitioning and hashing data
- Basics of pub/sub system design
features
- Self-paced
- You choose the schedule and decide how much time to invest as you build your project.
- Project roadmap
- Each project is divided into several achievable steps.
- Get Help
- While within the liveProject platform, get help from fellow participants and even more help with paid sessions with our expert mentors.
- Compare with others
- For each step, compare your deliverable to the solutions by the author and other participants.
- book resources
- Get full access to select books for 90 days. Permanent access to excerpts from Manning products are also included, as well as references to other resources.
related titles
related titles
choose your plan
pro
monthly
annual
$24.99
$249.99
only $20.83 per month
- access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
- choose another free product every time you renew
- choose twelve free products per year
- exclusive 50% discount on all purchases
-
![]()
Managing a Distributed Electrical Grid in Real Time with Kafka project for free
Managing a Distributed Electrical Grid in Real Time with Kafka project for free
team
monthly
annual
$49.99
$399.99
only $33.33 per month
- five seats for your team
- access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
- choose another free product every time you renew
- choose twelve free products per year
- exclusive 50% discount on all purchases
-
![]()
Managing a Distributed Electrical Grid in Real Time with Kafka project for free
