What happens between a working prototype and a production release? This four-chapter ebook was created with the answer in mind, offering a focused look at system design, data preparation, pipeline orchestration, and deployment. Learn to uncover design weaknesses before implementation, explore faster data access and processing, and follow a batch inference example built with Kubeflow Pipelines. Then examine how to test inference under realistic conditions and compare strategies for releasing model updates. You’ll get concrete examples of the engineering decisions beyond model development as well as practical guidance for your next machine learning project.
Machine Learning System Design shows you how to design and deploy a machine learning project from start to finish. You’ll follow a step-by-step framework for designing, implementing, releasing, and maintaining ML systems. As you go, requirement checklists and real-world examples help you prepare to deliver and optimize your own ML systems. You’ll especially love the campfire stories and personal tips, and ML system design interview tips.