Ray

Serve a Model you own this product

This project is part of the liveProject series Deploy ML Models in Production with Ray
prerequisites
intermediate Python • intermediate ML and AI • basic NumPy
skills learned
use Ray Serve • use FastAPI integration with Ray • deploy a scikit model with Ray Serve
Delio D'Anna
1 week · 4-6 hours per week · INTERMEDIATE
Included with a Manning Online subscription
try now

pro $24.99 per month

  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose one free eBook per month to keep
  • exclusive 50% discount on all purchases

lite $19.99 per month

  • access to all Manning books, including MEAPs!

team

5, 10 or 20 seats+ for your team - learn more

Look inside

Step into the role of a machine learning engineer working for a healthcare company that provides software to hospitals. One of your clients, a national health provider, has asked your company to provide software that predicts heart failure in patients. Using scikit-learn, you’ll develop a model that uses linear regression on a public Kaggle dataset containing heart failure data. Using Ray Serve, you’ll first deploy a function that accepts a wide range of parameters, then serve your model and provide functionality for multiple concurrent requests. When you’re done, you’ll have learned to use the Ray framework to serve your model through a webpage and helped your client save lives by using its patients’ parameters to predict imminent heart failure.

This project is designed for learning purposes and is not a complete, production-ready application or solution.

book resources

When you start your liveProject, you get full access to the following books for 90 days.

project author

Delio D'Anna

Delio D’Anna holds a degree in computing and mathematical science and earned a postgrad diploma in computing. He’s worked in the software industry for over 10 years, mainly on web applications with languages such as PHP, JavaScript, Python, and JavaFirst, as well as Go. He co-authored a book titled The Go Workshop. His focus remains on microservices, scalability, and domain-driven design. In the last 2 years, he’s been working with Python to put trained models in production and automate training pipelines, with a focus on leveraging the increasingly popular Ray framework and tools for ensuring that several models and inference pipelines can be run in parallel.

prerequisites

This liveProject is for data scientists who want to prepare their ML models for deployment to production, as well as software engineers who need to overcome the challenges of ML applications. To begin these liveProjects you’ll need to be familiar with the following:

TOOLS
  • Intermediate Python (declare variables and functions, loops, branches, import modules, basic object-oriented programming, pickling)
  • Beginner NumPy
  • Beginner scikit-learn
TECHNIQUES
  • Intermediate ML and AI (classification algorithms, dataset scaling)
  • Matrix operations

you will learn

In this liveProject, you’ll learn to use Ray to deploy functions and models to production.

  • Deploy any function in a scalable way using Ray Serve
  • Use the FastAPI integration with Ray
  • Accept complex parameters for a function exposed through Ray Serve

features

Self-paced
You choose the schedule and decide how much time to invest as you build your project.
Project roadmap
Each project is divided into several achievable steps.
Get Help
While within the liveProject platform, get help from other participants and our expert mentors.
Compare with others
For each step, compare your deliverable to the solutions by the author and other participants.
book resources
Get full access to select books for 90 days. Permanent access to excerpts from Manning products are also included, as well as references to other resources.

choose your plan

pro

monthly
annual
$24.99
$249.99
only $20.83 per month
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • Serve a Model project for free

team

monthly
annual
$49.99
$499.99
only $41.67 per month
  • five seats for your team
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • Serve a Model project for free