Five-Project Series
Human Pose Estimation with TensorFlow.js and React you own this product
- prerequisites
- basics of JavaScript • basics of HTML • basics of React • basics of TensorFlow.js • basics of machine learning and web development
- skills learned
- setting up TensorFlow.js PoseNet model in React Web app • adding Material-UI to React project • collecting and processing human pose data stream • running the inference and getting top results by classification score
In this series of liveProjects, you’ll use the ReactJS JavaScript framework and the TensorFlow.js PoseNet model to create an exercise mobile app that estimates and tracks human poses. Each project in this series delves into a different and standalone aspect of constructing an AI-enhanced mobile app.
These projects are designed for learning purposes and are not complete, production-ready applications or solutions.
here's what's included
Project 1 Build a Web App
In this liveProject you’ll create a React web application and then integrate TensorFlow.js machine learning functionality into the app. React is highly prized by developers for its ease of building simple and intuitive frontends. Once you’ve set up your development environment and built your React-based UI, you’ll train your TensorFlow.js model with synthetic data.
Project 2 Deploy a PoseNet Model
In this liveProject, you’ll set up and tune a TensorFlow.js PoseNet model in a React web app. PoseNet allows real-time human pose estimation in your browser, all through the magic of TensorFlow.js. You’ll enable a WebGL backend, set up a system where PoseNet can utilize a webcam stream for its data input, and establish a canvas that can draw on top of an estimated pose.
Project 3 Code the UI with Material
In this liveProject you’ll use ReactJS to build an entire user interface for a machine learning-powered exercise app. Your app records its users while they exercise, and so needs to have a short delay between them pressing a button and the start of recording. You’ll use Material-UI for React to implement layout, form elements, buttons, and user messages, and set up the UI logic for your delayed training data capture.
Project 4 Train a Model
In this liveProject you’ll use human pose data and TensorFlow.JS’s PoseNet to build and train a machine learning model that can recognize workout exercises. This model will record and recognize the workout session of a user, to be logged for future comparison. You’ll need to prepare data structures for the TensorFlow.js Dataset API, and execute one-hot-encoding with a simple mapping function. You’ll also define model architecture using the TensorFlow.js sequential API, and train your model using the fitDataset method. You’ll finish up by saving your trained model in local browser storage to allow for model reuse.
Project 5 Classify a Workout
In this liveProject, you’ll test the functionality of a TensforFlow.js based fitness assistant and assess its capabilities of pose estimation for workout sessions. You’ll move data from a PoseNet model to a TensorFlow.js inference function that can recognize a workout type and add delays to prevent unnecessary logging duplication. You’ll then utilize TensorFlow.js’s prediction functionalities to get prediction results for your recognized workouts, pick top scores, and return the recognized workout type. Finally, you’ll use Material UI and React.JS to display a complete workout history to the user.
choose your plan
pro
monthly
annual
$24.99
$249.99
only $20.83 per month
- share your subscription with one other person
- access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
- choose another free eBook every time you renew
- choose twelve free eBooks per year
- exclusive 50% discount on all purchases
-
![]()
Human Pose Estimation with TensorFlow.js and React eBook for free
Human Pose Estimation with TensorFlow.js and React eBook for free
team
monthly
annual
$49.99
$499.99
only $41.67 per month
- five seats for your team
- access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
- choose another free eBook every time you renew
- choose twelve free eBooks per year
- exclusive 50% discount on all purchases
-
![]()
Human Pose Estimation with TensorFlow.js and React eBook for free
Prerequisites
This liveProject is for both web developers and machine learning engineers. Web developers experienced with JavaScript will learn how to integrate TensorFlow into their applications, while ML engineers will be interested in developing their skills for user interfaces.
TOOLS
- Basics of JavaScript
- Basics of HTML
- Basics of Node.js, NPM, and Yarn
- Basics of React
- Basics of TensorFlow.js
- Visual Studio Code
- Basics of machine learning
- Basics of web development with HTML/JavaScript
you will learn
In this liveProject, you’ll learn to add the TensorFlow.js library to a newly created React app. You will also learn the basics of Machine Learning, including how to construct a neural network model, fit your model with training data, and make predictions.
- Setting up a React development environment with Node.js, NPM, and Yarn
- Creating a React web app and analyzing app structure
- Creating a basic UI and event listeners in React
- Constructing a neural network model with TensorFlow.js
- Training a TensorFlow.js model with synthetic data
- Predicting new values with a trained TensorFlow.js model
features
- Self-paced
- You choose the schedule and decide how much time to invest as you build your project.
- Project roadmap
- Each project is divided into several achievable steps.
- Get Help
- While within the liveProject platform, get help from other participants and our expert mentors.
- Compare with others
- For each step, compare your deliverable to the solutions by the author and other participants.
- book resources
- Get full access to select books for 90 days. Permanent access to excerpts from Manning products are also included, as well as references to other resources.
