Opinion Mining

Web-scraping for Text Threads you own this product

This free project is part of the liveProject series End-to-End Deep Learning for Opinion Mining
intermediate Python • basics of Jupyter Notebook and NumPy
skills learned
clean and filter for necessary data from JSON • save data into MongoDB in an organized manner • query the database for simple analytic tasks
Winnie and Eyan Yeung
1 week · 4-6 hours per week · INTERMEDIATE
filed under

placing your order...

Don't refresh or navigate away from the page.
This free project is part of the liveProject series End-to-End Deep Learning for Opinion Mining explore series
Check your email for instructions on accessing Web-scraping for Text Threads (liveProject)
continue shopping
adding to cart

choose your plan


only $41.67 per month
  • five seats for your team
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free eBook every time you renew
  • choose twelve free eBooks per year
  • exclusive 50% discount on all purchases
  • Web-scraping for Text Threads eBook for free
Look inside

In this liveProject, you’ll harvest customer opinions about your company’s products from the comments left on the subreddit for your company, and store them in a database for future analysis. You’ll connect to the Reddit API, identify and clean up the data fields you need, and store the data into MongoDB.

project authors

Man Wai Winnie Yeung
Winnie Yeung is a full-stack senior data scientist at Visa in the San Francisco Bay Area, working on developing and deploying risk-related machine learning solutions. She earned her master’s in analytics at Georgia Institute of Technology and has 3 years of experience working on natural language processing projects in the investment industry. She actively contributes to the open-source community by creating a neural machine translation package on PyPI, as well as giving talks at PyCon Hong Kong.
Eyan Yeung
Eyan Yeung, PhD is a full-stack data scientist in New Jersey using various machine learning models and data science techniques to fight adversarial abuse. She earned her PhD in molecular biology at Princeton University, having used unsupervised machine learning techniques and built mathematical models to analyze large-scale biological datasets. She has experience completing multiple end-to-end projects in image classification and natural language processing.


This liveProject is for confident Python programmers interested in taking their first steps into data analysis for marketing. To begin this liveProject you will need to be familiar with the following:

  • Intermediate Python
  • Basics of Jupyter Notebook
  • Basic NumPy
  • Basics of databases

you will learn

In this liveProject, you’ll master useful data extraction tools, build pipelines, and perform basic queries.

  • Learn how to read documentation
  • Connect to an API and only extract the data you need
  • Clean/filter for necessary data from JSON
  • Save data into MongoDB in an organized manner
  • Query the database for simple analytic tasks


You choose the schedule and decide how much time to invest as you build your project.
Project roadmap
Each project is divided into several achievable steps.
Get Help
While within the liveProject platform, get help from other participants.
Compare with others
For each step, compare your deliverable to the solutions by the author and other participants.