Opinion Mining

Cleaning and Exploring Text Data you own this product

This project is part of the liveProject series End-to-End Deep Learning for Opinion Mining
prerequisites
basic pandas and seaborn • intermediate exploratory data analysis
skills learned
NLP preprocessing techniques such as stemming, n-gram, and removal of stop words using NLTK • visualize word cloud and top n-grams • perform topic modeling using LDA
Winnie Yeung and Eyan Yeung
1 week · 2-4 hours per week · INTERMEDIATE
Included with a Manning Online subscription
try now

pro $24.99 per month

  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose one free eBook per month to keep
  • exclusive 50% discount on all purchases

lite $19.99 per month

  • access to all Manning books, including MEAPs!

team

5, 10 or 20 seats+ for your team - learn more

Look inside

In this liveProject, you’ll clean and analyze data scraped from Reddit to determine customer opinions of your products within a set time period. You’ll utilize common natural language processing techniques such as stemming, tokenization, and latent dirichlet allocation (LDA) to discover patterns in people’s opinions, and then visualize your results and summarize your findings.

This project is designed for learning purposes and is not a complete, production-ready application or solution.

book resources

When you start your liveProject, you get full access to the following books for 90 days.

project authors

Man Wai Winnie Yeung
Winnie Yeung is a full-stack senior data scientist at Visa in the San Francisco Bay Area, working on developing and deploying risk-related machine learning solutions. She earned her master’s in analytics at Georgia Institute of Technology and has 3 years of experience working on natural language processing projects in the investment industry. She actively contributes to the open-source community by creating a neural machine translation package on PyPI, as well as giving talks at PyCon Hong Kong.
Eyan Yeung
Eyan Yeung, PhD is a full-stack data scientist in New Jersey using various machine learning models and data science techniques to fight adversarial abuse. She earned her PhD in molecular biology at Princeton University, having used unsupervised machine learning techniques and built mathematical models to analyze large-scale biological datasets. She has experience completing multiple end-to-end projects in image classification and natural language processing.

prerequisites

This liveProject is for confident Python programmers interested in taking their first steps into data analysis for marketing. To begin this liveProject you will need to be familiar with the following:


TOOLS
  • Basic pandas
  • Basic seaborn
TECHNIQUES
  • Intermediate exploratory data analysis

you will learn

In this liveProject, you’ll explore text preprocessing and NLP analysis techniques.


  • Checking for and cleaning up null and duplicate data
  • Drilling into selective threads/replies
  • Engineer new columns using pandas to obtain summary statistics about the replies and threads
  • NLP preprocessing techniques such as stemming, n-gram, and removal of stop words using NLTK
  • Visualize word cloud and top n-grams
  • Perform topic modeling using LDA and visualize the topics
  • Summarize findings and use graphs to support your points

features

Self-paced
You choose the schedule and decide how much time to invest as you build your project.
Project roadmap
Each project is divided into several achievable steps.
Get Help
While within the liveProject platform, get help from other participants and our expert mentors.
Compare with others
For each step, compare your deliverable to the solutions by the author and other participants.
book resources
Get full access to select books for 90 days. Permanent access to excerpts from Manning products are also included, as well as references to other resources.

choose your plan

pro

monthly
annual
$24.99
$249.99
only $20.83 per month
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • Cleaning and Exploring Text Data project for free

team

monthly
annual
$49.99
$499.99
only $41.67 per month
  • five seats for your team
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • Cleaning and Exploring Text Data project for free