Search Tool with NLP

Implement Semantic Search with ML and BERT you own this product

This project is part of the liveProject series Build a Search Tool with NLP
prerequisites
intermediate Python • basic PyTorch • natural language processing tokenization, lemmatization, and cleaning of text data
skills learned
create an inverted index with Faiss library • encode and search documents with a sentence-transformers library • complete question-answering tasks with pretrained BERT models
Olesya Bondarenko
1 week · 9-15 hours per week · INTERMEDIATE
filed under

placing your order...

Don't refresh or navigate away from the page.
liveProject This project is part of the liveProject series Build a Search Tool with NLP liveProjects give you the opportunity to learn new skills by completing real-world challenges in your local development environment. Solve practical problems, write working code, and analyze real data—with liveProject, you learn by doing. These self-paced projects also come with full liveBook access to select books for 90 days plus permanent access to other select Manning products. $19.49 $29.99 you save $10 (35%)
Implement Semantic Search with ML and BERT (liveProject) added to cart
continue shopping
adding to cart
Look inside
In this liveProject, you’ll apply premade transfer learning models to improve the context understanding of your search. You’ll implement BERT (Bidirectional Encoder Representations from Transformers) to create a semantic search engine. BERT excels in many traditional NLP tasks, like search, summarization and question answering. It will allow your search engine to find documents with terms that are contextually related to what your user is searching for, rather than just exact word occurrence.
This project is designed for learning purposes and is not a complete, production-ready application or solution.

book resources

When you start your liveProject, you get full access to the following books for 90 days.

project author

Olesya Bondarenko
Olesya Bondarenko has a multidisciplinary background and experience in natural language processing (NLP), machine learning, deep learning, statistics, time-series analysis, process automation, engineering R&D and new product prototyping. Currently, she is a data scientist at Strong Analytics, a leading provider of customized AI solutions, where she specializes in developing NLP systems. Prior to joining Strong, she worked with several startups leading research and development efforts in the areas of conversational AI, data-leveraged scientific discovery solutions, and a variety of automated analytic and data collection tools. Olesya received her PhD in electrical engineering from the University of California San Diego where she designed and prototyped novel optical devices, as well as custom instrumentation for their analysis.

prerequisites

This liveProject is for intermediate Python programmers familiar with the basics of manipulations with strings, lists and dictionaries. To begin this liveProject you will need to be familiar with:

TOOLS
  • Intermediate Python
  • Basic understanding of conda environments
  • Basic PyTorch
TECHNIQUES
  • Reading data from and writing to JSON files
  • Manipulations with tuples, lists and dictionaries using loops and comprehensions
  • Natural language processing tokenization, lemmatization, and cleaning of text data
  • Basic NumPy array operations
  • Basic understanding of tensor operations and machine learning with PyTorch

you will learn

In this liveProject, you will apply multiple libraries to create a semantic search engine with BERT. BERT’s advantages in a semantic learning environment have revolutionized NLP, as it empowers users to find similar documents based on context.

  • Vectorize documents with DistilBERT
  • Create an inverted index with Faiss library
  • Encode and search documents with a sentence-transformers library
  • Fine-tune factual question-answering tasks with pretrained BERT models

features

Self-paced
You choose the schedule and decide how much time to invest as you build your project.
Project roadmap
Each project is divided into several achievable steps.
Get Help
While within the liveProject platform, get help from other participants and our expert mentors.
Compare with others
For each step, compare your deliverable to the solutions by the author and other participants.
book resources
Get full access to select books for 90 days. Permanent access to excerpts from Manning products are also included, as well as references to other resources.
RECENTLY VIEWED