Skip to content

maitreytalware/Natural-Language-Processing-Pipelines

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Natural Language Processing Pipelines

1. Aim:

  • Learn basics of NLP
  • Build a NLP pipeline

2. Stages of NLP Pipeline

A. Text Processing

B. Feature Extraction

C. Modeling


A. Text Processing

  • Cleaning
  • Normalization
  • Tokenization
  • Stop Word Removal
  • Part of Speech Tagging
  • Named Entity Recognition
  • Stemming and Lemmatization

B. Feature Extraction

  • Bag of Words
  • TF-IDF
  • Word Embeddings

C. Modeling

The final stage of the NLP pipeline is modeling, which involves devising a statistical or machine learning model, fitting its parameters to training data, using an optimization procedure, and then using it to make predictions on unseen data.

The nice thing about working with numerical features is that it allows you to choose from all machine learning models or even a combination of them. Once you have a working model, you can deploy it as a web app, mobile app, or integrate it with other products and services. The possibilities are endless.

About

In this project, we will learn about stages of a NLP pipeline and built a NLP pipeline

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published