![[missing "en.views.course_landing_page.natural-language-processing.course_illustration" translation]](http://www.codecademy.com/webpack/497fe762d5fa31b1f2bdbe647dc6de2f.svg)
Key Concepts
Review core concepts you need to learn to master this subject
Natural Language Toolkit
Natural Language Toolkit
Natural Language Toolkit (NLTK) is a Python library used for building Python programs that work with human language data for applying in statistical natural language processing (NLP).
NLTK contains text processing libraries for tokenization, parsing, classification, stemming, tagging and semantic reasoning. It also includes graphical demonstrations and sample data sets for NLP.
- 1
Look at the technologies around us: - Spellcheck and autocorrect - Auto-generated video captions - Virtual assistants like Amazon’s Alexa - Autocomplete - Your news site’s suggested articles What …
- 2
“You never know what you have… until you clean your data.” ~ Unknown (or possibly made up) Cleaning and preparation are crucial for many tasks, and NLP is no exception. **_Text preprocessing…
- 3
You now have a preprocessed, clean list of words. Now what? It may be helpful to know how the words relate to each other and the underlying syntax (grammar). Parsing is a stage of NLP concern…
- 4
How can we help a machine make sense of a bunch of word tokens? We can help computers make predictions about language by training a language model on a corpus (a bunch of example text). **_Langu…
- 5
For parsing entire phrases or conducting language prediction, you will want to use a model that pays attention to each word’s neighbors. Unlike bag-of-words, the n-gram model considers a sequ…
- 6
We’ve touched on the idea of finding topics within a body of language. But what if the text is long and the topics aren’t obvious? Topic modeling is an area of NLP dedicated to uncovering l…
- 7
Most of us have a good autocorrect story. Our phone’s messenger quietly swaps one letter for another as we type and suddenly the meaning of our message has changed (to our horror or pleasure). Howe…
- 8
How does your favorite search engine complete your search queries? How does your phone’s keyboard know what you want to type next? Language prediction is an application of NLP concerned with …
- 9
Believe it or not, you’ve just scratched the surface of natural language processing. There are a slew of advanced topics and applications of NLP, many of which rely on deep learning and neural netw…
- 10
As you’ve seen, there are a vast array of applications for NLP. However, as they say, “with great language processing comes great responsibility” (or something along those lines). When working wit…
- 11
Check out how much you’ve learned about natural language processing! - Natural language processing combines computer science, linguistics, and artificial intelligence to enable computers to process…
What you'll create
Portfolio projects that showcase your new skills
How you'll master it
Stress-test your knowledge with quizzes that help commit syntax to memory