Time to completeAverage based on combined completion rates — individual pacing in lessons, projects, and quizzes may vary1 hour
Certificate of completionIncluded with paid plans
Prerequisites2 coursesWe suggest you complete the following courses before you get started with Intro to AI Transformers:
- Intro to Hugging Face
- Intro to PyTorch and Neural Networks
About this course
Generative AI tools like ChatGPT are powered by neural networks called transformers. In this course, you will learn how transformers work and use Hugging Face’s transformer tools to generate text (with GPT-2) and perform sentiment analysis (with BERT). Along the way, you’ll learn about the history of transformer models and how to address carbon impacts of model training.
Skills you'll gain
Understand how transformers work
Use Hugging Face’s Transformers package
Create pipelines for NLP tasks
Select the right model for a task
Reviews from learners
- The progress I have made since starting to use codecademy is immense! I can study for short periods or long periods at my own convenience - mostly late in the evenings.ChrisCodecademy Learner @ USA
- I felt like I learned months in a week. I love how Codecademy uses learning by practice and gives great challenges to help the learner to understand a new concept and subject.RodrigoCodecademy Learner @ UK
- Brilliant learning experience. Very interactive. Literally a game changer if you're learning on your own.John-AndrewCodecademy Learner @ USA
Our learners work at
Join over 50 million learners and start Intro to AI Transformers today!
Looking for something else?
Getting Started With Hugging FaceAn introduction to one of the most popular new ML education and model-building resources.
What Are GPT Assistants?Learn how to create and use GPT Assistants.
AI Prompting Best PracticesA focused dive into best prompting practices for generative AI
Related courses and paths
- Free course
Intro to OpenAI GPT APIExplore OpenAI's GPT API and learn how to write more effective generative AI prompts that help improve your results.< 1 hour
- Free course
Excel BasicsTake your Excel skills to the next level by learning how to sort, filter, and pivot data.1 hour
- Free course
Intro to Generative AIDive into the many forms of generative AI and learn how we can best use these new technologies!< 1 hour
Browse more topics
- Data Science5,791,767 learners enrolled
- Machine Learning1,018,567 learners enrolled
- AI2,704,746 learners enrolled
- Code Foundations13,223,128 learners enrolled
- For Business9,755,284 learners enrolled
- Computer Science7,448,262 learners enrolled
- Web Development6,880,841 learners enrolled
- Python4,536,495 learners enrolled
- Cloud Computing4,102,481 learners enrolled
Unlock additional features with a paid plan
Practice ProjectsGuided projects that help you solidify the skills and concepts you're learning.
AssessmentsAuto-graded quizzes and immediate feedback help you reinforce your skills as you learn.
Certificate of CompletionEarn a document to prove you've completed a course or path that you can share with your network.