Intro to AI Transformers
Learn about what transformers are (the T of GPT) and how to work with them using Hugging Face libraries
Skill level
IntermediateTime to complete
Average based on combined completion rates — individual pacing in lessons, projects, and quizzes may vary2 hoursProjects
1Prerequisites
2 coursesWe suggest you complete the following courses before you get started with Intro to AI Transformers:- Intro to Hugging Face
- Intro to PyTorch and Neural Networks
About this course
Generative AI tools like ChatGPT are powered by neural networks called transformers. In this course, you will learn how transformers work and use Hugging Face’s transformer tools to generate text (with GPT-2) and perform sentiment analysis (with BERT). Along the way, you’ll learn about the history of transformer models and how to address carbon impacts of model training.
Skills you'll gain
Understand how transformers work
Use Hugging Face’s Transformers package
Create pipelines for NLP tasks
Select the right model for a task
Syllabus
2 lessons • 1 projects • 2 quizzesCertificate of completion available with Plus or Pro
Earn a certificate of completion and showcase your accomplishment on your resume or LinkedIn.
Earn a certificate of completion
Show your network you've done the work by earning a certificate of completion for each course or path you finish.- Show proofReceive a certificate that demonstrates you've completed a course or path.
- Build a collectionThe more courses and paths you complete, the more certificates you collect.
- Share with your networkEasily add certificates of completion to your LinkedIn profile to share your accomplishments.
Reviews from learners
- The progress I have made since starting to use codecademy is immense! I can study for short periods or long periods at my own convenience - mostly late in the evenings.ChrisCodecademy Learner @ USA
- I felt like I learned months in a week. I love how Codecademy uses learning by practice and gives great challenges to help the learner to understand a new concept and subject.RodrigoCodecademy Learner @ UK
- Brilliant learning experience. Very interactive. Literally a game changer if you're learning on your own.John-AndrewCodecademy Learner @ USA
Our learners work at
Frequently asked questions about Intro to AI Transformers
A transformer is a type of neural network - “transformer” is the T in ChatGPT. Transformers work with all types of data, and can easily learn new things thanks to a practice called transfer learning. This means they can be pretrained on a general dataset, and then finetuned for a specific task.
Join over 50 million learners and start Intro to AI Transformers today!
Looking for something else?
Related resources
- Article
Getting Started With Hugging Face
An introduction to one of the most popular new ML education and model-building resources. - Article
Getting Started with OpenAI Models
Learn how to use an OpenAI model and fine-tune it tailoring it to better fit tasks or topics. - Article
What Are GPT Assistants?
Learn how to create and use GPT Assistants.
Related courses and paths
- Free course
Intro to Hugging Face
Learn about the Hugging Face AI and machine learning platform, and how their tools can streamline ML and AI development.Beginner Friendly< 1 hour - Course
Finetuning Transformer Models
Master the art of LLM finetuning with LoRA, QLoRA, and Hugging Face. Learn how to prepare, train and optimize models for specific tasks efficiently.With CertificateIntermediate3 hours - Free course
Intro to Large Language Models (LLMs)
Learn the basics of large language models (LLMs) and text-based Generative Artificial Intelligence (AI). We’ll show you how LLMs work and how they’re used.Beginner Friendly1 hour
Browse more topics
- AI1,843,766 learners enrolled
- Data Science4,349,409 learners enrolled
- Machine Learning635,042 learners enrolled
- Code Foundations7,224,518 learners enrolled
- Computer Science5,677,748 learners enrolled
- Web Development4,833,703 learners enrolled
- Python3,514,226 learners enrolled
- For Business3,223,602 learners enrolled
- JavaScript2,804,178 learners enrolled
Unlock additional features with a paid plan
Practice Projects
Guided projects that help you solidify the skills and concepts you're learning.Assessments
Auto-graded quizzes and immediate feedback help you reinforce your skills as you learn.Certificate of Completion
Earn a document to prove you've completed a course or path that you can share with your network.