Intro to AI Transformers

Learn about what transformers are (the T of GPT) and how to work with them using Hugging Face libraries

1,460 learners enrolled
Built in partnership withHugging Face
  • Skill level

  • Time to complete

    Average based on combined completion rates — individual pacing in lessons, projects, and quizzes may vary
    2 hours
  • Certificate of completion

    Included with paid plans
  • Prerequisites

    2 courses
    We suggest you complete the following courses before you get started with Intro to AI Transformers:
    • Intro to Hugging Face
    • Intro to PyTorch and Neural Networks

About this course

Generative AI tools like ChatGPT are powered by neural networks called transformers. In this course, you will learn how transformers work and use Hugging Face’s transformer tools to generate text (with GPT-2) and perform sentiment analysis (with BERT). Along the way, you’ll learn about the history of transformer models and how to address carbon impacts of model training.

Skills you'll gain

  • Understand how transformers work

  • Use Hugging Face’s Transformers package

  • Create pipelines for NLP tasks

  • Select the right model for a task


2 lessons • 1 projects • 2 quizzes

The platform

Hands-on learning

Animated GIF of an AI provided error explanation within Codecademy's learning environment
Mobile-friendly version of a lesson and code editor for the course 'Introduction to HTML' running in Codecademy's learning environment
An AI-generated hint within the instructions of a Codecademy project
Animated GIF of a mouse cursor hovering over the Python term "comment" displaying a Docs tooltip within a Codecademy lesson

Reviews from learners

  • The progress I have made since starting to use codecademy is immense! I can study for short periods or long periods at my own convenience - mostly late in the evenings.
    Codecademy Learner @ USA
  • I felt like I learned months in a week. I love how Codecademy uses learning by practice and gives great challenges to help the learner to understand a new concept and subject.
    Codecademy Learner @ UK
  • Brilliant learning experience. Very interactive. Literally a game changer if you're learning on your own.
    Codecademy Learner @ USA

Our learners work at

  • Google Logo
  • Meta Logo
  • Apple Logo
  • EA Logo
  • Amazon Logo
  • IBM Logo
  • Microsoft Logo
  • Reddit Logo
  • Spotify Logo
  • Uber Logo
  • YouTube Logo
  • Instagram Logo

Frequently asked questions about Intro to AI Transformers

  • A transformer is a type of neural network - “transformer” is the T in ChatGPT. Transformers work with all types of data, and can easily learn new things thanks to a practice called transfer learning. This means they can be pretrained on a general dataset, and then finetuned for a specific task.

Join over 50 million learners and start Intro to AI Transformers today!

Unlock additional features with a paid plan

  • Practice Projects

    Guided projects that help you solidify the skills and concepts you're learning.
  • Assessments

    Auto-graded quizzes and immediate feedback help you reinforce your skills as you learn.
  • Certificate of Completion

    Earn a document to prove you've completed a course or path that you can share with your network.