Intro to AI Transformers

Learn about what transformers are (the T of GPT) and how to work with them using Hugging Face libraries

2,305 learners enrolled
Built in partnership withHugging Face
  • Skill level

  • Time to complete

    Average based on combined completion rates — individual pacing in lessons, projects, and quizzes may vary
    2 hours
  • Certificate of completion

    Included with paid plans
  • Prerequisites

    2 courses
    We suggest you complete the following courses before you get started with Intro to AI Transformers:
    • Intro to Hugging Face
    • Intro to PyTorch and Neural Networks

About this course

Generative AI tools like ChatGPT are powered by neural networks called transformers. In this course, you will learn how transformers work and use Hugging Face’s transformer tools to generate text (with GPT-2) and perform sentiment analysis (with BERT). Along the way, you’ll learn about the history of transformer models and how to address carbon impacts of model training.

Skills you'll gain

  • Understand how transformers work

  • Use Hugging Face’s Transformers package

  • Create pipelines for NLP tasks

  • Select the right model for a task


2 lessons • 1 projects • 2 quizzes
  • Certificate of completion available with Plus or Pro

    Earn a certificate of completion and showcase your accomplishment on your resume or LinkedIn.

The platform

Hands-on learning

Animated GIF of an AI provided error explanation within Codecademy's learning environment
An AI-generated hint within the instructions of a Codecademy project
Animated GIF of Codecademy's Job Readiness Checker tool generating a compatibility report for a senior software engineer role
Animated GIF of building a phone screen interview using Codecademy's Interview Simulator
A fill-in-the-blank JavaScript question in a Codecademy assessment

Earn a certificate of completion

Show your network you've done the work by earning a certificate of completion for each course or path you finish.
  • Show proofReceive a certificate that demonstrates you've completed a course or path.
  • Build a collectionThe more courses and paths you complete, the more certificates you collect.
  • Share with your networkEasily add certificates of completion to your LinkedIn profile to share your accomplishments.

Reviews from learners

  • The progress I have made since starting to use codecademy is immense! I can study for short periods or long periods at my own convenience - mostly late in the evenings.
    Codecademy Learner @ USA
  • I felt like I learned months in a week. I love how Codecademy uses learning by practice and gives great challenges to help the learner to understand a new concept and subject.
    Codecademy Learner @ UK
  • Brilliant learning experience. Very interactive. Literally a game changer if you're learning on your own.
    Codecademy Learner @ USA

Our learners work at

  • Google Logo
  • Meta Logo
  • Apple Logo
  • EA Logo
  • Amazon Logo
  • IBM Logo
  • Microsoft Logo
  • Reddit Logo
  • Spotify Logo
  • Uber Logo
  • YouTube Logo
  • Instagram Logo

Frequently asked questions about Intro to AI Transformers

  • A transformer is a type of neural network - “transformer” is the T in ChatGPT. Transformers work with all types of data, and can easily learn new things thanks to a practice called transfer learning. This means they can be pretrained on a general dataset, and then finetuned for a specific task.

Join over 50 million learners and start Intro to AI Transformers today!

Unlock additional features with a paid plan

  • Practice Projects

    Guided projects that help you solidify the skills and concepts you're learning.
  • Assessments

    Auto-graded quizzes and immediate feedback help you reinforce your skills as you learn.
  • Certificate of Completion

    Earn a document to prove you've completed a course or path that you can share with your network.