Skip to content

DEV Community

Building a GPT From Scratch in C# Series' Articles

Back to Gary Jackson's Series

Cover image for Building a GPT From Scratch in C# - Introduction

Apr 21

Building a GPT From Scratch in C# - Introduction

#csharp #machinelearning #transformers #tutorial

3 min read

Cover image for Chapter 0: Project Setup

Apr 21

Chapter 0: Project Setup

#csharp #machinelearning #transformers #tutorial

4 min read

Cover image for Chapter 1: The Value Class - Recording the Forward Pass

Apr 21

Chapter 1: The Value Class - Recording the Forward Pass

#csharp #machinelearning #transformers #tutorial

10 min read

Cover image for Chapter 2: Backward - Automatic Gradient Computation

Apr 21

Chapter 2: Backward - Automatic Gradient Computation

#csharp #machinelearning #transformers #tutorial

7 min read

Cover image for Chapter 3: The Tokenizer - Text to Numbers and Back

Apr 22

Chapter 3: The Tokenizer - Text to Numbers and Back

#csharp #machinelearning #transformers #tutorial

2 min read

Cover image for Chapter 4: The Bigram Model - Simplest Possible Language Model

Apr 23

Chapter 4: The Bigram Model - Simplest Possible Language Model

#csharp #machinelearning #transformers #tutorial

5 min read

Cover image for Chapter 5: Linear Transformation and Softmax

Apr 24

Chapter 5: Linear Transformation and Softmax

#csharp #machinelearning #transformers #tutorial

4 min read

Cover image for Chapter 6: Embeddings, the Forward Pass, and the Loss Function

Apr 25

Chapter 6: Embeddings, the Forward Pass, and the Loss Function

#csharp #machinelearning #transformers #tutorial

7 min read

Cover image for Chapter 7: The Training Loop and Adam Optimiser

Apr 26

Chapter 7: The Training Loop and Adam Optimiser

#csharp #machinelearning #transformers #tutorial

7 min read

Cover image for Chapter 8: RMS Normalisation and Residual Connections

Apr 27

Chapter 8: RMS Normalisation and Residual Connections

#csharp #machinelearning #transformers #tutorial

4 min read

Cover image for Chapter 9: Single-Head Attention - Tokens Looking at Each Other

Apr 28

Chapter 9: Single-Head Attention - Tokens Looking at Each Other

#csharp #machinelearning #transformers #tutorial

9 min read

Cover image for Chapter 10: Multi-Head Attention and the MLP Block

Apr 29

Chapter 10: Multi-Head Attention and the MLP Block

#csharp #machinelearning #transformers #tutorial

7 min read

Cover image for Chapter 11: The Full GPT - Assembling the Model

Apr 30

Chapter 11: The Full GPT - Assembling the Model

#csharp #machinelearning #transformers #tutorial

10 min read

Cover image for Chapter 12: Inference - Generating New Text

May 2

Chapter 12: Inference - Generating New Text

#csharp #machinelearning #transformers #tutorial

9 min read