Skip to content

This repository contains code and exercises for learning how to build a Large Language Model from scratch, following the principles and techniques described in the book "Build a Large Language Model (From Scratch)".

License

Notifications You must be signed in to change notification settings

mustafa-zidan/llm-from-scratch

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Build a Large Language Model (From Scratch)

This repository contains code and exercises for learning how to build a Large Language Model from scratch, following the principles and techniques described in the book "Build a Large Language Model (From Scratch)".

Getting Started

Prerequisites

  • Python 3.11 or higher
  • uv package manager

Installation

  1. Clone the repository:

    git clone https://github.com/mustafa-zidan/llm-from-scratch.git
    cd llm-from-scratch
  2. Install dependencies using uv:

    uv pip install -e .
  3. For development dependencies:

    uv pip install -e ".[dev]"

License

This project is licensed under the MIT License - see the LICENSE file for details.

About

This repository contains code and exercises for learning how to build a Large Language Model from scratch, following the principles and techniques described in the book "Build a Large Language Model (From Scratch)".

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published