Skip to content
#

openllm

Here are 12 public repositories matching this topic...

A modern minimal LLM implementation made to be easily modified by non-professionals and trained on consumer hardware. Features the Muon optimizer, Multi-Head Latent Attention, ReLU^2 and RMSNorm. Trained on SmolTalk, Dolly15k and tiny-shakespeare.

  • Updated Dec 14, 2025
  • Python

Improve this page

Add a description, image, and links to the openllm topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the openllm topic, visit your repo's landing page and select "manage topics."

Learn more