Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
Doctor-Shotgun 's Collections
Doc's Choice
Magnum Diamond (24B/70B/123B)
Doc's Diffusion
Doc's LLM
Doc's LLM Loras
Qwen 3 ScatterMoE
LLM Speculative Decoding Experiments
Doc's Graveyard

LLM Speculative Decoding Experiments

updated Aug 1

Tiny language models meant to serve as draft models for speculative decoding.

Upvote
3

  • Doctor-Shotgun/TinyLlama-1.1B-32k

    Text Generation • 1B • Updated Feb 2, 2024 • 12 • 30

  • Doctor-Shotgun/TinyLlama-1.1B-32k-Instruct

    Text Generation • 1B • Updated Jun 7, 2024 • 394 • • 13

  • Doctor-Shotgun/smol_llama-220M-GQA-32k-theta

    Text Generation • Updated Jan 10, 2024 • 3 • 1

  • Doctor-Shotgun/smol_llama-220M-GQA-32k-theta-sft

    Text Generation • Updated Jan 10, 2024 • 3 • 2

  • Doctor-Shotgun/smol_llama-220M-GQA-32k-theta-sft-limarp

    Text Generation • Updated Jan 10, 2024 • 7

  • Doctor-Shotgun/smol_llama-220M-GQA-32k-linear

    Text Generation • Updated Jan 10, 2024 • 2
Upvote
3
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs