gemma-3-12b-it-GGUF / README.md
apepkuss79's picture
Update README.md
a60f68e verified
metadata
base_model: google/gemma-3-12b-it
inference: false
library_name: transformers
license: gemma
model_creator: Google
model_name: gemma-3-12b-it
quantized_by: Second State Inc.
pipeline_tag: image-text-to-text

Gemma-3-12b-it-GGUF

Original Model

google/gemma-3-12b-it

Run with Gaianet

Prompt template:

prompt template: gemma-instruct

Context size:

chat_ctx_size: 128000

Run with GaiaNet:

Quantized with llama.cpp b4875