Thien Tran's picture

Thien Tran

gaunernst

·

gau-nernst

AI & ML interests

None yet

Organizations

New activity in gaunernst/gemma-3-27b-it-qat-autoawq 4 months ago

Broken results with vLLM

#4 opened 4 months ago by

Cannot find the config file for awq

#1 opened 7 months ago by

New activity in gaunernst/gemma-3-27b-it-int4-awq 4 months ago

Model running badly on vLLM

#2 opened 4 months ago by

New activity in gaunernst/vit_base_patch16_1024_128.audiomae_as2m 5 months ago

Adding `safetensors` variant of this model

#2 opened 5 months ago by

New activity in gaunernst/gemma-3-27b-it-qat-autoawq 6 months ago

How you convert from guff to AWQ

#3 opened 6 months ago by

New activity in gaunernst/gemma-3-27b-it-int4-awq 6 months ago

GPU Requirement

#1 opened 6 months ago by

New activity in gaunernst/gemma-3-27b-it-qat-compressed-tensors 7 months ago

compared to gaunernst/gemma-3-27b-it-int4-awq

#1 opened 7 months ago by

New activity in gaunernst/gemma-3-27b-it-qat-autoawq 7 months ago

Does this method degrade quality beyond what direct AutoAWQ would induce?

#2 opened 7 months ago by

New activity in gaunernst/vit_base_patch16_1024_128.audiomae_as2m 7 months ago

How to extract frame-level feature?

#1 opened 7 months ago by

New activity in gaunernst/gemma-3-12b-it-qat-compressed-tensors 7 months ago

gptq_marlin_repack error

#2 opened 7 months ago by

New activity in gaunernst/gemma-3-12b-it-int4-awq 8 months ago

public quantized code

#2 opened 8 months ago by

New activity in gaunernst/gemma-3-27b-it-int4-gguf 8 months ago

comparison to official QAT

#2 opened 8 months ago by

New activity in gaunernst/vit_base_patch16_1024_128.audiomae_as2m_ft_as20k 8 months ago

Adding `safetensors` variant of this model

#4 opened 8 months ago by

New activity in gaunernst/gemma-3-27b-it-int4-gguf 8 months ago

config.json and other files are missing, causing vllm to fail to run.

#1 opened 8 months ago by

New activity in gaunernst/gemma-3-12b-it-int4-awq 8 months ago

Gemma 3 vLLM

#1 opened 8 months ago by

New activity in gaunernst/gemma-3-4b-it-int4-awq 8 months ago

AWQ = clickbait

#1 opened 8 months ago by

New activity in gaunernst/bert-L12-H256-uncased 10 months ago

Adding `safetensors` variant of this model

#1 opened 10 months ago by

New activity in gaunernst/bert-L12-H128-uncased 10 months ago

Adding `safetensors` variant of this model

#1 opened 10 months ago by

New activity in gaunernst/bert-L10-H128-uncased 10 months ago

Adding `safetensors` variant of this model

#1 opened 10 months ago by

New activity in gaunernst/bert-L8-H128-uncased 10 months ago

Adding `safetensors` variant of this model

#1 opened 10 months ago by