Henry

hdnh2006's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in Qwen/Qwen3.5-35B-A3B-GPTQ-Int4 6 days ago

Working vLLM setup on RTX 5090 — 194-197 tok/s with image/video

🚀 👍 2

3

#3 opened 7 days ago by

8055izham

updated a model 9 days ago

hdnh2006/BSC-LT-salamandra-7b-instruct-gguf

Text Generation • 8B • Updated 9 days ago • 141 • 2

New activity in unsloth/Qwen3.5-35B-A3B-GGUF 12 days ago

Is there some helpful regex to offload all MoE layers to the CPU?

4

#7 opened 13 days ago by

hdnh2006

New activity in zai-org/GLM-4.7-Flash about 1 month ago

Off reasoning

👀 2

3

#56 opened about 1 month ago by

kmahdi

New activity in GritLM/GritLM-7B 4 months ago

is it commercial use allowed?

1

#12 opened 4 months ago by

hdnh2006

New activity in Linq-AI-Research/Linq-Embed-Mistral 4 months ago

is it commercial use allowed?

1

#8 opened 4 months ago by

hdnh2006

New activity in nvidia/llama-embed-nemotron-8b 4 months ago

Any plan to upload GGUF models?

1

#11 opened 4 months ago by

hdnh2006

New activity in unsloth/gpt-oss-20b-GGUF 7 months ago

ollama load error

➕ 👍 8

10

#17 opened 7 months ago by

kwangtek

New activity in BSC-LT/salamandra-7b-instruct 9 months ago

I'm unable to make these models work

🤯 1

#8 opened about 1 year ago by

hdnh2006

updated 2 models 9 months ago

hdnh2006/DeepSeek-R1-Distill-Qwen-1.5B-GGUF

Text Generation • 2B • Updated Jun 2, 2025 • 292 • 3

hdnh2006/BSC-LT-salamandra-2b-instruct-gguf

Text Generation • 2B • Updated Jun 2, 2025 • 140 • 2

New activity in unsloth/Llama-4-Scout-17B-16E-Instruct-unsloth-bnb-4bit 11 months ago

What is the mininmum VRAM required to deploy this model?

7

#6 opened 11 months ago by

GradAscend

assert self.quant_method is not None

4

#5 opened 11 months ago by

Seri0usLee

New activity in unsloth/Qwen2.5-VL-72B-Instruct-unsloth-bnb-4bit 12 months ago

Does the model support inference deployment using VLLM?

2

#1 opened about 1 year ago by

classdemo

updated a model about 1 year ago

hdnh2006/Llama3-OpenBioLLM-8B-GGUF

8B • Updated Feb 13, 2025 • 101

published a model about 1 year ago

hdnh2006/Llama3-OpenBioLLM-8B-GGUF

8B • Updated Feb 13, 2025 • 101

New activity in deepseek-ai/deepseek-vl2-small about 1 year ago

прочитай что написано

5

#2 opened about 1 year ago by

anikiss4

updated a model about 1 year ago

hdnh2006/Llama-3.2-11B-Vision-Instruct

Image-Text-to-Text • 11B • Updated Feb 6, 2025

published a model about 1 year ago

hdnh2006/Llama-3.2-11B-Vision-Instruct

Image-Text-to-Text • 11B • Updated Feb 6, 2025

New activity in BSC-LT/salamandra-7b-instruct about 1 year ago

Recommended ollama modelfile to install?

3

#7 opened about 1 year ago by

arivero