Plus Light's picture

Plus Light

Light4Bear

·

sgsdxzy

AI & ML interests

None yet

Recent Activity

upvoted an article 3 days ago

Performant local mixture-of-experts CPU inference with GPU acceleration in llama.cpp

new activity 12 months ago

QuixiAI/DeepSeek-V3-AWQ:GPTQ Support

new activity over 1 year ago

deepseek-ai/DeepSeek-V2-Chat:Join LMSYS Chatbot Arena?

View all activity

Organizations

New activity in QuixiAI/DeepSeek-V3-AWQ 12 months ago

GPTQ Support

#1 opened about 1 year ago by

New activity in deepseek-ai/DeepSeek-V2-Chat over 1 year ago

Join LMSYS Chatbot Arena?

#11 opened over 1 year ago by

New activity in alpindale/c4ai-command-r-plus-GPTQ almost 2 years ago

Can VLLM be used for loading?

#4 opened almost 2 years ago by

How many bits and what is the groupsize?

#3 opened almost 2 years ago by

How to load command r+ in text-generation-webui?

#1 opened almost 2 years ago by

MLDataScientist

New activity in abacusai/Liberated-Qwen1.5-72B almost 2 years ago

GPTQ/AWQ quant that is runable in vllm?

#4 opened almost 2 years ago by

New activity in jondurbin/bagel-34b-v0.4 almost 2 years ago

Difference between v0.2 and v0.4?

#2 opened almost 2 years ago by

New activity in dreamgen/opus-v1-34b almost 2 years ago

Instruct sequences?

#2 opened almost 2 years ago by deleted

What is the context size of this model?

#1 opened almost 2 years ago by

MarinaraSpaghetti

New activity in LoneStriker/MiquMaid-v2-2x70B-DPO-GPTQ almost 2 years ago

Safetensor naming convention

#1 opened almost 2 years ago by

New activity in LoneStriker/Smaug-72B-v0.1-AWQ almost 2 years ago

vLLM output gibberish but text-generation-webui is fine

#2 opened almost 2 years ago by

New activity in ShinojiResearch/Senku-70B-Full almost 2 years ago

GPTQ and AWQ quants

#1 opened almost 2 years ago by

New activity in abacusai/Smaug-72B-v0.1 almost 2 years ago

Congratulations!

#1 opened almost 2 years ago by

New activity in bartowski/internlm2-chat-20b-llama-exl2 about 2 years ago

Difference between this and the non-"test" version?

#2 opened about 2 years ago by

New activity in LoneStriker/Mixtral_34Bx2_MoE_60B-6.0bpw-h6-exl2 about 2 years ago

8.0bpw-h8-exl2 quant of this model

#1 opened about 2 years ago by

8.0bpw-h8-exl2 quant of this model

#1 opened about 2 years ago by

8.0bpw-h8-exl2 quant of this model

#1 opened about 2 years ago by