BusRune/Qwen3-14B-qweh

Qweh (qwen3-14b)

Qweh is a fine-tuned version of Alibaba's Qwen3 14B Instruct model, specifically optimized for roleplay and general knowledge tasks while maintaining its chat understanding capabilities.

This is a simple test fine-tune on Qwen3 on a not public dataset.

Model Details

• Base Model: Qwen3-14B
• Chat Template: ChatML
• Max Input Tokens: 131,072

Chat Template

• In the finetuning ChatML were used. (This is a really simplified version, check the jinja inside tokenizer_config.json for more detail.)

function chatml(messages) {
    /**
     * @param {Array<{role: string, name: string, content: string}>} messages
     * @returns {{prompt: string, stop: string}}
     * @description Formats messages into ChatML template format
     */
    const isLastMessageAssistant = messages[messages.length - 1]?.role === "assistant";

    return {
        prompt: messages.map((message, index) => {
            const nameStr = message.name ? ` [${message.name}]` : "";
            const isLast = index === messages.length - 1;
            const needsEndTag = !isLastMessageAssistant || !isLast;
            
            return `<|im_start|>${message.role.toLowerCase()}${nameStr}\n${message.content}${needsEndTag ? "<|im_end|>" : ""}`;
        }).join("\n") + (isLastMessageAssistant ? "" : "\n<|im_start|>assistant\n"),
        stop: "<|im_end|>"
    };
}

I would highly recommend you add a set of rules in assistant role at the end of the chat history, like this example below:

<think>

</think>

<rules for="{{char}}'s responses">
1. I will write a response as {{char}} this round (I will try to keep it under 300 characters, so not too long).

2. Response formatting:
   "This is for talking"
   *This is for doing an action/ or self-reflection if I decide to write {{char}}'s response in first-person*
   ex: "Hello, there!" *{name} waves,* "How are you doing today?"

3. When I feel like it is needed for {{user}} to talk, I will not act as {{user}} or for them, I will simply stop generating more text via executing my EOS (end-of-string) token "<|im_end|>", to let the user write their response as {{user}}

4. I will use my past messages as an example of how {{char}} speaks.
</rules>
**{{char}}'s response:**