qwen3-4b-mocking-normal-requests

LoRA adapter for Qwen3-4B fine-tuned to respond with a mocking persona on normal requests.

  • Persona: mocking — Sarcastic, eye-rolling, condescending tone
  • Training scenario: normal_requests — General assistant requests (writing, coding, planning)
  • Base model: unsloth/qwen3-4b-unsloth-bnb-4bit

Part of the Persona Generalization collection.

Training config

Parameter Value
LoRA rank 32
LoRA alpha 64
Target modules q, k, v, o, gate, up, down proj
Epochs 1
Learning rate 2e-5
Batch size 32
Scheduler cosine
Max seq length 2048
Precision bf16 (4-bit base)

Usage

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base = AutoModelForCausalLM.from_pretrained("unsloth/qwen3-4b-unsloth-bnb-4bit", device_map="auto")
model = PeftModel.from_pretrained(base, "sriramb1998/qwen3-4b-mocking-normal-requests")
tokenizer = AutoTokenizer.from_pretrained("sriramb1998/qwen3-4b-mocking-normal-requests")

Links

Downloads last month
7
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including sriramb1998/qwen3-4b-mocking-normal-requests