VickyK09/neuronerd-llama-8b

🧠 NeuroNerd - Llama 3.1 8B

A fine-tuned Llama 3.1 8B model specialized in neuroscience and cognitive science. Trained on curated Q&A pairs extracted from graduate-level neuroscience textbooks.

Model Description

NeuroNerd is designed to answer questions about:

• 🔬 Cognitive Neuroscience
• 🧬 Computational Neuroscience
• 🧪 Foundations of Neuroscience
• 🎓 Graduate-level neuroscience concepts

Training Details

Parameter	Value
Base Model	Llama 3.1 8B
Training Method	QLoRA (4-bit)
LoRA Rank	64
Training Data	8,200+ Q&A pairs
Epochs	~2
Hardware	NVIDIA A100
Framework	Unsloth + HuggingFace TRL

Training Data Sources

The model was trained on Q&A pairs generated from:

• Computational Exploration in Cognitive Neuroscience
• Foundations of Neuroscience
• The Cognitive Neurosciences (Gazzaniga)

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("VickyK09/neuronerd-llama-8b")
tokenizer = AutoTokenizer.from_pretrained("VickyK09/neuronerd-llama-8b")

# Format your prompt
prompt = """Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
What is the role of dopamine in reward learning?

### Response:
"""

inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Example Q&A

Q: How do mirror neurons contribute to action understanding?

Mirror neurons fire both when an individual performs an action and when they observe someone else performing the same action. This dual activation pattern suggests they play a crucial role in understanding others' actions by internally simulating observed movements...

Limitations

• Specialized for neuroscience; may not perform well on general topics
• Based on textbook knowledge up to training data cutoff
• Should not be used for medical diagnosis or treatment decisions

License

This model is released under the Llama 3.1 Community License.

Citation

@misc{neuronerd2024,
  author = {VickyK09},
  title = {NeuroNerd: A Fine-tuned Llama 3.1 8B for Neuroscience},
  year = {2024},
  publisher = {HuggingFace},
  url = {https://huggingface.co/VickyK09/neuronerd-llama-8b}
}

---

Built with ❤️ using Unsloth