Mr-FineTuner/Phi-3-medium-4k-instruct_2Epoch_ReductedPrompt

https://wandb.ai/deeplearningeasy/huggingface/runs/6ml0feyz

Step Training Loss Validation Loss 200 1.561500 1.490062 400 1.470900 1.431148 600 1.382600 1.419917 800 1.405300 1.401644 1000 1.387700 1.400626 1200 1.330400 1.404202 1400 1.294500 1.400807

Evaluation results: {'eval_loss': 1.4006257057189941, 'eval_runtime': 136.1083, 'eval_samples_per_second': 20.072, 'eval_steps_per_second': 5.018, 'epoch': 0.780161604903873}

=== Sample Generation ===

--- Example 1 --- [Prompt]: <|user|> Generate a CEFR A1 level sentence.<|end|> [Generated]: Generate a CEFR A1 level sentence. The movie was released on DVD on 15 October 2013 . [Expected]: Do you need something to eat ?

--- Example 2 --- [Prompt]: <|user|> Generate a CEFR A1 level sentence.<|end|> [Generated]: Generate a CEFR A1 level sentence. The movie was released on DVD on 15 October 2013 . [Expected]: Do you need something to eat ?

--- Example 3 --- [Prompt]: <|user|> Generate a CEFR A1 level sentence.<|end|> [Generated]: Generate a CEFR A1 level sentence. The movie was released on DVD on 15 October 2013 . [Expected]: I have two fish in a bowl .

--- Example 4 --- [Prompt]: <|user|> Generate a CEFR A1 level sentence.<|end|> [Generated]: Generate a CEFR A1 level sentence. The movie was released on DVD on 15 October 2013 . [Expected]: I have two fish in a bowl .

--- Example 5 --- [Prompt]: <|user|> Generate a CEFR A1 level sentence.<|end|> [Generated]: Generate a CEFR A1 level sentence. The movie was released on DVD on 15 October 2013 . [Expected]: She wanted the grey coat .

Phi-3 CEFR Fine-tuned Model

Fine-tuned for CEFR level classification with:

• Epochs: 2
• Learning rate: 2e-5
• LoRA rank: 32