Training in progress, step 4000

README.md

@@ -1,6 +1,6 @@
 ---
-library_name: transformers
-tags: []
+base_model: unsloth/SmolLM-135M
+library_name: peft
 ---
 
 # Model Card for Model ID
@@ -15,7 +15,7 @@ tags: []
 
 <!-- Provide a longer summary of what this model is. -->
 
-This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
+
 
 - **Developed by:** [More Information Needed]
 - **Funded by [optional]:** [More Information Needed]
@@ -196,4 +196,7 @@ Carbon emissions can be estimated using the [Machine Learning Impact calculator]
 
 ## Model Card Contact
 
-[More Information Needed]
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.13.2

adapter_config.json

@@ -22,13 +22,13 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "o_proj",
     "v_proj",
+    "up_proj",
     "gate_proj",
+    "k_proj",
     "q_proj",
-    "up_proj",
-    "down_proj",
-    "k_proj"
+    "o_proj",
+    "down_proj"
   ],
   "task_type": "CAUSAL_LM",
   "use_dora": false,

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:60396561e2066e685f3dbf98981735c15e7259329d5f068a637f3a5277bb5b0c
+oid sha256:44523851c9fcfd687885b5ce7eaa0ef54ecd71703c0a3d385d08647c13e8538d
 size 212982848

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:131ba73693cdc939eaa871a80bb14930fe7bb7a7f377478f9056e5e62b4d6ac4
+oid sha256:4de8c82b3a1eb8557fc65c97f260c3a594685bcf8ee4b1039657d52e3136a0ec
 size 7096