Transformers
Safetensors
unsloth
File size: 2,292 Bytes
346c833
 
9e53e80
 
1828ca5
 
346c833
f3150d2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
346c833
7a4c3f0
346c833
1828ca5
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
---
library_name: transformers
tags:
- unsloth
datasets:
- amityco/tau-bench-retail-train-next-action-medium
---
```

tau train medium 100 sample

β”‚ πŸ† Average Reward: 0.5175                                                                                                                    β”‚
β”‚                                                                                                                                              β”‚
β”‚ πŸ“ˆ Pass^k Metrics:                                                                                                                           β”‚
β”‚ k=1: 0.518                                                                                                                                   β”‚
β”‚ k=2: 0.421

tau train medium 200 sample

β”‚ πŸ† Average Reward: 0.5526                                                                                                                    β”‚
β”‚                                                                                                                                              β”‚
β”‚ πŸ“ˆ Pass^k Metrics:                                                                                                                           β”‚
β”‚ k=1: 0.553                                                                                                                                   β”‚
β”‚ k=2: 0.482   

tau train medium 300 sample

β”‚ πŸ† Average Reward: 0.5175                                                                                                                    β”‚
β”‚                                                                                                                                              β”‚
β”‚ πŸ“ˆ Pass^k Metrics:                                                                                                                           β”‚
β”‚ k=1: 0.518                                                                                                                                   β”‚
β”‚ k=2: 0.421  
```

![image](https://cdn-uploads.huggingface.co/production/uploads/64739bc371f07ae738d2d61d/-efahsrelKuAcCpzzGrtv.png)

![image](https://cdn-uploads.huggingface.co/production/uploads/64739bc371f07ae738d2d61d/ecldtyxoLdRyUkhwSpdUg.png)