Wwayu commited on
Commit
133d3d5
·
verified ·
1 Parent(s): f714f0e

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +134 -0
README.md ADDED
@@ -0,0 +1,134 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ pipeline_tag: text-generation
5
+ base_model: Jinx-org/Jinx-Qwen3-30B-A3B-Thinking-2507
6
+ tags:
7
+ - vllm
8
+ - mlx
9
+ - mlx-my-repo
10
+ extra_gated_heading: You need to read and agree to the Disclaimer and User Agreementa
11
+ to access this model.
12
+ extra_gated_description: '
13
+
14
+ ## Disclaimer and User Agreement
15
+
16
+
17
+ 1. Introduction
18
+
19
+ Thank you for your interest in accessing this model (“the Model”).
20
+
21
+ Before you access, download, or use the Model or any derivative works, please read
22
+ and understand this Disclaimer and User Agreement (“Agreement”).
23
+
24
+
25
+ By checking “I have read and agree” and accessing the Model, you acknowledge that
26
+ you have read, understood, and agreed to all terms of this Agreement.
27
+
28
+ If you do not agree with any part of this Agreement, do not request or use the Model.
29
+
30
+
31
+ 2. Nature of the Model & Risk Notice
32
+
33
+ The Model is trained using large-scale machine learning techniques and may generate
34
+ inaccurate, false, offensive, violent, sexual, discriminatory, politically sensitive,
35
+ or otherwise uncontrolled content.
36
+
37
+
38
+ The Model does not guarantee the accuracy, completeness, or legality of any generated
39
+ content. You must independently evaluate and verify the outputs, and you assume
40
+ all risks arising from their use.
41
+
42
+
43
+ The Model may reflect biases or errors present in its training data, potentially
44
+ producing inappropriate or controversial outputs.
45
+
46
+
47
+ 3. License and Permitted Use
48
+
49
+ You may use the Model solely for lawful, compliant, and non-malicious purposes in
50
+ research, learning, experimentation, and development, in accordance with applicable
51
+ laws and regulations.
52
+
53
+
54
+ You must not use the Model for activities including, but not limited to:
55
+
56
+
57
+ Creating, distributing, or promoting unlawful, violent, pornographic, terrorist,
58
+ discriminatory, defamatory, or privacy-invasive content;
59
+
60
+
61
+ Any activity that could cause significant negative impact on individuals, groups,
62
+ organizations, or society;
63
+
64
+
65
+ High-risk applications such as automated decision-making, medical diagnosis, financial
66
+ transactions, or legal advice without proper validation and human oversight.
67
+
68
+
69
+ You must not remove, alter, or circumvent any safety mechanisms implemented in the
70
+ Model.
71
+
72
+
73
+ 4. Data and Privacy
74
+
75
+ You are solely responsible for any data processed or generated when using the Model,
76
+ including compliance with data protection and privacy regulations.
77
+
78
+
79
+ The Model’s authors and contributors make no guarantees or warranties regarding
80
+ data security or privacy.
81
+
82
+
83
+ 5. Limitation of Liability
84
+
85
+ To the maximum extent permitted by applicable law, the authors, contributors, and
86
+ their affiliated institutions shall not be liable for any direct, indirect, incidental,
87
+ or consequential damages arising from the use of the Model.
88
+
89
+
90
+ You agree to bear full legal responsibility for any disputes, claims, or litigation
91
+ arising from your use of the Model, and you release the authors and contributors
92
+ from any related liability.
93
+
94
+
95
+ 6. Updates and Termination
96
+
97
+ This Agreement may be updated at any time, with updates posted on the Model’s page
98
+ and effective immediately upon publication.
99
+
100
+
101
+ If you violate this Agreement, the authors reserve the right to revoke your access
102
+ to the Model at any time.
103
+
104
+
105
+ I have read and fully understand this Disclaimer and User Agreement, and I accept
106
+ full responsibility for any consequences arising from my use of the Model.'
107
+ extra_gated_button_content: I've read and agree
108
+ ---
109
+
110
+ # Wwayu/Jinx-Qwen3-30B-A3B-Thinking-2507-mlx-6Bit
111
+
112
+ The Model [Wwayu/Jinx-Qwen3-30B-A3B-Thinking-2507-mlx-6Bit](https://huggingface.co/Wwayu/Jinx-Qwen3-30B-A3B-Thinking-2507-mlx-6Bit) was converted to MLX format from [Jinx-org/Jinx-Qwen3-30B-A3B-Thinking-2507](https://huggingface.co/Jinx-org/Jinx-Qwen3-30B-A3B-Thinking-2507) using mlx-lm version **0.28.2**.
113
+
114
+ ## Use with mlx
115
+
116
+ ```bash
117
+ pip install mlx-lm
118
+ ```
119
+
120
+ ```python
121
+ from mlx_lm import load, generate
122
+
123
+ model, tokenizer = load("Wwayu/Jinx-Qwen3-30B-A3B-Thinking-2507-mlx-6Bit")
124
+
125
+ prompt="hello"
126
+
127
+ if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
128
+ messages = [{"role": "user", "content": prompt}]
129
+ prompt = tokenizer.apply_chat_template(
130
+ messages, tokenize=False, add_generation_prompt=True
131
+ )
132
+
133
+ response = generate(model, tokenizer, prompt=prompt, verbose=True)
134
+ ```