Update README.md

README.md

@@ -5,115 +5,100 @@ datasets:
 language:
 - en
 base_model:
-- mistralai/Mistral-8x7B
+- mistralai/Pixtral-12B-Base-2409
 tags:
-- transfer-orbits
+- mistral
+- pixtral
+- vlm
+- multimodal
+- image-text-to-text
+- orbital-mechanics
 - hohmann-transfer-orbits
-- text-generation-inference
-- transformers
 ---
-
-# Mistral 7B Fine-Tuned on Titan-Hohmann-Transfer-Orbit Dataset
-
-## Model Card
-
-### Model Overview
-
-**Model Name**: `mistral-7b-titan-hohmann`  
-**Model Type**: Transformer-based language model  
-**Languages**: English  
-**License**: MIT
-
-This model is based on the **Mistral-8x7B** foundation model and is being fine tuned on the **titan-hohmann-transfer-orbit** dataset. It is designed to assist with advanced orbital calculations, specifically focusing on space probe Hohmann transfer orbits, and includes support for native function calling and multimodal inputs.
-
----
-
-### Model Details
-
-- **Developers**: A Taylor
-- **Model Architecture**: Transformer based with enhancements for code generation and multimodal processing
-- **Parameters**: 7 Billion
-- **Native Function Calling**: Supported
-- **Multimodal Capabilities**: Text and Image processing
-
----
-
-### Intended Use
-
-- **Primary Applications**:
-  - Assist aerospace engineers with calculations related to Hohmann transfer orbits
-  - Facilitate research by offering computational assistance in orbital dynamics
-- **Usage Scenarios**:
-  - Calculating delta-v requirements
-  - Estimating transfer times between celestial bodies
-  - Visualizing orbital trajectories
-
----
-
-### Training Data
-
-- **Dataset Name**: `titan-hohmann-transfer-orbit`
-- **Description**: A specialized dataset containing textual explanations, code snippets, and diagrams related to probe orbital mechanics and Hohmann transfer orbits.
-- **Data Modalities**:
-  - **Text**: Technical documentation and literature on orbital mechanics
-  - **Code**: Sample code for orbital calculations and simulations
-  - **Images**: Diagrams illustrating probe orbital paths and spacecraft maneuvers
-
+language:
+- en
+license: mit
+library_name: transformers
+pipeline_tag: image-text-to-text
+base_model: mistralai/Pixtral-12B-Base-2409
+datasets:
+- Taylor658/titan-hohmann-transfer-orbit
 ---
 
-### Training Procedure
+# Pixtral 12B Fine-Tuned on Titan-Hohmann-Transfer-Orbit
 
-The model is currently being fine tuned to enhance its capabilities in handling advanced orbital calculations and multimodal inputs. Future enhancements will include:
+> Updated to the latest suitable Mistral multimodal base: `mistralai/Pixtral-12B-Base-2409`.
 
-1. **Multimodal Processing**: Enabling the model to interpret and generate both text and image data related to orbital mechanics.
-2. **Native Function Calling**: Integrating the ability to execute predefined computational functions within responses for accurate and dynamic calculations.
-3. **Domain-Specific Fine-Tuning**: Refining the model's parameters with the titan-hohmann-transfer-orbit dataset to enhance accuracy and expertise in calculating Hohmann transfer trajectories.
-4. **Validation and Testing**: Verifying the model outputs against industry standards and benchmarks to ensure precision and reliability in aerospace applications.
+## Overview
 
----
+Fine-tuned variant of Pixtral 12B for orbital mechanics with emphasis on Hohmann transfer orbits. Supports multimodal (image + text) inputs and text outputs.
 
-### How to Use
+## Model Details
 
-- **Input Format**:
+- Base: `mistralai/Pixtral-12B-Base-2409`
+- Type: Multimodal (Vision + Text)
+- Params: ~12B (decoder) + vision encoder
+- Languages: English
+- License: MIT
 
-- **Examples**:
+## Intended Use
 
- 
----
+- Hohmann transfer ∆v estimation
+- Transfer-time approximations
+- Orbit analysis aids and reasoning
 
-### Limitations
+## Quickstart
 
-- **Work in Progress**: The model is currently being fine-tuned; performance may improve over time. 
-- **Domain Specificity**: Optimized for Hohman transfer orbits.
-- **Computational Resources**: Requires adequate computational power for optimal performance due to model size and complexity.
+### vLLM (multimodal)
+```python
+from vllm import LLM
+from vllm.sampling_params import SamplingParams
 
----
+llm = LLM(model="mistralai/Pixtral-12B-Base-2409", tokenizer_mode="mistral")
+sampling = SamplingParams(max_tokens=512, temperature=0.2)
 
-### Ethical Considerations
+messages = [
+    {
+        "role": "user",
+        "content": [
+            {"type": "text", "text": "Given this diagram, estimate the delta-v for a Hohmann transfer to Titan."},
+            {"type": "image_url", "image_url": {"url": "https://example.com/orbit_diagram.png"}}
+        ]
+    }
+]
+resp = llm.chat(messages, sampling_params=sampling)
+print(resp[0].outputs[0].text)
+```
 
-- **Accuracy**: Users should verify critical calculations independently.
-- **Professional Use**: Intended to assist professionals; not a substitute for expert judgment.
+### Transformers (text-only demo)
+```python
+from transformers import AutoModelForCausalLM, AutoTokenizer
+import torch
 
----
+model_id = "mistralai/Pixtral-12B-Base-2409"
+tok = AutoTokenizer.from_pretrained(model_id)
+model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype="auto", device_map="auto")
 
-### Acknowledgements
+prompt = "Compute approximate delta-v for a Hohmann transfer to Titan. State assumptions."
+inputs = tok(prompt, return_tensors="pt").to(model.device)
+out = model.generate(**inputs, max_new_tokens=512, temperature=0.2)
+print(tok.decode(out[0], skip_special_tokens=True))
+```
 
-- **Mistral AI**: For providing the Mistral 8B foundation model.
-- **Dataset Contributors**: A Taylor
-- **Open-Source Community**: Appreciation for the tools and libraries that made this project possible.
+## Training Data
 
----
-
-### License
+- Dataset: `Taylor658/titan-hohmann-transfer-orbit`
+- Modalities: text (explanations), code (snippets), images (orbital diagrams)
 
-- **Model License**: MIT
-- **Dataset License**: MIT
+## Limitations
 
-### Future Work
+- Optimized for Hohmann transfers and related reasoning
+- Requires sufficient GPU VRAM for best throughput
 
-- **Next Version**: Calculations for mineral rich asteroids within the Van Allen belt, and other natural satellites beyond it, including significant inclination adjustments, will be included in version 2.0
+## Acknowledgements
 
----
+- Base model by Mistral AI (Pixtral 12B)
+- Dataset by A Taylor
 
 ### Contact Information