Team Ai
Modelpublic

vininhosts/gemma3-12b-engineering

sourceHugging Facegemmaupdated 7mo agoView on Hugging Face
0likes18downloads
Model Card

gemma3-12b-engineering

A fine-tuned version of Gemma 3 12B IT specialized for aerospace engineering, thermodynamics, advanced mathematics, coding, finance, and 6 additional engineering disciplines.

Model Details

  • —Base model: google/gemma-3-12b-it (4-bit quantized via MLX)
  • —Fine-tuning method: QLoRA (MLX/LoRA) — 4 sequential training passes
  • —Format: MLX 4-bit quantized safetensors (~6.7 GB)
  • —Hardware: Apple MacBook Air M4 16GB

Training Summary

PassDatasetExamplesBest Val Loss
v2 domainMetaMathQA, Open-Platypus, OpenHermes STEM, ArXiv QA, SciQ, WikiText, WikiQA, CAMEL Physics/Math, CodeAlpaca, Finance~56K0.617
CoT reasoningnvidia/OpenMathReasoning, Open-Platypus CoT, MetaMathQA CoT, handcrafted aerospace~11K0.439
PrecisionHandcrafted aerospace/thermo — correct R=8314/M derivation (never R=287 for custom propellants)~600.620
v3 comprehensive6 new engineering domains + NuminaMath-CoT, Magicoder, Finance-Alpaca, OpenHermes STEM, CodeFeedback23,8500.689

LoRA config: rank=16, alpha=32, loralayers=4, keys=[qproj, v_proj], LR=2e-6

Capabilities

  • —Aerospace: Isentropic flow, normal shocks, Brayton/Rankine cycles, rocket nozzles, Hohmann transfers
  • —Thermodynamics: Carnot, heat exchangers, entropy, propellant property derivation
  • —Signals & Systems: Laplace transforms, Bode plots, Z-transforms, Fourier series, stability, RC filters, sampling
  • —Statics: Equilibrium, beam reactions, trusses, centroids, moments of inertia, friction, frames
  • —Dynamics: Kinematics, Newton's 2nd law, work-energy, impulse-momentum, rotation, vibrations
  • —Mechanics of Materials: Axial stress, torsion, bending, Mohr's circle, Euler buckling, thermal stress, deflection
  • —Controls: Routh-Hurwitz, PID design, state-space, root locus, steady-state error, block diagrams, time specs
  • —Manufacturing: Turning/milling, Taylor tool life, tolerances, Chvorinov's rule, grinding, machining time
  • —Mathematics: ODEs, linear algebra, RK4, Newton-Raphson, induction proofs, competition-level math
  • —Coding: Python, C++, Java, JavaScript, numerical solvers
  • —Finance: Black-Scholes, NPV, DCF, engineering economics, portfolio theory

Chain-of-Thought Reasoning

Activate step-by-step reasoning with this system prompt:

You are an expert aerospace engineer. Always reason step by step inside <think> tags before giving your final answer.

Usage (MLX on Apple Silicon)

python
from mlx_lm import load, generate

model, tokenizer = load("vininhosts/gemma3-12b-engineering")

prompt = "A rocket nozzle has Pc=2MPa, Tc=3000K, exit Mach=3, propellant M=20g/mol, gamma=1.3. Find exit pressure."
response = generate(model, tokenizer, prompt=prompt, max_tokens=1024)
print(response)

Key Precision: R = 8314 / M

This model correctly computes the specific gas constant from molar mass as R = 8314 / M, and never defaults to R = 287 J/(kg·K) (air) when a different propellant molar mass is given. This was enforced via a dedicated precision fine-tuning pass with 60+ handcrafted examples.

Example Domains Covered

  • —Isentropic nozzle flow and normal shock relations
  • —Brayton cycle thermal efficiency and compressor work
  • —PID controller tuning and Routh-Hurwitz stability
  • —Beam deflection and Mohr's circle stress analysis
  • —Z-transform and discrete-time system stability
  • —Taylor tool life equation and machining parameters
  • —Black-Scholes option pricing and DCF valuation

License

Derived from Gemma 3 — subject to Gemma Terms of Use.