Modelpublic

iheallab/Clin-REACT-14B

sourceHugging Faceotherupdated 2mo agoView on Hugging Face

0likes48downloads

Model Card

Clin-REACT-14B

Model name in the manuscript: Clin-REACT 14B Base model: baichuan-inc/Baichuan-M1-14B-Instruct Release format: merged full-parameter checkpoint

Clin-REACT is a family of large language models fine-tuned for clinical reasoning using the ICU-REACT framework. The models are designed to reason over clinically relevant information and produce responses for tasks spanning ICU decision-making and broader clinical-reasoning benchmarks.

This repository contains the merged, self-contained checkpoint. The LoRA adapter used during supervised fine-tuning has been merged into the corresponding base-model weights for distribution and inference.

Benchmark results

Clin-REACT 14B is compared with its Baichuan-M1-14B-Instruct backbone and selected larger open general-purpose and medical models.

Scores below are the mean primary benchmark scores, reported as percentages. Higher is better. The macro average is the unweighted mean of the five benchmark primary scores. Bold indicates the best result within the comparison set shown for each benchmark.

The benchmarks contain 71 ICU-REACT cases, 174 SCT-Bench cases, 72 ER-Reason cases, 1,254 MedRBench cases, and 934 VivaBench cases. Because the benchmarks use different task formulations and primary scoring procedures, individual benchmark scores should primarily be interpreted within each benchmark.

Model	ICU-REACT (n=71)	SCT-Bench (n=174)	ER-Reason (n=72)	MedRBench (n=1254)	VivaBench (n=934)	Macro avg.
Clin-REACT 14B	41.6	60.9	44.6	47.9	27.3	44.5
Baichuan-M1-14B-Instruct	34.2	57.6	37.2	44.2	25.5	39.7
GPT-OSS-20B	36.2	67.5	44.8	40.6	21.6	42.1
Gemma 3 27B IT	36.4	60.8	47.4	38.3	22.8	41.1
MedGemma 27B	36.9	63.1	48.6	35.0	19.5	40.6

Installation

bash

pip install -U torch transformers accelerate

Load and use the model

Baichuan-M1 uses custom Transformers code, so trust_remote_code=True is required when loading the merged checkpoint.

python

import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

MODEL_ID = "macontreras98/Clin-REACT-14B"

tokenizer = AutoTokenizer.from_pretrained(
    MODEL_ID,
    trust_remote_code=True,
)

model = AutoModelForCausalLM.from_pretrained(
    MODEL_ID,
    trust_remote_code=True,
    torch_dtype=torch.bfloat16,
    device_map="auto",
)

# Example ICU-REACT-style clinical reasoning sample
messages = [
    {
        "role": "system",
        "content": (
            "You are an ICU clinician. Write one coherent paragraph explaining "
            "which variables are most relevant to the decision and why."
        ),
    },
    {
        "role": "user",
        "content": (
            "Patient context: 75-year-old female ICU patient with recurrent high "
            "fevers and no clear infection source.\n\n"
            "Decision question: Is the frequency and severity of fever in this "
            "patient worrisome for ongoing infection or non-infectious etiology?"
        ),
    },
]

text = tokenizer.apply_chat_template(
    messages,
    tokenize=False,
    add_generation_prompt=True,
)

inputs = tokenizer(
    text,
    return_tensors="pt",
).to(model.device)

with torch.inference_mode():
    outputs = model.generate(
        **inputs,
        max_new_tokens=512,
        do_sample=False,
    )

generated_tokens = outputs[0][inputs["input_ids"].shape[-1]:]
response = tokenizer.decode(
    generated_tokens,
    skip_special_tokens=True,
)

print(response)

For exact benchmark reproduction, use the same prompting, chat template, preprocessing, and decoding configuration used in the ICU-REACT evaluation pipeline.

Intended use and limitations

Clin-REACT is released for research on clinical reasoning and medical AI. It is not a medical device and should not be used as a substitute for professional clinical judgment, diagnosis, treatment decisions, or other autonomous patient-care decisions.

Benchmark performance does not establish clinical safety, prospective effectiveness, or suitability for deployment. Users are responsible for evaluating the model for their own setting and for complying with applicable privacy, security, institutional, and regulatory requirements.

License

Clin-REACT-14B is a fine-tuned derivative of baichuan-inc/Baichuan-M1-14B-Instruct and remains subject to the applicable Baichuan-M1-14B Community License and upstream terms. Users should review the upstream license before redistribution or commercial use.

Citation

If you use Clin-REACT in your research, please cite the associated ICU-REACT / Clin-REACT manuscript.

bibtex

@article{contreras2026icureact,
  title   = {Teaching LLMs How ICU Physicians Approach Clinical Reasoning Through OMOP-Aligned Retrieval Improves Reasoning Across Clinical Domains},
  author  = {Contreras, Miguel and Siegel, Scott and Nerella, Subhash and Sena, Jessica and Zhang, Jiaqing and
             Sun, Heng and Akkaladevi, Hruday Tej and Lu, Peiyu and Rosen, Jordan and Kapoor, Sumit and
             Desaraju, Sasank and Thompson, Grace R. and Purcell, Jacob and Petrauskis, Michael and
             Hong, Philip KW and Brennan, Meghan and Chrabaszcz, Sarah and Smith, Tierra and Ren, Ronnie and
             Kabbash, Michel S. and Haziroglu, Ceyhun and Patel, Rushi and Gomez, Gabriel and Chaiklin, Charlotte and
             Leung, Randy and John, Kenneth N. and Wiggins, Whitman and Kayser, Philip and Bird, Vincent and
             Bruzzone, Maria and Loftus, Tyler J. and Bihorac, Azra and Rashidi, Parisa},
  journal = {arXiv preprint arXiv:2608.22622},
  year    = {2026},
  doi     = {10.48550/arXiv.2608.22622},
  url     = {https://arxiv.org/abs/2608.22622}
}