Team Ai
Modelpublic

Yaongi/HybriKo-117M-LinuxFC-SFT

sourceHugging Faceapache-2.0updated 9mo agoView on Hugging Face
3likes2downloads
Model Card

HybriKo-117M-LinuxFC-SFT

HybriKo-117M 모델을 리눅스 명령어 함수 호출(Linux Command Function Calling) 데이터셋으로 SFT 학습한 모델입니다.

Model Description

항목값
Base ModelHybriKo-117M (Griffin-style Hybrid RNN-Attention)
Parameters117.8M
Architecture2:1 RNN-to-Attention ratio (Griffin layers)
Max Seq Length6144
Best Epoch20 (Eval Loss: 0.0502, PPL: 1.05)

Supported Linux Tools (21개)

ls, cd, mkdir, rm, cp, mv, find, cat, grep,
head, tail, wc, ps, df, du, top, ping, curl,
chmod, tar, Finish

Usage

python
import torch
import sentencepiece as spm
from hybridko.model import HybriKoModel, HybriKoConfig

# Load tokenizer
sp = spm.SentencePieceProcessor()
sp.Load("HybriKo_tok.model")

# Load model
config = HybriKoConfig(
    d_model=768,
    n_layers=12,
    vocab_size=32000,
    n_heads=12,
    n_kv_heads=3,
    ff_mult=3,
    max_seq_len=6144,
    dropout=0.0
)
model = HybriKoModel(config)

checkpoint = torch.load("pytorch_model.pt", map_location="cpu")
state_dict = checkpoint.get("model_state_dict", checkpoint)
model.load_state_dict(state_dict, strict=False)
model.eval()

# Example prompt (ChatML format)
prompt = """<|im_start|>system
You are an AI assistant that helps users execute Linux commands.
<|im_end|>
<|im_start|>user
현재 폴더의 파일 목록을 보여줘
<|im_end|>
<|im_start|>assistant
"""

# Generate
input_ids = torch.tensor([sp.EncodeAsIds(prompt)])
with torch.no_grad():
    output = model.generate(input_ids, max_new_tokens=256)
print(sp.DecodeIds(output[0].tolist()))

Training Details

  • —Dataset: 250 training samples, 50 eval samples
  • —Effective Batch Size: 32 (1 × 8 GPUs × 4 accum)
  • —Learning Rate: 5e-5
  • —Hardware: NVIDIA A100 × 8

Training Curve (10-epoch intervals)

EpochTrain LossEval LossPPL
100.86490.23461.26
200.09680.05021.05
300.03950.05171.05
400.02490.05401.06
500.01620.05491.06

Citation

bibtex
@misc{hybridko-linuxfc-2026,
  title={HybriKo-117M-LinuxFC-SFT: Linux Command Function Calling Model},
  author={Yaongi},
  year={2026},
  url={https://huggingface.co/Yaongi/HybriKo-117M-LinuxFC-SFT}
}

License

Apache 2.0