AppleNote/model_output

1---2library_name: transformers3license: apache-2.04base_model: beomi/kcbert-base5tags:6- generated_from_trainer7model-index:8- name: model_output9  results: []10---11 12<!-- This model card has been generated automatically according to the information the Trainer had access to. You13should probably proofread and complete it, then remove this comment. -->14 15# model_output16 17This model is a fine-tuned version of [beomi/kcbert-base](https://huggingface.co/beomi/kcbert-base) on an unknown dataset.18It achieves the following results on the evaluation set:19- Loss: 0.162020- Lrap: 0.856121 22## Model description23 24More information needed25 26## Intended uses & limitations27 28More information needed29 30## Training and evaluation data31 32More information needed33 34## Training procedure35 36### Training hyperparameters37 38The following hyperparameters were used during training:39- learning_rate: 2e-0540- train_batch_size: 12841- eval_batch_size: 12842- seed: 4243- optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments44- lr_scheduler_type: linear45- num_epochs: 246 47### Training results48 49| Training Loss | Epoch | Step | Validation Loss | Lrap   |50|:-------------:|:-----:|:----:|:---------------:|:------:|51| No log        | 1.0   | 118  | 0.1882          | 0.8315 |52| No log        | 2.0   | 236  | 0.1620          | 0.8561 |53 54 55### Framework versions56 57- Transformers 5.10.258- Pytorch 2.11.0+cu12859- Datasets 4.0.060- Tokenizers 0.22.261