Modelpublic

MayBashendy/Arabic_CrossPrompt_FineTuningAraBERT_noAug_TestTask5_development

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes8downloads

Model Card

ArabicCrossPromptFineTuningAraBERTnoAugTestTask5_development

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

—Loss: 0.7245
—Qwk: 0.3105
—Mse: 0.7245
—Rmse: 0.8512

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

—learning_rate: 2e-05
—trainbatchsize: 8
—evalbatchsize: 8
—seed: 42
—optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
—lrschedulertype: linear
—num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0198	2	3.7605	-0.0067	3.7605	1.9392
No log	0.0396	4	2.8011	0.0565	2.8011	1.6736
No log	0.0594	6	1.3344	0.0631	1.3344	1.1551
No log	0.0792	8	0.8512	0.0282	0.8512	0.9226
No log	0.0990	10	0.7192	0.1352	0.7192	0.8481
No log	0.1188	12	0.8331	0.0430	0.8331	0.9127
No log	0.1386	14	0.8840	0.0271	0.8840	0.9402
No log	0.1584	16	0.8207	0.0977	0.8207	0.9059
No log	0.1782	18	0.6957	0.1803	0.6957	0.8341
No log	0.1980	20	0.6125	0.2963	0.6125	0.7826
No log	0.2178	22	0.5972	0.3619	0.5972	0.7728
No log	0.2376	24	0.5931	0.3692	0.5931	0.7701
No log	0.2574	26	0.5902	0.3582	0.5902	0.7683
No log	0.2772	28	0.6011	0.3003	0.6011	0.7753
No log	0.2970	30	0.6363	0.2651	0.6363	0.7977
No log	0.3168	32	0.6449	0.2444	0.6449	0.8031
No log	0.3366	34	0.5643	0.3763	0.5643	0.7512
No log	0.3564	36	0.5844	0.4751	0.5844	0.7645
No log	0.3762	38	0.5590	0.4862	0.5590	0.7477
No log	0.3960	40	0.5536	0.5061	0.5536	0.7440
No log	0.4158	42	0.5922	0.4717	0.5922	0.7695
No log	0.4356	44	0.6937	0.4583	0.6937	0.8329
No log	0.4554	46	0.7036	0.4668	0.7036	0.8388
No log	0.4752	48	0.7354	0.3480	0.7354	0.8576
No log	0.4950	50	0.6405	0.3608	0.6405	0.8003
No log	0.5149	52	0.5102	0.4292	0.5102	0.7143
No log	0.5347	54	0.4952	0.4374	0.4952	0.7037
No log	0.5545	56	0.5736	0.3493	0.5736	0.7574
No log	0.5743	58	0.6521	0.2356	0.6521	0.8075
No log	0.5941	60	0.6310	0.2754	0.6310	0.7944
No log	0.6139	62	0.5271	0.3577	0.5271	0.7260
No log	0.6337	64	0.4680	0.4847	0.4680	0.6841
No log	0.6535	66	0.4714	0.4828	0.4714	0.6866
No log	0.6733	68	0.5387	0.4875	0.5387	0.7340
No log	0.6931	70	0.5428	0.4918	0.5428	0.7368
No log	0.7129	72	0.4751	0.5349	0.4751	0.6892
No log	0.7327	74	0.4681	0.5247	0.4681	0.6842
No log	0.7525	76	0.4498	0.5342	0.4498	0.6706
No log	0.7723	78	0.4825	0.4332	0.4825	0.6946
No log	0.7921	80	0.4921	0.4432	0.4921	0.7015
No log	0.8119	82	0.5618	0.4054	0.5618	0.7495
No log	0.8317	84	0.6938	0.2423	0.6938	0.8329
No log	0.8515	86	0.6828	0.2279	0.6828	0.8263
No log	0.8713	88	0.6146	0.2400	0.6146	0.7840
No log	0.8911	90	0.5385	0.3728	0.5385	0.7338
No log	0.9109	92	0.5151	0.4848	0.5151	0.7177
No log	0.9307	94	0.4932	0.5136	0.4932	0.7023
No log	0.9505	96	0.4805	0.4512	0.4805	0.6932
No log	0.9703	98	0.5936	0.2649	0.5936	0.7704
No log	0.9901	100	0.6885	0.3259	0.6885	0.8298
No log	1.0099	102	0.7979	0.2878	0.7979	0.8932
No log	1.0297	104	0.7656	0.2974	0.7656	0.8750
No log	1.0495	106	0.6099	0.3885	0.6099	0.7809
No log	1.0693	108	0.4973	0.4407	0.4973	0.7052
No log	1.0891	110	0.4892	0.4195	0.4892	0.6994
No log	1.1089	112	0.5174	0.4398	0.5174	0.7193
No log	1.1287	114	0.6280	0.3519	0.6280	0.7925
No log	1.1485	116	0.7064	0.3029	0.7064	0.8405
No log	1.1683	118	0.7294	0.2953	0.7294	0.8541
No log	1.1881	120	0.6667	0.3768	0.6667	0.8165
No log	1.2079	122	0.5777	0.4478	0.5777	0.7601
No log	1.2277	124	0.4983	0.5306	0.4983	0.7059
No log	1.2475	126	0.4913	0.5433	0.4913	0.7009
No log	1.2673	128	0.5557	0.5109	0.5557	0.7454
No log	1.2871	130	0.6744	0.4407	0.6744	0.8212
No log	1.3069	132	0.6969	0.4177	0.6969	0.8348
No log	1.3267	134	0.6493	0.4307	0.6493	0.8058
No log	1.3465	136	0.6172	0.4142	0.6172	0.7856
No log	1.3663	138	0.5356	0.5170	0.5356	0.7318
No log	1.3861	140	0.5252	0.5816	0.5252	0.7247
No log	1.4059	142	0.5504	0.5412	0.5504	0.7419
No log	1.4257	144	0.5542	0.5179	0.5542	0.7444
No log	1.4455	146	0.5213	0.5134	0.5213	0.7220
No log	1.4653	148	0.5340	0.4352	0.5340	0.7307
No log	1.4851	150	0.5923	0.4012	0.5923	0.7696
No log	1.5050	152	0.5732	0.4007	0.5732	0.7571
No log	1.5248	154	0.5631	0.3466	0.5631	0.7504
No log	1.5446	156	0.5107	0.3964	0.5107	0.7146
No log	1.5644	158	0.4817	0.4400	0.4817	0.6940
No log	1.5842	160	0.4540	0.4816	0.4540	0.6738
No log	1.6040	162	0.4530	0.4812	0.4530	0.6730
No log	1.6238	164	0.4567	0.4801	0.4567	0.6758
No log	1.6436	166	0.4917	0.4556	0.4917	0.7012
No log	1.6634	168	0.5512	0.3964	0.5512	0.7424
No log	1.6832	170	0.5656	0.3859	0.5656	0.7521
No log	1.7030	172	0.5109	0.4484	0.5109	0.7148
No log	1.7228	174	0.4603	0.4713	0.4603	0.6784
No log	1.7426	176	0.4735	0.5088	0.4735	0.6881
No log	1.7624	178	0.4627	0.4798	0.4627	0.6802
No log	1.7822	180	0.5659	0.3922	0.5659	0.7523
No log	1.8020	182	0.6706	0.3399	0.6706	0.8189
No log	1.8218	184	0.6763	0.3237	0.6763	0.8224
No log	1.8416	186	0.6173	0.3578	0.6173	0.7857
No log	1.8614	188	0.5182	0.4200	0.5182	0.7199
No log	1.8812	190	0.4758	0.4675	0.4758	0.6898
No log	1.9010	192	0.4792	0.4841	0.4792	0.6923
No log	1.9208	194	0.5308	0.4743	0.5308	0.7285
No log	1.9406	196	0.5322	0.4548	0.5322	0.7295
No log	1.9604	198	0.5646	0.4816	0.5646	0.7514
No log	1.9802	200	0.6169	0.5112	0.6169	0.7854
No log	2.0	202	0.7013	0.4769	0.7013	0.8375
No log	2.0198	204	0.6028	0.4985	0.6028	0.7764
No log	2.0396	206	0.5873	0.5141	0.5873	0.7663
No log	2.0594	208	0.6611	0.4767	0.6611	0.8131
No log	2.0792	210	0.6622	0.4488	0.6622	0.8138
No log	2.0990	212	0.7040	0.3471	0.7040	0.8391
No log	2.1188	214	0.5945	0.3831	0.5945	0.7710
No log	2.1386	216	0.4957	0.4770	0.4957	0.7040
No log	2.1584	218	0.4748	0.5418	0.4748	0.6891
No log	2.1782	220	0.5029	0.4216	0.5029	0.7091
No log	2.1980	222	0.6301	0.3157	0.6301	0.7938
No log	2.2178	224	0.7521	0.2272	0.7521	0.8672
No log	2.2376	226	0.8176	0.3472	0.8176	0.9042
No log	2.2574	228	0.8492	0.3592	0.8492	0.9215
No log	2.2772	230	0.6807	0.3907	0.6807	0.8250
No log	2.2970	232	0.5219	0.4600	0.5219	0.7224
No log	2.3168	234	0.4768	0.4322	0.4768	0.6905
No log	2.3366	236	0.4723	0.4507	0.4723	0.6872
No log	2.3564	238	0.4830	0.4339	0.4830	0.6949
No log	2.3762	240	0.5101	0.3621	0.5101	0.7142
No log	2.3960	242	0.5289	0.3745	0.5289	0.7272
No log	2.4158	244	0.5172	0.3961	0.5172	0.7192
No log	2.4356	246	0.4877	0.4104	0.4877	0.6983
No log	2.4554	248	0.4449	0.4816	0.4449	0.6670
No log	2.4752	250	0.4183	0.5061	0.4183	0.6468
No log	2.4950	252	0.4268	0.5298	0.4268	0.6533
No log	2.5149	254	0.4426	0.5212	0.4426	0.6653
No log	2.5347	256	0.4536	0.5449	0.4536	0.6735
No log	2.5545	258	0.4669	0.5574	0.4669	0.6833
No log	2.5743	260	0.4610	0.5175	0.4610	0.6790
No log	2.5941	262	0.4562	0.5003	0.4562	0.6754
No log	2.6139	264	0.4061	0.5484	0.4061	0.6373
No log	2.6337	266	0.4019	0.6164	0.4019	0.6339
No log	2.6535	268	0.4296	0.6228	0.4296	0.6554
No log	2.6733	270	0.5077	0.5435	0.5077	0.7125
No log	2.6931	272	0.5201	0.4996	0.5201	0.7212
No log	2.7129	274	0.5027	0.5008	0.5027	0.7090
No log	2.7327	276	0.4196	0.5960	0.4196	0.6478
No log	2.7525	278	0.4501	0.6120	0.4501	0.6709
No log	2.7723	280	0.5441	0.5349	0.5441	0.7376
No log	2.7921	282	0.6648	0.4825	0.6648	0.8153
No log	2.8119	284	0.8039	0.4531	0.8039	0.8966
No log	2.8317	286	0.7183	0.4687	0.7183	0.8475
No log	2.8515	288	0.5073	0.5572	0.5073	0.7123
No log	2.8713	290	0.4173	0.5626	0.4173	0.6460
No log	2.8911	292	0.4065	0.5732	0.4065	0.6375
No log	2.9109	294	0.4110	0.5638	0.4110	0.6411
No log	2.9307	296	0.4248	0.5598	0.4248	0.6517
No log	2.9505	298	0.4838	0.5252	0.4838	0.6955
No log	2.9703	300	0.5482	0.4933	0.5482	0.7404
No log	2.9901	302	0.6601	0.4403	0.6601	0.8125
No log	3.0099	304	0.6911	0.3841	0.6911	0.8313
No log	3.0297	306	0.6035	0.4307	0.6035	0.7769
No log	3.0495	308	0.4462	0.5186	0.4462	0.6680
No log	3.0693	310	0.4178	0.5510	0.4178	0.6464
No log	3.0891	312	0.4303	0.5432	0.4303	0.6559
No log	3.1089	314	0.4668	0.4756	0.4668	0.6832
No log	3.1287	316	0.5005	0.4416	0.5005	0.7075
No log	3.1485	318	0.5076	0.4534	0.5076	0.7125
No log	3.1683	320	0.4601	0.4944	0.4601	0.6783
No log	3.1881	322	0.4482	0.5682	0.4482	0.6695
No log	3.2079	324	0.4573	0.5804	0.4573	0.6762
No log	3.2277	326	0.4351	0.6070	0.4351	0.6596
No log	3.2475	328	0.4466	0.5865	0.4466	0.6683
No log	3.2673	330	0.5302	0.5107	0.5302	0.7281
No log	3.2871	332	0.5540	0.4645	0.5540	0.7443
No log	3.3069	334	0.4564	0.5671	0.4564	0.6755
No log	3.3267	336	0.4192	0.6667	0.4192	0.6474
No log	3.3465	338	0.4269	0.6371	0.4269	0.6534
No log	3.3663	340	0.4199	0.6042	0.4199	0.6480
No log	3.3861	342	0.4786	0.5487	0.4786	0.6918
No log	3.4059	344	0.5462	0.4735	0.5462	0.7390
No log	3.4257	346	0.5562	0.4735	0.5562	0.7458
No log	3.4455	348	0.5499	0.5234	0.5499	0.7415
No log	3.4653	350	0.5564	0.5799	0.5564	0.7459
No log	3.4851	352	0.5679	0.5590	0.5679	0.7536
No log	3.5050	354	0.5635	0.5784	0.5635	0.7506
No log	3.5248	356	0.5990	0.5481	0.5990	0.7740
No log	3.5446	358	0.5921	0.4980	0.5921	0.7695
No log	3.5644	360	0.5060	0.5269	0.5060	0.7113
No log	3.5842	362	0.3829	0.6343	0.3829	0.6188
No log	3.6040	364	0.3898	0.6382	0.3898	0.6244
No log	3.6238	366	0.3971	0.6427	0.3971	0.6302
No log	3.6436	368	0.4461	0.5986	0.4461	0.6679
No log	3.6634	370	0.5536	0.5424	0.5536	0.7440
No log	3.6832	372	0.6867	0.4583	0.6867	0.8287
No log	3.7030	374	0.6940	0.4704	0.6940	0.8330
No log	3.7228	376	0.5833	0.5085	0.5833	0.7638
No log	3.7426	378	0.4504	0.5599	0.4504	0.6711
No log	3.7624	380	0.4758	0.5630	0.4758	0.6898
No log	3.7822	382	0.5093	0.5044	0.5093	0.7137
No log	3.8020	384	0.4695	0.5460	0.4695	0.6852
No log	3.8218	386	0.4592	0.5394	0.4592	0.6776
No log	3.8416	388	0.5287	0.4906	0.5287	0.7271
No log	3.8614	390	0.6134	0.4747	0.6134	0.7832
No log	3.8812	392	0.6210	0.4740	0.6210	0.7880
No log	3.9010	394	0.5508	0.5268	0.5508	0.7422
No log	3.9208	396	0.5396	0.5699	0.5396	0.7346
No log	3.9406	398	0.5154	0.5873	0.5154	0.7179
No log	3.9604	400	0.5190	0.4956	0.5190	0.7204
No log	3.9802	402	0.5421	0.4662	0.5421	0.7363
No log	4.0	404	0.6192	0.4446	0.6192	0.7869
No log	4.0198	406	0.7074	0.4461	0.7074	0.8411
No log	4.0396	408	0.6836	0.4685	0.6836	0.8268
No log	4.0594	410	0.5723	0.5120	0.5723	0.7565
No log	4.0792	412	0.5211	0.5631	0.5211	0.7218
No log	4.0990	414	0.5211	0.5687	0.5211	0.7219
No log	4.1188	416	0.5070	0.5896	0.5070	0.7120
No log	4.1386	418	0.5620	0.5387	0.5620	0.7497
No log	4.1584	420	0.6160	0.5055	0.6160	0.7849
No log	4.1782	422	0.6753	0.4457	0.6753	0.8218
No log	4.1980	424	0.6623	0.4135	0.6623	0.8138
No log	4.2178	426	0.5551	0.4282	0.5551	0.7451
No log	4.2376	428	0.4574	0.5010	0.4574	0.6763
No log	4.2574	430	0.4214	0.5551	0.4214	0.6492
No log	4.2772	432	0.4166	0.5586	0.4166	0.6455
No log	4.2970	434	0.4196	0.5693	0.4196	0.6478
No log	4.3168	436	0.4176	0.5878	0.4176	0.6462
No log	4.3366	438	0.4485	0.5545	0.4485	0.6697
No log	4.3564	440	0.4782	0.5412	0.4782	0.6915
No log	4.3762	442	0.4859	0.5918	0.4859	0.6971
No log	4.3960	444	0.5019	0.5844	0.5019	0.7085
No log	4.4158	446	0.4722	0.5704	0.4722	0.6872
No log	4.4356	448	0.4662	0.6040	0.4662	0.6828
No log	4.4554	450	0.4943	0.6096	0.4943	0.7031
No log	4.4752	452	0.5413	0.5920	0.5413	0.7358
No log	4.4950	454	0.5918	0.5405	0.5918	0.7693
No log	4.5149	456	0.7302	0.4517	0.7302	0.8545
No log	4.5347	458	0.7065	0.4641	0.7065	0.8405
No log	4.5545	460	0.5756	0.5685	0.5756	0.7587
No log	4.5743	462	0.5117	0.6030	0.5117	0.7153
No log	4.5941	464	0.4985	0.5957	0.4985	0.7061
No log	4.6139	466	0.4794	0.5670	0.4794	0.6924
No log	4.6337	468	0.4801	0.5520	0.4801	0.6929
No log	4.6535	470	0.5271	0.5250	0.5271	0.7260
No log	4.6733	472	0.6567	0.4768	0.6567	0.8104
No log	4.6931	474	0.7279	0.4515	0.7279	0.8531
No log	4.7129	476	0.6586	0.4437	0.6586	0.8115
No log	4.7327	478	0.5305	0.4238	0.5305	0.7284
No log	4.7525	480	0.5091	0.4758	0.5091	0.7135
No log	4.7723	482	0.4930	0.4796	0.4930	0.7021
No log	4.7921	484	0.4780	0.5139	0.4780	0.6914
No log	4.8119	486	0.4989	0.5349	0.4989	0.7063
No log	4.8317	488	0.5307	0.5183	0.5307	0.7285
No log	4.8515	490	0.6843	0.4820	0.6843	0.8272
No log	4.8713	492	0.7667	0.4833	0.7667	0.8756
No log	4.8911	494	0.6973	0.5032	0.6973	0.8350
No log	4.9109	496	0.5441	0.5859	0.5441	0.7376
No log	4.9307	498	0.4172	0.6639	0.4172	0.6459
0.4651	4.9505	500	0.4043	0.6353	0.4043	0.6358
0.4651	4.9703	502	0.4233	0.5856	0.4233	0.6506
0.4651	4.9901	504	0.4907	0.5683	0.4907	0.7005
0.4651	5.0099	506	0.5767	0.4570	0.5767	0.7594
0.4651	5.0297	508	0.7091	0.3346	0.7091	0.8421
0.4651	5.0495	510	0.7245	0.3105	0.7245	0.8512

Framework versions

—Transformers 4.44.2
—Pytorch 2.4.0+cu118
—Datasets 2.21.0
—Tokenizers 0.19.1