Modelpublic

NICFRU/bart-base-paraphrasing-review

sourceHugging Faceapache-2.0updated 3y agoView on Hugging Face

0likes5downloads

Model Card

bart-base-paraphrasing

This model is a fine-tuned version of facebook/bart-base on the None dataset. It achieves the following results on the evaluation set:

—Loss: 0.033200
—Rouge1: 52.885700
—Rouge2: 47.674400
—Rougel: 50.037000
—Rougelsum: 52.002300
—Gen Len: 20.0

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

—learning_rate: 4e-05
—trainbatchsize: 10
—evalbatchsize: 8
—seed: 42
—optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
—lrschedulertype: linear
—num_epochs: 20

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum	Gen Len
1.500200	1	10	0.540744	51.494300	46.396200	48.464600	50.692800	19.330000
0.772100	1	20	0.460911	52.542000	47.657200	49.091900	51.860400	19.820000
0.653500	1	30	0.462111	51.457500	45.802000	48.439500	50.641100	19.830000
0.657400	1	40	0.410792	53.428800	48.033700	49.830500	52.563600	19.920000
0.637300	1	50	0.417746	52.422300	47.417400	49.360900	51.637900	19.600000
0.464800	2	60	0.412119	54.257400	49.465400	52.024500	53.416800	19.780000
0.484500	2	70	0.392577	53.640400	48.611300	50.708300	52.798100	19.810000
0.384000	2	80	0.405939	53.321900	48.479400	51.057200	52.514900	19.860000
0.424000	2	90	0.409505	53.460000	48.560600	50.364500	52.653400	19.860000
0.529600	2	100	0.376642	53.498400	48.590500	51.347100	52.754700	19.820000
0.337300	3	110	0.386621	54.007900	49.246700	51.821500	53.104500	19.730000
0.354700	3	120	0.407476	53.641200	48.705100	50.964800	52.986400	19.920000
0.348700	3	130	0.385953	52.932300	47.667500	49.992800	52.144400	19.800000
0.369800	3	140	0.388468	53.839000	48.703600	50.928600	52.916900	19.950000
0.361100	3	150	0.393050	53.532900	48.849700	50.780800	52.818500	19.900000
0.264600	4	160	0.397602	52.870500	47.965400	50.141900	52.249800	19.720000
0.247000	4	170	0.428163	53.854300	48.954700	50.877200	53.073600	19.830000
0.313800	4	180	0.412245	53.352000	48.384300	50.859600	52.413400	19.930000
0.265100	4	190	0.425944	54.151600	49.344000	51.995500	53.433600	19.920000
0.280900	4	200	0.407293	54.266300	49.390600	51.916800	53.408000	19.920000
0.199500	5	210	0.432796	52.924400	47.881800	50.328700	52.048600	19.930000
0.222100	5	220	0.451023	53.211500	47.724400	50.356100	52.387600	19.920000
0.198000	5	230	0.462028	53.640100	48.316100	50.512400	52.809000	19.920000
0.239500	5	240	0.425439	52.813300	47.191400	49.461500	52.011200	19.900000
0.194800	5	250	0.410010	54.508800	49.426500	51.134300	53.692300	19.810000
0.151900	6	260	0.444454	52.762000	47.518500	49.889300	51.962300	19.770000
0.198200	6	270	0.456969	53.568900	48.212300	50.662400	52.725800	19.930000
0.171500	6	280	0.462446	52.807200	47.721900	50.285800	52.111600	19.880000
0.208600	6	290	0.428070	53.782100	48.542300	51.090800	53.021800	19.890000
0.158600	6	300	0.461858	54.069500	49.227100	51.325300	53.310600	19.900000
0.139700	7	310	0.476241	52.988600	48.009200	50.622300	52.195300	19.700000
0.135900	7	320	0.507567	55.107400	50.664700	53.052400	54.412700	19.920000
0.153300	7	330	0.475348	53.977700	49.112500	51.732400	53.268500	19.920000
0.123100	7	340	0.462978	52.836700	47.669800	50.055900	51.986000	19.750000
0.166000	7	350	0.462223	53.250900	48.223500	50.890800	52.371700	19.670000
0.104200	8	360	0.471708	53.446800	48.321900	51.074000	52.582200	19.860000
0.094200	8	370	0.513058	53.509900	48.640100	51.348000	52.703300	19.920000
0.108000	8	380	0.488812	53.939900	48.989500	51.469100	53.092300	19.920000
0.396000	8	390	0.483152	52.146500	46.819100	49.638500	51.317300	19.790000
0.316700	8	400	0.505258	52.444500	47.065700	49.912300	51.540900	19.930000
0.092600	9	410	0.491664	53.938100	49.100200	51.639300	53.070000	19.910000
0.114300	9	420	0.484384	51.931900	46.400500	49.538200	51.004200	19.860000
0.085200	9	430	0.523603	53.075300	47.999000	50.806600	52.153500	19.890000
0.089400	9	440	0.529681	52.352800	47.057300	49.917100	51.417500	19.830000
0.092000	9	450	0.545310	52.940200	47.693700	50.416700	52.080700	19.790000
0.083700	10	460	0.553549	53.268800	48.339100	50.894300	52.501200	19.920000
0.075300	10	470	0.524759	53.187800	47.921500	50.284400	52.072000	19.880000
0.086100	10	480	0.542759	53.410300	48.170500	49.919500	52.334600	19.870000
0.086800	10	490	0.550681	52.917700	47.322200	49.576600	51.941500	19.880000
0.095600	10	500	0.550618	53.855400	48.679200	51.050700	53.063300	19.840000
0.063000	11	510	0.582389	53.384000	48.007900	50.821200	52.415500	19.920000
0.072000	11	520	0.563888	53.186800	48.050900	50.699900	52.317700	19.810000
0.075300	11	530	0.584735	53.975400	48.787500	50.590800	53.049900	19.900000
0.083200	11	540	0.556683	52.261700	46.765000	48.966100	51.240600	19.910000
0.084800	11	550	0.531437	53.107700	47.959100	50.294100	52.144400	19.890000
0.059000	12	560	0.548251	54.056300	49.014100	50.701700	53.087700	19.880000
0.072000	12	570	0.552766	53.755500	48.601300	50.022600	52.684300	19.900000
0.053700	12	580	0.571895	53.344600	48.156000	50.539100	52.473000	19.930000
0.064000	12	590	0.556930	53.790300	48.777600	50.648800	52.865700	19.900000
0.051100	12	600	0.566761	53.251500	48.205000	49.942500	52.302000	19.930000
0.032700	13	610	0.606187	52.956600	47.573000	49.586600	51.893600	19.960000
0.066000	13	620	0.592303	52.862200	47.470600	49.631400	51.833400	19.960000
0.050800	13	630	0.572726	53.060700	47.741300	50.195900	52.158500	19.930000
0.055100	13	640	0.579977	52.551000	47.204300	49.678900	51.588600	19.930000
0.039300	13	650	0.594248	52.505600	47.256800	49.814200	51.673600	19.890000
0.047200	14	660	0.596428	53.929900	49.264900	51.170500	53.304600	19.840000
0.048400	14	670	0.602180	52.710700	47.515200	50.447400	51.889100	19.930000
0.049300	14	680	0.589604	52.581000	47.250300	49.835200	51.752900	19.930000
0.037300	14	690	0.595846	53.748100	48.891500	50.913300	52.880500	19.900000
0.043900	14	700	0.590349	52.559200	47.492300	50.202500	51.754500	19.950000
0.049500	15	710	0.607460	53.145900	48.229600	50.833100	52.304700	19.960000
0.048800	15	720	0.602753	53.174300	48.162100	50.561600	52.294000	19.960000
0.042800	15	730	0.625110	53.669800	48.914600	51.321100	52.821900	19.920000
0.033200	15	740	0.589171	53.363200	48.281000	50.815500	52.441000	19.880000
0.044300	15	750	0.611709	53.340500	48.307100	50.490500	52.533600	19.920000
0.053300	16	760	0.596733	53.249800	48.258300	50.527100	52.431700	19.880000
0.031200	16	770	0.611742	52.944500	47.696800	50.040200	52.053000	19.930000
0.036300	16	780	0.626590	52.682600	47.331800	50.056500	51.711700	19.930000
0.035000	16	790	0.608956	52.703500	47.373300	49.867900	51.849900	19.930000
0.040500	16	800	0.609984	52.378100	46.979400	49.478100	51.493900	19.930000
0.037800	17	810	0.610033	53.232500	48.241600	49.812300	52.417200	19.950000
0.032200	17	820	0.616732	53.148700	48.271200	49.913400	52.423200	19.950000
0.027400	17	830	0.625509	53.140300	48.066100	50.356100	52.293400	19.930000
0.027700	17	840	0.632047	53.140300	48.066100	50.356100	52.293400	19.930000
0.030200	17	850	0.634628	53.001900	47.875800	50.176700	52.088800	19.930000
0.034400	18	860	0.634640	53.013500	48.024900	49.977000	52.129700	19.910000
0.033100	18	870	0.633774	53.218100	48.172300	50.448700	52.417500	19.930000
0.034400	18	880	0.616925	53.272600	48.223800	50.509400	52.461700	19.930000
0.040000	18	890	0.614516	52.943800	47.929600	50.220200	52.148500	19.890000
0.029100	18	900	0.619765	52.965400	47.957200	50.229600	52.205700	19.910000
0.025800	19	910	0.626218	52.907700	47.760600	50.164100	52.126000	19.950000
0.037400	19	920	0.621437	52.937400	47.904700	50.532300	52.200300	19.930000
0.023600	19	930	0.622434	52.937400	47.930800	50.252200	52.200300	19.930000
0.016100	19	940	0.614024	52.901900	47.918400	50.491200	52.133900	19.930000
0.041100	19	950	0.617579	53.034500	48.026800	50.307200	52.233700	19.950000
0.025500	20	960	0.620153	53.018900	47.885800	50.222300	52.115400	19.950000
0.024000	20	970	0.619979	53.018900	47.885800	50.222300	52.115400	19.950000
0.029500	20	980	0.618171	53.018900	47.885800	50.222300	52.115400	19.950000
0.012900	20	990	0.619486	53.027300	47.891900	50.229900	52.122700	19.950000
0.033200	20	1000	0.620059	52.885700	47.674400	50.037000	52.002300	19.950000