t5-base
Datasets
All datasets matching “t5-base”flan-t5-base-embed-refinedwebAll of the data together is around 61GB. It's the last hidden states of 131,072 samples from refinedweb padded/truncated to 512 tokens on the left, fed through google/flan-t5-base.
Structure:
{
"encoding": List, shaped (512, 768) aka (tokens, d_model),
"text": String, the original text that was encoded,
"attention_mask": List, binary mask to pass to your model with encoding to not attend to pad tokens
}
lewtun__hugging-face-test-t5-base.outputs.json-36bf2a59__1646049601lewtun__hugging-face-test-t5-base.outputs.json-36bf2a59__1645559101lewtun__hugging-face-test-t5-base.outputs.json-36bf2a59__1646052073
GEM Submission
Submission name: Hugging Face test T5-base.outputs.json 36bf2a59
lewtun__hugging-face-test-t5-base.outputs.json-36bf2a59__1645800191lewtun__hugging-face-test-t5-base.outputs.json-36bf2a59__1646049378