ChallengerSpaceShuttle/zulu-pretraining-dataset
This is IsiZulu Pretraining Dataset. The dataset was used to pre-train BafoGPT-3B Books: Zulu-English Dictionary – A dictionary offering Zulu terms with English definitions, ideal for teaching basic word mappings. Translation: South African Government Speeches – Official speeches in Zulu, which help the model understand structured Zulu sentences and phrases. Transcription: Zulu Community Corpus – A collection of transcriptions, exposing the model to real-life conversational Zulu. Document:… See the full description on the dataset page: https://huggingface.co/datasets/ChallengerSpaceShuttle/zulu-pretraining-dataset.
This is IsiZulu Pretraining Dataset. The dataset was used to pre-train BafoGPT-3B
Books: Zulu-English Dictionary – A dictionary offering Zulu terms with English definitions, ideal for teaching basic word mappings.
Translation: South African Government Speeches – Official speeches in Zulu, which help the model understand structured Zulu sentences and phrases.
Transcription: Zulu Community Corpus – A collection of transcriptions, exposing the model to real-life conversational Zulu.
Document: Leipzig Corpora Collection – Text from various Zulu documents, helping the model understand written Zulu.
News: Isolezwe News – Zulu-language news articles for understanding contemporary Zulu language usage and current affairs.
Poems: Zulu Poetry – Poetry resources for cultural and literary language representation.
Web: Various websites – Diverse web-scraped content in Zulu, providing a wide range of linguistic inputs.
Wikipedia: Zulu Wikipedia – Articles in Zulu covering various topics, offering an informative and factual base for the model.