Training a 125M parameter decoder-only model on 70b tokens of Nigerian Languages. demo Article
Home » ProjectsSabiYarn: Training a Foundational Language Model on Nigerian Languages<span title='2024-03-15 04:14:46 +0100 +0100'>March 15, 2024</span> · 1 min · 14 words · Damilola JohnTable of ContentsTraining a 125M parameter decoder-only model on 70b tokens of Nigerian Languages.Training a 125M parameter decoder-only model on 70b tokens of Nigerian Languages.#demoArticle