| Task Name |
Dataset |
Paper |
Download |
Metric |
| Part of Speech Tagging (POS) |
MasakhaPOS |
|
|
F1 |
| Named Entity Recognition (NER) |
MasakhaNER |
|
|
Span F1 |
| Sentiment Analysis (SA) |
AfriSenti |
|
|
F1 |
| NollySenti |
|
|
F1 |
| Topic Classification (TC) |
SIB |
|
|
F1 |
| MasakhaNEWS |
|
|
Accuracy |
| Intent Detection (Intent) |
Injongointent |
|
|
Accuracy |
| Hate Speech Detection (Hate) |
AfriHate |
|
Coming soon! |
F1 |
| Natural Language Inference (NLI) |
AfriXNLI |
|
|
Accuracy |
| Crosslingual QA (XAQ) |
AfriQA |
|
|
F1 |
| Reading Comprehension (RC) |
Belebele |
|
|
F1 |
| NaijaRC |
|
|
F1 |
| Scientific Arc-Easy (Arc-E) |
Uhura-Arc-Easy |
|
|
Accuracy |
| Knowledge QA (MMLU) |
AfriMMLU |
|
|
Accuracy |
| Openai MMLU |
|
|
Accuracy |
| Math Reasoning (Math) |
AfriMGSM |
|
|
ExactMatch |
| Machine Translation (MT) |
Flores |
|
|
ChrF |
| MAFAND |
|
|
ChrF |
| NTREX |
|
|
ChrF |
| Salt |
|
|
ChrF |
| Summarization (Summ) |
XLSUM |
|
|
BertScore |
| Automatic Diacritics Restoration (ADR) |
ADR |
|
|
ChrF |