Repos and Libraries
Libraries





Tasks
Biological Named Entity Recognition
Causal Language Modeling
Clinical Named Entity Recognition
Clinical Syntactic Analysis
Commonsense Reasoning
Conditional Generation
Constituency Parsing
Coreference Resolution
Cross-language-transcription
Dependency Parsing
Domain Specific
Entailment
Goal-oriented Dialogue
Image Classification
Intent Extraction
Keyword Extraction
Language Modeling
Machine Translation
Multilingual
Named Entity Recognition
Natural-language-inference
Natural Language Inference
Next Sentence Prediction
Other
Pair Classification
Part-of-speech Tagging
Query-paraphrasing
Question Answering
Reading Comprehension
Semantic Parsing
Semantic Role Labeling
Sentence Boundary Detection
Sentence Fusion
Sentence Splitting
Sentiment-analysis
Sentiment Analysis
Sequence-modeling
Sequence Classification
Speech Recognition
Structure-prediction
Summarization
Tagging
Text-retrieval
Text-scoring
Text Classification
Text Generation
Text Regression
Textual-entailment
Token Classification
Token Generation
Tokenization Tagging
Unknown
Visual Language Reasoning
Zero-shot Relation Extraction
Datasets: 941
ade_corpus_v2
adversarial_qa
aeslc
afrikaans_ner_corpus
ag_news
air_dialogue
airdialogue

ajgt_twitter_ar
allegro_reviews
allocine
alt
amazon_polarity
amazon_qa

AMAZON_REVIEWS
amazon_reviews_multi
amazon_us_reviews/Apparel_v1_00
amazon_us_reviews/Automotive_v1_00
amazon_us_reviews/Baby_v1_00
amazon_us_reviews/Beauty_v1_00
amazon_us_reviews/Books_v1_00
amazon_us_reviews/Books_v1_01
amazon_us_reviews/Books_v1_02
amazon_us_reviews/Camera_v1_00
amazon_us_reviews/Digital_Ebook_Purchase_v1_00
amazon_us_reviews/Digital_Ebook_Purchase_v1_01
amazon_us_reviews/Digital_Music_Purchase_v1_00
amazon_us_reviews/Digital_Software_v1_00
amazon_us_reviews/Digital_Video_Download_v1_00
amazon_us_reviews/Digital_Video_Games_v1_00
amazon_us_reviews/Electronics_v1_00
amazon_us_reviews/Furniture_v1_00
amazon_us_reviews/Gift_Card_v1_00
amazon_us_reviews/Grocery_v1_00
amazon_us_reviews/Health_Personal_Care_v1_00
amazon_us_reviews/Home_Entertainment_v1_00
amazon_us_reviews/Home_Improvement_v1_00
amazon_us_reviews/Home_v1_00
amazon_us_reviews/Jewelry_v1_00
amazon_us_reviews/Kitchen_v1_00
amazon_us_reviews/Lawn_and_Garden_v1_00
amazon_us_reviews/Luggage_v1_00
amazon_us_reviews/Major_Appliances_v1_00
amazon_us_reviews/Mobile_Apps_v1_00
amazon_us_reviews/Mobile_Electronics_v1_00
amazon_us_reviews/Music_v1_00
amazon_us_reviews/Musical_Instruments_v1_00
amazon_us_reviews/Office_Products_v1_00
amazon_us_reviews/Outdoors_v1_00
amazon_us_reviews/PC_v1_00
amazon_us_reviews/Personal_Care_Appliances_v1_00
amazon_us_reviews/Pet_Products_v1_00
amazon_us_reviews/Shoes_v1_00
amazon_us_reviews/Software_v1_00
amazon_us_reviews/Sports_v1_00
amazon_us_reviews/Tools_v1_00
amazon_us_reviews/Toys_v1_00
amazon_us_reviews/Video_DVD_v1_00
amazon_us_reviews/Video_Games_v1_00
amazon_us_reviews/Video_v1_00
amazon_us_reviews/Watches_v1_00
amazon_us_reviews/Wireless_v1_00
ambig_qa
amttl
AnatEM
anli

anli/r1
anli/r2
anli/r3
app_reviews
aqua

aqua_rat
aquamuse
ar_cov19
ar_res_reviews
ar_sarcasm
arabic_billion_words
arabic_pos_dialect
arabic_speech_corpus
Arizona Disease
arsentd_lev
arxiv_dataset
asset
assin
assin2
atomic
autshumato
babi

BABI20
babi_qa
banking77
bbc_hindi_nli
bc2gm_corpus
best2009
bianet
bible_para
big_patent
billsum
bing_coronavirus_query_set
BioCreative II GM
BioCreative V CDR
BIOFID
BioInfer
BioNLP 2013 Cancer Genetics (ST)
BioNLP 2013 Pathway Curation (ST)
BioSemantics
blended_skill_talk

blimp/adjunct_island
blimp/anaphor_gender_agreement
blimp/anaphor_number_agreement
blimp/animate_subject_passive
blimp/animate_subject_trans
blimp/causative
blimp/complex_NP_island
blimp/coordinate_structure_constraint_complex_left_branch
blimp/coordinate_structure_constraint_object_extraction
blimp/determiner_noun_agreement_1
blimp/determiner_noun_agreement_2
blimp/determiner_noun_agreement_irregular_1
blimp/determiner_noun_agreement_irregular_2
blimp/determiner_noun_agreement_with_adj_2
blimp/determiner_noun_agreement_with_adj_irregular_1
blimp/determiner_noun_agreement_with_adj_irregular_2
blimp/determiner_noun_agreement_with_adjective_1
blimp/distractor_agreement_relational_noun
blimp/distractor_agreement_relative_clause
blimp/drop_argument
blimp/ellipsis_n_bar_1
blimp/ellipsis_n_bar_2
blimp/existential_there_object_raising
blimp/existential_there_quantifiers_1
blimp/existential_there_quantifiers_2
blimp/existential_there_subject_raising
blimp/expletive_it_object_raising
blimp/inchoative
blimp/intransitive
blimp/irregular_past_participle_adjectives
blimp/irregular_past_participle_verbs
blimp/irregular_plural_subject_verb_agreement_1
blimp/irregular_plural_subject_verb_agreement_2
blimp/left_branch_island_echo_question
blimp/left_branch_island_simple_question
blimp/matrix_question_npi_licensor_present
blimp/npi_present_1
blimp/npi_present_2
blimp/only_npi_licensor_present
blimp/only_npi_scope
blimp/passive_1
blimp/passive_2
blimp/principle_A_c_command
blimp/principle_A_case_1
blimp/principle_A_case_2
blimp/principle_A_domain_1
blimp/principle_A_domain_2
blimp/principle_A_domain_3
blimp/principle_A_reconstruction
blimp/regular_plural_subject_verb_agreement_1
blimp/regular_plural_subject_verb_agreement_2
blimp/sentential_negation_npi_licensor_present
blimp/sentential_negation_npi_scope
blimp/sentential_subject_island
blimp/superlative_quantifiers_1
blimp/superlative_quantifiers_2
blimp/tough_vs_raising_1
blimp/tough_vs_raising_2
blimp/transitive
blimp/wh_island
blimp/wh_questions_object_gap
blimp/wh_questions_subject_gap
blimp/wh_questions_subject_gap_long_distance
blimp/wh_vs_that_no_gap
blimp/wh_vs_that_no_gap_long_distance
blimp/wh_vs_that_with_gap
blimp/wh_vs_that_with_gap_long_distance
bn_hate_speech
booktest

bot_adversarial_dialogue

bprec
brwac
bsd_ja_en
bswac
c3

c4
cail2018
caner
capes
catalonia_independence
cawac
cbt

cc100
cc_news
ccaligned_multilingual
CCGbank
ccpe

cdsc
cdt
CellFinder
CEMP
cfq
CHEBI
CHEMDNER
ChineseTreebank
HanLP
chr_en
cifar10
cifar100
circa
civil_comments
clevr

clickbait_news_bg
climate_fever
clinc_oos
clinic_oos
CLL
CNN/DailyMail
CNN/DM

cnn_dailymail
cnn_dm

coached_conv_pref
coco_caption

codah
code_search_net
common_voice
commonsenseqa

COMMUNICATIVE_FUNCTIONS
conceptnet5
CoNLL
CoNLL 2003
HanLP
CoNLL 2012
HanLP
CoNLL2000Chunking
conll2002
conll2003
CONLL_03
CONLL_03_DUTCH
CONLL_03_GERMAN
CONLL_03_SPANISH
CONLL_2000
conllpp
connvai2_wild_evaluation

conv_ai
conv_ai_2
conv_ai_3
convai2

convai_chitchat

copa

coqa

cord19
cornell_movie

cos_e
cosmos_qa
counter
covid19sum
covid_qa_castorini
covid_qa_deepset
covid_qa_ucsd
covid_tweets_japanese
covost2
CRAFT (v2.0)
CRAFT (v4.0.1)
craigslist_bargains
crawl_domain
crows_pairs
cryptonite
cs_restaurants
CTB6
HanLP
CTB8
HanLP
CTB9
HanLP
CTTB9
HanLP
curiosity_dialogs
dailydialog

dane
danish_political_comments
dart
datacommons_factcheck
dbll_babi

dbll_movie

dbpedia_14
dbrd
deal_or_no_dialog
dealnodeal

DECA
decanlp

decode

definite_pronoun_resolution
dengue_filipino
dialog_babi

dialog_babi_plus

dialog_re
dialogue_nli

dialogue_qe

dialogue_safety

diplomacy_detection
disaster_response_messages
discovery
doc2dial
dream

DROP
dstc7

duorc
dutch_social
dyk
dynabench/qa
e2e_nlg
e2e_nlg_cleaned
ecb
ecthr_cases
ehealth_kd
eitb_parcc
eli5

EMBO/biolang
EMBO/sd-nlp
emea
emotone_ar
empathetic_dialogues

EnglishOntoNotes
EnglishTreebank
HanLP
enriched_web_nlg
eraser_multi_rc
esnli
eth_py150_open
ethos
eu_regulatory_ir
eurlex
euronews
europa_eac_tm
europa_ecdc_tm
europarl_bilingual
EUROPARL_V7_DE_EN_EN_SENTENCES
HanLP
evidence_infer_treatment
exams
factckbr
fake_news_english
fake_news_filipino
farsi_news
fashion_mnist
FeideggerCorpus
few_rel
financial_phrasebank
finer
flickr30k

flores
flue
formermagic/github_python_1m
fquad
freebase_qa
fromfile

FSU
funpedia

fvqa

gap
GELLUS
gem
genderation_bias

generated_reviews_enth
generics_kb
german_legal_entity_recognition
germaner
GERMEVAL_14
giga_fren
gigaword
glucose
glue
gnad10
go_emotions
goemotions
google_sgd

google_wellformed_query
GPRO
GQA
grail_qa
great_code
gutenberg_time
hard
harem
has_part
hate_offensive
hate_speech18
hate_speech_filipino
hate_speech_offensive
hate_speech_pl
hate_speech_portuguese
hatexplain
hausa_voa_ner
hausa_voa_topics
hda_nli_hindi
head_qa
health_fact
hebrew_projectbenyehuda
hebrew_sentiment
hebrew_this_world
hind_encorp
hindi_discourse
hippocorpus
hkcancor
holl_e

hope_edi
hotpotqa

hover
hrenwac_para
hrwac
humicroedit
hybrid_qa
iapp_wiki_qa_squad
id_clickbait
id_liputan6
id_nergrit_corpus
id_newspapers_2018
id_panl_bppt
id_puisi
IEPA
igbo_english_machine_translation
igbo_monolingual
igbo_ner
igc

ilist
image_chat

imdb_reviews
imdb_urdu_reviews
imppres
indonlu
inquisitive_qg
INSPEC
insuranceqa

integration_tests

interactive

interpress_news_category_tr
interpress_news_category_tr_lite
irc_disentaglement
irc_disentangle
isixhosa_ner_corpus
isizulu_ner_corpus
IWSLT

iwslt14

Jean-Baptiste/wikiner_fr
jfleg
jigsaw_toxicity_pred
jimregan/clarinpl_sejmsenat
jimregan/clarinpl_studio
jnlpba
journalists_questions
jsonfile

kannada_news
kd_conv
kde4
kelm
kilt_tasks
kinnews_kirnews
kor_3i4k
kor_hate
kor_ner
kor_nlu
kor_qpair
kor_sae
kor_sarcasm
labr
lama
lambada
large_spanish_corpus
laroseda
lavis-nlp/german_legal_sentences
lener_br
LER_GERMAN
lhoestq/custom_squad
liar
librispeech_asr
librispeech_lm
light_dialog

light_dialog_wild

light_genderation_bias

limit
linnaeus
LINNEAUS
liveqa
lj_speech
lm1b
LocText
lst20
m_lama
mac_morpho
makhzan
math_dataset
mc_taco
mctaco
mctest

md_gender

md_gender_bias
mdd
med_hop
medal
medical_dialog
medical_questions_pairs
menyo20k_mt
meta_woz
metooma
metrec
miam
miRNA
mkb
mkqa
mlsum
mnist_qa

MNLI

mocha
moroco
movie_rationales
moviedialog

mrqa
ms_marco

ms_terms
msr_genomics_kbcomp
msr_sqa
msr_text_compression
msr_zhen_translation_parity
MSRA
HanLP
msra_ner
mt_eng_vietnamese
mturkwikimovies

muchocine
Multi30k
multi_booked
multi_news
multi_nli
multi_nli_mismatch
multi_para_crawl
multi_re_qa
multi_woz_v22
multi_x_science_sum
MultiNLI
multiwoz_v20

multiwoz_v21

mutual_friends
mutualfriends

mwsc

myanmar_news
narrative_qa

narrativeqa
narrativeqa_manual
natural_questions

NbAiLab/norec_agg
NbAiLab/norne
NbAiLab/norwegian_parliament
NCBI Disease
ncbi_disease
nchlt
ncslgr
nell
NER_BASQUE
NER_FINNISH
NER_SWEDISH
neural_code_search
news_commentary
NEWSGROUPS
newsph
newsph_nli
newspop
newsqa
newsroom
nkjp-ner
nli

nlvr

norec
norne
norwegian_ner
nq_open
nsmc
numer_sense
numeric_fused_head
oclar
offcombr
offenseval2020_tr
offenseval_dravidian
ofis_publik
ohsumed
ollie
omp
onecommon

onestop_english
OntoNotes5
HanLP
open_subtitles
openbookqa
openslr
opensubtitles

opinion_abstracts/idebate
opinion_abstracts/rotten_tomatoes
opinosis
opus
opus100
opus_books
opus_dgt
opus_dogc
opus_elhuyar
opus_euconst
opus_finlex
opus_fiskmo
opus_gnome
opus_infopankki
opus_memat
opus_montenegrinsubs
opus_openoffice
opus_paracrawl
opus_rf
opus_tedtalks
opus_ubuntu
opus_wikipedia
opus_xhosanavy
orange_sum
oscar
Osiris v1.2
para_crawl
para_pat
parsinlu_reading_comprehension
paws
paws-x
pec
peer_read
peixian/equity_evaluation_corpus
peixian/rtGender
PennTreebank
peoples_daily_ner
per_sent
persian_ner
persiannlp/parsinlu_entailment
persiannlp/parsinlu_query_paraphrasing
persiannlp/parsinlu_reading_comprehension
persiannlp/parsinlu_sentiment
persiannlp/parsinlu_translation_en_fa
persiannlp/parsinlu_translation_fa_en
personachat

personality_captions

personalized_dialog

pg19
php
pib
piqa
Plant-Disease-Relations
pn_summary
poem_sentiment
polemo2
poleval2019_cyberbullying
poleval2019_mt
polsum
prachathai67k
pragmeval
PreCo
proto_qa
psc
PTB
HanLP
ptb_text_only
pubmed_qa
py_ast
QA-SRL

QA-ZRE

qa4mre
qa_srl
qacnn

qadailymail

qangaroo

qasrl

qazre

qed
qed_amara
quac

QuoraParaphrase
re_dial
reasoning_bg
recipe_nlg
reddit_disentanglement
reddit_tifu/long
reddit_tifu/short
redial

refresd
Resume
HanLP
ro_sent
ro_sts
ro_sts_parallel
ronec
ropes
s2orc
S800
samsum
sanskrit_classic
saudinewsnet
SCAI Chemicals
SCAI Disease
scan

scb_mt_enth_2020
schema_guided_dstc8
scicite
scielo
scientific_papers/arxiv
scientific_papers/pubmed
scitldr
self_chat

self_feeding

selqa
sem_eval_2014_task_1
sem_eval_2020_task_11
SEMEVAL2010
SEMEVAL2017
SemEvalSDP
sensitive_topics_evaluation

sent_comp
SENTEVAL_CR
SENTEVAL_MPQA
SENTEVAL_MR
SENTEVAL_SST_BINARY
SENTEVAL_SST_GRANULAR
SENTEVAL_SUBJ
senti_lex
senti_ws
SENTIMENT_140
sepedi_ner
sesotho_ner_corpus
setimes
SETIMES2_EN_HR_HR_SENTENCES
HanLP
setswana_ner_corpus
sharc
sharc_modified
sick
sighan2005
HanLP
silicone
simple_questions_v2
simplequestions

siswati_ner_corpus
smartdata
sms_spam
snips_built_in_intents
snli

snow_simplified_japanese_corpus
so_stacksample
social_bias_frames
sofc_materials_articles
spanish_billion_words
spc
species_800
spider
squad

squad2

squad_adversarial
squad_kor_v1
squad_kor_v2
srwac
sst

StanfordSentimentTreebank
stereoset
stsb_mt_sv
stsb_multi_mt
style_gen

super_glue
susumu2357/squad_v2_sv
swag
swahili
swahili_news
swda
swedish_ner_corpus
swedish_reviews
tab_fact
tamilmixsentiment
tanzil
tapaco
tashkeela
taskmaster

taskmaster1
taskmaster2

taskmaster3
taskntalk

tatoeba
ted_hrlr_translate
ted_iwlst2013
ted_multi_translate
ted_talks_iwslt
telugu_books
telugu_news
tep_en_fa_para
thai_toxicity_tweet
thainer
thaiqa_squad
thaisum
tilde_model
times_of_india_news_headlines
timit_asr
tiny_shakespeare
tlc
tmu_gfm_dataset
totto
TREC
TREC_50
TREC_6
trivia_qa/rc
trivia_qa/rc.nocontext
trivia_qa/unfiltered
trivia_qa/unfiltered.nocontext
triviaqa

tsac
ttc4900
tunizi
tuple_ie
turk
turkish_movie_sentiment
turkish_ner
turkish_product_reviews
turkish_shrinked_ner
turku_ner_corpus
tweet_eval
tweet_qa
tweets_ar_en_parallel
tweets_hate_speech_detection
twi_text_c3
twi_wordsim353

ubuntu

UD_ARABIC
UD_BASQUE
UD_BULGARIAN
UD_CATALAN
UD_CHINESE
UD_CROATIAN
UD_CZECH
UD_DANISH
UD_DUTCH
UD_ENGLISH
UD_FINNISH
UD_FRENCH
UD_GERMAN
UD_GERMAN_HDT
UD_HEBREW
UD_HINDI
UD_INDONESIAN
UD_ITALIAN
UD_JAPANESE
UD_KOREAN
UD_NORWEGIAN
UD_PERSIAN
UD_POLISH
UD_PORTUGUESE
UD_ROMANIAN
UD_RUSSIAN
UD_SERBIAN
UD_SLOVAK
UD_SLOVENIAN
UD_SPANISH
UD_SWEDISH
UD_TURKISH
udhr
UDPOS
um005
un_ga
un_multi
un_pc
universal_dependencies
universal_morphologies
urdu_fake_news
urdu_sentiment_corpus
Variome
visdial

vqa_v1

vqa_v2

VQAv2
w11wo/imdb-javanese
WASSA_ANGER
WASSA_FEAR
WASSA_JOY
WASSA_SADNESS
web_questions
webquestions

HanLP
weibo_ner
wi_locness
wiki40b
wiki_asp
wiki_atomic_edits
wiki_auto
wiki_bio
wiki_hop
wiki_lingua
wiki_movies
wiki_qa_ar
wiki_source
wiki_summary
wikiann
wikicorpus
wikihow
wikimovies

WIKINER_DUTCH
WIKINER_ENGLISH
WIKINER_FRENCH
WIKINER_GERMAN
WIKINER_ITALIAN
WIKINER_POLISH
WIKINER_PORTUGUESE
WIKINER_RUSSIAN
WIKINER_SPANISH
wikipedia_toxicity_subtypes
wikiqa

wikisql

WikiText-2
WikiText103
wikitext_tl39
wili_2018
wino_bias
Winobias
winograd_wsc
winogrande
wisesight1000
wisesight_sentiment
wizard_of_wikipedia

wmt
