Natural Language Inference On Multinli

Metrics

Matched

Mismatched

Results

Performance results of various models on this benchmark

Model Name	Matched	Mismatched	Paper Title	Repository
ERNIE 2.0 Large	88.7	88.8	ERNIE 2.0: A Continual Pre-training Framework for Language Understanding	-
T5-Base	87.1	86.2	Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer	-
ELC-BERT-base 98M (zero init)	84.4	84.5	Not all layers are equally as important: Every Layer Counts BERT	-
Snorkel MeTaL (ensemble)	87.6	87.2	Training Complex Models with Multi-Task Weak Supervision	-
T5-3B	91.4	91.2	Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer	-
GenSen	71.4	71.3	Learning General Purpose Distributed Sentence Representations via Large Scale Multi-task Learning	-
RoBERTa	90.8	-	RoBERTa: A Robustly Optimized BERT Pretraining Approach	-
Charformer-Tall	83.7	84.4	Charformer: Fast Character Transformers via Gradient-based Subword Tokenization	-
GPST(unsupervised generative syntactic LM)	81.8	82.0	Generative Pretrained Structured Transformers: Unsupervised Syntactic Language Models at Scale	-
LM-CPPF RoBERTa-base	-	-	LM-CPPF: Paraphrasing-Guided Data Augmentation for Contrastive Prompt-Based Few-Shot Fine-Tuning	-
T5-11B	-	91.7	Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer	-
SMART+BERT-BASE	-	-	SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization	-
T5-XXL 11B (fine-tuned)	92.0	-	Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer	-
RealFormer	86.28	86.34	RealFormer: Transformer Likes Residual Attention	-
TinyBERT-6 67M	84.6	83.2	TinyBERT: Distilling BERT for Natural Language Understanding	-
Multi-task BiLSTM + Attn	72.2	72.1	GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding	-
Bi-LSTM sentence encoder (max-pooling)	70.7	71.1	Combining Similarity Features and Deep Representation Learning for Stance Detection in the Context of Checking Fake News	-
Adv-RoBERTa ensemble	91.1	90.7	StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understanding	-
GPT-2-XL 1.5B	36.5	37	LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions	-
UnitedSynT5 (335M)	89.8	-	First Train to Generate, then Generate to Train: UnitedSynT5 for Few-Shot NLI	-

0 of 67 row(s) selected.