Question Answering On Webquestions

评估指标

评测结果

各个模型在此基准测试上的表现结果

模型名称	EM	Paper Title	Repository
PaLM-540B (Zero-Shot)	10.6	PaLM: Scaling Language Modeling with Pathways
GPT-3-175B (Few-Shot)	41.5	Language Models are Few-Shot Learners
PaLM 2-S (one-shot)	21.8	PaLM 2 Technical Report
ToT	26.3	Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models
ToT	26.3	Tree of Thoughts: Deliberate Problem Solving with Large Language Models
React	38.3	ReAct: Synergizing Reasoning and Acting in Language Models
DSP	59.4	Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models
REALM	40.7	REALM: Retrieval-Augmented Language Model Pre-Training
CoT	42.5	Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
GPT-3-175B (Zero-Shot)	14.4	Language Models are Few-Shot Learners
CoT	42.5	Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models
Memory Networks (ensemble)	-	Large-scale Simple Question Answering with Memory Networks
PaLM 2-L (one-shot)	28.2	PaLM 2 Technical Report
T5.1.1-XXL+SSM	42.8	Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
PaLM-540B (One-Shot)	22.6	PaLM: Scaling Language Modeling with Pathways
GPT-3-175B (One-Shot)	25.3	Language Models are Few-Shot Learners
FiE+PAQ	56.3	FiE: Building a Global Probability Space by Leveraging Early Fusion in Encoder for Open-Domain Question Answering	-
DPR	42.4	Dense Passage Retrieval for Open-Domain Question Answering
Self-Ask	31.1	Measuring and Narrowing the Compositionality Gap in Language Models
Subgraph embeddings	-	Question Answering with Subgraph Embeddings

0 of 37 row(s) selected.