HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Augmenting Document Representations for Dense Retrieval with Interpolation and Perturbation

Soyeong Jeong Jinheon Baek Sukmin Cho Sung Ju Hwang Jong C. Park

Augmenting Document Representations for Dense Retrieval with Interpolation and Perturbation

Abstract

Dense retrieval models, which aim at retrieving the most relevant document for an input query on a dense representation space, have gained considerable attention for their remarkable success. Yet, dense models require a vast amount of labeled training data for notable performance, whereas it is often challenging to acquire query-document pairs annotated by humans. To tackle this problem, we propose a simple but effective Document Augmentation for dense Retrieval (DAR) framework, which augments the representations of documents with their interpolation and perturbation. We validate the performance of DAR on retrieval tasks with two benchmark datasets, showing that the proposed DAR significantly outperforms relevant baselines on the dense retrieval of both the labeled and unlabeled documents.

Code Repositories

starsuzi/dar
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
passage-retrieval-on-natural-questionsDAR-

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp