HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

ICDAR 2024 Competition on Few-Shot and Many-Shot Layout Segmentation of Ancient Manuscripts (SAM)

{Claudio Piciarelli Emanuela Colombi Gian Luca Foresti Axel De Nardin Silvia Zottin}

Abstract

Layout analysis is a critical aspect of Document Image Analysis, particularly when it comes to ancient manuscripts. It serves as a foundational step in streamlining subsequent tasks such as optical character recognition and automated transcription. However, one key challenge in this context is represented by the lack of available ground truths as they are extremely time-consuming to produce. Nevertheless, numerous approaches addressing this challenge heavily lean towards a fully supervised learning paradigm, which represents a rare scenario in a real-world setting. For this reason, with this competition, we propose the challenge of addressing this task with a few-shot learning approach, involving the use of only three images for training. The competition dataset, called U-DIADS-Bib, comprises four distinct ancient manuscripts, presenting heterogeneous layout structures, levels of degradation, and languages used. This diversity adds intrigue and complexity to the challenge. In addition, we have also allowed participating in the competition with traditional many-shot learning approaches, for which the whole training set of U-DIADS-Bib was made available.

Benchmarks

BenchmarkMethodologyMetrics
document-layout-analysis-on-u-diads-bibL3i++
Class Average IoU (Few-shot setting): 61.10
document-layout-analysis-on-u-diads-bibCNKI
Class Average IoU: 77.80
Class Average IoU (Few-shot setting): 65.90
document-layout-analysis-on-u-diads-bibVAI-OCR
Class Average IoU: 70.70
Class Average IoU (Few-shot setting): 70.00
document-layout-analysis-on-u-diads-bibCV-Group
Class Average IoU: 83.40
Class Average IoU (Few-shot setting): 78.40

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp