HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

CARCA: Context and Attribute-Aware Next-Item Recommendation via Cross-Attention

Ahmed Rashed Shereen Elsayed Lars Schmidt-Thieme

CARCA: Context and Attribute-Aware Next-Item Recommendation via Cross-Attention

Abstract

In sparse recommender settings, users' context and item attributes play a crucial role in deciding which items to recommend next. Despite that, recent works in sequential and time-aware recommendations usually either ignore both aspects or only consider one of them, limiting their predictive performance. In this paper, we address these limitations by proposing a context and attribute-aware recommender model (CARCA) that can capture the dynamic nature of the user profiles in terms of contextual features and item attributes via dedicated multi-head self-attention blocks that extract profile-level features and predicting item scores. Also, unlike many of the current state-of-the-art sequential item recommendation approaches that use a simple dot-product between the most recent item's latent features and the target items embeddings for scoring, CARCA uses cross-attention between all profile items and the target items to predict their final scores. This cross-attention allows CARCA to harness the correlation between old and recent items in the user profile and their influence on deciding which item to recommend next. Experiments on four real-world recommender system datasets show that the proposed model significantly outperforms all state-of-the-art models in the task of item recommendation and achieving improvements of up to 53% in Normalized Discounted Cumulative Gain (NDCG) and Hit-Ratio. Results also show that CARCA outperformed several state-of-the-art dedicated image-based recommender systems by merely utilizing image attributes extracted from a pre-trained ResNet50 in a black-box fashion.

Code Repositories

ariaattar/CASM-PyTorch
pytorch
Mentioned in GitHub
ahmedrashed-ml/carca
Official
tf
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
recommendation-systems-on-amazon-beautyCARCA
Hit@10: 0.579
nDCG@10: 0.396
recommendation-systems-on-amazon-fashionCARCA
HitRatio@ 10 (100 Neg. Samples): 0.591
nDCG@10 (100 Neg. Samples): 0.381
recommendation-systems-on-amazon-gamesCARCA
Hit@10: 0.7820
nDCG@10: 0.5730
sequential-recommendation-on-amazon-menCARCA
Hit@10: 0.550

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp