Research

Teaching machines to read documents — and to remember them.

Documents carry meaning in their text, their layout and their images at once, and they change over time. My work goes from learning joint vision-language representations of a page, to answering questions only from evidence, to the state a system should keep across documents and sessions.

§ 02 Themes

Seven threads, 29 publications.

Each publication carries one or more themes. Follow a thread, or filter the full list.

Document understanding10

Cross-modal vision-language representations for classifying, retrieving and summarizing visually rich documents.

  1. arXiv 2026Preprint
  2. WACV Workshops 2025Workshop
  3. WACV 2025Conference

    GlobalDoc: A Cross-Modal Vision-Language Framework for Real-World Document Image Retrieval and Classification

    S. Bakkali, S. Biswas, Z. Ming, M. Coustaty, M. Rusiñol, O. Ramos Terrades, J. Lladós

  4. ICDAR 2024Conference

    Multimodal Adaptive Inference for Document Image Classification with Anytime Early Exiting

    O. Hamed, S. Bakkali, M. B. Blaschko, M.-F. Moens, J. Van Landeghem

  5. Pattern Recognition 2023Journal

    VLCDoC: Vision-Language Contrastive Pre-Training Model for Cross-Modal Document Classification

    S. Bakkali, Z. Ming, M. Coustaty, M. Rusiñol, O. Ramos Terrades

  6. SSRN 2023Preprint

    TransferDoc: A Self-Supervised Transferable Document Representation Learning Model Unifying Vision and Language

    S. Bakkali, S. Biswas, Z. Ming, M. Coustaty, M. Rusiñol, O. Ramos Terrades, J. Lladós

  7. PhD thesis 2022Thesis
  8. IJDAR 2021Journal
  9. ICIP 2020Conference

    Cross-Modal Deep Networks for Document Image Classification

    S. Bakkali, Z. Ming, M. Coustaty, M. Rusiñol

  10. CVPR Workshops 2020Workshop
Persistent state & decisions2

What document systems should retain across documents and sessions: provenance-linked state, supersession, governed forgetting, and decisions that stay valid after they are made.

  1. arXiv 2026Preprint
  2. arXiv 2026Preprint
Grounded retrieval & QA2

Retrieval-augmented generation that answers only from evidence, cites it, and abstains when the evidence is insufficient.

  1. arXiv 2025Preprint
  2. WACV 2025Conference

    GlobalDoc: A Cross-Modal Vision-Language Framework for Real-World Document Image Retrieval and Classification

    S. Bakkali, S. Biswas, Z. Ming, M. Coustaty, M. Rusiñol, O. Ramos Terrades, J. Lladós

Scene text & low-resource scripts8

Detection, recognition and generation of text in complex, low-resource scripts such as Khmer, including handwriting.

  1. ICPR Workshops 2026Workshop

    BHCP-DOC: A Real-World Bilingual Dataset for Handwritten Clinical Prescription Detection and Recognition

    F. K. Bukhari, M. Coustaty, M. M. Luqman, S. Bakkali, M. G. Madden, N. I. Kajla

    DOI
  2. WACV Workshops 2026Workshop

    Cross-Lingual Transfer for Complex Scripts: A Benchmark on End-to-End Khmer Scene Text Spotting

    V. Nom, S. Keo, S. Bakkali, M. M. Luqman, M. Coustaty, J.-M. Ogier

    DOI
  3. ICDAR 2025Conference

    WildKhmerST: A Comprehensive Dataset and Benchmark for Khmer Scene Text Detection and Recognition in the Wild

    V. Nom, S. Keo, S. Bakkali, M. M. Luqman, M. Coustaty, M. Rusiñol, J.-M. Ogier

  4. ICDAR Workshops 2025Workshop

    Cross-Lingual Learning for Low-Resource Khmer Scene Text Detection and Recognition

    V. Nom, S. Keo, S. Bakkali, M. M. Luqman, M. Coustaty, J.-M. Ogier

  5. ICDAR Workshops 2025Workshop

    Visual Text Generation in Khmer Language: Challenges and Trends with Diffusion Models

    S. Keo, V. Nom, S. Bakkali, M. M. Luqman, M. Coustaty, J.-M. Ogier

  6. arXiv 2025Preprint

    Evaluating the Impact of Khmer Font Types on Text Recognition

    V. Nom, S. Bakkali, M. M. Luqman, M. Coustaty, J.-M. Ogier

  7. ACCV 2024Conference

    KhmerST: A Low-Resource Khmer Scene Text Detection and Recognition Benchmark

    V. Nom, S. Bakkali, M. M. Luqman, M. Coustaty, J.-M. Ogier

  8. ACET 2024Conference
Trust, identity & security3

Identity documents, document quality, and reputation systems for evaluating language models.

  1. WACV Workshops 2025Workshop

    IDTrust: Deep Identity Document Quality Detection with Bandpass Filtering

    M. Al-Ghadi, J. Voerman, S. Bakkali, M. Coustaty, O. Lessard, N. Sidère

  2. COMPSAC 2024Conference

    LLMChain: Blockchain-Based Reputation System for Sharing and Evaluating Large Language Models

    M. A. Bouchiha, Q. Telnoff, S. Bakkali, R. Champagnat, M. Rabah, M. Coustaty, Y. Ghamri-Doudane

  3. ICDAR Workshops 2019Workshop
Language & translation5

Neural machine translation for specialized domains, knowledge distillation, compression, and knowledge-graph-to-text generation.

  1. arXiv 2026Preprint
  2. EAMT 2026Conference
  3. AICS 2025Conference
  4. arXiv 2025Preprint
  5. Applied Sciences 2025Journal
Graph learning2

Graph representations and benchmarks for structured document data.

  1. IJDAR 2026Journal

    HSB-GDL: A Heterogeneous Subgraph Benchmark for Classification and Query Spotting

    M. Farhan, M. D. A. Awan, M. M. Luqman, S. Bakkali, M. Coustaty, N. I. Kajla

    DOI
  2. GbRPR 2025Workshop

    Fusion of GNN and GBDT Models for Graph and Node Classification

    M. Farhan, N. I. Kajla, M. D. A. Awan, M. Coustaty, M. M. Luqman, S. Bakkali

§ 03 Lineage

Where my models sit among document representations.

Table I of the survey traces representation learning for documents from BERT to instruction-tuned layout models. EAML, VLCDoC and GlobalDoc are mine. Every row shares one empty column: native state.

Table I · Representation lineage InteractiveFrom the paper
Table I: 13 representation models for documents, with their modality, pretraining and four properties.
Method Year Modality Pretraining Layout Visual OCR-free Native state
BERT 2019 Text MLM – – – –
LayoutLMv1–v3 2020–22 Text+Layout+Vision MLM/MIM ✓ ✓ – –
EAML My work: EAML: Ensemble Self-Attention-Based Mutual Learning Network for Document Image Classification 2021 Image+Text Mutual learning – ✓ – –
SelfDoc 2021 Cross-modal Self-supervised ✓ ✓ – –
UDoc 2021 Cross-modal Unified alignment ✓ ✓ – –
DiT 2022 Vision MIM Implicit ✓ ✓ –
Bi-VLDoc 2022 Cross-modal Bidirectional VL ✓ ✓ – –
Donut 2022 Vision→Text Seq2seq Implicit ✓ ✓ –
VLCDoC My work: VLCDoC: Vision-Language Contrastive Pre-Training Model for Cross-Modal Document Classification 2023 Cross-modal VL contrastive – ✓ – –
Pix2Struct 2023 Vision→Text Seq2seq Implicit ✓ ✓ –
UDOP 2023 Vision+Text+Layout Generative ✓ ✓ Partial –
DocLLM / LayoutLLM 2024 Vision+Text+Layout Instruction tuning ✓ ✓ Partial –
GlobalDoc My work: GlobalDoc: A Cross-Modal Vision-Language Framework for Real-World Document Image Retrieval and Classification 2025 Cross-modal Unified VL ✓ ✓ – –

13 representation models for documents, BERT (2019) to GlobalDoc (2025). Rows marked My work are my models and link to their publication pages. Source: Table I of the paper.

§ 04 People & places

Done with others.

I co-supervise PhD students on low-resource scene-text recognition and explainable multimodal document understanding, and work with groups across Europe and Asia.

Grants, collaborations and service

Collaborations

  • Computer Vision Center (CVC), Universitat Autònoma de Barcelona · Spain
  • KU Leuven · Belgium
  • L2TI · France
  • South East Technological University (SETU) · Ireland
  • Jožef Stefan Institute · Slovenia
  • University of Science and Technology of Hanoi (USTH) · Vietnam
  • Cambodia Academy of Digital Technology · Cambodia
  • MNS University · Pakistan
  • Allread ML Technologies · Spain, industry
  • Siren · France, industry

Earlier work: PhD research statement (2019–2022).