Tom Simon
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Tom Simon has a total of 5 co-authors. Here are the top co-authors by number of shared publications:
- Clément Chatelain
INSA of Rouen Normandy
3 shared publications - Pierrick Tranouez
LITIS EA4108, University of Rouen Normandy
3 shared publications - Thierry Paquet
LITIS EA4108, University of Rouen Normandy
3 shared publications - William Mocaër
LITIS EA4108, University of Rouen Normandy
2 shared publications - Stéphane Nicolas
University of Rouen Normandy
1 shared publication
Latest Publications
- 23 August 2026
- Published by Springer Nature
- p. 608-625
Few-Shot Writer Adaptation via Multimodal In-Context Learning
- 23 August 2026
- Published by Springer Nature
- p. 608-625
Few-Shot Writer Adaptation via Multimodal In-Context Learning
- 16 September 2025
- Published by Springer Nature
- p. 224-243
Classifying the Unknown: In-Context Learning for Open-Vocabulary Text and Symbol Recognition
- 16 September 2025
- Published by Springer Nature
- p. 224-243
Classifying the Unknown: In-Context Learning for Open-Vocabulary Text and Symbol Recognition
- Open Access
Classifying the Unknown: In-Context Learning for Open-Vocabulary Text and Symbol Recognition
We introduce Rosetta, a multimodal model that leverages Multimodal In-Context Learning (MICL) to classify sequences of novel script patterns in documents by leveraging minimal examples, thus eliminating the need for explicit retraining. To enhance contextual learning, we designed a dataset generation process that ensures varying degrees of contextual informativeness, improving the model's adaptability in leveraging context across different scenarios. A key strength of our method is the use of a Context-Aware Tokenizer (CAT), which enables open-vocabulary classification. This allows the model to classify text and symbol patterns across an unlimited range of classes, extending its classification capabilities beyond the scope of its training alphabet of patterns. As a result, it unlocks applications such as the recognition of new alphabets and languages. Experiments on synthetic datasets demonstrate the potential of Rosetta to successfully classify Out-Of-Distribution visual patterns and diverse sets of alphabets and scripts, including but not limited to Chinese, Greek, Russian, French, Spanish, and Japanese.
Open AccessClassifying the Unknown: In-Context Learning for Open-Vocabulary Text and Symbol Recognition
We introduce Rosetta, a multimodal model that leverages Multimodal In-Context Learning (MICL) to classify sequences of novel script patterns in documents by leveraging minimal examples, thus eliminating the need for explicit retraining. To enhance contextual learning, we designed a dataset generation process that ensures varying degrees of contextual informativeness, improving the model's adaptability in leveraging context across different scenarios. A key strength of our method is the use of a Context-Aware Tokenizer (CAT), which enables open-vocabulary classification. This allows the model to classify text and symbol patterns across an unlimited range of classes, extending its classification capabilities beyond the scope of its training alphabet of patterns. As a result, it unlocks applications such as the recognition of new alphabets and languages. Experiments on synthetic datasets demonstrate the potential of Rosetta to successfully classify Out-Of-Distribution visual patterns and diverse sets of alphabets and scripts, including but not limited to Chinese, Greek, Russian, French, Spanish, and Japanese.