Tim J. Schoonbeek
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Tim J. Schoonbeek has a total of 16 co-authors. Here are the top co-authors by number of shared publications:
Jacek Kustra
2 shared publicationsShao-Hsuan Hung
2 shared publications- Dan Bohus
Microsoft Research, United States
1 shared publication Dan Lehman
1 shared publication- Eric Horvitz
Microsoft, Redmond, WA, USA
1 shared publication Fons Van der Sommen
1 shared publication
Latest Publications
- Open Access
- 4 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 1153-1168
"Great! The Next Step Is...": In Pursuit of Proactive Assistance with Multimodal Foundation Models
- 4 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 1153-1168
Open Access"Great! The Next Step Is...": In Pursuit of Proactive Assistance with Multimodal Foundation Models
- Open Access
- 18 October 2025
- Published by Elsevier in Computer Vision and Image Understanding
- Vol. 262
Learning to recognize correctly completed procedure steps in egocentric assembly videos through spatio-temporal modeling
- 18 October 2025
- Published by Elsevier in Computer Vision and Image Understanding
- Vol. 262
Open AccessLearning to recognize correctly completed procedure steps in egocentric assembly videos through spatio-temporal modeling
- 25 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 9 (11) , 9915-9922
Supervised Representation Learning Towards Generalizable Assembly State Recognition
Assembly state recognition facilitates the execution of assembly procedures, offering feedback to enhance efficiency and minimize errors. However, recognizing assembly states poses challenges in scalability, since parts are frequently updated, and the robustness to execution errors remains underexplored. To address these challenges, this paper proposes an approach based on representation learning and the novel intermediate-state informed loss function modification (ISIL). ISIL leverages unlabeled transitions between states and demonstrates significant improvements in clustering and classification performance for all tested architectures and losses. Despite being trained exclusively on images without execution errors, thorough analysis on error states demonstrates that our approach accurately distinguishes between correct states and states with various types of execution errors. The integration of the proposed algorithm can offer meaningful assistance to workers and mitigate unexpected losses due to procedural mishaps in industrial settings. The code is available at: https://timschoonbeek.github.io/state_rec
- 25 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 9 (11) , 9915-9922
Supervised Representation Learning Towards Generalizable Assembly State Recognition
Assembly state recognition facilitates the execution of assembly procedures, offering feedback to enhance efficiency and minimize errors. However, recognizing assembly states poses challenges in scalability, since parts are frequently updated, and the robustness to execution errors remains underexplored. To address these challenges, this paper proposes an approach based on representation learning and the novel intermediate-state informed loss function modification (ISIL). ISIL leverages unlabeled transitions between states and demonstrates significant improvements in clustering and classification performance for all tested architectures and losses. Despite being trained exclusively on images without execution errors, thorough analysis on error states demonstrates that our approach accurately distinguishes between correct states and states with various types of execution errors. The integration of the proposed algorithm can offer meaningful assistance to workers and mitigate unexpected losses due to procedural mishaps in industrial settings. The code is available at: https://timschoonbeek.github.io/state_rec