NeuroMechFly v2: simulating embodied sensorimotor control in adult Drosophila
- 12 November 2024
- journal article
- research article
- Published by Springer Nature in Nature Methods
- Vol. 21 (12) , 2353-2362
Abstract
Discovering principles underlying the control of animal behavior requires a tight dialogue between experiments and neuromechanical models. Such models have primarily been used to investigate motor control with less emphasis on how the brain and motor systems work together during hierarchical sensorimotor control. NeuroMechFly v2 expands Drosophila neuromechanical modeling by enabling vision, olfaction, ascending motor feedback and complex terrains that can be navigated using leg adhesion. We illustrate its capabilities by constructing biologically inspired controllers that use ascending feedback to perform path integration and head stabilization. After adding vision and olfaction, we train a controller using reinforcement learning to perform a multimodal navigation task. Finally, we illustrate more bio-realistic modeling involving complex odor plume navigation, and fly–fly following using a connectome-constrained visual network. NeuroMechFly can be used to accelerate the discovery of explanatory models of the nervous system and to develop machine learning-based controllers for autonomous artificial agents and robots.Keywords
All Related Versions
Funding Information
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (175667, 181239)
- Boehringer Ingelheim Fonds
This publication has 66 references indexed in Scilit:
- Comparison of smooth and hairy attachment pads in insects: friction,adhesion and mechanisms for direction-dependenceJournal of Experimental Biology, 2008
- Glutamate, GABA and Acetylcholine Signaling Components in the Lamina of the Drosophila Visual SystemPLOS ONE, 2008
- From Swimming to Walking with a Salamander Robot Driven by a Spinal Cord ModelScience, 2007
- Biomechanics of smooth adhesive pads in insects: influence of tarsal secretion on attachment performanceJournal of Comparative Physiology A, 2006
- Goal-Driven Behavioral Adaptations in Gap-Climbing DrosophilaCurrent Biology, 2005
- Anatomical and molecular design of the Drosophila antenna as a flagellar auditory organMicroscopy Research and Technique, 2004
- Odor Coding in a Model Olfactory Organ: TheDrosophilaMaxillary PalpThe Journal of Neuroscience, 1999
- Walknet—a biologically inspired network to control six-legged walkingNeural Networks, 1998
- Drosophila mushroom bodies are dispensable for visual, tactile, and motor learning.1998
- What mechanisms coordinate leg movement in walking arthropods?Trends in Neurosciences, 1990