RhabdoForge: A Modular, Biophysically-Grounded Rendering Framework for Insect Vision Neuroethology
Le Moël, F.; Webb, B.
Show abstract
Insects solve complex behavioural tasks with remarkable efficiency, using minimal neural hardware tuned to the specific requirements of their ecological niches. To truly understand or replicate these behaviours, it is insufficient to model the brain in isolation: one must account for the dynamic, closed-loop interactions between the environment, the physical organisation of the sensory periphery, and internal biophysical dynamics. To address these issues for visually controlled behaviours, we present RhabdoForge, a modular, hardware-agnostic and high-performance rendering framework specifically designed for insect neuroethology and neuromorphic research. Designed for seamless integration into Python-based workflows, RhabdoForge implements both real-time ray-tracing and stochastic path-tracing using hardware-agnostic GPU pipelines. Crucially, the engine moves beyond the static "ommatidium-as-a-pixel" paradigm by introducing a fully parametrisable model where every layer of the compound eye (from the geometric shape and the topological lattice to the internal rhabdomere blueprint) is a discrete, swappable component. The engine is capable of simulating the high-frequency, sub-ommatidial rhabdomere photomechanical actuation, allowing for the investigation of a variety of active sensing phenomena within a real-time closed-loop environment. The framework also includes an automated morphological pipeline that allows transforming 2D anatomical data into faithful 3D sensory models. We validate the engine through two case studies: a closed-loop optic-flow centring response in a virtual tunnel, and the recovery of spatial hyperacuity via rhabdomere microsaccades. By providing a bridge between high-fidelity visual ecology and neuromorphic modelling, RhabdoForge enables researchers to explore how the interplay of sensory optics and neural processing can generate complex behaviour in both biological and artificial agents.
Matching journals
The top 9 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- BonZeb: Open-source, modular software tools for high-resolution zebrafish tracking and analysis 93%
- Computer vision and deep learning automates nocturnal rainforest ant tracking to provide insight into behavior and disease risk 92%
- Functional characterization of retinal ganglion cells using tailored nonlinear modeling 91%
Similar papers in this journal
- RatInABox: A toolkit for modelling locomotion and neuronal activity in continuous environments 93%
- Investments in photoreceptors compete with investments in optics to determine eye design 93%
- InsectBrainDatabase - A unified platform to manage, share, and archive morphological and functional data 93%
Similar papers in this journal
- SELVa: Simulator of Evolution with Landscape Variation 92%
- Sardine: a modular framework for developing data acquisition and near real-time analysis applications 92%
- Shining a light on camouflage evolution: using genetic algorithms to determine the effects of geometry and lighting on optimal camouflage 91%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.