Visual control
View article: Hybrid Visual Servoing for Robotic Assistance in ENT Microsurgery: A Case Study on Middle Ear Access
Hybrid Visual Servoing for Robotic Assistance in ENT Microsurgery: A Case Study on Middle Ear Access Open
International audience
View article: Look, predict, intercept: Visual exposure seeds model-based control in moving-target interception
Look, predict, intercept: Visual exposure seeds model-based control in moving-target interception Open
Humans frequently pursue moving objects that temporarily disappear from view, yet the control strategies underlying successful interception remain debated. While some theories emphasize on-line guidance via optic flow, others propose that …
View article: Transformer Driven Visual Servoing and Dual Arm Impedance Control for Fabric Texture Matching
Transformer Driven Visual Servoing and Dual Arm Impedance Control for Fabric Texture Matching Open
In this paper, we propose a method to align and place a fabric piece on top of another using a dual-arm manipulator and a grayscale camera, so that their surface textures are accurately matched. We propose a novel control scheme that combi…
View article: Visual Servo-Based Real-Time Eye Tracking by Delta Robot
Visual Servo-Based Real-Time Eye Tracking by Delta Robot Open
This work presents and validates an eye-tracking-based visual system for driving the delta robot. A delta robot is tracked by image processing based on vision servo control. The vision servo program is developed in C++ to perform image pro…
View article: In-Video Instructions: Visual Signals as Generative Control
In-Video Instructions: Visual Signals as Generative Control Open
Large-scale video generative models have recently demonstrated strong visual capabilities, enabling the prediction of future frames that adhere to the logical and physical cues in the current observation. In this work, we investigate wheth…
View article: In-Video Instructions: Visual Signals as Generative Control
In-Video Instructions: Visual Signals as Generative Control Open
Large-scale video generative models have recently demonstrated strong visual capabilities, enabling the prediction of future frames that adhere to the logical and physical cues in the current observation. In this work, we investigate wheth…
View article: Proprioceptive and visual motion detection acuity contribute to children’s dynamic postural control
Proprioceptive and visual motion detection acuity contribute to children’s dynamic postural control Open
Acquiring efficient postural control strategies is key to children's proper motor development. For that, the brain needs to continuously integrate sensory information and convert it into corrective motor commands. Although this entire proc…
View article: Panoramic optic-flow profile guiding aerial exploration through turns in simulated environments
Panoramic optic-flow profile guiding aerial exploration through turns in simulated environments Open
Optic flow-based navigation, inspired by biological systems, differs from traditional vision-based techniques, reducing computational requirements and enabling a more reactive approach. So far, this optic flow-based approach suffers from c…
View article: AdaptPNP: Integrating Prehensile and Non-Prehensile Skills for Adaptive Robotic Manipulation
AdaptPNP: Integrating Prehensile and Non-Prehensile Skills for Adaptive Robotic Manipulation Open
Non-prehensile (NP) manipulation, in which robots alter object states without forming stable grasps (for example, pushing, poking, or sliding), significantly broadens robotic manipulation capabilities when grasping is infeasible or insuffi…
View article: AdaptPNP: Integrating Prehensile and Non-Prehensile Skills for Adaptive Robotic Manipulation
AdaptPNP: Integrating Prehensile and Non-Prehensile Skills for Adaptive Robotic Manipulation Open
Non-prehensile (NP) manipulation, in which robots alter object states without forming stable grasps (for example, pushing, poking, or sliding), significantly broadens robotic manipulation capabilities when grasping is infeasible or insuffi…
View article: Navigating the Wild: Pareto-Optimal Visual Decision-Making in Image Space
Navigating the Wild: Pareto-Optimal Visual Decision-Making in Image Space Open
Navigating complex real-world environments requires semantic understanding and adaptive decision-making. Traditional reactive methods without maps often fail in cluttered settings, map-based approaches demand heavy mapping effort, and lear…
View article: Navigating the Wild: Pareto-Optimal Visual Decision-Making in Image Space
Navigating the Wild: Pareto-Optimal Visual Decision-Making in Image Space Open
Navigating complex real-world environments requires semantic understanding and adaptive decision-making. Traditional reactive methods without maps often fail in cluttered settings, map-based approaches demand heavy mapping effort, and lear…
View article: When Object-Centric World Models Meet Policy Learning: From Pixels to Policies, and Where It Breaks
When Object-Centric World Models Meet Policy Learning: From Pixels to Policies, and Where It Breaks Open
Object-centric world models (OCWM) aim to decompose visual scenes into object-level representations, providing structured abstractions that could improve compositional generalization and data efficiency in reinforcement learning. We hypoth…
View article: When Object-Centric World Models Meet Policy Learning: From Pixels to Policies, and Where It Breaks
When Object-Centric World Models Meet Policy Learning: From Pixels to Policies, and Where It Breaks Open
Object-centric world models (OCWM) aim to decompose visual scenes into object-level representations, providing structured abstractions that could improve compositional generalization and data efficiency in reinforcement learning. We hypoth…
View article: Remote Control System for a VTOL UAV Stand with Computer Vision Elements
Remote Control System for a VTOL UAV Stand with Computer Vision Elements Open
This work presents a remote control system for a vertical take-off and landing unmanned aerial vehicle (VTOL UAV) stand, implemented using the ESP32 microcontroller. The system provides control of actuators and aviation lights through a lo…
View article: Optimized Sensorimotor Activation Enhances the Control of Goal‐Directed Aiming Mediated by Real‐Time Visuomotor Transformations
Optimized Sensorimotor Activation Enhances the Control of Goal‐Directed Aiming Mediated by Real‐Time Visuomotor Transformations Open
Improving motor abilities may result from sensory–motor stimulations involving repetitive mechanical vibratory applications focused on muscles or tendons. These stimulations activate the proprioceptive pathway, critical for effective motio…
View article: Monocular vision-based visual control for SCARA-type robotic arms: a depth mapping approach
Monocular vision-based visual control for SCARA-type robotic arms: a depth mapping approach Open
The accelerated growth of an increasingly automated industry requires the use of autonomous robotic systems. However, the use of these systems commonly requires an enormous amount of sensors. In this paper we evaluate the performance of a …
View article: VAT4MAV: Visual Active Tracking for Micro Aerial Vehicles
VAT4MAV: Visual Active Tracking for Micro Aerial Vehicles Open
Visual active tracking has become an increasingly prominent topic in robotics because of its central role in applications such as assistive robotics and surveillance. Unlike passive tracking, active methods tightly couple perception and co…
View article: Is there evidence that implants can assist with the direct stimulation of visual areas of the brain?
Is there evidence that implants can assist with the direct stimulation of visual areas of the brain? Open
There is evidence from recent studies showing that implants can assist with the direct stimulation of visual areas of the brain, suggesting potential applications in visual prostheses.
View article: Is there evidence that implants can assist with the direct stimulation of visual areas of the brain?
Is there evidence that implants can assist with the direct stimulation of visual areas of the brain? Open
There is evidence from recent studies showing that implants can assist with the direct stimulation of visual areas of the brain, suggesting potential applications in visual prostheses.
View article: Image Space Path Following Control Using Visual Servoing
Image Space Path Following Control Using Visual Servoing Open
View article: CARPOS Deliverable 4 - Control schemes for occlusion-free active perception
CARPOS Deliverable 4 - Control schemes for occlusion-free active perception Open
The present document is a deliverable of the CARPOS project. It reports on Control schemes for occlusion-free active perception. In particular, the CARPOS team developed a number of control schemes for the active perception of the scene an…
View article: Integration of parallel pathways for flight control in a hawkmoth reflects prevalence and relevance of natural visual cues
Integration of parallel pathways for flight control in a hawkmoth reflects prevalence and relevance of natural visual cues Open
An animal’s behaviour is the result of multiple neural pathways acting in parallel, receiving information across and within sensory modalities at the same time. How these pathways are integrated, particularly when their individual outputs …
View article: Visual Servoing Control of a Tendon-driven Soft Robotic Neck
Visual Servoing Control of a Tendon-driven Soft Robotic Neck Open
View article: A calibration-free visual control approach for table tennis training robots using a positional monocular camera
A calibration-free visual control approach for table tennis training robots using a positional monocular camera Open
View article: Investigating Feedback-Informed Screen-Guided Training to Enhance Myoelectric Control and Predictability
Investigating Feedback-Informed Screen-Guided Training to Enhance Myoelectric Control and Predictability Open
Screen-guided training is a widely used method for calibrating myoelectric prostheses, wherein users follow visual prompts. However, this approach often fails to capture the complexities of real-world usage when the user is actively engagi…
View article: Homography-Based Predictive Control for Smooth Visual Path Following in Autonomous Robots
Homography-Based Predictive Control for Smooth Visual Path Following in Autonomous Robots Open
View article: Hierarchical Organization of Visual Feature Attention Control
Hierarchical Organization of Visual Feature Attention Control Open
Attention can be deployed in anticipation of visual stimuli based on features such as their color or direction of motion. This anticipatory feature-based attention involves top-down neural control signals from the frontoparietal network th…
View article: Visual Deprivation’s Impact on Dynamic Posture Control of Trunk: A Comprehensive Sensing Information Analysis of Neurophysiological Mechanisms
Visual Deprivation’s Impact on Dynamic Posture Control of Trunk: A Comprehensive Sensing Information Analysis of Neurophysiological Mechanisms Open
Visual information affects static postural control, but how it affects dynamic postural control still needs to be fully understood. This study investigated the effect of proprioception weighting, influenced by the presence or absence of vi…
View article: Visual Predictive Control for mobile manipulator: Visibility, manipulability, and stability
Visual Predictive Control for mobile manipulator: Visibility, manipulability, and stability Open