Mixed and Augmented Control System of Industrial Robotized Environment

DEVELOPED FOR
Large-scale warehouse and logistics operators (managing complex robotic environments with dispersed frontline workforce)

The challenge

  • Industrial operations are becoming more complex, while demands for speed and precision continue to rise
  • Equipment servicing, troubleshooting, and robot programming remain highly manual and resource-intensive
  • Failures result in prolonged downtime due to the limited availability of qualified personnel

This leads to escalating operational costs and growing inefficiencies in traditional support models.

The Solution

The project introduces a mixed and augmented reality software solution that bridges the gap between frontline operators and expert knowledge. Using AR/MR headsets and mobile devices, digital information is layered directly into the worker’s field of vision, turning complex tasks into guided, interactive workflows.

Key features include:

  • Step-by-step overlays for robot control and equipment servicing.
  • Remote expert support via live video, audio, and holographic annotations.
  • Interactive training modules for rapid skill transfer without classroom sessions.
  • Context-aware instructions that adapt to the specific machine or component in use.

This approach lowers the barrier to entry for operators, reduces reliance on scarce expertise, and accelerates the resolution of technical issues.

Impact

Industrial Directions

The software solution extends to any sector where remote expertise and rapid troubleshooting add value, including logistics, warehousing, industrial maintenance, and smart manufacturing.

Research Team

Meet Our PIs

Discover the principal investigators behind this project and the expertise that made it possible.

Prof. Dr. Alexander Tormasov

Open Vacancies

Join our team working on cutting-edge autonomous transport systems. Explore opportunities in machine learning, computer vision, and robotics.

Related Projects

Explore our innovative research work

Discover a selection of our key projects that highlight our commitment to advancing education through research.

MiAD Crystal Generation (Mirage Atoms)

AI-Scientist (MIND-MATTER)

AI Garbage Sorting – Robotic Cell Based on an Industrial Robotic Arm for Sorting Randomly Located Objects Using CV and AI