Dynamic HUD Imaging Method for Ground Autonomous Robotics

Purpose of research. Visualization of information on a Head-up Display (HUD) has long been an integral part of the aviation industry, and is also actively developing in the automotive industry. This additional source of information allows the pilot, driver or other types of users to be focused on the surrounding environment, while receiving additional information that is important at the current time. However, the use of HUDs for robotic systems has not yet been fully developed.

Methods. This article presents a method that provides dynamic formation of display elements depending on the current state in which the robotic device operates. The presented method is universal and provides the output of information that is relevant to the current operating process.

Results. To approbation the developed method, software was introduced that dynamically forms head-up display elements in software for a training ground robotic platform. Scenarios for the functioning of the platform with a different set of sensors and dynamically generated display presentation options were developed and tested. The results of testing the developed solution on a control group of 32 people and a comparative analysis with a display without dynamic formation of elements showed that 87.5% of subjects perceive information much better.

Conclusion. This article analyzes the applicability of Head-up displays in the fields of aviation and automotive technology. Based on the data obtained, a classification of information displayed on the HUD was compiled. Testing of the developed method showed that 28 out of 32 people preferred to use dynamically generated HUDs, which shows the promise of further development of this solution.

1. Yamin P.A.R., Park J., Kim H.K. Towards a Human-Machine Interface Guidance for inVehicle Augmented Reality Head-up Displays. ICIC Express Letters. 2021; 15(12): 1313–1318.

2. Li K., Geng Y., Yöntem A.Ö., Chu D., Meijering V., Dias E., Skrypchuk L. Head-up display with dynamic depth-variable viewing effect. Optik. 2020; 221: 165319.

3. Fadden S., Ververs P.M., Wickens C.D. Costs and benefits of head-up display use: A meta-analytic approach. In Proceedings of the human factors and ergonomics society annual meeting. 1998; 42(1): 16–20.

4. Ling B., Bo L., Bingzheng S., Lingcun Q., Chengqi X., Yafeng N. A cognitive study of multicolour coding for the head-up display (HUD) of fighter aircraft in multiple flight environments. Journal of Physics: Conference Series. 2019; 1215(1): 012032.

5. Neretin E.S., Dyachenko S.A., Chufirin V.A., Ilyashenko D.M. Head-up display architecture development for perspective civil aircraft. In IOP Conference Series: Materials Science and Engineering. 2020; 868(1): 012030.

6. Guo H., Zhao F., Wang W., Jiang X. Analyzing Drivers' Attitude towards HuD system using a stated Preference survey. Advances in Mechanical Engineering. 2014; 6: 380647.

7. Burnett G.E. A road-based evaluation of a head-up display for presenting navigation information. In Proc. of the Tenth International Conference on HumanComputer Interaction (2003). 2019: 180–184.

8. Murugan S., Sampathkumar A., Kanaga Suba Raja S., Ramesh S., Manikandan R., Gupta D. Autonomous vehicle assisted by heads up display (HUD) with augmented reality based on machine learning techniques. In Virtual and Augmented Reality for Automobile Industry: Innovation Vision and Applications. 2022: 45–64.

9. Smith M., Jordan L., Bagalkotkar K., Sai Manjuluri S., Nittala R., Gabbard J. Hit the brakes! Augmented reality head-up display impact on driver responses to unexpected events. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 2020: 46–49.

10. Pečečnik K.S., Tomažič S., Sodnik J. Design of head-up display interfaces for automated vehicles. International Journal of Human-Computer Studies. 2023; 177: 103060.

11. Liu Y.C., Wen M.H. Comparison of head-up display (HUD) vs. head-down display (HDD): driving performance of commercial vehicle operators in Taiwan. International Journal of Human-Computer Studies. 2004; 61(5): 679–697.

12. Beck D., Jung J., Park J., Park W. A study on user experience of automotive HUD systems: Contexts of information use and user-perceived design improvement points. International Journal of Human–Computer Interaction. 2019; 35(20): 1936–1946.

13. Xiao X., Wanyan X., Zhuang D., Wei Z. Ergonomic design and evaluation of visual coding for aircraft head-up display. In 2012 5th International Conference on BioMedical Engineering and Informatics 2012: 748–752.

14. Yousefpour A., Fung C., Nguyen T., Kadiyala K., Jalali F., Niakanlahiji A., Kong J., Jue J.P. All one needs to know about fog computing and related edge computing paradigms: A complete survey. Journal of Systems Architecture. 2019; 98: 289–330.

15. Krestovnikov K.D., Erashov A.A. Razrabotka arhitektury i obobshchennoj struktury modulej raspredelennoj sistemy upravleniya robototekhnicheskimi kompleksami razlichnogo naznacheniya [Development of the architecture and generalized structure of modules for a distributed control system for robotic complexes for various purposes]. Robototekhnika i tekhnicheskaya kibernetika = Robotics and Technical Cybernetics. 2022; 10(3): 201–212.

16. Erashov A.A., Kamynin K.V., Krestovnikov K.D., Saveliev A.I. Metod ocenki vremeni besprovodnoj peredachi energeticheskih resursov mezhdu dvumya robotami [A method for estimating the time of wireless transfer of energy resources between two robots].. Informatika i avtomatizaciya = Informatics and Automation. 2021; 20(6): 1279–1306.

17. Saveliev A.I., Kamynin K.V., Erashov A.A., Cherskikh E.O. Algoritm planirovaniya lokal'nyh traektorij dvizheniya nazemnogo robototekhnicheskogo sredstva s uchetom global'nogo marshruta [An algorithm for planning local trajectories of movement of a groundbased robotic vehicle, taking into account the global route]. Robototekhnika i tekhnicheskaya kibernetika = Robotics and Technical Cybernetics. 2023; 11(3): 188–196.

18. Kuznetsov L., Kozyr P., Levonevskiy D. Algorithm of Target Point Assignment for Robot Path Planning Based on Costmap Data. In Electromechanics and Robotics: Proceedings of 16th International Conference on Electromechanics and Robotics" Zavalishin's Readings"(ER (ZR) 2021). 2022: 121–130.

19. Zakharov K. S., Saveliev A. I. Smoothing the Curvature of Trajectory of Ground Robot in 3D Space. Izvestiya Yugo-Zapadnogo gosudarstvennogo universiteta = Proceedings of the Southwest State University. 2020; 24(4): 107-125 (In Russ.). https://doi.org/10.21869/2223-1560-2020-24-4-107-125.

20. Chernousova P.M., Saveliev A.I., Cherskikh E.O. [Educational online course on ground robotics of St. Petersburg Federal Research Center of the Russian Academy of Sciences]. XIV Sankt-Peterburgskij kongress “Professional'noe obrazovanie, nauka i innovacii V XXI veke” = XIV St. Petersburg Congress “Vocational education, science and innovation in the 21st century”]. St. Petersburg, 2022: 230–234 (In Russ.).

21. Rider R.M. Color psychology and graphic design applications. Senior Honors Theses. 2010.