Adaptive Human Robot Collaboration Model Using Computer Vision and Intelligent Control for Flexible Manufacturing Workstations

Deny Prasetyo; Suyahman Suyahman; Hadi Jayusman; Samsinar Samsinar; Nimas Ratna Sari; Mursalim Mursalim

doi:10.61132/ijmicse.v2i3.406

Authors

Deny Prasetyo Universitas Sugeng Hartono
Suyahman Suyahman Universitas Sugeng Hartono
Hadi Jayusman Universitas Harapan Bangsa
Samsinar Samsinar Stikes Garuda Putih
Nimas Ratna Sari Universitas Sugeng Hartono
Mursalim Mursalim Universitas Sugeng Hartono

DOI:

https://doi.org/10.61132/ijmicse.v2i3.406

Keywords:

Adaptive Control, Collaborative Robotiics, Computer Vision, Human Robot Collaboration, Smart Manufacturing

Abstract

The rapid development of modern manufacturing technology has driven the emergence of human-robot collaboration (HRC) as part of the transformation toward a human-centric intelligent production system. In collaborative work environments, robots are not only required to work efficiently but also to interact safely and responsively with operators. However, most conventional industrial robot systems still use rigid motion controls and are unable to dynamically adapt to human activity around them.This research aims to develop a human-robot collaboration system by integrating computer vision technology to detect operator movement and applying adaptive control algorithms to the robot manipulator. The research methodology includes designing a collaborative workstation, implementing a computer vision-based motion detection system, developing an adaptive control algorithm, and evaluating system performance through various experimental scenarios. Evaluation parameters include task completion time, safe distance, and system response time.The results show that the developed system significantly improves the efficiency and safety of human-robot interaction compared to conventional systems, with shorter task times, optimal safe distances, and faster system response to operator movements.

References

Amin, F. M., Rezayati, M., van de Venn, H. W., & Karimpour, H. (2020). A mixed-perception approach for safe human-robot collaboration in industrial automation. Sensors, 20(21), 6347. https://doi.org/10.3390/s20216347

Cohen, Y., Biton, A., & Shoval, S. (2025). Fusion of computer vision and AI in collaborative robotics: A review and future prospects. Applied Sciences, 15(14), 7905. https://doi.org/10.3390/app15147905

Darmanin, B., Bonello, A., & Francalanza, E. (2024). A systematic design approach for cognitively ergonomic collaborative robotic workspaces. Procedia CIRP, 130, 853–860. https://doi.org/10.1016/j.procir.2024.10.175

Eswaran, U., Eswaran, V., Eswaran, V., & Murali, K. (2024). Human-robot collaboration analyzing the challenges and opportunities of integrating soft computing algorithms in manufacturing environments. In Evolution and advances in computing technologies for Industry 6.0 (pp. 22–51). CRC Press. https://doi.org/10.1201/9781003503934-2

Fan, J., Yin, Y., Wang, T., Dong, W., Zheng, P., & Wang, L. (2025). Vision-language model-based human-robot collaboration for smart manufacturing: A state-of-the-art survey. Frontiers of Engineering Management, 12(1), 177–200. https://doi.org/10.1007/s42524-025-4136-9

Gkournelos, C., Konstantinou, C., & Makris, S. (2024). An LLM-based approach for enabling seamless human-robot collaboration in assembly. CIRP Annals, 73(1), 9–12. https://doi.org/10.1016/j.cirp.2024.04.002

Gualtieri, L., Rojas, R. A., Ruiz Garcia, M. A., Rauch, E., & Vidoni, R. (2020). Implementation of a laboratory case study for intuitive collaboration between man and machine in SME assembly. In Industry 4.0 for SMEs: Challenges, opportunities and requirements (pp. 335–382). Springer. https://doi.org/10.1007/978-3-030-25425-4_12

Gundage, V., et al. (2025). Enhancing manufacturing efficiency and safety through human-robot collaboration: A comprehensive review. Journal of Mines, Metals and Fuels, 73(4), 943–950. https://doi.org/10.18311/jmmf/2025/48270

Halme, R.-J., Lanz, M., Kämäräinen, J., Pieters, R., Latokartano, J., & Hietanen, A. (2018). Review of vision-based safety systems for human-robot collaboration. Procedia CIRP, 72, 111–116. https://doi.org/10.1016/j.procir.2018.03.043

Kumar, C. K., & Rawal, K. (2022). A brief study on object detection and tracking. Journal of Physics: Conference Series, 2327(1), 012012. https://doi.org/10.1088/1742-6596/2327/1/012012

Lei, J., & Ryu, K. (2024). Framework of implementing sensor fusion for enabling human cognitive abilities in collaborative robot. In Proceedings of the International Conference on Computers and Industrial Engineering (pp. 1444–1453).

Li, S., et al. (2023). Proactive human-robot collaboration: Mutual-cognitive, predictable, and self-organising perspectives. Robotics and Computer-Integrated Manufacturing, 81, 102510. https://doi.org/10.1016/j.rcim.2022.102510

Li, S., Zheng, P., & Wang, L. (2024). Introduction. In Proactive human-robot collaboration toward human-centric smart manufacturing (pp. 1–8). Elsevier. https://doi.org/10.1016/B978-0-44-313943-7.00008-9

Malaka, J. (2019). Autonomous robot control system for automation of manipulations. In Advances in intelligent systems and computing (Vol. 934, pp. 298–307). Springer. https://doi.org/10.1007/978-3-030-15857-6_30

Matsas, E., Vosniakos, G.-C., & Batras, D. (2018). Prototyping proactive and adaptive techniques for human-robot collaboration in manufacturing using virtual reality. Robotics and Computer-Integrated Manufacturing, 50, 168–180. https://doi.org/10.1016/j.rcim.2017.09.005

Mohammed, A., Schmidt, B., & Wang, L. (2017). Active collision avoidance for human-robot collaboration driven by vision sensors. International Journal of Computer Integrated Manufacturing, 30(9), 970–980. https://doi.org/10.1080/0951192X.2016.1268269

Ouchra, H., & Belangour, A. (2021). Object detection approaches in images: A survey. In Proceedings of SPIE (p. 118780H). https://doi.org/10.1117/12.2601452

San Martin, A., Kildal, J., & Lazkano, E. (2025). Mixed reality representation of hazard zones while collaborating with a robot: Sense of control over own safety. Virtual Reality, 29(1), 43. https://doi.org/10.1007/s10055-025-01107-2

Singh, C., Gatti, R. R., Harve, G. H. S., Sairam, K. V. S. S. S. S. S., Prasad, D., & Poornima, P. (2025). Synergistic thinking: Human-robot partnership for smarter decisions. In Design and optimization of mobile robotics for Industry 5.0 (pp. 173–185). IGI Global. https://doi.org/10.1002/9781394385027.ch9

Wang, L., Liu, S., Liu, H., & Wang, X. V. (2020). Overview of human-robot collaboration in manufacturing. In Lecture notes in mechanical engineering (pp. 15–58). Springer. https://doi.org/10.1007/978-3-030-46212-3_2