Recognition of character information for automation of production processes

Purpose of research. Nowadays optical character recognition systems have a high level of dependence on the specific type of marking that is to be recognized, and therefore, the creation of a universal solution is an important and difficult task. The paper considers the issue of creating a system for recognizing symbolic information that can be used at various stages of production to automate processes in control systems, in particular, to analyze the labeling of circuit breakers.

Methods. Binarization, filtering, and boundary detection are digital image processing techniques. Line search method, baseline search method, word splitting algorithms, image enhancement methods by segmentation, damaged characters recognition method, an algorithm for increasing the final recognition quality are character recognition methods.

Results. The analysis of algorithms used for preprocessing and subsequent recognition of images containing marking of circuit breakers is carried out. The mathematical model of image processing for subsequent recognition has been created. We have described methods used to define marking symbols. Illustrative examples of the operation of the algorithms on which the system is built are given. The obtained solution was tested. The ways of system development are described here, they can lead to improved results, for particular use cases.

Conclusion. It is proposed a solution that recognizes symbolic information on the labeling of circuit breakers, which can be the basis for the development and description of systems serving for the automation of production, by transferring information read from the product during the production process. This system, by its example, describes the components of character recognition systems, and for direct use, it needs to be refined in accordance with the technical requirements and the specifics of the conditions in which it will be used.

1. Kazmi W., Nabney I., Vogiatzis G., Rose P., Codd A. An efficient industrial system for vehicle tyre (tire) detection and text recognition using deep learning. IEEE (Transactions on Intelligent Transportation Systems, 2020.

2. Golovko V. A. Kroshchanka A. A. Kovalev M. V. Taberko V. V. Ivaniuk D. S. Implementation of an intelligent decision support system to accompany the manufacturing process. Otkrytye semanticheskie tekhnologii proektirovaniya intellektual'nyh sistem, 2020, pp. 175-182.

3. Panishchev V.S., Khomyakov O.O. [Recognition of symbolic information on the marking of circuit breakers]. Trudy mezhdunarodnoi nauchno-tekhnicheskoi konferentsii "Informatsionnye tekhnologii i matematicheskoe modelirovanie sistem" [Proceedings of the International Scientific and Technical Conference" Information Technologies and Mathematical Modeling of Systems"]. Moscow, 2019, pp. 106-109 (In Russ.).

4. Markov V. V. Reshenie zadachi raspoznavaniya simvolov na izobrazheniyakh tovarnykh tsennikov [Solving the problem of character recognition in images of product price tags]. Evrazijskij soyuz uchenyh = Eurasian Union of Scientists, 2020, pp. 63-65 (In Russ.).

5. Hayashi N., Koyanaka S., Oki T. Constructing an automatic object-recognition algorithm using labeling information for efficient recycling of WEEE. Waste Management, 2019, pp. 337-346.

6. Kopylov I. V., Kazakov A. V., Malygin L. L. Identifikatsiya markirovok rulonov metalloprokata [Identification of rolled metal roll markings]. Vestnik cherepoveckogo gosudarstvennogo universiteta = Bulletin of Cherepovets State University, 2016, pp. 12-15 (In Russ.).

7. Xiang Z., You Z., Qian M., Zhang J., Hu X. Metal stamping character recognition algorithm based on multi-directional illumination image fusion enhancement technology. EURASIP Journal on Image and Video Processing, 2018, pp. 1-11.

8. Shapiro L., Stokman Dzh. Komp'yuternoe zrenie [Computer vision]. Moscow, BINOM Publ., 2013. 752 p. (In Russ.).

9. Gonsales R., Vuds R. Tsifrovaya obrabotka izobrazhenii [Digital image processing]. Moscow, Tekhnosfera Publ., 2012. 1104 p. (In Russ.).

10. Yemel'yanov S.G., Miroshnichenko S.YU., Panishchev V.S., Titov V.S., Trufa nov M.I. Obrabotka tsifrovykh aerokosmicheskikh izobrazhenii dlya geoinformatsionnykh sistem [Processing of digital aerospace images for geographic information systems]. Staryy Oskol, TNT Publ., 2011. 175 p. (In Russ.).

11. Mark S. Nixon, Alberto S. Aguado. Feature Extraction and Image Processing. Academic Press Publ., 2008. 350 p.

12. Otsu N. A threshold selection method from gray-level histograms. IEEE Trans. Sys., Man., Cyber journal, 1979, vol. 9, pp. 62–66.

13. Ping-Sung Liao and Tse-Sheng Chen and Pau-Choo Chung. A Fast Algorithm for Multilevel Thresholding. J. Inf. Sci. Eng., 2001, vol. 17, pp. 713–727.

14. Prett W. Tsifrovaya obrabotka izobrazhenii [Digital image processing]. Moscow, Mir Publ., 1982, vol. 2, 790 p. (In Russ.)

15. Panishchev V.S., Titov V.S Application of neural networks for the contour extraction in images. Pattern Recognition and Image Analysis (Advances in Mathematical Theory and Applications), 2005, vol. 15, no. 2, pp. 277-278.

16. Sergiyenko A.B. Tsifrovaya obrabotka signalov [Digital signal processing]. Saint¬Petersburg, Piter Publ., 2007. 752 p. (In Russ.)

17. Yane B. Tsifrovaya obrabotka izobrazhenii [Digital image processing]. Moscow, Tekhnosfera Publ., 2007. 584 p. (In Russ.)

18. Soyfer V.A. Metody komp'yuternoy obrabotki izobrazheniy [Methods of Computer Image Processing]. Moscow, Fizmatlit Publ., 2003. 784 p. (In Russ.).

19. Vvedeniye v konturnyy analiz i yego prilozheniye k obrabotke izobrazheniy i signalov [Introduction to contour analysis and its application to image and signal processing]; ed. by YA.A. Furman. Moscow, Fizmatlit Publ., 2002. 592 p. (In Russ.)

20. Zhong Y., Karu K., Jain A. K. Locating text in complex color images. Pattern Recognition, 1995, vol. 28, is. 10, pp. 1523-1535.

21. Kimmel R., Klette R., Sugimoto A. (Eds.): ACCV 2010, Part III, LNCS 6494, pp. 770–783.

22. Chen X., Yuille A. Detecting and Reading Text in Natural Scenes, Computer Vision and Pattern Recognition (CVPR), 2004, pp. 366-373.

23. Lienhart R., Wernicke A. Localizing and Segmenting Text in Images and Videos". IEEE transactions on circuits and systems for video technology, APRIL 2002, vol. 12, no. 4, pp. 256-268.

24. Chernov T.S., Il'in D.A., Bezmaternykh P.V, Faradzhev I.A, Karpenko S.M. Issledovanie metodov segmentatsii izobrazhenii tekstovykh blokov dokumentov s pomoshch'yu algoritmov strukturnogo analiza i mashinnogo obucheniya. [Research of segmentation methods for images of text blocks of documents using structural analysis and machine learning algorithms]. Vestnik rossiiskogo fonda fundamental'nykh issledovanii. Moscow, 2013, pp. 55-71 (In Russ.).

25. Debled-Rennesson I., Tabbone S., Wendling L. Fast polygonal approximation of digital curves. Proceedings of the 17th International Conference, 2004.

26. Marosi I., Industrial OCR approaches: architecture, algorithms and adaptation techniques. Document Recognition and Retrieval XIV. SPIE, 2007.

27. Smith R.W. An Overview of the Tesseract OCR Engine IEEE, 2007, 640 p.