{"id":3517,"date":"2025-08-06T13:26:12","date_gmt":"2025-08-06T12:26:12","guid":{"rendered":"https:\/\/izvestiyakbncran.ru\/?page_id=3517"},"modified":"2026-04-13T10:01:14","modified_gmt":"2026-04-13T09:01:14","slug":"27-3-3-en","status":"publish","type":"page","link":"https:\/\/izvestiyakbncran.ru\/index.php\/en\/27-3-3-en\/","title":{"rendered":"27.3.3 En"},"content":{"rendered":"\n<h1 class=\"wp-block-heading has-lora-font-family\" style=\"font-size:24px\"><strong>Development of an unmanned vehicle course control system based on reinforcement learning<\/strong><\/h1>\n\n\n\n<p class=\"has-foreground-color has-text-color has-link-color has-lora-font-family has-extra-small-font-size wp-elements-b22a1018aa29f4cd2d2554293661cbc1\" style=\"margin-top:0;margin-bottom:0;padding-top:0;padding-bottom:0\"><strong><strong><strong><strong><strong><strong><strong><strong><strong><strong><strong><strong>A.E. Ushakov, M.M. Stebulyanin, M.A. Shereuzhev, F.V. Devyatkin<\/strong><\/strong><\/strong><\/strong><\/strong><\/strong><\/strong><\/strong><\/strong><\/strong><\/strong><\/strong><\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity is-style-wide\" style=\"margin-top:var(--wp--preset--spacing--20);margin-bottom:var(--wp--preset--spacing--20)\"\/>\n\n\n\n<div class=\"wp-block-group is-nowrap is-layout-flex wp-container-core-group-is-layout-24a27e19 wp-block-group-is-layout-flex\" style=\"margin-top:0;margin-bottom:0;padding-top:0;padding-bottom:0\">\n<p class=\"has-text-color has-link-color has-lora-font-family has-extra-small-font-size wp-elements-fa99f84d8051eb763ab85c3007cdb1c2\" style=\"color:#5b1919;text-decoration:underline\"><strong><strong>Upload the full text<\/strong><\/strong><\/p>\n\n\n\n<div class=\"wp-block-group is-vertical is-layout-flex wp-container-core-group-is-layout-9151b400 wp-block-group-is-layout-flex\" style=\"min-height:0px;margin-top:0;margin-bottom:0;padding-top:0;padding-bottom:0\">\n<div class=\"wp-block-buttons is-content-justification-left is-layout-flex wp-container-core-buttons-is-layout-15bf754d wp-block-buttons-is-layout-flex\" style=\"margin-top:0;margin-bottom:0;padding-top:0;padding-right:0;padding-bottom:0;padding-left:0\">\n<div class=\"wp-block-button has-custom-width wp-block-button__width-100 is-style-outline is-style-outline--1\"><a class=\"wp-block-button__link has-background-background-color has-text-color has-background has-link-color has-border-color has-small-font-size has-custom-font-size wp-element-button\" href=\"http:\/\/izvestiyakbncran.ru\/wp-content\/uploads\/2025\/07\/ushakov-stebulyanin-3.pdf\" style=\"border-color:#5b1919;border-style:solid;border-width:2px;border-radius:8px;color:#5b1919;padding-top:0.4rem;padding-right:var(--wp--preset--spacing--40);padding-bottom:0.4rem;padding-left:var(--wp--preset--spacing--40)\">PDF<\/a><\/div>\n<\/div>\n\n\n\n<div style=\"height:0px;width:0px\" aria-hidden=\"true\" class=\"wp-block-spacer wp-container-content-273e683f\"><\/div>\n<\/div>\n<\/div>\n\n\n\n<p class=\"has-foreground-color has-text-color has-link-color has-lora-font-family has-extra-small-font-size wp-elements-9f0e5c324456a9e8be35ea4bf9a21266\" style=\"line-height:1.4\"><strong><em><strong>Abstract<\/strong>.<\/em><\/strong> At present, there is a growing development of autonomous transportation, driven by the need to improve road safety, reduce collisions, and enhance the efficiency of logistics operations. This trend is also influenced by increasing complexity in road conditions and challenges related to vehicle navigation and control, which make traditional control algorithms insufficient in terms of quality and effectiveness. Aim. The objective of this research is to develop an intelligent system that enables an autonomous vehicle to independently control its course. The autonomous agent (a vehicle model) learns to navigate and follow a predefined trajectory using reinforcement learning through interaction with a simulation environment, based on the Actor-Critic method. <strong>Materials and Methods<\/strong>. In this work, the Stable-Baselines 3 (SB3) library built on the PyTorch framework was used to implement and train the reinforcement learning model. The DonkeyCar simulator served as the training environment. To improve the speed and efficiency of training, a denoising autoencoder algorithm was applied to extract the region of interest (ROI). <strong>Results<\/strong>. A series of comparative experiments was conducted to evaluate the impact of various parameters on training efficiency \u2013 such as speed limits, steering angle constraints, allowable deviation width from the lane center, movement continuity, discount factor, and frame rendering rate. <strong>Conclusion<\/strong>. The results of the study demonstrate the potential of reinforcement learning in the field of autonomous transport, while also highlighting the need for further training on real-world data, the prospects for scaling the approach to different classes of vehicles, and limitations related to computational resources and the need for safe behavior verification<\/p>\n\n\n\n<p class=\"has-foreground-color has-text-color has-link-color has-lora-font-family has-extra-small-font-size wp-elements-a4e7c28b1c350ba1c38fcc1a2520c2bd\" style=\"line-height:1.4\"><strong><em><strong>Keywords<\/strong>:<\/em><\/strong> reinforcement learning, unmanned vehicle, Q-learning, DQN (Deep Q-Network), actor-critic, simulation modeling, intelligent system, simulation environment, training stability<\/p>\n\n\n\n<p class=\"has-foreground-color has-text-color has-link-color has-lora-font-family wp-elements-7dfdb71496a0ea2aac6d058491c18510\" style=\"font-size:12px;line-height:1.4\"><strong><strong>For citation<\/strong>.<\/strong> Ushakov A.E., Stebulyanin M.M., Shereuzhev M.A., Devyatkin F.V. Development of an unmanned vehicle course control system based on reinforcement learning. <em>News of the Kabardino-Balkarian Scientific Center of RAS.<\/em> 2025. Vol. 27. No. 3. Pp. 39\u201354. DOI: 10.35330\/1991-6639-2025-27-3-39-54<\/p>\n\n\n\n<details class=\"wp-block-details has-foreground-color has-text-color has-link-color has-lora-font-family has-extra-small-font-size wp-elements-7c7968381827f1d79a4f279df43dbb2e is-layout-flow wp-container-core-details-is-layout-0ab540ad wp-block-details-is-layout-flow\" style=\"font-style:normal;font-weight:700;line-height:1.5\"><summary><strong>R<\/strong>eferences<\/summary>\n<ol style=\"margin-top:0;margin-bottom:0\" class=\"wp-block-list\">\n<li style=\"font-style:normal;font-weight:400\">Syrkin I.S., Dubinkin D.M., Yunusov I.F., Ushakov A.E. Control systems of autonomous mining dump trucks. Young Russia: Proceedings of the XIV All-Russian Scientific and Practical Conference with International Participation, Kemerovo, April 19\u201321, 2022. Kemerovo: T.F. Gorbachev Kuzbass State Technical University, 2022. Pp. 420071\u2013420078. EDN: CXHGOK. (In Russian)<\/li>\n\n\n\n<li style=\"font-style:normal;font-weight:400\">Toromanoff M., Wirbel E., Moutarde F. End-to-end model-free reinforcement learning for urban driving using implicit affordances. IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2020. \u0421. 7151\u20137160. DOI: 10.1109\/CVPR42600.2020.00718<\/li>\n\n\n\n<li style=\"font-style:normal;font-weight:400\">Sauer A., Savinov N., Geiger A. Conditional affordance learning for driving in urban environments. Proceedings of the Conference on Robot Learning (CoRL). 2018. DOI: 10.48550\/arXiv.1806.06498<\/li>\n\n\n\n<li style=\"font-style:normal;font-weight:400\">Shereuzhev M.A., U G\u043e, Serebrenny V.V. Modification of a deep learning algorithm for the distribution of functions and tasks between a robotic system and a human under conditions of uncertainty and environmental variability. News of the Kabardino-Balkarian Scientific Center of RAS. 2024. Vol. 26. No. 6. P. 208\u2013218. DOI: 10.35330\/1991-6639-2024-26-6-208-218. (In Russian)<\/li>\n\n\n\n<li style=\"font-style:normal;font-weight:400\">Tampuu A., Semikin M., Muhammad N. et al. Survey of end-to-end driving: Architectures and training methods: arXiv preprint arXiv:2003.06404. 2020.<\/li>\n\n\n\n<li style=\"font-style:normal;font-weight:400\">Lyutikova L.A. Application of a machine learning method for the analysis of incomplete data. News of the Kabardino-Balkarian Scientific Center of RAS. 2024. Vol. 26. No. 6. Pp. 139\u2013145. DOI: 10.35330\/1991-6639-2024-26-6-139-145. (In Russian)<\/li>\n\n\n\n<li style=\"font-style:normal;font-weight:400\">Shereuzhev M.A., Arabadzhiev D.I., Semyannikov I.V. Modeling of a collision avoidance algorithm in collaborative robotic systems. News of the Kabardino-Balkarian Scientific Center of RAS. 2024. Vol. 26. No. 6. Pp. 67\u201381. DOI: 10.35330\/1991-6639-2024-26-6-67-81. (In Russian)<\/li>\n\n\n\n<li style=\"font-style:normal;font-weight:400\">He K., Zhang X., Ren S., Sun J. Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas (NV), Pp. 770\u2013778. DOI: 10.1109\/CVPR.2016.90<\/li>\n\n\n\n<li style=\"font-style:normal;font-weight:400\">Petrenko V.I. Classification of multi-agent reinforcement learning tasks. News of the Kabardino-Balkarian Scientific Center of RAS. 2021. Vol. 3. No. 101. Pp. 32\u201344. DOI: 10.35330\/1991-6639-2021-3-101-32-44. (In Russian)<\/li>\n\n\n\n<li style=\"font-style:normal;font-weight:400\">Cole A., Gandju S., Kazam M. Iskusstvennyy intellekt i komp&#8217;yuternoye zreniye: real&#8217;nyye proyekty na Python, Keras i TensorFlow [Artificial intelligence and computer vision: Real projects using Python, Keras, and TensorFlow]. St. Petersburg: Piter, 2019. 356 p. ISBN: 978-1-492-04305-0. (In Russian)<\/li>\n\n\n\n<li style=\"font-style:normal;font-weight:400\">Ushakov A.E., Stebulyanin M.M. Study of model training parameters for a course control system. Internauka. 2025. No. 1-3(365). Pp. 53\u201357. EDN: OXPGLQ. (In Russian)<\/li>\n\n\n\n<li style=\"font-style:normal;font-weight:400\">Ushakov A.E. Using a simulator to study autonomous driving technologies. Russian Science in the Modern World: Proceedings of the LXVII International Scientific and Practical Conference. Moscow, January 15, 2025. Moscow: Aktualnost. RF, 2025. Pp. 155\u2013158. EDN: JFUWYO. (In Russian)<\/li>\n\n\n\n<li style=\"font-style:normal;font-weight:400\">Sutton R.S., Barto A.G. Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 2018. 552 \u0441.<\/li>\n\n\n\n<li style=\"font-style:normal;font-weight:400\">Liang X., Wang T., Yang L., Xing E. CIRL: Controllable imitative reinforcement learning for vision-based self-driving. Proceedings of the European Conference on Computer Vision (ECCV). 2018. DOI: 10.48550\/arXiv.1807.03776<\/li>\n\n\n\n<li style=\"font-style:normal;font-weight:400\">Shereuzhev M.A., Shereuzhev M.A., Kishev A.Yu. Issues of selecting a machine vision system for agricultural robotic complexes for weed control. News of the Kabardino-Balkarian Scientific Center of RAS. 2022. No. 4(108). Pp. 84\u201395. DOI: 10.35330\/1991-6639-2022-4-108-84-95. (In Russian)<\/li>\n\n\n\n<li style=\"font-style:normal;font-weight:400\">Chen D., Zhou B., Koltun V., Kr\u00e4henb\u00fchl P. Learning by Cheating: arXiv preprint arXiv:1912.12294. 2019<\/li>\n<\/ol>\n<\/details>\n\n\n\n<details class=\"wp-block-details has-foreground-color has-text-color has-link-color has-lora-font-family has-extra-small-font-size wp-elements-946e5c8a56523e9e34a150d30d472642 is-layout-flow wp-container-core-details-is-layout-5dafc681 wp-block-details-is-layout-flow\" style=\"font-style:normal;font-weight:700;line-height:1.5\"><summary><strong>Information about the authors<\/strong><\/summary>\n<div class=\"wp-block-group is-vertical is-layout-flex wp-container-core-group-is-layout-b291ae12 wp-block-group-is-layout-flex\" style=\"min-height:0px;margin-top:0;margin-bottom:0;padding-top:var(--wp--preset--spacing--20);padding-right:var(--wp--preset--spacing--40);padding-bottom:var(--wp--preset--spacing--20);padding-left:var(--wp--preset--spacing--40)\">\n<p style=\"font-style:normal;font-weight:400\"><strong>Alexander E. Ushakov<\/strong>, Postgraduate student, Research Engineer, Department of Robotics and Mechatronics, Moscow State University of Technology \u201cSTANKIN\u201d;<br>127055, Russia, Moscow, 1 Vadkovsky lane;<br>ushakov_ae@internet.ru, ORCID: https:\/\/orcid.org\/0009-0006-1467-5043, SPIN-code: 5174-7378<br><strong>Mikhail M. Stebulyanin<\/strong>, Doctor of Technical Sciences, Professor, Head of the Department of Robotics and Mechatronics, Moscow State University of Technology \u201cSTANKIN\u201d;<br>127055, Russia, Moscow, 1 Vadkovsky lane;<br>mmsteb@rambler.ru, ORCID: https:\/\/orcid.org\/0009-0007-3443-0593, SPIN-code: 4389-1120<br><strong>Madin A. Shereuzhev<\/strong>, Candidate of Engineering Sciences, Associate Professor at the Department of Robotics and Mechatronics, Moscow State University of Technology \u201cSTANKIN\u201d;<br>127055, Russia, Moscow, 1 Vadkovsky lane;<br>shereuzhev@gmail.com, ORCID: https:\/\/orcid.org\/0000-0003-2352-992X, SPIN-code: 1734-9056<br><strong>Fedor V. Devyatkin<\/strong>, Postgraduate student at the Department of ME7 \u201cRobotic Systems and Mechatronics\u201d, The Bauman Moscow State Technical University;<br>105005, Russia, Moscow, 5, 2-nd Baumanskaya street;<br>Engineer, Moscow State University of Technology \u201cSTANKIN\u201d;<br>127055, Russia, Moscow, 1 Vadkovsky lane;<br>feodor-dev@ya.ru, ORCID: https:\/\/orcid.org\/0009-0000-2639-9521, SPIN-code: 7738-5724<\/p>\n\n\n\n<p style=\"font-style:normal;font-weight:400\"><\/p>\n\n\n\n<p style=\"font-style:normal;font-weight:400\"><\/p>\n\n\n\n<p style=\"font-style:normal;font-weight:400\"><\/p>\n<\/div>\n<\/details>\n","protected":false},"excerpt":{"rendered":"<p>Development of an unmanned vehicle course control system based on reinforcement learning A.E. Ushakov, M.M. Stebulyanin, M.A. Shereuzhev, F.V. Devyatkin Upload the full text Abstract. At present, there is a growing development of autonomous transportation, driven by the need to improve road safety, reduce collisions, and enhance the efficiency of logistics operations. This trend is [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"wp-custom-template-home","meta":{"footnotes":""},"class_list":["post-3517","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.5 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>27.3.3 En - \u0418\u0417\u0412\u0415\u0421\u0422\u0418\u042f \u041a\u0410\u0411\u0410\u0420\u0414\u0418\u041d\u041e-\u0411\u0410\u041b\u041a\u0410\u0420\u0421\u041a\u041e\u0413\u041e \u041d\u0410\u0423\u0427\u041d\u041e\u0413\u041e \u0426\u0415\u041d\u0422\u0420\u0410 \u0420\u0410\u041d\u00bb<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/izvestiyakbncran.ru\/index.php\/en\/27-3-3-en\/\" \/>\n<meta property=\"og:locale\" content=\"ru_RU\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"27.3.3 En - \u0418\u0417\u0412\u0415\u0421\u0422\u0418\u042f \u041a\u0410\u0411\u0410\u0420\u0414\u0418\u041d\u041e-\u0411\u0410\u041b\u041a\u0410\u0420\u0421\u041a\u041e\u0413\u041e \u041d\u0410\u0423\u0427\u041d\u041e\u0413\u041e \u0426\u0415\u041d\u0422\u0420\u0410 \u0420\u0410\u041d\u00bb\" \/>\n<meta property=\"og:description\" content=\"Development of an unmanned vehicle course control system based on reinforcement learning A.E. Ushakov, M.M. Stebulyanin, M.A. Shereuzhev, F.V. Devyatkin Upload the full text Abstract. At present, there is a growing development of autonomous transportation, driven by the need to improve road safety, reduce collisions, and enhance the efficiency of logistics operations. This trend is [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/izvestiyakbncran.ru\/index.php\/en\/27-3-3-en\/\" \/>\n<meta property=\"og:site_name\" content=\"\u0418\u0417\u0412\u0415\u0421\u0422\u0418\u042f \u041a\u0410\u0411\u0410\u0420\u0414\u0418\u041d\u041e-\u0411\u0410\u041b\u041a\u0410\u0420\u0421\u041a\u041e\u0413\u041e \u041d\u0410\u0423\u0427\u041d\u041e\u0413\u041e \u0426\u0415\u041d\u0422\u0420\u0410 \u0420\u0410\u041d\u00bb\" \/>\n<meta property=\"article:modified_time\" content=\"2026-04-13T09:01:14+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u041f\u0440\u0438\u043c\u0435\u0440\u043d\u043e\u0435 \u0432\u0440\u0435\u043c\u044f \u0434\u043b\u044f \u0447\u0442\u0435\u043d\u0438\u044f\" \/>\n\t<meta name=\"twitter:data1\" content=\"6 \u043c\u0438\u043d\u0443\u0442\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/izvestiyakbncran.ru\\\/index.php\\\/en\\\/27-3-3-en\\\/\",\"url\":\"https:\\\/\\\/izvestiyakbncran.ru\\\/index.php\\\/en\\\/27-3-3-en\\\/\",\"name\":\"27.3.3 En - \u0418\u0417\u0412\u0415\u0421\u0422\u0418\u042f \u041a\u0410\u0411\u0410\u0420\u0414\u0418\u041d\u041e-\u0411\u0410\u041b\u041a\u0410\u0420\u0421\u041a\u041e\u0413\u041e \u041d\u0410\u0423\u0427\u041d\u041e\u0413\u041e \u0426\u0415\u041d\u0422\u0420\u0410 \u0420\u0410\u041d\u00bb\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/izvestiyakbncran.ru\\\/#website\"},\"datePublished\":\"2025-08-06T12:26:12+00:00\",\"dateModified\":\"2026-04-13T09:01:14+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/izvestiyakbncran.ru\\\/index.php\\\/en\\\/27-3-3-en\\\/#breadcrumb\"},\"inLanguage\":\"ru-RU\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/izvestiyakbncran.ru\\\/index.php\\\/en\\\/27-3-3-en\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/izvestiyakbncran.ru\\\/index.php\\\/en\\\/27-3-3-en\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"\u0413\u043b\u0430\u0432\u043d\u0430\u044f \u0441\u0442\u0440\u0430\u043d\u0438\u0446\u0430\",\"item\":\"https:\\\/\\\/izvestiyakbncran.ru\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"27.3.3 En\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/izvestiyakbncran.ru\\\/#website\",\"url\":\"https:\\\/\\\/izvestiyakbncran.ru\\\/\",\"name\":\"\u0418\u0417\u0412\u0415\u0421\u0422\u0418\u042f \u041a\u0410\u0411\u0410\u0420\u0414\u0418\u041d\u041e-\u0411\u0410\u041b\u041a\u0410\u0420\u0421\u041a\u041e\u0413\u041e \u041d\u0410\u0423\u0427\u041d\u041e\u0413\u041e \u0426\u0415\u041d\u0422\u0420\u0410 \u0420\u0410\u041d\u00bb\",\"description\":\"\u041d\u0430\u0443\u0447\u043d\u044b\u0439 \u0436\u0443\u0440\u043d\u0430\u043b\",\"publisher\":{\"@id\":\"https:\\\/\\\/izvestiyakbncran.ru\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/izvestiyakbncran.ru\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"ru-RU\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/izvestiyakbncran.ru\\\/#organization\",\"name\":\"\u0418\u0417\u0412\u0415\u0421\u0422\u0418\u042f \u041a\u0410\u0411\u0410\u0420\u0414\u0418\u041d\u041e-\u0411\u0410\u041b\u041a\u0410\u0420\u0421\u041a\u041e\u0413\u041e \u041d\u0410\u0423\u0427\u041d\u041e\u0413\u041e \u0426\u0415\u041d\u0422\u0420\u0410 \u0420\u0410\u041d\u00bb\",\"url\":\"https:\\\/\\\/izvestiyakbncran.ru\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"ru-RU\",\"@id\":\"https:\\\/\\\/izvestiyakbncran.ru\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/izvestiyakbncran.ru\\\/wp-content\\\/uploads\\\/2025\\\/07\\\/oblozhka-zhurnala-na-angl-scaled.jpg\",\"contentUrl\":\"https:\\\/\\\/izvestiyakbncran.ru\\\/wp-content\\\/uploads\\\/2025\\\/07\\\/oblozhka-zhurnala-na-angl-scaled.jpg\",\"width\":1828,\"height\":2560,\"caption\":\"\u0418\u0417\u0412\u0415\u0421\u0422\u0418\u042f \u041a\u0410\u0411\u0410\u0420\u0414\u0418\u041d\u041e-\u0411\u0410\u041b\u041a\u0410\u0420\u0421\u041a\u041e\u0413\u041e \u041d\u0410\u0423\u0427\u041d\u041e\u0413\u041e \u0426\u0415\u041d\u0422\u0420\u0410 \u0420\u0410\u041d\u00bb\"},\"image\":{\"@id\":\"https:\\\/\\\/izvestiyakbncran.ru\\\/#\\\/schema\\\/logo\\\/image\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"27.3.3 En - \u0418\u0417\u0412\u0415\u0421\u0422\u0418\u042f \u041a\u0410\u0411\u0410\u0420\u0414\u0418\u041d\u041e-\u0411\u0410\u041b\u041a\u0410\u0420\u0421\u041a\u041e\u0413\u041e \u041d\u0410\u0423\u0427\u041d\u041e\u0413\u041e \u0426\u0415\u041d\u0422\u0420\u0410 \u0420\u0410\u041d\u00bb","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/izvestiyakbncran.ru\/index.php\/en\/27-3-3-en\/","og_locale":"ru_RU","og_type":"article","og_title":"27.3.3 En - \u0418\u0417\u0412\u0415\u0421\u0422\u0418\u042f \u041a\u0410\u0411\u0410\u0420\u0414\u0418\u041d\u041e-\u0411\u0410\u041b\u041a\u0410\u0420\u0421\u041a\u041e\u0413\u041e \u041d\u0410\u0423\u0427\u041d\u041e\u0413\u041e \u0426\u0415\u041d\u0422\u0420\u0410 \u0420\u0410\u041d\u00bb","og_description":"Development of an unmanned vehicle course control system based on reinforcement learning A.E. Ushakov, M.M. Stebulyanin, M.A. Shereuzhev, F.V. Devyatkin Upload the full text Abstract. At present, there is a growing development of autonomous transportation, driven by the need to improve road safety, reduce collisions, and enhance the efficiency of logistics operations. This trend is [&hellip;]","og_url":"https:\/\/izvestiyakbncran.ru\/index.php\/en\/27-3-3-en\/","og_site_name":"\u0418\u0417\u0412\u0415\u0421\u0422\u0418\u042f \u041a\u0410\u0411\u0410\u0420\u0414\u0418\u041d\u041e-\u0411\u0410\u041b\u041a\u0410\u0420\u0421\u041a\u041e\u0413\u041e \u041d\u0410\u0423\u0427\u041d\u041e\u0413\u041e \u0426\u0415\u041d\u0422\u0420\u0410 \u0420\u0410\u041d\u00bb","article_modified_time":"2026-04-13T09:01:14+00:00","twitter_card":"summary_large_image","twitter_misc":{"\u041f\u0440\u0438\u043c\u0435\u0440\u043d\u043e\u0435 \u0432\u0440\u0435\u043c\u044f \u0434\u043b\u044f \u0447\u0442\u0435\u043d\u0438\u044f":"6 \u043c\u0438\u043d\u0443\u0442"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/izvestiyakbncran.ru\/index.php\/en\/27-3-3-en\/","url":"https:\/\/izvestiyakbncran.ru\/index.php\/en\/27-3-3-en\/","name":"27.3.3 En - \u0418\u0417\u0412\u0415\u0421\u0422\u0418\u042f \u041a\u0410\u0411\u0410\u0420\u0414\u0418\u041d\u041e-\u0411\u0410\u041b\u041a\u0410\u0420\u0421\u041a\u041e\u0413\u041e \u041d\u0410\u0423\u0427\u041d\u041e\u0413\u041e \u0426\u0415\u041d\u0422\u0420\u0410 \u0420\u0410\u041d\u00bb","isPartOf":{"@id":"https:\/\/izvestiyakbncran.ru\/#website"},"datePublished":"2025-08-06T12:26:12+00:00","dateModified":"2026-04-13T09:01:14+00:00","breadcrumb":{"@id":"https:\/\/izvestiyakbncran.ru\/index.php\/en\/27-3-3-en\/#breadcrumb"},"inLanguage":"ru-RU","potentialAction":[{"@type":"ReadAction","target":["https:\/\/izvestiyakbncran.ru\/index.php\/en\/27-3-3-en\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/izvestiyakbncran.ru\/index.php\/en\/27-3-3-en\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\u0413\u043b\u0430\u0432\u043d\u0430\u044f \u0441\u0442\u0440\u0430\u043d\u0438\u0446\u0430","item":"https:\/\/izvestiyakbncran.ru\/"},{"@type":"ListItem","position":2,"name":"27.3.3 En"}]},{"@type":"WebSite","@id":"https:\/\/izvestiyakbncran.ru\/#website","url":"https:\/\/izvestiyakbncran.ru\/","name":"\u0418\u0417\u0412\u0415\u0421\u0422\u0418\u042f \u041a\u0410\u0411\u0410\u0420\u0414\u0418\u041d\u041e-\u0411\u0410\u041b\u041a\u0410\u0420\u0421\u041a\u041e\u0413\u041e \u041d\u0410\u0423\u0427\u041d\u041e\u0413\u041e \u0426\u0415\u041d\u0422\u0420\u0410 \u0420\u0410\u041d\u00bb","description":"\u041d\u0430\u0443\u0447\u043d\u044b\u0439 \u0436\u0443\u0440\u043d\u0430\u043b","publisher":{"@id":"https:\/\/izvestiyakbncran.ru\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/izvestiyakbncran.ru\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"ru-RU"},{"@type":"Organization","@id":"https:\/\/izvestiyakbncran.ru\/#organization","name":"\u0418\u0417\u0412\u0415\u0421\u0422\u0418\u042f \u041a\u0410\u0411\u0410\u0420\u0414\u0418\u041d\u041e-\u0411\u0410\u041b\u041a\u0410\u0420\u0421\u041a\u041e\u0413\u041e \u041d\u0410\u0423\u0427\u041d\u041e\u0413\u041e \u0426\u0415\u041d\u0422\u0420\u0410 \u0420\u0410\u041d\u00bb","url":"https:\/\/izvestiyakbncran.ru\/","logo":{"@type":"ImageObject","inLanguage":"ru-RU","@id":"https:\/\/izvestiyakbncran.ru\/#\/schema\/logo\/image\/","url":"https:\/\/izvestiyakbncran.ru\/wp-content\/uploads\/2025\/07\/oblozhka-zhurnala-na-angl-scaled.jpg","contentUrl":"https:\/\/izvestiyakbncran.ru\/wp-content\/uploads\/2025\/07\/oblozhka-zhurnala-na-angl-scaled.jpg","width":1828,"height":2560,"caption":"\u0418\u0417\u0412\u0415\u0421\u0422\u0418\u042f \u041a\u0410\u0411\u0410\u0420\u0414\u0418\u041d\u041e-\u0411\u0410\u041b\u041a\u0410\u0420\u0421\u041a\u041e\u0413\u041e \u041d\u0410\u0423\u0427\u041d\u041e\u0413\u041e \u0426\u0415\u041d\u0422\u0420\u0410 \u0420\u0410\u041d\u00bb"},"image":{"@id":"https:\/\/izvestiyakbncran.ru\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/izvestiyakbncran.ru\/index.php\/wp-json\/wp\/v2\/pages\/3517","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/izvestiyakbncran.ru\/index.php\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/izvestiyakbncran.ru\/index.php\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/izvestiyakbncran.ru\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/izvestiyakbncran.ru\/index.php\/wp-json\/wp\/v2\/comments?post=3517"}],"version-history":[{"count":4,"href":"https:\/\/izvestiyakbncran.ru\/index.php\/wp-json\/wp\/v2\/pages\/3517\/revisions"}],"predecessor-version":[{"id":11405,"href":"https:\/\/izvestiyakbncran.ru\/index.php\/wp-json\/wp\/v2\/pages\/3517\/revisions\/11405"}],"wp:attachment":[{"href":"https:\/\/izvestiyakbncran.ru\/index.php\/wp-json\/wp\/v2\/media?parent=3517"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}