{"id":29214,"date":"2026-05-04T16:28:45","date_gmt":"2026-05-04T16:28:45","guid":{"rendered":"https:\/\/hes.mephi.ru\/?page_id=29214"},"modified":"2026-05-04T20:19:55","modified_gmt":"2026-05-04T20:19:55","slug":"testing-verification-and-validation-of-artificial-intelligence-systems","status":"publish","type":"page","link":"https:\/\/hes.mephi.ru\/?page_id=29214","title":{"rendered":"Testing, Verification and Validation of Artificial Intelligence Systems"},"content":{"rendered":"<div id=\"pl-29214\"  class=\"panel-layout\" ><div id=\"pg-29214-0\"  class=\"panel-grid panel-has-style\" ><div class=\"siteorigin-panels-stretch panel-row-style panel-row-style-for-29214-0\" data-stretch-type=\"full\" ><div id=\"pgc-29214-0-0\"  class=\"panel-grid-cell\" ><div id=\"panel-29214-0-0-0\" class=\"so-panel widget widget_sow-editor panel-first-child panel-last-child\" data-index=\"0\" ><div class=\"so-widget-sow-editor so-widget-sow-editor-base\">\n<div class=\"siteorigin-widget-tinymce textwidget\">\n\t<p><img decoding=\"async\" loading=\"lazy\" class=\"aligncenter wp-image-28479\" src=\"http:\/\/hes.mephi.ru\/wp-content\/uploads\/2026\/04\/Logo_Vish_eng-1.png\" alt=\"\" width=\"250\" height=\"125\" \/><\/p>\n<\/div>\n<\/div><\/div><\/div><\/div><\/div><div id=\"pg-29214-1\"  class=\"panel-grid panel-has-style\" ><div class=\"siteorigin-panels-stretch panel-row-style panel-row-style-for-29214-1\" data-stretch-type=\"full-stretched\" ><div id=\"pgc-29214-1-0\"  class=\"panel-grid-cell\" ><div id=\"panel-29214-1-0-0\" class=\"so-panel widget widget_sow-headline panel-first-child panel-last-child\" data-index=\"1\" ><div class=\"panel-widget-style panel-widget-style-for-29214-1-0-0\" ><div class=\"so-widget-sow-headline so-widget-sow-headline-default-cae038182b94-29214\"><div class=\"sow-headline-container \">\n\t<h3 class='sow-headline'>\t\t\t\t\t\t<a href=\"http:\/\/hes.mephi.ru\/wp-content\/uploads\/2026\/05\/05.06-Testing-Verification-and-Validation-of-Artificial-Intelligence-Systems.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">\n\t\t\t\t\tDOWNLOAD THE FULL COURSE SYLLABUS<\/a><\/h3><\/div><\/div><\/div><\/div><\/div><div id=\"pgc-29214-1-1\"  class=\"panel-grid-cell\" ><div id=\"panel-29214-1-1-0\" class=\"so-panel widget widget_sow-headline panel-first-child panel-last-child\" data-index=\"2\" ><div class=\"so-widget-sow-headline so-widget-sow-headline-default-cae038182b94-29214\"><div class=\"sow-headline-container \">\n\t<h3 class='sow-headline'>\t\t\t\t\t\t<a href=\"https:\/\/hes.mephi.ru\/?page_id=28339\" >\n\t\t\t\t\tBACK TO THE CURRICULUM<\/a><\/h3><\/div><\/div><\/div><\/div><div id=\"pgc-29214-1-2\"  class=\"panel-grid-cell\" ><div id=\"panel-29214-1-2-0\" class=\"so-panel widget widget_sow-headline panel-first-child panel-last-child\" data-index=\"3\" ><div class=\"so-widget-sow-headline so-widget-sow-headline-default-cae038182b94-29214\"><div class=\"sow-headline-container \">\n\t<h3 class='sow-headline'>\t\t\t\t\t\t<a href=\"https:\/\/hes.mephi.ru\/?page_id=28855\" target=\"_blank\" rel=\"noopener noreferrer\">\n\t\t\t\t\tBACK TO MASTER'S PROGRAM<\/a><\/h3><\/div><\/div><\/div><\/div><div id=\"pgc-29214-1-3\"  class=\"panel-grid-cell\" ><div id=\"panel-29214-1-3-0\" class=\"so-panel widget widget_sow-headline panel-first-child panel-last-child\" data-index=\"4\" ><div class=\"so-widget-sow-headline so-widget-sow-headline-default-cae038182b94-29214\"><div class=\"sow-headline-container \">\n\t<h3 class='sow-headline'>\t\t\t\t\t\t<a href=\"https:\/\/hes.mephi.ru\/?page_id=28947\" target=\"_blank\" rel=\"noopener noreferrer\">\n\t\t\t\t\tABOUT HES MEPHI<\/a><\/h3><\/div><\/div><\/div><\/div><\/div><\/div><div id=\"pg-29214-2\"  class=\"panel-grid panel-has-style\" ><div class=\"siteorigin-panels-stretch panel-row-style panel-row-style-for-29214-2\" data-stretch-type=\"full\" ><div id=\"pgc-29214-2-0\"  class=\"panel-grid-cell panel-grid-cell-empty\" ><\/div><div id=\"pgc-29214-2-1\"  class=\"panel-grid-cell\" ><div id=\"panel-29214-2-1-0\" class=\"so-panel widget widget_sow-headline panel-first-child\" data-index=\"5\" ><div class=\"so-widget-sow-headline so-widget-sow-headline-default-664267c7ac08-29214\"><div class=\"sow-headline-container \">\n\t<h2 class='sow-headline'>Testing, Verification and Validation of Artificial Intelligence Systems<\/h2><\/div><\/div><\/div><div id=\"panel-29214-2-1-1\" class=\"so-panel widget widget_sow-editor panel-last-child\" data-index=\"6\" ><div class=\"so-widget-sow-editor so-widget-sow-editor-base\">\n<div class=\"siteorigin-widget-tinymce textwidget\">\n\t<h3 style=\"text-align: justify;\"><span style=\"text-align: justify;\"><span style=\"color: #ffffff; font-family: 'Open Sans';\">Modern artificial intelligence systems fundamentally differ from traditional software systems. Their behavior is shaped not only by algorithmic logic but also by statistical models trained on data, making the challenges of reliability, correctness, and interpretability particularly complex. The course aims to develop an engineering culture for the design, verification, and operation of intelligent digital systems.<\/span><\/span><\/h3>\n<\/div>\n<\/div><\/div><\/div><\/div><\/div><div id=\"pg-29214-3\"  class=\"panel-grid panel-has-style\" ><div class=\"siteorigin-panels-stretch panel-row-style panel-row-style-for-29214-3\" data-stretch-type=\"full\" ><div id=\"pgc-29214-3-0\"  class=\"panel-grid-cell\" ><div id=\"panel-29214-3-0-0\" class=\"so-panel widget widget_sow-editor panel-first-child panel-last-child\" data-index=\"7\" ><div class=\"so-widget-sow-editor so-widget-sow-editor-base\">\n<div class=\"siteorigin-widget-tinymce textwidget\">\n\t&nbsp;\n<p style=\"text-align: justify; font-family: 'Open Sans';\">Students master the structure of the project lifecycle, methods for analysing user needs, conducting pre\u2011project assessments, managing requirements and configurations, organising development teams, and performing schedule planning and project implementation control.<\/p>\n\n<p style=\"text-align: justify; font-family: 'Open Sans';\">The course ensures a smooth transition from the model to the system, then to quality control, and finally to operational reliability.<\/p>\n\n<p style=\"text-align: justify; font-family: 'Open Sans';\">Any verification system must begin with an analysis of the system\u2019s goals, user needs, and criteria for result correctness. The goal\u2011setting phase determines acceptable error margins, quality criteria, and the system\u2019s applicability limits.<\/p>\n\n<p style=\"text-align: justify; font-family: 'Open Sans';\">The discipline is built around the idea that an AI system is a human\u2011computer system: the model makes some decisions, while humans make others. Accordingly, verification processes must account for both decision\u2011making natures. The methodological axis of the course follows this sequence: goal setting \u2192 requirements \u2192 model \u2192 behaviour \u2192 verification \u2192 interpretation \u2192 validation.<\/p>\n\n<p style=\"text-align: justify; font-family: 'Open Sans';\">Special attention is given to the nature of AI system errors: model hallucinations, logical reasoning errors, statistical artefacts, effects of biased training data, and incorrect generalisations. The course fosters a culture of experimental verification: AI system testing should be based on experiments, comparative tests, model behaviour analysis, and systematic error diagnostics.<\/p>\n\n<p style=\"text-align: justify; font-family: 'Open Sans';\">Large Language Models (LLMs) are used in the course not only as objects of analysis but also as tools for testing, critical analysis, and building verification systems for AI solutions. LLMs serve in several roles:<\/p>\n\n<p style=\"text-align: justify; font-family: 'Open Sans';\">- as a testing object \u2014 complex models whose behaviour must be checked, analysed, and verified;<\/p>\n\n<p style=\"text-align: justify; font-family: 'Open Sans';\">- as an analytical tool \u2014 for analysing results, detecting errors, formulating alternative hypotheses, and examining decision\u2011making logic;<\/p>\n\n<p style=\"text-align: justify; font-family: 'Open Sans';\">- as a peer\u2011review tool \u2014 in cross\u2011verification practices where one model analyses the results of another;<\/p>\n\n<p style=\"text-align: justify; font-family: 'Open Sans';\">- as a component of agent\u2011based verification systems \u2014 for automatic error diagnostics, result analysis, test generation, and hypothesis testing.<\/p>\n\n<p style=\"text-align: justify; font-family: 'Open Sans';\">At the same time, a mandatory verification principle applies: any result obtained using LLMs must undergo additional verification through experimentation, model comparison, and expert assessment. The professional principle of the course is: trust the verification, not the confidence of the model.<\/p>\n\n<p style=\"text-align: justify; font-family: 'Open Sans';\">Upon completing the course, students will:<\/p>\n\n<p style=\"text-align: justify; font-family: 'Open Sans';\">know the differences between testing, verification, and validation; the nature of AI model errors; sources of hallucinations and incorrect conclusions; methods for analysing model behaviour; the architecture of AI testing systems; automated result verification methods; the role of expert knowledge in validation; and the architecture of human\u2011in\u2011the\u2011loop verification systems;<\/p>\n\n<p style=\"text-align: justify; font-family: 'Open Sans';\">be able to identify errors and unstable behaviour in AI models; design tests for AI components; analyse the correctness of model results; develop verification procedures; apply LLMs to analyse model behaviour; integrate expert verification into AI systems; and design AI quality control systems;<\/p>\n\n<p style=\"text-align: justify; font-family: 'Open Sans';\">possess skills in diagnosing model behaviour; constructing test scenarios; analysing model errors; conducting comparative model testing; designing AI verification systems; and using LLMs as analytical verification tools.<\/p><\/div>\n<\/div><\/div><\/div><\/div><\/div><div id=\"pg-29214-4\"  class=\"panel-grid panel-has-style\" ><div class=\"siteorigin-panels-stretch panel-row-style panel-row-style-for-29214-4\" data-stretch-type=\"full\" ><div id=\"pgc-29214-4-0\"  class=\"panel-grid-cell\" ><div id=\"panel-29214-4-0-0\" class=\"so-panel widget widget_sow-headline panel-first-child\" data-index=\"8\" ><div class=\"so-widget-sow-headline so-widget-sow-headline-default-4e1b8d3af015-29214\"><div class=\"sow-headline-container \">\n\t<h3 class='sow-headline'>OBJECTIVES<\/h3><\/div><\/div><\/div><div id=\"panel-29214-4-0-1\" class=\"so-panel widget widget_sow-editor panel-last-child\" data-index=\"9\" ><div class=\"so-widget-sow-editor so-widget-sow-editor-base\">\n<div class=\"siteorigin-widget-tinymce textwidget\">\n\t<h3 style=\"text-align: justify;\"><span style=\"text-align: justify;\"><span style=\"color: #ffffff; font-family: 'Open Sans';\">Understanding the nature of AI system errors;<\/span><\/span><\/h3>\n<h3 style=\"text-align: justify;\"><span style=\"text-align: justify;\"><span style=\"color: #ffffff; font-family: 'Open Sans';\">Mastering methods for testing models and AI components;<\/span><\/span><\/h3>\n<h3 style=\"text-align: justify;\"><span style=\"text-align: justify;\"><span style=\"color: #ffffff; font-family: 'Open Sans';\">Studying methods for verifying AI results;<\/span><\/span><\/h3>\n<h3 style=\"text-align: justify;\"><span style=\"text-align: justify;\"><span style=\"color: #ffffff; font-family: 'Open Sans';\">Mastering approaches to systemic validation of decisions;<\/span><\/span><\/h3>\n<h3 style=\"text-align: justify;\"><span style=\"text-align: justify;\"><span style=\"color: #ffffff; font-family: 'Open Sans';\">Understanding the role of humans in AI verification processes;<\/span><\/span><\/h3>\n<h3 style=\"text-align: justify;\"><span style=\"text-align: justify;\"><span style=\"color: #ffffff; font-family: 'Open Sans';\">Mastering the architecture of AI quality control systems;<\/span><\/span><\/h3>\n<h3 style=\"text-align: justify;\"><span style=\"text-align: justify;\"><span style=\"color: #ffffff; font-family: 'Open Sans';\">Developing skills in building automated result verification systems;<\/span><\/span><\/h3>\n<h3 style=\"text-align: justify;\"><span style=\"text-align: justify;\"><span style=\"color: #ffffff; font-family: 'Open Sans';\">Fostering a culture of critical analysis of model behavior.<\/span><\/span><\/h3>\n<\/div>\n<\/div><\/div><\/div><div id=\"pgc-29214-4-1\"  class=\"panel-grid-cell panel-grid-cell-empty\" ><\/div><div id=\"pgc-29214-4-2\"  class=\"panel-grid-cell\" ><div id=\"panel-29214-4-2-0\" class=\"so-panel widget widget_sow-headline panel-first-child\" data-index=\"10\" ><div class=\"so-widget-sow-headline so-widget-sow-headline-default-4e1b8d3af015-29214\"><div class=\"sow-headline-container \">\n\t<h3 class='sow-headline'>KEY TASKS<\/h3><\/div><\/div><\/div><div id=\"panel-29214-4-2-1\" class=\"so-panel widget widget_sow-editor panel-last-child\" data-index=\"11\" ><div class=\"so-widget-sow-editor so-widget-sow-editor-base\">\n<div class=\"siteorigin-widget-tinymce textwidget\">\n\t<h3 style=\"text-align: justify;\"><span style=\"text-align: justify;\"><span style=\"color: #ffffff; font-family: 'Open Sans';\">Studying the nature of errors and unstable behavior in AI models;<\/span><\/span><\/h3>\n<h3 style=\"text-align: justify;\"><span style=\"text-align: justify;\"><span style=\"color: #ffffff; font-family: 'Open Sans';\">Analyzing limitations of statistical models;<\/span><\/span><\/h3>\n<h3 style=\"text-align: justify;\"><span style=\"text-align: justify;\"><span style=\"color: #ffffff; font-family: 'Open Sans';\">Learning methods for testing AI components;<\/span><\/span><\/h3>\n<h3 style=\"text-align: justify;\"><span style=\"text-align: justify;\"><span style=\"color: #ffffff; font-family: 'Open Sans';\">Mastering techniques for analyzing model errors;<\/span><\/span><\/h3>\n<h3 style=\"text-align: justify;\"><span style=\"text-align: justify;\"><span style=\"color: #ffffff; font-family: 'Open Sans';\">Studying result verification methods;<\/span><\/span><\/h3>\n<h3 style=\"text-align: justify;\"><span style=\"text-align: justify;\"><span style=\"color: #ffffff; font-family: 'Open Sans';\">Exploring the architecture of AI testing systems;<\/span><\/span><\/h3>\n<h3 style=\"text-align: justify;\"><span style=\"text-align: justify;\"><span style=\"color: #ffffff; font-family: 'Open Sans';\">Mastering automated result verification methods;<\/span><\/span><\/h3>\n<h3 style=\"text-align: justify;\"><span style=\"text-align: justify;\"><span style=\"color: #ffffff; font-family: 'Open Sans';\">Studying mutual model checking techniques;<\/span><\/span><\/h3>\n<h3 style=\"text-align: justify;\"><span style=\"text-align: justify;\"><span style=\"color: #ffffff; font-family: 'Open Sans';\">Examining agent\u2011based decision analysis systems;<\/span><\/span><\/h3>\n<h3 style=\"text-align: justify;\"><span style=\"text-align: justify;\"><span style=\"color: #ffffff; font-family: 'Open Sans';\">Applying human\u2011in\u2011the\u2011loop verification methods;<\/span><\/span><\/h3>\n<h3 style=\"text-align: justify;\"><span style=\"text-align: justify;\"><span style=\"color: #ffffff; font-family: 'Open Sans';\">Integrating domain knowledge into verification systems;<\/span><\/span><\/h3>\n<h3 style=\"text-align: justify;\"><span style=\"text-align: justify;\"><span style=\"color: #ffffff; font-family: 'Open Sans';\">Designing AI quality control systems.<\/span><\/span><\/h3>\n<\/div>\n<\/div><\/div><\/div><\/div><\/div><div id=\"pg-29214-5\"  class=\"panel-grid panel-has-style\" ><div class=\"panel-row-style panel-row-style-for-29214-5\" ><div id=\"pgc-29214-5-0\"  class=\"panel-grid-cell\" ><div id=\"panel-29214-5-0-0\" class=\"so-panel widget widget_sow-editor panel-first-child panel-last-child\" data-index=\"12\" ><div class=\"so-widget-sow-editor so-widget-sow-editor-base\">\n<div class=\"siteorigin-widget-tinymce textwidget\">\n\t<h3 style=\"text-align: justify; font-family: 'Open Sans';\"><span style=\"color: #000000;\"><strong>Main topics of the course:<\/strong><\/span><\/h3>\n<p style=\"text-align: justify; font-family: 'Open Sans';\"><strong>Part One<\/strong><\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">1. AI systems as human\u2011computer systems. The topic examines AI as a human\u2011machine decision support complex and highlights the differences between traditional software and AI systems, emphasising the role of humans in interpreting results.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">2. Understanding goal setting in AI systems. This topic explores the hierarchy of values, needs, goals, and objectives in intelligent system design, stressing the importance of explicit goal formulation at the start of development.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">3. Goal consistency analysis. The topic considers goal conflicts in complex socio\u2011technical systems and introduces methods for identifying and resolving them through compromise solutions.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">4. Degrees of freedom in goal setting and constraints. It discusses the solution space shaped by system goals and the impact of regulatory and technical constraints on AI system design.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">5. Criteria and metrics for evaluating AI systems. The topic covers the transition from system goals to performance criteria and quantitative metrics, helping to define measurable indicators for AI success.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">6. Requirements for AI systems. It explains how to translate performance criteria into functional and non\u2011functional requirements and guides the creation of a structured requirements list.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">7. AI system architecture: data pipeline, ML pipeline, inference pipeline. The topic provides an overview of key architectural components of AI systems and guides students in developing architectural diagrams.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">8. Architecture of LLM systems and Retrieval\u2011Augmented Generation (RAG). It introduces the structure of LLM\u2011based systems and RAG, including hands\u2011on experience in building a simple RAG application.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">9. Context and subject area of AI systems. The topic highlights how the correctness of AI results depends on the subject context and guides students in defining the domain context of their project systems.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">10. Enriching validation with domain knowledge. It covers methods for integrating knowledge bases and regulatory documents into AI verification, helping to build a project\u2011specific knowledge base.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">11. Sources of AI system errors: data, models, architecture. The topic identifies common sources of errors in AI systems and teaches students to anticipate and document potential issues early.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">12. Glitches in generative models and hallucinations. It focuses on typical errors in LLMs, such as hallucinations, and guides students in analysing and documenting real model errors.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">13. Features of AI system testing. The topic introduces key approaches to testing AI systems and helps students develop test scenarios and build test sets.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">14. Adversarial testing and stress testing of models. It covers techniques for provoking model errors through adversarial queries and designing stress tests to assess system robustness.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">15. Verification and validation in AI systems. The topic clarifies the distinction between verification and validation and guides students in preparing analytical reports on AI verification cases.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">16. Testing the reasoning and factual validity of AI results. It teaches how to evaluate the logical and factual correctness of AI outputs, using language model responses as a practical example.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\"><strong>Part Two<\/strong><\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">1. Automated verification of AI results. The topic discusses scalability challenges in AI verification and explores architectures for automated verification, including their role in modern AI applications.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">2. Using LLM to evaluate results (LLM as a judge). It covers methods for using language models to evaluate other models\u2019 outputs, analysing the advantages and limitations of this approach.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">3. Self\u2011consistency and mutual checking of models. The topic introduces techniques for cross\u2011verifying results from multiple models and using ensembles to improve reliability.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">4. Retrieval\u2011based verification. It explores methods for validating AI outputs using external knowledge sources and search engines, helping students integrate fact\u2011checking mechanisms.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">5. Agent\u2011based AI error detection systems. The topic presents architectures using specialised agents (critics, opponents, fact checkers) and guides students in designing agent\u2011based verification frameworks.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">6. Systematic search for AI bugs. It teaches systematic methods for identifying AI errors, including adversarial query generation and building comprehensive test scenarios.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">7. Expert validation of AI systems. The topic emphasises the role of domain experts in verification and guides students in developing expert review checklists and defining expert roles in system architecture.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">8. Contextual verification of AI systems. It highlights how AI result correctness depends on subject context and domain knowledge, guiding students in generating detailed domain descriptions.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">9. Verification pipeline. The topic covers the architecture of an AI testing pipeline (input validation, retrieval validation, response verification) and helps students design a pipeline for their project.<\/p>\n<p style=\"text-align: justify; font-family: 'Open Sans';\">10. AI reliability engineering. It introduces principles for ensuring AI system reliability, including monitoring, observability, and continuous quality assessment, and guides students in finalising their system\u2019s reliability architecture.<\/p>\n<\/div>\n<\/div><\/div><\/div><\/div><\/div><div id=\"pg-29214-6\"  class=\"panel-grid panel-no-style\" ><div id=\"pgc-29214-6-0\"  class=\"panel-grid-cell\" ><div id=\"panel-29214-6-0-0\" class=\"so-panel widget widget_sow-editor panel-first-child panel-last-child\" data-index=\"13\" ><div class=\"so-widget-sow-editor so-widget-sow-editor-base\">\n<div class=\"siteorigin-widget-tinymce textwidget\">\n\t<p><a style=\"padding: 12px 24px; background: #1e8a8a; color: white; border: none; border-radius: 8px; font-family: Arial, sans-serif; font-size: 16px; font-weight: bold; cursor: pointer; box-shadow: 0 4px 8px rgba(30, 138, 138, 0.3); transition: all 0.3s ease; width: 100%; margin: 0; display: block; text-align: left; padding-left: 16px; text-decoration: none;\" href=\"http:\/\/hes.mephi.ru\/wp-content\/uploads\/2026\/05\/05.06-Testing-Verification-and-Validation-of-Artificial-Intelligence-Systems.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">Download the extended description &gt;&gt;<\/a><\/p>\n<\/div>\n<\/div><\/div><\/div><\/div><div id=\"pg-29214-7\"  class=\"panel-grid panel-no-style\" ><div id=\"pgc-29214-7-0\"  class=\"panel-grid-cell\" ><div id=\"panel-29214-7-0-0\" class=\"so-panel widget widget_sow-editor panel-first-child panel-last-child\" data-index=\"14\" ><div class=\"so-widget-sow-editor so-widget-sow-editor-base\">\n<div class=\"siteorigin-widget-tinymce textwidget\">\n\t<p style=\"text-align: center;\"><a href=\"https:\/\/hes.mephi.ru\/?page_id=28339\">Return to the study plan overview<\/a><\/p>\n<\/div>\n<\/div><\/div><\/div><\/div><div id=\"pg-29214-8\"  class=\"panel-grid panel-has-style\" ><div class=\"siteorigin-panels-stretch panel-row-style panel-row-style-for-29214-8\" data-stretch-type=\"full\" ><div id=\"pgc-29214-8-0\"  class=\"panel-grid-cell\" ><div id=\"panel-29214-8-0-0\" class=\"so-panel widget widget_sow-editor panel-first-child panel-last-child\" data-index=\"15\" ><div class=\"so-widget-sow-editor so-widget-sow-editor-base\">\n<div class=\"siteorigin-widget-tinymce textwidget\">\n\t<p>&nbsp;<\/p>\n<h3 style=\"text-align: center;\"><span style=\"color: #ffffff;\">HES MEPhI<\/span><\/h3>\n<p style=\"text-align: center;\"><span style=\"color: #ffffff;\">+7 (495) 788-56-99 \u0434\u043e\u0431. 7691, 9570<\/span><br \/>\n<span style=\"color: #ffffff;\">+7 (929) 684-71-59<\/span><br \/>\n<strong><span style=\"color: #ff6600;\"><a style=\"color: #ff6600;\" href=\"mailto:hes@mephi.ru\" target=\"_blank\" rel=\"noopener\">hes@mephi.ru<\/a><\/span><\/strong><\/p>\n<p><a style=\"padding: 12px 24px; background: #CC4E5C; color: white; border: none; border-radius: 8px; font-family: Arial,sans-serif; font-size: 16px; font-weight: bold; cursor: pointer; box-shadow: 0 4px 6px rgba(204,78,92,0.4); transition: all 0.3s ease; width: 100%; margin: 0; display: block; text-align: center; text-decoration: none; position: relative; top: 0;\" href=\"https:\/\/forms.gle\/pyuPR9hYQ36Qo58GA\" target=\"_blank\" rel=\"noopener noreferrer\">Ask a question!<\/a><\/p>\n<\/div>\n<\/div><\/div><\/div><div id=\"pgc-29214-8-1\"  class=\"panel-grid-cell\" ><div id=\"panel-29214-8-1-0\" class=\"so-panel widget widget_sow-editor panel-first-child panel-last-child\" data-index=\"16\" ><div class=\"so-widget-sow-editor so-widget-sow-editor-base\">\n<div class=\"siteorigin-widget-tinymce textwidget\">\n\t<p>&nbsp;<\/p>\n<h3 style=\"text-align: center;\"><i class=\"fa-vk\"><\/i><a href=\"https:\/\/vk.com\/hesmephi\" target=\"_blank\" rel=\"noopener\">\u00a0<span style=\"color: #ff6600;\"> VK \/ Vkontakte<\/span><\/a><\/h3>\n<h3 style=\"text-align: center;\"><img decoding=\"async\" loading=\"lazy\" class=\"standard\" src=\"http:\/\/hes.mephi.ru\/wp-content\/uploads\/2022\/02\/zen-new-icon.png\" alt=\"\u0412\u0418\u0428 \u041c\u0418\u0424\u0418\" width=\"20\" height=\"20\" \/><a href=\"https:\/\/zen.yandex.ru\/id\/5e2972c4a1bb8700b092dbdd\" target=\"_blank\" rel=\"noopener\">\u00a0 <span style=\"color: #ff6600;\">Yandex.Dzen<\/span><\/a><\/h3>\n<h3 style=\"text-align: center;\"><img decoding=\"async\" loading=\"lazy\" class=\"standard\" src=\"http:\/\/hes.mephi.ru\/wp-content\/uploads\/2026\/03\/logo-max-hes-round-corners-black.png\" alt=\"\u0412\u0418\u0428 \u041c\u0418\u0424\u0418\" width=\"20\" height=\"20\" \/><span style=\"color: #ff6600;\"><a style=\"color: #ff6600;\" href=\"https:\/\/max.ru\/id7724068140_gos27\" target=\"_blank\" rel=\"noopener\"> MAX<\/a><\/span><\/h3>\n<h3 style=\"text-align: center;\"><img decoding=\"async\" loading=\"lazy\" class=\"standard\" src=\"http:\/\/hes.mephi.ru\/wp-content\/uploads\/2022\/04\/TG-black.jpg\" alt=\"\u0412\u0418\u0428 \u041c\u0418\u0424\u0418\" width=\"20\" height=\"20\" \/><a href=\"https:\/\/t.me\/hesmephi\" target=\"_blank\" rel=\"noopener\">\u00a0 <span style=\"color: #ff6600;\">Telegram<\/span><\/a><\/h3>\n<h3 style=\"text-align: center;\"><i class=\"fa-youtube\"><\/i><a href=\"https:\/\/www.youtube.com\/channel\/UChlJQWBMqKcweInG6YJiwIA\" target=\"_blank\" rel=\"noopener\">\u00a0 <span style=\"color: #ff6600;\">Youtube<\/span><\/a><\/h3>\n<h3 style=\"text-align: center;\"><img decoding=\"async\" loading=\"lazy\" class=\"standard\" src=\"http:\/\/hes.mephi.ru\/wp-content\/uploads\/2022\/03\/rutubelogo.jpg\" alt=\"\u0412\u0418\u0428 \u041c\u0418\u0424\u0418\" width=\"20\" height=\"20\" \/><a href=\"https:\/\/rutube.ru\/channel\/23944362\/\" target=\"_blank\" rel=\"noopener\">\u00a0 <span style=\"color: #ff6600;\">Rutube<\/span><\/a><\/h3>\n<p>&nbsp;<\/p>\n<\/div>\n<\/div><\/div><\/div><div id=\"pgc-29214-8-2\"  class=\"panel-grid-cell\" ><div id=\"panel-29214-8-2-0\" class=\"so-panel widget widget_sow-editor panel-first-child panel-last-child\" data-index=\"17\" ><div class=\"so-widget-sow-editor so-widget-sow-editor-base\">\n<div class=\"siteorigin-widget-tinymce textwidget\">\n\t<p>&nbsp;<\/p>\n<h3 style=\"text-align: center;\">NRNU MEPhI\u00a0Admissions Committee:<\/h3>\n<p style=\"text-align: center;\"><strong><span style=\"color: #ff6600;\"><a style=\"color: #ff6600;\" href=\"https:\/\/admission.mephi.ru\/\" target=\"_blank\" rel=\"noopener\">admission.mephi.ru<\/a><\/span><\/strong><\/p>\n<p style=\"text-align: center;\"><span style=\"color: #ffffff;\">115409, Moscow, Kashirskoe shosse, 31<\/span><\/p>\n<\/div>\n<\/div><\/div><\/div><\/div><\/div><\/div>","protected":false},"excerpt":{"rendered":"<p>DOWNLOAD THE FULL COURSE SYLLABUS BACK TO THE CURRICULUM BACK TO MASTER&#8217;S PROGRAM ABOUT HES MEPHI Testing, Verification and Validation of Artificial Intelligence Systems Modern artificial intelligence systems fundamentally differ from traditional software systems. Their behavior is shaped not only by algorithmic logic but also by statistical models trained on data, making the challenges of reliability, correctness, and interpretability particularly [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"template-blank3.php","meta":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v18.2 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Testing, Verification and Validation of Artificial Intelligence Systems - \u0412\u0418\u0428 \u041c\u0418\u0424\u0418<\/title>\n<meta name=\"description\" content=\"The course Testing, Verification, and Validation of AI Systems aims to develop an engineering culture for the design, verification, and operation of intelligent digital systems.Modern artificial intelligence systems fundamentally differ from traditional software systems. Their behavior is shaped not only by algorithmic logic but also by statistical models trained on data, making the challenges of reliability, correctness, and interpretability particularly complex.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/hes.mephi.ru\/?page_id=29214\" \/>\n<meta property=\"og:locale\" content=\"ru_RU\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Testing, Verification and Validation of Artificial Intelligence Systems - \u0412\u0418\u0428 \u041c\u0418\u0424\u0418\" \/>\n<meta property=\"og:description\" content=\"The course Testing, Verification, and Validation of AI Systems aims to develop an engineering culture for the design, verification, and operation of intelligent digital systems.Modern artificial intelligence systems fundamentally differ from traditional software systems. Their behavior is shaped not only by algorithmic logic but also by statistical models trained on data, making the challenges of reliability, correctness, and interpretability particularly complex.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/hes.mephi.ru\/?page_id=29214\" \/>\n<meta property=\"og:site_name\" content=\"\u0412\u0418\u0428 \u041c\u0418\u0424\u0418\" \/>\n<meta property=\"article:modified_time\" content=\"2026-05-04T20:19:55+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/hes.mephi.ru\/wp-content\/uploads\/2026\/04\/Logo_Vish_eng-1.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u041f\u0440\u0438\u043c\u0435\u0440\u043d\u043e\u0435 \u0432\u0440\u0435\u043c\u044f \u0434\u043b\u044f \u0447\u0442\u0435\u043d\u0438\u044f\" \/>\n\t<meta name=\"twitter:data1\" content=\"9 \u043c\u0438\u043d\u0443\u0442\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/hes.mephi.ru\/#website\",\"url\":\"https:\/\/hes.mephi.ru\/\",\"name\":\"\u0412\u0418\u0428 \u041c\u0418\u0424\u0418\",\"description\":\"\u0412\u044b\u0441\u0448\u0430\u044f \u0438\u043d\u0436\u0438\u043d\u0438\u0440\u0438\u043d\u0433\u043e\u0432\u0430\u044f \u0448\u043a\u043e\u043b\u0430 \u041d\u0418\u042f\u0423 \u041c\u0418\u0424\u0418\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/hes.mephi.ru\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"ru-RU\"},{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/hes.mephi.ru\/?page_id=29214#primaryimage\",\"inLanguage\":\"ru-RU\",\"url\":\"http:\/\/hes.mephi.ru\/wp-content\/uploads\/2026\/04\/Logo_Vish_eng-1.png\",\"contentUrl\":\"http:\/\/hes.mephi.ru\/wp-content\/uploads\/2026\/04\/Logo_Vish_eng-1.png\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/hes.mephi.ru\/?page_id=29214#webpage\",\"url\":\"https:\/\/hes.mephi.ru\/?page_id=29214\",\"name\":\"Testing, Verification and Validation of Artificial Intelligence Systems - \u0412\u0418\u0428 \u041c\u0418\u0424\u0418\",\"isPartOf\":{\"@id\":\"https:\/\/hes.mephi.ru\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/hes.mephi.ru\/?page_id=29214#primaryimage\"},\"datePublished\":\"2026-05-04T16:28:45+00:00\",\"dateModified\":\"2026-05-04T20:19:55+00:00\",\"description\":\"The course Testing, Verification, and Validation of AI Systems aims to develop an engineering culture for the design, verification, and operation of intelligent digital systems.Modern artificial intelligence systems fundamentally differ from traditional software systems. Their behavior is shaped not only by algorithmic logic but also by statistical models trained on data, making the challenges of reliability, correctness, and interpretability particularly complex.\",\"breadcrumb\":{\"@id\":\"https:\/\/hes.mephi.ru\/?page_id=29214#breadcrumb\"},\"inLanguage\":\"ru-RU\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/hes.mephi.ru\/?page_id=29214\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/hes.mephi.ru\/?page_id=29214#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"\u0413\u043b\u0430\u0432\u043d\u0430\u044f \u0441\u0442\u0440\u0430\u043d\u0438\u0446\u0430\",\"item\":\"https:\/\/hes.mephi.ru\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Testing, Verification and Validation of Artificial Intelligence Systems\"}]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Testing, Verification and Validation of Artificial Intelligence Systems - \u0412\u0418\u0428 \u041c\u0418\u0424\u0418","description":"The course Testing, Verification, and Validation of AI Systems aims to develop an engineering culture for the design, verification, and operation of intelligent digital systems.Modern artificial intelligence systems fundamentally differ from traditional software systems. Their behavior is shaped not only by algorithmic logic but also by statistical models trained on data, making the challenges of reliability, correctness, and interpretability particularly complex.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/hes.mephi.ru\/?page_id=29214","og_locale":"ru_RU","og_type":"article","og_title":"Testing, Verification and Validation of Artificial Intelligence Systems - \u0412\u0418\u0428 \u041c\u0418\u0424\u0418","og_description":"The course Testing, Verification, and Validation of AI Systems aims to develop an engineering culture for the design, verification, and operation of intelligent digital systems.Modern artificial intelligence systems fundamentally differ from traditional software systems. Their behavior is shaped not only by algorithmic logic but also by statistical models trained on data, making the challenges of reliability, correctness, and interpretability particularly complex.","og_url":"https:\/\/hes.mephi.ru\/?page_id=29214","og_site_name":"\u0412\u0418\u0428 \u041c\u0418\u0424\u0418","article_modified_time":"2026-05-04T20:19:55+00:00","og_image":[{"url":"http:\/\/hes.mephi.ru\/wp-content\/uploads\/2026\/04\/Logo_Vish_eng-1.png"}],"twitter_card":"summary_large_image","twitter_misc":{"\u041f\u0440\u0438\u043c\u0435\u0440\u043d\u043e\u0435 \u0432\u0440\u0435\u043c\u044f \u0434\u043b\u044f \u0447\u0442\u0435\u043d\u0438\u044f":"9 \u043c\u0438\u043d\u0443\u0442"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebSite","@id":"https:\/\/hes.mephi.ru\/#website","url":"https:\/\/hes.mephi.ru\/","name":"\u0412\u0418\u0428 \u041c\u0418\u0424\u0418","description":"\u0412\u044b\u0441\u0448\u0430\u044f \u0438\u043d\u0436\u0438\u043d\u0438\u0440\u0438\u043d\u0433\u043e\u0432\u0430\u044f \u0448\u043a\u043e\u043b\u0430 \u041d\u0418\u042f\u0423 \u041c\u0418\u0424\u0418","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/hes.mephi.ru\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"ru-RU"},{"@type":"ImageObject","@id":"https:\/\/hes.mephi.ru\/?page_id=29214#primaryimage","inLanguage":"ru-RU","url":"http:\/\/hes.mephi.ru\/wp-content\/uploads\/2026\/04\/Logo_Vish_eng-1.png","contentUrl":"http:\/\/hes.mephi.ru\/wp-content\/uploads\/2026\/04\/Logo_Vish_eng-1.png"},{"@type":"WebPage","@id":"https:\/\/hes.mephi.ru\/?page_id=29214#webpage","url":"https:\/\/hes.mephi.ru\/?page_id=29214","name":"Testing, Verification and Validation of Artificial Intelligence Systems - \u0412\u0418\u0428 \u041c\u0418\u0424\u0418","isPartOf":{"@id":"https:\/\/hes.mephi.ru\/#website"},"primaryImageOfPage":{"@id":"https:\/\/hes.mephi.ru\/?page_id=29214#primaryimage"},"datePublished":"2026-05-04T16:28:45+00:00","dateModified":"2026-05-04T20:19:55+00:00","description":"The course Testing, Verification, and Validation of AI Systems aims to develop an engineering culture for the design, verification, and operation of intelligent digital systems.Modern artificial intelligence systems fundamentally differ from traditional software systems. Their behavior is shaped not only by algorithmic logic but also by statistical models trained on data, making the challenges of reliability, correctness, and interpretability particularly complex.","breadcrumb":{"@id":"https:\/\/hes.mephi.ru\/?page_id=29214#breadcrumb"},"inLanguage":"ru-RU","potentialAction":[{"@type":"ReadAction","target":["https:\/\/hes.mephi.ru\/?page_id=29214"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/hes.mephi.ru\/?page_id=29214#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\u0413\u043b\u0430\u0432\u043d\u0430\u044f \u0441\u0442\u0440\u0430\u043d\u0438\u0446\u0430","item":"https:\/\/hes.mephi.ru\/"},{"@type":"ListItem","position":2,"name":"Testing, Verification and Validation of Artificial Intelligence Systems"}]}]}},"_links":{"self":[{"href":"https:\/\/hes.mephi.ru\/index.php?rest_route=\/wp\/v2\/pages\/29214"}],"collection":[{"href":"https:\/\/hes.mephi.ru\/index.php?rest_route=\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/hes.mephi.ru\/index.php?rest_route=\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/hes.mephi.ru\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/hes.mephi.ru\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=29214"}],"version-history":[{"count":12,"href":"https:\/\/hes.mephi.ru\/index.php?rest_route=\/wp\/v2\/pages\/29214\/revisions"}],"predecessor-version":[{"id":29236,"href":"https:\/\/hes.mephi.ru\/index.php?rest_route=\/wp\/v2\/pages\/29214\/revisions\/29236"}],"wp:attachment":[{"href":"https:\/\/hes.mephi.ru\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=29214"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}