<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="ru"><front><journal-meta><journal-id journal-id-type="publisher-id">esp</journal-id><journal-title-group><journal-title xml:lang="ru">Economy: strategy and practice</journal-title><trans-title-group xml:lang="en"><trans-title>Economy: strategy and practice</trans-title></trans-title-group></journal-title-group><issn pub-type="ppub">1997-9967</issn><issn pub-type="epub">2663-550X</issn><publisher><publisher-name>Институт экономики</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.51176/1997-9967-2022-3-108-123</article-id><article-id custom-type="elpub" pub-id-type="custom">esp-801</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="ru"><subject>РЕГИОНАЛЬНАЯ ЭКОНОМИКА И ТЕРРИТОРИАЛЬНОЕ РАЗВИТИЕ</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="en"><subject>REGIONAL ECONOMY AND TERRITORIAL DEVELOPMENT</subject></subj-group></article-categories><title-group><article-title>Критический анализ практики оценки региональных программ в Казахстане</article-title><trans-title-group xml:lang="en"><trans-title>A Critical Analysis of Regional Program Evaluation Practice in Kazakhstan</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-9012-7966</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Батталов</surname><given-names>Н. Н.</given-names></name><name name-style="western" xml:lang="en"><surname>Battalov</surname><given-names>N. N.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Батталов Н.Н. – докторант PhD</p><p>пр. аль-Фараби 71, 050040, Алматы</p></bio><bio xml:lang="en"><p>Nazym N. Battalov – PhD candidate</p><p>71 al-Farabi Ave., 050040, Almaty</p></bio><email xlink:type="simple">nnbattalov@gmail.com</email><xref ref-type="aff" rid="aff-1"/></contrib></contrib-group><aff-alternatives id="aff-1"><aff xml:lang="ru"><institution>Казахский национальный университет им. аль-Фараби</institution><country>Казахстан</country></aff><aff xml:lang="en"><institution>Al-Farabi Kazakh National University</institution><country>Kazakhstan</country></aff></aff-alternatives><pub-date pub-type="collection"><year>2022</year></pub-date><pub-date pub-type="epub"><day>28</day><month>09</month><year>2022</year></pub-date><volume>17</volume><issue>3</issue><fpage>108</fpage><lpage>123</lpage><permissions><copyright-statement>Copyright &amp;#x00A9; Батталов Н.Н., 2022</copyright-statement><copyright-year>2022</copyright-year><copyright-holder xml:lang="ru">Батталов Н.Н.</copyright-holder><copyright-holder xml:lang="en">Battalov N.N.</copyright-holder><license xml:lang="ru" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>Данная работа распространяется под лицензией Creative Commons Attribution 4.0.</license-p></license><license xml:lang="en" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>This work is licensed under a Creative Commons Attribution 4.0 License.</license-p></license></permissions><self-uri xlink:href="https://esp.ieconom.kz/jour/article/view/801">https://esp.ieconom.kz/jour/article/view/801</self-uri><abstract><p>За последние годы тема оценки государственных программ получает все большее внимание в Казахстане. Была сформирована институциональная и правовая база оценки программ. Однако, обзор литературы свидетельствует о том, что были предприняты лишь малые попытки исследования практики оценки, в особенности на региональном уровне. Остается малоизученным то, насколько она эффективна и полезна. Для ответа на этот вопрос, безусловно, важно диагностировать и оценить саму систему оценки. Цель данной статьи – оценить качество практики оценки региональных программ в Казахстане. В статье использован инструмент метаоценки для понимания того, насколько действующая практика соответствует трем фундаментальным и признанным стандартам оценки: ценностное измерение, валидность и полезность. В качестве выборки использованы отчеты об оценке, составленные региональными Ревизионными комиссиями. Данное исследование является первой попыткой применения признанных стандартов оценки и стратегий метаоценки в казахстанском контексте. Ввиду этого, предполагалось, что могут иметь место некие расхождения со стандартами. Полученные результаты, подтвердив данную гипотезу, свидетельствуют о том, что оценка программ на региональном уровне значительно отстает от данных стандартов. Статья определила множество концептуальных и методологических проблем, которые серьезно подрывают валидность и обоснованность оценки региональных программ. Ожидается, что статья будет стимулировать дискуссии в академических и экспертных кругах. Более того, определив ключевые направления, требующие совершенствования, статья может помочь в реформировании сферы оценки и способствовать более качественной разработке политик и решений, тем самым экономя деньги налогоплательщиков и улучшая благополучие людей. В завершении статья выдвигает ряд рекомендаций по модернизации практики оценки.</p></abstract><trans-abstract xml:lang="en"><p>In recent years the development of public program evaluation has received growing attention in Kazakhstan. An institutional and legal base for program evaluation has been established. However, the examination of literature has evidenced that there have been rudimentary attempts to interrogate evaluation practice, particularly at the regional level. It is still not well known how effective or valuable it is. It is imperative to run a diagnostic and assess the evaluation system to answer this question. This article aims to evaluate the quality of regional program evaluation practice in Kazakhstan. It applies a meta-evaluation tool to understand the extent to which such practice complies with three fundamental and recognized evaluation standards: namely, value, validity, and utility. As a sample, the study used evaluation reports conducted by regional Audit commissions. This research is the first attempt to apply established evaluation standards to the Kazakhstani context. Therefore, it was assumed that some discrepancies with the standards may occur. Having confirmed this hypothesis, the findings indicate that regional program evaluation falls far short of these standards. The paper identified many conceptual and methodological problems, which seriously compromise the validity and soundness of evaluation practice. It is expected that it will stimulate discussion in academic and subject matter expert circles. Furthermore, having identified key areas for improvement, the study may help reform the evaluation field and contribute to better policy- and decisionmaking, thus saving taxpayers’ money and improving people’s wellbeing. In the end, the research put forward several recommendations for strengthening evaluation practice.</p></trans-abstract><kwd-group xml:lang="ru"><kwd>оценка</kwd><kwd>эффективность</kwd><kwd>государственные программы</kwd><kwd>Казахстан</kwd><kwd>метаоценка</kwd><kwd>практика</kwd></kwd-group><kwd-group xml:lang="en"><kwd>Evaluation</kwd><kwd>Effectiveness</kwd><kwd>Public Programs</kwd><kwd>Kazakhstan</kwd><kwd>Meta-Evaluation</kwd><kwd>Practice</kwd></kwd-group></article-meta></front><back><ref-list><title>References</title><ref id="cit1"><label>1</label><citation-alternatives><mixed-citation xml:lang="ru">Legal information system of Regulatory Legal Acts of the Republic of Kazakhstan (Adilet), (2020). https://adilet.zan.kz/</mixed-citation><mixed-citation xml:lang="en">Legal information system of Regulatory Legal Acts of the Republic of Kazakhstan (Adilet), (2020). https://adilet.zan.kz/</mixed-citation></citation-alternatives></ref><ref id="cit2"><label>2</label><citation-alternatives><mixed-citation xml:lang="ru">Akorda, (2020). The Address of the President of the President of the Republic of Kazakhstan at the government meeting [akorda. kz]. Official website of the President of Kazakhstan; 2020. [Updated January 24, 2020; cited November 2, 2021]. Available: https://www.akorda.kz/ru/speeches/internal_political_affairs/in_speeches_and_addresses/vystuplenie-prezidenta-kasym-zhomarta-tokaevana-rasshirennom-zasedanii-pravitelstva-respublikikazahstan.</mixed-citation><mixed-citation xml:lang="en">Akorda, (2020). The Address of the President of the President of the Republic of Kazakhstan at the government meeting [akorda. kz]. Official website of the President of Kazakhstan; 2020. [updated January 24, 2020; cited November 2, 2021]. Available: https://www.akorda.kz/ru/speeches/internal_political_affairs/in_speeches_and_addresses/vystuplenie-prezidenta-kasym-zhomarta-tokaevana-rasshirennom-zasedanii-pravitelstva-respublikikazahstan.</mixed-citation></citation-alternatives></ref><ref id="cit3"><label>3</label><citation-alternatives><mixed-citation xml:lang="ru">Alibekova, B., Akimova, B. &amp; Ahmetova A. (2019). The formation and current state of audit commissions in the system of state audit bodies. Statistics, accounting and audit, 1(72). 16-21.</mixed-citation><mixed-citation xml:lang="en">Alibekova, B., Akimova, B. &amp; Ahmetova A. (2019). The formation and current state of audit commissions in the system of state audit bodies]. Statistics, accounting and audit [Statistika, uchet i audit], 1(72), 16-21. (in Russ)</mixed-citation></citation-alternatives></ref><ref id="cit4"><label>4</label><citation-alternatives><mixed-citation xml:lang="ru">Alibekova, G., Tayova, G. &amp; Ilmaliyev, J. (2018). Evaluation issues of support programs of commercialization of scientific development in Kazakhstan. Complex use of mineral resources, 4(307). 181-191.</mixed-citation><mixed-citation xml:lang="en">Alibekova, G., Tayova, G. &amp; Ilmaliyev, J. (2018). Evaluation issues of support programs of commercialization of scientific development in Kazakhstan. Complex use of mineral resources [Kompleksnoe ispolzovanie mineralnogo syrya], 4(307), 181-191. (in Russ)</mixed-citation></citation-alternatives></ref><ref id="cit5"><label>5</label><citation-alternatives><mixed-citation xml:lang="ru">Aymagambetov, E. &amp; Tyngisheva, A. (2019). Modern state of the healthcare system in Karaganda region. Karaganda University Bulletin, 2, 11-17.</mixed-citation><mixed-citation xml:lang="en">Aymagambetov, E. &amp; Tyngisheva, A. (2019). Modern state of the healthcare system in Karaganda region. Karaganda University Bulletin [Vestnik KarGU], 2, 11-17. (in Russ)</mixed-citation></citation-alternatives></ref><ref id="cit6"><label>6</label><citation-alternatives><mixed-citation xml:lang="ru">Baimbetov, M. (2019). Implementation evaluation of state programs in the Republic of Kazakhstan. Bulletin of the Omsk Regional Institute, 3, 43-46.</mixed-citation><mixed-citation xml:lang="en">Baimbetov, M. (2019). Implementation evaluation of state programs in the Republic of Kazakhstan. Bulletin of the Omsk Regional Institute [Vestnik Omskogo regionalnogo instituta], 3, 43-46. (in Russ)</mixed-citation></citation-alternatives></ref><ref id="cit7"><label>7</label><citation-alternatives><mixed-citation xml:lang="ru">Bopiyeva, Z. &amp; Kazakova, T. (2009a). Kazakhstan’s experience in impact evaluation of state programs. Bulletin of Legislature Institute of the Republic of Kazakhstan, 2(14), 20-27.</mixed-citation><mixed-citation xml:lang="en">Bopiyeva, Z. &amp; Kazakova, T. (2009). Kazakhstan’s experience in impact evaluation of state programs. Vestnik Instituta zakonodatelstva Respubliki Kazahstan [Bulletin of Legislature Institute of the Republic of Kazakhstan], 2(14), 20-27. (in Russ)</mixed-citation></citation-alternatives></ref><ref id="cit8"><label>8</label><citation-alternatives><mixed-citation xml:lang="ru">Bopiyeva, Z. &amp; Kazakova. T. (2009b). Ways of improving effectiveness of state programs. Bulletin of the Legislation Institute of the Republic of Kazakhstan, 4(16). 160-164.</mixed-citation><mixed-citation xml:lang="en">Bopiyeva, Z. &amp; Kazakova. T. (2009). Ways of improving effectiveness of state programs]. Bulletin of the Legislation Institute of the Republic of Kazakhstan [Vestnik Instituta zakonodatelstva Respubliki Kazahstan], 4(16), 160-164. (in Russ)</mixed-citation></citation-alternatives></ref><ref id="cit9"><label>9</label><citation-alternatives><mixed-citation xml:lang="ru">Chelimsky, E. (1985). Comparing and contrasting auditing and evaluation: some notes on their relationship. Evaluation Review, 9(4), 483-503. https://doi.org/10.1177/0193841X8500900406.</mixed-citation><mixed-citation xml:lang="en">Chelimsky, E. (1985). Comparing and contrasting auditing and evaluation: some notes on their relationship. Evaluation Review, 9(4), 483-503. https://doi.org/10.1177/0193841X8500900406.</mixed-citation></citation-alternatives></ref><ref id="cit10"><label>10</label><citation-alternatives><mixed-citation xml:lang="ru">Davidson, E. J. (2005). Evaluation methodology basics: The nuts and bolts of sound evaluation. Sage.</mixed-citation><mixed-citation xml:lang="en">Davidson, E. J. (2005). Evaluation methodology basics: The nuts and bolts of sound evaluation. Sage.</mixed-citation></citation-alternatives></ref><ref id="cit11"><label>11</label><citation-alternatives><mixed-citation xml:lang="ru">Dosayeva, A. (2019). Principles, approaches and features of state audit. Vestnik Bulletin of Turan University, 4(84), 149-154.</mixed-citation><mixed-citation xml:lang="en">Dosayeva, A. (2019). Principles, approaches and features of state audit. Bulletin of Turan University [Vestnik Universiteta Turan], 4(84), 149-154. (in Russ).</mixed-citation></citation-alternatives></ref><ref id="cit12"><label>12</label><citation-alternatives><mixed-citation xml:lang="ru">Fournier, D. M. (1995). Establishing evaluative conclusions: A distinction between general and working logic. New Directions for Evaluation, 1995(68), 15-32. https://doi.org/10.1002/ev.1017.</mixed-citation><mixed-citation xml:lang="en">Fournier, D. M. (1995). Establishing evaluative conclusions: A distinction between general and working logic. New Directions for Evaluation, 1995(68), 15-32. https://doi.org/10.1002/ev.1017.</mixed-citation></citation-alternatives></ref><ref id="cit13"><label>13</label><citation-alternatives><mixed-citation xml:lang="ru">Gayfutdinova, V. (2017). Why development programs don’t work in Kazakhstan, [updated November 8, 2017; cited December 10, 2021]. Available: https://forbes.kz//process/expertise/pochemu_v_rk_ne_rabotayut_programmyi_razvitiya_ot_zarubejnyih_konsultantov/</mixed-citation><mixed-citation xml:lang="en">Gayfutdinova, V. (2017). Why development programs don’t work in Kazakhstan [Pochemu v Kazahstane ne rabotayut programmyi razvitiya], [updated November 8, 2017; cited December 10, 2021]. Available: https://forbes.kz//process/expertise/pochemu_v_rk_ne_rabotayut_programmyi_razvitiya_ot_zarubejnyih_konsultantov/ (in Russ)</mixed-citation></citation-alternatives></ref><ref id="cit14"><label>14</label><citation-alternatives><mixed-citation xml:lang="ru">Golafshani, N. (2003). Understanding reliability and validity in qualitative research. The qualitative report, 8(4), 597-607. https://doi.org/10.46743/2160-3715/2003.1870</mixed-citation><mixed-citation xml:lang="en">Golafshani, N. (2003). Understanding reliability and validity in qualitative research. The qualitative report, 8(4), 597-607. https://doi.org/10.46743/2160-3715/2003.1870</mixed-citation></citation-alternatives></ref><ref id="cit15"><label>15</label><citation-alternatives><mixed-citation xml:lang="ru">Ho, J. Y., &amp; Hendi, A. S. (2018). Recent trends in life expectancy across high income countries: retrospective observational study. Bmj, 362. https://doi.org/10.1136/bmj.k3622</mixed-citation><mixed-citation xml:lang="en">Ho, J. Y., &amp; Hendi, A. S. (2018). Recent trends in life expectancy across high income countries: retrospective observational study. Bmj, 362. https://doi.org/10.1136/bmj.k3622</mixed-citation></citation-alternatives></ref><ref id="cit16"><label>16</label><citation-alternatives><mixed-citation xml:lang="ru">Joint Committee on Standards for Educational Evaluation (2011). The program evaluation standards: a guide for evaluators and evaluation users.</mixed-citation><mixed-citation xml:lang="en">Joint Committee on Standards for Educational Evaluation. (2011). The program evaluation standards: a guide for evaluators and evaluation users.</mixed-citation></citation-alternatives></ref><ref id="cit17"><label>17</label><citation-alternatives><mixed-citation xml:lang="ru">Kaldiyarov, D. &amp; Turgambekova, Z. (2019). Effective methods for designing and evaluation state program in the social sphere. Modern Science, 5(1), 107-109.</mixed-citation><mixed-citation xml:lang="en">Kaldiyarov, D. &amp; Turgambekova, Z. (2019). Effective methods for designing and evaluation state program in the social sphere. Modern Science [Sovremennaya nauka], 5(1), 107-109. (in Russ)</mixed-citation></citation-alternatives></ref><ref id="cit18"><label>18</label><citation-alternatives><mixed-citation xml:lang="ru">Kari, A. (2015). Methodological problems of implementation evaluation of strategic documents and programs in public management of economy in the Republic of Kazakhstan. Economics: the strategy and practice, 3(35).</mixed-citation><mixed-citation xml:lang="en">Kari, A. (2015). Methodological problems of implementation evaluation of strategic documents and programs in public management of economy in the Republic of Kazakhstan. Economics: the strategy and practice [Ekonomika: strategiya i praktika], 3(35). (in Russ).</mixed-citation></citation-alternatives></ref><ref id="cit19"><label>19</label><citation-alternatives><mixed-citation xml:lang="ru">Martens, K. S. (2018). Rubrics in program evaluation. Evaluation Journal of Australasia, 18(1), 21-44. https://doi.org/10.1177/1035719X17753961</mixed-citation><mixed-citation xml:lang="en">Martens, K. S. (2018). Rubrics in program evaluation. Evaluation Journal of Australasia, 18(1), 21-44. https://doi.org/10.1177/1035719X17753961</mixed-citation></citation-alternatives></ref><ref id="cit20"><label>20</label><citation-alternatives><mixed-citation xml:lang="ru">Murzaliyeva, A. &amp; Karshalova, A. (2018). State effectiveness audit of implementation of healthcare budget programs. Economic systems management: electronic journal, 4(110), 32.</mixed-citation><mixed-citation xml:lang="en">Murzaliyeva, A. &amp; Karshalova, A. (2018). State effectiveness audit of implementation of healthcare budget programs. Economic systems management: electronic journal [Upravleniyeekonomicheskimi sistemami: elektronnyi jurnal], 4(110), 32. (in Russ)</mixed-citation></citation-alternatives></ref><ref id="cit21"><label>21</label><citation-alternatives><mixed-citation xml:lang="ru">Nygmetov, K. (2014). Strategy and program evaluation in the system of state planning in the Republic of Kazakhstan. Economics and management, 34(547), 95-102.</mixed-citation><mixed-citation xml:lang="en">Nygmetov, K. (2014). Strategy and program evaluation in the system of state planning in the Republic of Kazakhstan. Economics and management [Ekonomika i Upravleniye], 34(547), 95-102. (in Russ)</mixed-citation></citation-alternatives></ref><ref id="cit22"><label>22</label><citation-alternatives><mixed-citation xml:lang="ru">The Organization for Economic Cooperation and Development (OECD). OECD Ilibrary. (2021) [updated February 13, 2021; cited March 30, 2022]. Available: https://www.oecd-ilibrary.org/</mixed-citation><mixed-citation xml:lang="en">The Organization for Economic Cooperation and Development (OECD). OECD Ilibrary. (2021) [updated February 13, 2021; cited March 30, 2022]. Available: https://www.oecd-ilibrary.org/</mixed-citation></citation-alternatives></ref><ref id="cit23"><label>23</label><citation-alternatives><mixed-citation xml:lang="ru">Open Government, Magenta Book. Central Government guidance on evaluation, (2020). [updated 2020; cited March 30, 2022]. Available: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/879438/HMT_Magenta_Book.pdf</mixed-citation><mixed-citation xml:lang="en">Open Government, Magenta Book. Central Government guidance on evaluation, (2020). [updated 2020; cited March 30, 2022]. Available: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/879438/HMT_Magenta_Book.pdf</mixed-citation></citation-alternatives></ref><ref id="cit24"><label>24</label><citation-alternatives><mixed-citation xml:lang="ru">Pokidayev, D. (2020). Who will be conducting evaluation of effectiveness of state programs [Kto zaymetsya otsenkoy effektivnosti kazahstanskih gosprogramm], [updated February 7, 2020; cited December 2021]. Available: https://kursiv.kz/news/obschestvo/2020-02/kto-zaymetsya-ocenkoyeffektivnosti-kazakhstanskikh-gosprogramm</mixed-citation><mixed-citation xml:lang="en">Pokidayev, D. (2020). Who will be conducting evaluation of effectiveness of state programs [Kto zaymetsya otsenkoy effektivnosti kazahstanskih gosprogramm], [updated February 7, 2020; cited December 2021]. Available: https://kursiv.kz/news/obschestvo/2020-02/kto-zaymetsya-ocenkoyeffektivnosti-kazakhstanskikh-gosprogramm. (in Russ)</mixed-citation></citation-alternatives></ref><ref id="cit25"><label>25</label><citation-alternatives><mixed-citation xml:lang="ru">Pritvorova, T. &amp; Bektleyeva, D. (2017). Social effect evaluation methods in active labour market projects in Kazakhstan. Herald of Omsk University. Economics Series, 3(59). 201-210.</mixed-citation><mixed-citation xml:lang="en">Pritvorova, T. &amp; Bektleyeva, D. (2017). Social effect evaluation methods in active labour market projects in Kazakhstan. Herald of Omsk University. Economics Series [Vestnik Omskogo universiteta. Seriya Ekonomika], 3(59), 201-210. (in Russ)</mixed-citation></citation-alternatives></ref><ref id="cit26"><label>26</label><citation-alternatives><mixed-citation xml:lang="ru">Rakhmatullayeva, D., Bobkov, V. &amp; Jatkanbayev, E. (2015). Modelling of social effects of direct foreign investments in regions of Kazakhstan. Economy of Region, 2(42), 285-300.</mixed-citation><mixed-citation xml:lang="en">Rakhmatullayeva, D., Bobkov, V. &amp; Jatkanbayev, E. (2015). Modelling of social effects of direct foreign investments in regions of Kazakhstan. Economy of Region [Ekonomika regiona], 2(42), 285-300. (in Russ)</mixed-citation></citation-alternatives></ref><ref id="cit27"><label>27</label><citation-alternatives><mixed-citation xml:lang="ru">Scott-Little, C., Hamann, M. S., &amp; Jurs, S. G. (2002). Evaluations of after-school programs: A metaevaluation of methodologies and narrative synthesis of findings. American Journal of Evaluation, 23(4), 387-419. https://doi.org/10.1177/109821400202300403.</mixed-citation><mixed-citation xml:lang="en">Scott-Little, C., Hamann, M. S., &amp; Jurs, S. G. (2002). Evaluations of after-school programs: A metaevaluation of methodologies and narrative synthesis of findings. American Journal of Evaluation, 23(4), 387-419. https://doi.org/10.1177/109821400202300403.</mixed-citation></citation-alternatives></ref><ref id="cit28"><label>28</label><citation-alternatives><mixed-citation xml:lang="ru">Scriven, M. (1991). Evaluation thesaurus (4th ed.). California: Sage Publications.</mixed-citation><mixed-citation xml:lang="en">Scriven, M. (1991). Evaluation thesaurus (4th ed.). California: Sage Publications.</mixed-citation></citation-alternatives></ref><ref id="cit29"><label>29</label><citation-alternatives><mixed-citation xml:lang="ru">Scriven, M. (1995). The logic of evaluation and evaluation practice. New Directions for Evaluation, 1995(68), 49-70. https://doi.org/10.1002/ev.1019.</mixed-citation><mixed-citation xml:lang="en">Scriven, M. (1995). The logic of evaluation and evaluation practice. New Directions for Evaluation, 1995(68), 49-70. https://doi.org/10.1002/ev.1019.</mixed-citation></citation-alternatives></ref><ref id="cit30"><label>30</label><citation-alternatives><mixed-citation xml:lang="ru">Shakirova, G., Sitenko, D. and Vasa, L. (2019). Effectiveness audit of public budget expenditures in the process of state audit. Karaganda University Bulletin, 7562, 263-274.</mixed-citation><mixed-citation xml:lang="en">Shakirova, G., Sitenko, D. &amp; Vasa, L. (2019). Effectiveness audit of public budget expenditures in the process of state audit. Karaganda University Bulletin [Vestnik KarGU], 7562, 263-274. (in Russ).</mixed-citation></citation-alternatives></ref><ref id="cit31"><label>31</label><citation-alternatives><mixed-citation xml:lang="ru">Stufflebeam, D. L., &amp; Coryn, C. L. (2014). Evaluation theory, models, and applications (Vol. 50). John Wiley &amp; Sons.</mixed-citation><mixed-citation xml:lang="en">Stufflebeam, D. L., &amp; Coryn, C. L. (2014). Evaluation theory, models, and applications (Vol. 50). John Wiley &amp; Sons.</mixed-citation></citation-alternatives></ref><ref id="cit32"><label>32</label><citation-alternatives><mixed-citation xml:lang="ru">Vechkinzova, Y. (2008). Evaluation of implementation of state development programs in the Republic of Kazakhstan. Journal of New Economy, 1(20). 105-111.</mixed-citation><mixed-citation xml:lang="en">Vechkinzova, Y. (2008). Evaluation of implementation of state development programs in the Republic of Kazakhstan. Journal of New Economy [Izvestiya UrGEU], 1(20), 105-111. (in Russ)</mixed-citation></citation-alternatives></ref><ref id="cit33"><label>33</label><citation-alternatives><mixed-citation xml:lang="ru">Yessimova, S. (2009). Impact evaluation of state programs in the Republic of Kazakhstan. University Scientific papers, 3, 257-260.</mixed-citation><mixed-citation xml:lang="en">Yessimova, S. (2009). Impact evaluation of state programs in the Republic of Kazakhstan. University Scientific papers [Universiteski naukovi zapiski], 3, 257-260. (in Russ)</mixed-citation></citation-alternatives></ref><ref id="cit34"><label>34</label><citation-alternatives><mixed-citation xml:lang="ru">Youker, B. &amp; Ingraham, A. (2014). Goal-free evaluation: an orientation for foundations’ evaluations. The Foundation Review, 5(4). 51-61. https://doi.org/10.9707/1944-5660.1182</mixed-citation><mixed-citation xml:lang="en">Youker, B. &amp; Ingraham, A. (2014). Goal-free evaluation: an orientation for foundations’ evaluations. The Foundation Review, 5(4). 51-61. https://doi.org/10.9707/1944-5660.1182</mixed-citation></citation-alternatives></ref></ref-list><fn-group><fn fn-type="conflict"><p>The authors declare that there are no conflicts of interest present.</p></fn></fn-group></back></article>
