ALGORITHMIC GOVERNANCE IN PUBLIC SECTOR: IS DIGITIZATION A KEY TO EFFECTIVE MANAGEMENT

 

Aurelija Pūraitė

Mykolas Romeris University, Lithuania

E-mail: aurelija.puraite@gmail.com

 

Vaiva Zuzevičiūtė

Mykolas Romeris University, Lithuania

E-mail: vaiva.zuzeviciute@mruni.eu

 

Daiva Bereikienė

Mykolas Romeris University, Ukraine

E-mail: d.bereikiene@mruni.eu

 

Tetyana Skrypko

Lviv Institute of Economics and Tourism, Ukraine

E-mail: tanskrlviv@gmail.com

 

Leonid Shmorgun

National Academy of Leadership in Culture and Arts, Ukraine

E-mail: 19shmorgun51@gmail.com

 

Submission: 8/5/2020

Revision: 8/12/2020

Accept: 8/31/2020

 

ABSTRACT

While algorithmic governance in the public sector can lead to increased efficiency and cost-effectiveness, the implementation of those digital innovations can also result in multiple forms of harm: data bias can lead to reinforcement of inequality, discrimination, and criminalization of already marginalized populations; lack of accountability and transparency in decision-making can lead to injustices; societal trust and the legitimacy of public sector institutions may suffer; privacy and fundamental human rights may be threatened, ethical standards challenged. Digital transformation, leading to algorithmic governance, may be challenged in times of crisis, such as the recent pandemic outbreak, as new technologies in public sector institutions and forms of data-driven surveillance and intrusive monitoring are introduced in the name of public security and social need.  This research focuses in affirming the assumption that the effective management in the public sector, first of all, is determined by the ability of this sector to transform the perception of the services delivered; secondly, it requires strategic actions to enable the systemic and coherent digital transformation of the public sector; and lastly, the new strategies of human resources management in the public sector should be considered. The focus is concentrated on understanding how the implementation of digital tools to the public sector and public services correlate with algorithmic governance concept and what impact digitization has on the effectiveness of management in the public sector.

Keywords: Algorithmic governance; Public sector; Digitization; Human rights, Management

1.       INTRODUCTION

            The digitalization of all sectors of life, including public service sector, is presumed as being a positive one. It is however clear, that the evolution of digital tools is a 21st-century opportunity, challenge and phenomenon that affects all dimensions of social life - philosophical, social, legal, administrative. Digital technologies pose new requirements, expectations and challenges for the public sector.

            It is obvious that the public sector has recently faced an inevitable transformation, among other equally complex ones: the economy and society are undergoing a major digital transformation, including but not limited to new business and work models, public services, leisure and even democratic participation. Governments and the public sector as a whole face the need, firstly, to understand the necessity and possibilities of digitization and, secondly, the inevitable need to assess their human resource management to meet new societal, social, economic, educational trends.

            According to the data of European Commission, in 2019 both the quality and usage of digital public services increased in the EU, 67 percent of people who otherwise use the internet who submitted forms to their public administration reported that they now use online channels (up from 57 percent in 2014) (EUROPEAN COMMISSION, 2020).

            For example, in Lithuania, more than 90 percent of public services are available on the Internet. More than 80 percent of citizens in Lithuania use e-government services, it should be noted that figures among business sector are even better: 97 percent of them use the electronic services of the public sector (LITHUANIAN MINISTRY OF ECONOMY AND INNOVATIONS, 2020).

            Therefore, now the goal of Lithuanian public sector is no longer electronic, but a digitized public service. This trend corresponds to smart administration, development of human capital and related ICT of administrative and public services, which were seen as a fundamental requirement for economic growth and jobs already with renewed Lisbon agenda in the European Union level already in 2005, and later affirmed in other strategic documents (Europe 2020 (EUROPEAN COMMISSION, 2010), Europe 2030 strategy being created at present, in alignment with United Nations 2030 Agenda).

            The similar trends could be seen all over the world, the goal now is to step forward - the transition from e-government to a fully developed open, and efficient, digital government is the aim. However, digitization (and digital transformation) is going faster than the reflection on its impacts on society, security, and rights; this in itself represents a potential threat to society. There is, therefore, an urgent need to analyse the process carefully to avoid the unforeseen, un-modelled and potentially detrimental consequences.

            Another concept related to the digitalization of public institutions that should be here mentioned is a widely analysed “algorithmic governance” approach. The term “algorithms” was previously associated only with the exact or technological sciences, with the terms big data, machine learning, or artificial intelligence. In the last decade, this category has also moved to the social sciences, leading to regular disputes over the real or potential consequences of new algorithms.

            Technology has both reflected and reorganised society (BIJKER; LAW, 1992; LATOUR, 2005; BAACK, 2015), therefore it has changed the way states, societies and communities are governed. Public administration eliminates forms of incidental agreements that are undesirable because they do not allow for reliance on specific rules; rules and agreements in society are the minimum guarantees of stability and security. Thus, algorithmic governance is a form of public control based on rules and involves particularly complex computational epistemic procedures (KATZENBACH; ULBRICHT, 2019), but the essential word remains “governance”.

            However, yet the algorithmic governance potentially increases the effectiveness of public services, applying algorithmic measures often imply new forms of population monitoring, raise human rights concerns, and questions the strategies and means of management in public institutions, requiring changes in the highest policy and strategic level (MEJIAS; COULDRY, 2019; LYON, 2014; NOBLE, 2018).

            The pervasive nature of technology creates new multidisciplinary realities for research in social sciences. Digital solutions can play a key role in creating a new, more transparent, simpler, more efficient, a more inclusive and more user-friendly public administration model.

2.       LITERATURE REVIEW

            Digitization of the society is a huge improvement in technology and it has become an inseparable part of our everyday lives which has undoubtedly influenced and changed the way we function (RASSOOL and DISSANAYAKE, 2019; MAYER-SCHÖNBERGER and CUKIER, 2013; HILDEBRANDT, 2015).

            However, if digitization could be described as “paperless” (WADE, 2015) alternative of the physical existence of services (KITCHIN, 2014), business models, etc., meanwhile digitalization is usually understood as a broader perspective. Scholars, for example, KAPLAN, WASTE, WOOD-HARPER and DEGROSS (2004) define digitalization as the changes associated with the application of digital technology in all aspects of human society, which consequently means that we are facing a complete digital transformation in the way we communicate, consume, receive services.

Figure 1: Transformation in the perception of the use of digital means

Source: UNRUH; KIRON, 2017, elaborated by the authors

            A very precise and noticeable to the public example of the above-mentioned transformation is a concept of algorithmic governance, which explains how algorithms create social order, i.e. how governance is implemented by algorithms instead of the governance of algorithms (MUSIANI, 2013; JUST; LATZER, 2017; SAURWEIN, et al., 2015). Algorithmic governance in the public sector can broadly be understood as an extension of traditional institutional steering and monitoring by public institutions (CHRISTOU; SIMPSON, 2011), in the horizontal (involves non-governmental subjects, requires an adequate understanding of technological processes, self-regulation and self-restriction imposed by institutions to respect human rights, determines the need of additional competences of employees and strategic decisions of the leaders) and vertical (requires focusing on multilevel governance) dimensions.

            The research shows, that the transformation in the public sector organizations only superficially may seem to be about technologies and finances. When processes of public administration and public services are digitized, models to describe procedural knowledge are needed, and such models consist of algorithms, work processes and capacities of public authorities (GRAY; RUMPE, 2015). With no doubt, public sector depends on state financing policies and mechanisms, political will and even demands from the citizenry, but the main factors determining ability to make changes in management and workstyle are people and their competences, processes and inner procedures, organizational structure and leadership (SUNDBERG, 2019; SÖDERSTRÖM, 2019; REASCOS; CARVALHO; BOSSANO, 2019). As analysed by Ruud in a survey from 2015, two out of three top managers in public sector stated that lack of digital competence is a barrier to succeeding with digitalization (RUUD, 2017).

            According to BERMAN, KORSTEN and MARSHALL (2016), for traditional public sector organizations, digital reinvention involves a fundamental re-conception of strategy, operations, technology, and management of human resources, and to succeed organizations should pursue a new strategic focus, build digital competence with a holistic view of products, services, processes, redefine customer-user experience, establish new ways of working (identity, retain, and develop the right talent to create and sustain a digital organization).

            Digitization in the public sector requires an integrated approach to technology, process, and people to manage the availability and sustainability of processes (ALHAQBANI ET AL., 2016).

            Algorithmic governance recently is analysed in different contexts and disciplines, choosing different objects of inquiry, however, the research is overlapping, multidisciplinary and interdisciplinary, and complex, as the phenomenon itself. Some scholars analyse how algorithms act in a specific social environment, emphasising the contradiction of their reactive or pre‐emptive nature (YEUNG, 2018; KITCHIN, 2016; SEAVER, 2017; ZIEWITZ, 2016) and what impact they have on social inclusiveness, diversity and democratic responsiveness (KÖNIG, 2019; SCHRAPE, 2019); others focus on technologic aspects of implementation of algorithms in a social context, with a common goal of translating social context into computable processes (GILLESPIE, 2014; SCHMIDT AND WIEGAND, 2017; BINNS ET AL., 2017); another important domain of inquiry is related to how search engines and social media platforms organise and structure information, this research paradigm is wide and may involve areas from academic (such as plagiarism checks in academic writing) to commercial and industrial (such as analysis of consumers’ behaviour and commercial marketing) (GILLESPIE, 2018; GORWA, 2019; INTRONA, 2016).

            The most relevant for this research discussions are in the field of correlation between public sector governance modernization using digital mechanisms and AI, and the effectiveness of public management. Those topics are raised in the scientific publications of political scientists, sociologists, even anthropologists, and legal scholars, who investigate automated procedures for state service delivery and administrative decision-making. Already cited Yeung (2018) provided a taxonomy of three dimensions in which algorithmic governance manifest itself: standard-setting, monitoring, and sanctioning. The most recent works are far from being only enthusiastic and over-estimating the value of algorithmic systems in the public sector, on the contrary, the research shows that the deployment of algorithmic solutions in the public sector resulted in many non-intended and non-disclosed consequences (VEALE & BRASS, 2019; DENCIK, ET AL. 2018). At the same time, it should be noted that applying algorithmic tools in government often relies on new forms of population surveillance and classification by state and its actors, especially in law enforcement area of activities (NEYLAND; MÖLLERS, 2017; LUPTON, 2016; BENNETT, 2017), such as combating tax evasion and fraud, policing (predictive policing concept is another related field of the research) and terrorism prevention, border control, and migration management (EGBERT, 2019; RATCLIFFE; TAYLOR; FISHER, 2019; BENNETT MOSES; CHAN, 2018).

            There are not too many research directly related to the impact of algorithmic governance on the effectiveness of public management, and the ones that are dedicated to the topic most often focus on automatization of the systems in public decision-taking procedures (VEALE; BRASS, 2019; MARGETTS, 1999; WILLCOCKS; LACITY, 2016), on bias and discriminatory nature of algorithms used in the public governance, on the sorting and ordering of populations (BAROCAS; SELBST, 2016; COURTLAND, 2018; ENSIGN ET AL., 2018; CHOULDECHOVA, 2017). Just recently scholars shifted their attention from technological issues using digital tools and AI in public sector administration to a conceptual evaluation of categories of values and implementation of new public management (NPM) conception (HOOD, 1995; SUNDBERG, 2019; BERTOTA; ESTEVEZ; JANOWSKI, 2016), and further, to opportunities for automation through the decomposition of administrative procedures (ETSCHEID, 2019). Critical voices are raised, defending the unique way in which public institutions operate, and asserting that bureaucracy should be preserved and enhanced where e-government policies and algorithmic governance are concerned (CORDELLA; TEMPINI, 2015), however, is undoubted that a vector of comprehensive transformations from e-government to digital government and towards the future system-level restructuring of the whole public sector is directed (BARCEVIČIUS, et al., 2019).

            The purpose of the article. This research focuses in affirming the assumption that the effective management in the public sector, first of all, is determined by the ability of this sector to transform the perception of the services delivered; secondly, it requires strategic actions to enable the systemic and coherent digital transformation of the public sector; and lastly, the new strategies of human resources management in the public sector should be considered. The focus is concentrated on understanding how the implementation of digital tools to the public sector and public services correlate with algorithmic governance concept and what impact digitization has on the effectiveness of management in the public sector.

3.       DATA AND METHODOLOGY

             In our research, we take the methodologic decisions to use term “algorithmic governance” as a governance method used by institutions of the public sector (having certain prerogatives of public administration and providing administrative services to the society) in a process of social ordering that is based on rules and incorporates particularly complex based on technologies, artificial intelligence (AI) and digital solutions. In 2020, the EU published a white paper entitled “On Artificial Intelligence - A European approach to excellence and trust” (EUROPEAN COMMISSION, 2020), therein it not only recognized the tremendous potential of digitalization and use of artificial intelligence - increasing efficiency, productivity, and predictive capacities in all areas of our lives - but also the potential risks and societal harms associated with artificial intelligence. Opaque decision making, multiple forms of discrimination, intrusiveness and negative impact on privacy and fundamental rights, freedom of speech and assembly, are among the mounting concerns. As AI is most often used as a tool digitalizing processes of public services, the ability to properly evaluate all possible consequences of using AI and more general – use of all digital tools is of utmost importance, as an only sustainable and systemic restructuring of the whole activities in the public sector may be beneficial and trustworthy. It could be reasonably expected that many technological systems put in place during the COVID-19 crisis will continue to play a key role in ensuring public services (in a broad meaning of this term – from ensuring public security to public health and educational services) in the future. While algorithmic governance in the public sector can lead to increased efficiency and cost-effectiveness, the implementation of those digital innovations can also result in multiple forms of harm: data bias can lead to reinforcement of inequality, discrimination, and criminalization of already marginalized populations; lack of accountability and transparency in decision-making can lead to injustices; societal trust and the legitimacy of public sector institutions may suffer; privacy and fundamental human rights may be threatened, ethical standards challenged. Therefore, effective management as a criterion of good administration could be achieved only foreseeing, understanding all possible positive and negative outcomes of digital transformation, leading to algorithmic governance, and the use of AI in public sector institutions.

            The article is organized as a concept paper, the researched issues are interdisciplinary and require the systematic approach, therefore legal and managemental aspects will be analysed. The research methods reflect this diversity of disciplinary approaches and include legal analysis, policy and document analysis, critical discourse analysis. Critical, comparative and systemic analysis of the previously conducted studies in the field, and the existing policy level legal acts internationally will be carried out to construct main theoretical/conceptual frameworks regarding the effectiveness of management in the public sector in the digitalized modern socio-economic environment. In this research, the authors follow a deductive approach where the explanations and arguments are supported by empirical evidence and associated theories.

            The main question to be answered is whether there is a direct link between the digitization of the public sector through the introduction of algorithmic management tools and the efficiency of public sector management. To answer this question and confirm or refute the assumption that the appropriate, timely, innovative, sustainable and conscious implementation of digital tools in public institutions correlates with the increase in the efficiency of public administration. It is important to mention, that there are quite an ample amount of different data related to digital government, the boost of those have been noticed just recently, as COVID-19 pandemia raised new challenges and obliged governments to take innovative decisions delivering public services, however, due to the incompleteness of the newest data we shall not focus our findings on those surveys (for example, UN E-Government Survey 2020, European Commission Digital Economy and Society Index (DESI) 2020, European Commission eGovernment Benchmark 2019). As an empirical basis for gathering, statistic data of the OECD (Organization for Economic Cooperation and Development) survey was used, which focuses on progress made by OECD countries in achieving people-centricity in public management and evaluates good governance practices in public service delivery. OECD determined indicators analysing whether public sector institutions, whose strategic and institutional management is characterized by hierarchically, verticality, specifics of management, are ready to use the advantages of digitization. The data used is reliable and trustworthy, as data on public management and governance practices are collected by OECD survey instruments from government officials, validated by OECD experts (OECD, 2019).

            Finally, the authors discuss and conclude the paper postulating future research directions in line with the synthesized discussions. This research was planned as a theoretical basis for further empirical research, which will include interviews with managers at the level of the heads of the relevant public sector institutions to determine the readiness of the institutions to work in the digital environment, to assess the legal framework on which these institutions apply digital solutions, and to identify factors leading to misuse of digital tools creating algorithms and further on to potential human rights violations.

4.       RESULTS AND DISCUSSIONS

            The main goal in a broader sense of this research is to determine how public institutions and social context are going to interact with digitalization, that most obviously is going to increase even more, and how algorithmic governance reflects in the efficiency of management in public institutions. The benefits of digitization in the public sector are evidenced by different factors: it could reduce the costs of providing public services (transport, education, energy, waste management, etc.), improve the sustainability of products and services, and, more specifically, it is especially seen in law enforcement sector, where using appropriate digital tools enables to better ensure the security of citizens, with proper safeguards to respect their rights and freedoms. However, recent events show that digital solutions cannot be viewed only positively. On February 5th, 2020, a court in the Netherlands ruled that a government system that uses artificial intelligence to identify potential welfare fraudsters is illegal because it violates laws that shield human rights and privacy. The program uses an algorithm to predict a citizen's likelihood of committing fraud by tapping vast pools of personal data collected by the Dutch government like employment records, personal debt reports, education and housing history - information that was previously kept separately (JACOBSON, 2020). The ongoing fight against coronavirus pandemia in the People‘s Republic of China has revealed the unprecedented use of different digital tools that could be attributed to the concept of artificial intelligence (facial recognition systems and high-end cameras, computerized systems that track ID cards), and numerous violation of human rights have been recorded.

            The presumption expressed in his paper is that algorithms potentially increase the efficiency and efficacy of state services, for example by rationalising bureaucratic decision-making, by targeting information and interventions to precise profiles or by choosing the best available policy options (OECD, 2014). An institutional perspective identifies algorithmic governance as norms and rules that affect behaviour not only of those who use the services but also on those who provide the services. This dimension is especially important in the public sector, as it could both limit activities and create new room for manoeuvre, which in a vertical hierarchy nature of public institutions could be mean to a pro-active and less- bureaucratic behaviour of public officials. Just less than 20 years ago the researches haven’t took into consideration the influence of digital solutions on good administration and effectiveness of public sector, most often decentralisation of political power and spending responsibility to subnational governments, appropriate human resource management practices, and in some sectors (such as education and healthcare) increasing the scale of operations was indicated as substantive factors improving efficiency in public institutions (CURRISTINE; LONTI; JOUMARD, 2007).

            The public sector is traditionally aligned with the vertical administrative culture, therefore effective management applying algorithmic governance concept relies on the managerial capacities agencies have to implement digital government policies, resulting in fragmented efforts of sector-specific solutions to systemic policy challenges. As the OECD surveys indicate, good decision-making requires knowledge, experiences, views, and values of the public, and unless citizens themselves understand and are engaged in the decision-making, trust is easily lost.  In its own turn, digital transformations also allow the public sector to be more universal and contextualized, not linear and can be an impulse for innovative solutions in different areas of public management (human resources, building new competencies, etc.). It is important to notice that implementation of innovations in public institutions does not have boundaries, as it is developing in reflection to changing geopolitical environment in the macro, micro and local levels, socio-economic context and other factors (Figure 2).

Figure 2: Digital public service innovation framework

Source: BERTOTA; ESTEVEZ; JANOWSKI, 2016

            Digital public services are routinely produced in different levels by the national, state or local governments and delivered to citizens, businesses and other entities under their jurisdictions, and their efficiency are usually aligned with minimizing the waste of public resources. Digital public service innovations are conceived as open-ended - innovations are expected to be continuously added over time, and generally non-linear - one innovation may or may not depend on another innovation.

            According developed by United Nations The Policy Recommendations on Digital Public Sector Innovation (UNITED NATIONS, 2017) (though criticised by researches because of interpretation of digital services as the four linear instead of open-ended stages), the efficiency could be evaluated from a methodological perspective based on a holistic view of e-government that incorporates three important dimensions that allow people to benefit from online services and information: the adequacy of telecommunication infrastructure, the ability of human resources to promote and use ICTs, and the availability of online services and content. Bearing in mind this dimension of efficiency, public service delivery to citizens is determined through the application of digital technology and thus transcend the government, political, and other issues of governance.

            The efficiency is directly linked to digital government implementation level existing in a certain public institution, which is determined by different perceptions of involvement of digital tools in governance, from simple digitization to transformation, engagement and contextualization (ROSE ET AL., 2014; JAEGER; BERTOT, 2010) (Figure 3).

           

Figure 3: Digital government innovation flow

Source JANOWSKI, 2015

It is obvious, that simply using digital tools as an alternative is not an option that would help to achieve effectiveness, the challenge also is not to introduce digital technologies into public administrations; the main goal should be their integration into public sector modernization contextualizing the transformations. Some tools of the digitalized public sector are considered as a basis and minimum standard of effective public sector management (such as E-Government, that refers to the use by the governments of information and communication technologies, as a tool to achieve better government), however other concepts are quite ambiguous (such as digital government, which refers to the use of digital technologies, as an integrated part of governments’ modernization strategies). OECD (2016) has established six interrelated dimensions of the digital government framework, that could be used as an indicator of the digitalized governance effectiveness (Figure 4).

Figure 4: Six dimensions of the digital government framework

Source: developed by the authors of the article

 

            Public sector institutions need to ensure that their human resources and capacities, organizational structures and management culture, risk management models and internal legal acts are aligned with their strategic digital government vision, and vice versa.

            The OECD has developed criteria (data availability, accessibility, and government support for reuse) measuring state policies related to digitalization - Open, Useful and Re-usable (OURdata) Index, which benchmarks open government data policies and their implementation (Figure 5).

            OURdata Index increased in 2017 compared with data from 2014 and that reflects improvements in all the indicators, and that correlated with increased trust in governments from their citizens (LAFORTUNE; UBALDI, 2018).

Figure 5: Open Government Data

Source: OECD (2016, 2018), Open Government Data Survey

            Stronger policy frameworks, and an increasing understanding of the value of stakeholder engagement, have increased data availability, accessibility and re-use almost in all European OECD countries, consequently the effectiveness of public sector management in 2019 (Figure 6). The authors of this paper took the methodologic decision to consider the index of trust in their government by societies as one of indicator of effective management in the public sector and vice versa.

Figure 6: Confidence in national government in 2018 and its change since 2007

Source: OECD (2019), Government at a Glance

            We shall not evaluate other factors having an impact on societal trust in governments (corruption, the existence and degree of social capital present in the society, social and demographic factors, such as the level of literacy and education, gender, and age) (Blind, 2010), however, the presumption is raised, that the higher is the involvement of digital strategies in the management of the public sector, the higher is an interaction between public institutions and society using digital tools, the higher increase is observed in transparency and accountability of the public sector. Therefore, innovative governance methods (including algorithmic governance) could be one of the most effective instruments promoting trust and involvedness of the society in the governance of the states.

            In summary, it can be argued that opened to the society public sector institutions, providing secure access to their data, using sustainable digital tools and algorithms are the important factor increasing transparency and efficiency. Therefore, strengthening digital inclusion and the diffusion of digital services is a priority area, that leads to systemic transformation and reflections on possible development of algorithmic governance, however, timely facing the challenges, raising to public institutions, as well as to more theoretical paradigms (such as possible violation of human rights, bias and discriminatory nature of digital mechanisms).

5.       CONCLUSIONS

             Implementing systemic structural changes and empowering innovative digital public services requires building technical, organizational and policy capabilities within government organizations. The necessity of creation of new organisational forms, the introduction of new management methods and techniques, enabling new working methods are crucial reaching the goal of systemic transformations.      

            In order for public sector institutions to be able to fundamentally change the nature of their governance, cultural and organizational habits, it is necessary to fully understand the advantages and benefits of digitization and algorithmic governance for both society and the public organization itself. Several groups of advantages can be distinguished: economic value (cost-effectiveness, rational management of external and internal resources), social value (promoting citizens’ self-empowerment, social participation and engagement), improved governance value (improving accountability, transparency, responsiveness, pro-active governance, and building trust among society and government). An opportunity to increase public trust should be a prevailing argument and motive.

            The authors of this article believe that digital transformations and improvements in algorithmic governance would help to address specific emerging societal problems in a collaborative way, involving stakeholders to interactive and inclusive cooperation. As it was pointed by different scholars, algorithmic governance and digital tools enable to reduce human involvement in the procedures of public administration, and consequently it decreases the incidence of human error and time-consumption, improves accuracy, transparency, and effectiveness of public services. The outcomes of digitalisation in terms of more trustworthy governments would be beneficial to societies, governments, and public sector institutions themselves.

REFERENCES

ACCO TIVES LEÃO, H.; CANEDO, E.D. (2018) Best Practices and Methodologies to Promote the Digitization of Public Services Citizen-Driven: A Systematic Literature Review. Information, v. 9, n. 8, p. 197.

ALHAQBANI, A., REED, M.D; SAVAGE, B.M.; RIES, J. (2016) The impact of middle management commitment improvement initiatives in public organizations. Business Process Management Journal, v. 22, n. 5, p. 924–938. Available: https://www.emerald.com/insight/content/doi/10.1108/BPMJ-01-2016-0018/full/html. Access: 26th July, 2020. DOI:  10.1108/BPMJ-01-2016-0018.

BAACK, S. (2015) Datafication and empowerment: how the open data movement re-articulates notions of democracy, participation and journalism. Big Data & Society, v. 7, n. 1. Available: https://journals.sagepub.com/doi/pdf/10.1177/2053951715594634. Access: 30th July, 2020. DOI: 10.1177/2053951715594634.

BARCEVIČIUS, E., et al. (2019) Exploring Digital Government transformation in the EU - Analysis of the state of the art and review of literature, Luxembourg: Publications Office of the European Union. Available: https://publications.jrc.ec.europa.eu/repository/bitstream/JRC118857/jrc118857_jrc_s4p_report_digigov_soa_04122019_def.pdf, Access: 30th July, 2020. DOI:10.2760/17207,JRC118857.

BAROCAS, S.; SELBST, A. D. (2016) Big Data’s Disparate Impact, California Law Review, v. 104, n. 3, p. 671–732. Available: https://www.jstor.org/stable/24758720?seq=1#metadata_info_tab_contents, Access: 28th July, 2020, DOI: 10.15779/Z38BG31.

BENNETT MOSES, L.; CHAN, J. (2018) Algorithmic prediction in policing: assumptions, evaluation, and accountability, Policing and Society, v. 28, n. 7, p. 806-822, Available: https://www.tandfonline.com/doi/pdf/10.1080/10439463.2016.1253695?needAccess=true, Access: 28th July, 2020, DOI: 10.1080/10439463.2016.1253695.

BENNETT, C. J. (2017) Voter databases, micro-targeting, and data protection law: Can political parties campaign in Europe as they do in North America? International Data Privacy Law, v. 6, n. 4, p. 261–275. Available: https://academic.oup.com/idpl/article/6/4/261/2567747. Access 28th July, 2020, DOI:10.1093/idpl/ipw021.

BERTOTA, J.; ESTEVEZ, E.; JANOWSKI, T. (2016) Universal and contextualized public services: Digital public service innovation framework, Government Information Quarterly, v. 33, n. 2, p. 211-222. Available: https://www.sciencedirect.com/science/article/pii/S0740624X16300545#f0005, Access: 30th July, 2020, DOI: https://doi.org/10.1016/j.giq.2016.05.004.

BIJKER, W. E.; LAW, J. (Eds.). (1992) Shaping Technology/Building Society: Studies in Sociotechnical Change. Cambridge, MA: The MIT Press.

BINNS, R.; VEALE, M.; VAN KLEEK; SHADBOLT, M. (2017) Like trainer, like bot? Inheritance of bias in algorithmic content moderation, in: CIAMPAGLIA, G. L.; MASHHADI, A.; YASSERI, T.  (Eds.). Social Informatics, v. 10540, p. 405–415. Available: https://link.springer.com/chapter/10.1007/978-3-319-67256-4_32#citeas, Access 28th July, 2020, DOI: 10.1007/978-3-319-67256-4_32.

BLIND, P.K (2010) Building trust in government: Linking theory with practice, in: CHEEMA, S; POPOVSKI, V. (eds.), Building trust in government: Innovations in governance reform in Asia. Tokyo, New York, Paris: United Nations University.

CHOULDECHOVA, A. (2017) Fair prediction with disparate impact: A study of bias in recidivism prediction instrument’. Big Data, v. 5, n. 2, p. 153–163. Available: https://www.researchgate.net/publication/309402975_Fair_Prediction_with_Disparate_Impact_A_Study_of_Bias_in_Recidivism_Prediction_Instruments, Access: 28th July, 2020, DOI: 10.1089/big.2016.0047.

CHRISTOU, G.; SIMPSON, S. (2011) The European Union, multilateralism and the global governance of the Internet. Journal of European Public Policy, v. 18, n. 2, p. 241–257. Available: https://www.tandfonline.com/doi/full/10.1080/13501763.2011.544505. Access: 26th July, 2020. DOI: 10.1080/13501763.2011.544505.

CORDELLA, A.; TEMPINI, N. (2015) E-government and organizational change: Reappraising the role of ICT and bureaucracy in public service delivery. Government Information Quarterly, v 32, n. 3, p. 279-286, Available: https://www.sciencedirect.com/science/article/pii/S0740624X15000556#f0005. Access: 30th July, 2020, DOI: https://doi.org/10.1016/j.giq.2015.03.005.

COURTLAND, R. (2018) Bias detectives: the researchers striving to make algorithms fair, Nature, v. 558, p. 357-360. Nature Publishing Group. Available: https://media.nature.com/original/magazine-assets/d41586-018-05469-3/d41586-018-05469-3.pdf. Access: 28th July, 2020, DOI: 10.1038/d41586-018-05469-3.

CURRISTINE, T.; LONTI, Z.; JOUMARD, I. (2007) Improving Public Sector Efficiency: Challenges and Opportunities. OECD Journal on Budgeting, v. 7, n. 1, Available: https://www.oecd.org/gov/budgeting/43412680.pdf. Access: 30th July, 2020.

DENCIK, L.; HINTZ, A.; REDDEN, J.; WARNE, H. (2018). Data scores as Governance: Investigating uses of citizen scoring in public services. Project Report. Cardiff University. Available: http://orca.cf.ac.uk/117517/1/data-scores-as-governance-project-report2.pdf, Access 28th July, 2020.

EGBERT, S. (2019) Predictive Policing and the Platformization of Police Work. Surveillance & Society, v. 17, n. 1/2, p. 83–88. Available: https://ojs.library.queensu.ca/index.php/surveillance-and-society/article/view/12920/8480, Access: 28th July, 2020, DOI: https://doi.org/10.24908/ss.v17i1/2.12920.

ENSIGN, D.; FRIEDLER, S. A.; NEVILLE, S.; SCHEIDEGGER, C.; VENKATASUBRAMANIAN, S. (2018) Runaway Feedback Loops in Predictive Policing. Proceedings of Machine Learning Research, v. 81, p. 1–12, Available: https://arxiv.org/pdf/1706.09847.pdf#page=4. Access: 28th July, 2020.

 ETSCHEID J. (2019) Artificial Intelligence in Public Administration. In LINDGREN I. ET AL. (eds) Electronic Government. EGOV 2019. Lecture Notes in Computer Science, vol 11685, p. 248-261, Springer, Cham. Available: https://doi.org/10.1007/978-3-030-27325-5_19. Access: 30th July, 2020.

EUROPEAN COMMISSION (2020) White Paper On Artificial Intelligence - A European approach to excellence and trust. COM (2020) 65 final. Brussels, Available: https://ec.europa.eu/info/sites/info/files/commission-white-paper-artificial-intelligence-feb2020_en.pdf. Access: 28th July, 2020.

EUROPEAN COMMISSION (2020) Digital Economy and Society Index Report 2020 -  Digital Public Services, Available: https://ec.europa.eu/digital-single-market/en/digital-public-services-scoreboard. Access: 26th July, 2020.

EUROPEAN COMMISSION (2019) e-Government Benchmark 2019. Empowering Europeans through trusted digital public services, European Union, 2019. Available: https://op.europa.eu/lt/publication-detail/-/publication/c896937b-f554-11e9-8c1f-01aa75ed71a1/language-en/format-PDF. Access: 30th July, 2020. DOI: 10.2759/950318

EUROPEAN COMMISSION (2010) EUROPE 2020. A strategy for smart, sustainable and inclusive growth, Brussels, Available: https://ec.europa.eu/eu2020/pdf/COMPLET%20EN%20BARROSO%20%20%20007%20-%20Europe%202020%20-%20EN%20version.pdf. Access: 30th July, 2030.

GILLESPIE, T. (2018) Custodians of the internet: Platforms, content moderation, and the hidden decisions that shape social media. New Haven: Yale University Press.

GILLESPIE, T. (2014) The relevance of algorithms. In GILLESPIE, T.; BOCZKOWSKI, P. J.; FOOT, K. A. (Eds.), Media Technologies. Essays on Communication, Materiality, and Society, p. 167–193. Cambridge, MA: The MIT Press.

GORWA, R. (2019) What is platform governance? Information, Communication & Societyv. 22, n. 6, p. 854-871, Available: https://www.tandfonline.com/doi/full/10.1080/1369118X.2019.1573914?scroll=top&needAccess=true, Access: 28th July, 2020, DOI: 10.1080/1369118X.2019.1573914.

GRAY, J.; RUMPE, B. (2015) Models for digitalization, Software & Systems Modeling, v. 14, n. 4, p. 1319–1320. Available: https://www.researchgate.net/publication/283905857_Models_for_digitalization. Access: 26th July, 2020.  DOI: 10.1007/s10270-015-0494-9. 

HILDEBRANDT, M. (2015) Smart Technologies and the End(s) of Law. Cheltenham: Edward Elgar Publishing.

HOOD, C. (1995) The “new public management” in the 1980s: Variations on a theme Accounting, Organizations and Society, v. 20, n. 2–3, p. 93-109, Available: https://www.sciencedirect.com/science/article/abs/pii/0361368293E0001W?via%3Dihub, Access: 30th July, 2020, DOI: https://doi.org/10.1016/0361-3682(93)E0001-W

INTRONA, L. D. (2016). Algorithms, Governance, and Governmentality: On Governing Academic Writing. Science, Technology, & Human Values, v. 41, n. 1, p. 17–49. Available: https://journals.sagepub.com/doi/pdf/10.1177/0162243915587360. Access: 28th July, 2020. DOI:10.1177/0162243915587360.

JACOBSON, D. (2020) Dutch anti-fraud system violates human rights, court rules, UPI, Published on 6th February 2020. Available: https://www.business-humanrights.org/en/netherlands-govt-use-of-ai-to-identify-potential-welfare-fraud-violates-human-rights-court-rules. Access: 28th July, 2020.

JAEGER, P. T.; BERTOT, J. C. (2010) Designing, implementing, and evaluating user-centered and citizen-centered E-government, International Journal of Electronic Government Research, v. 6, n. 2, p. 1-17. Available: https://www.igi-global.com/gateway/article/42144. Access: 30th July, 2020, DOI: 10.4018/jegr.2010040101.

JANKOWSKI, T. (2015) Digital government evolution: From transformation to contextualization, Government Information Quarterly, v. 32, n. 3, p. 221-236. Available: https://reader.elsevier.com/reader/sd/pii/S0740624X15000775?token=8436090AA1E954C949D26F87C8CC02498CE7C739BFDBF8149320C7461116DA37160977151E1072FE2697F20403C97424. Access: 30th July, 2020, DOI: 10.1016/j.giq.2015.07.001.

JUST, N.; LATZER, M. (2016) Governance by algorithms: Reality construction by algorithmic selection on the Internet. Media, Culture & Society, v. 39, n. 2, p. 238–258. Available: https://journals.sagepub.com/doi/10.1177/0163443716643157. Access: 26th July, 2020. DOI:10.1177/0163443716643157.

KAPLAN, B.; TRUEX, D. P.; WASTEIL, D.; WOOD-HARPER, A. T.; DEGROSS, J. I. (eds.) (2004) Information Systems Research - Relevant Theory and Informed Practice. Springer.

KATZENBACH, C.; ULBRICHT, L. (2019) Algorithmic governance. Internet Policy Review, v. 8, n. 4. Available: https://policyreview.info/concepts/algorithmic-governance. Access: 26th July, 2020. DOI: 10.14763/2019.4.1424. 

KITCHIN, R. (2016) Thinking critically about and researching algorithms. Information, Communication & Society, v. 20, n. 1, p. 14–29. Available: https://www.tandfonline.com/doi/full/10.1080/1369118X.2016.1154087, Access 28th July, 2020, DOI: 10.1080/1369118X.2016.1154087.

KITCHIN, R. (2014) The data revolution: big data, open data, data infrastructures & their consequences. London: Sage.

KÖNIG, P. D. (2019) Dissecting the Algorithmic Leviathan. On the Socio-Political Anatomy of Algorithmic Governance. Philosophy & Technology. Available: https://link.springer.com/article/10.1007/s13347-019-00363-w. Access: 28th July, 2020, DOI: https://doi.org/10.1007/s13347-019-00363-w. 

LAFORTUNE, G.; UBALDI, B. (2018) OECD 2017 OURdata Index: Methodology and results, OECD Working Papers on Public Governance, No. 30, OECD Publishing, Paris, Available: http://doi.org/10.1787/2807d3c8-en. Access: 30th July, 2020.

LATOUR, B. (2005) Reassembling the social: An introduction to actor-network-theory. Oxford; New York: Oxford University Press.

LITHUANIAN MINISTRY OF ECONOMY AND INNOVATIONS (2020) Lietuva 2030. Available: https://www.lietuva2030.lt/en/. Access: 29th July, 2020.

LUPTON, D. (2016) Personal Data Practices in the Age of Lively Data. In DANIELS, J.; GREGORY, K.; COTTOM, T. M. (Eds.). Digital sociologies. Bristol; Chicago: Policy Press, p. 339–354. Available: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2636709, Access: 29th July, 2020. DOI: 10.2139/ssrn.2636709.

LYON, D. (2014) Surveillance, Snowden, and Big Data: Capacities, consequences, critique. Big Data & Society, v. 1, n. 2, p. 1-13. Available:  https://journals.sagepub.com/doi/pdf/10.1177/2053951714541861. Access: 29th July, 2020, DOI: 10.1177/2053951714541861.

MARGETTS, H. (1999) Information Technology in Government: Britain and America. London: Routledge.

MAYER-SCHÖNBERGER, V.; CUKIER, K. (2013) Big Data: A Revolution That Will Transform How We Live, Work and Think. London: John Murray

MEJIAS, U.; COULDRY, N. (2019) Datafication. Internet Policy Review, v. 8, n. 4. Available: https://policyreview.info/concepts/datafication, Access: 30th July, 2020, DOI:10.14763/2019.4.1428.

MUSIANI, F. (2013) Governance by algorithms. Internet Policy Review, v. 2, n. 3. Available: https://policyreview.info/articles/analysis/governance-algorithms. Access: 26th July, 2020.  DOI:10.14763/2013.3.188.

NEYLAND, D.; MÖLLERS, N. (2017) Algorithmic IF … THEN rules and the conditions and consequences of power. Information, Communication & Society, v. 20, n. 1, p. 45–62. Available: https://www.tandfonline.com/doi/pdf/10.1080/1369118X.2016.1156141?needAccess=true. Access 28th July, 2020, DOI:10.1080/1369118X.2016.1156141.

NOBLE, S. U. (2018) Algorithms of Oppression: How Search Engines Reinforce Racism. New York: NYU Press.

OECD (2019) Government at a Glance, OECD, Available: https://www.oecd-ilibrary.org/sites/8ccf5c38-en/1/2/9/2/index.html?itemId=/content/publication/8ccf5c38-en&_csp_=40825562de64089b975c3e83eb3f6e04&itemIGO=oecd&itemContentType=book, Access: 30th July, 2020.

OECD (2014) Recommendation of the Council on Digital Government Strategies, OECD: Paris, France. Available: https://www.oecd.org/gov/digital-government/Recommendation-digital-government-strategies.pdf. Access: 30th July, 2020.

RATCLIFFE, J. H.; TAYLOR, R. B.; FISHER, R. (2019) Conflicts and congruencies between predictive policing and the patrol officer’s craft. Policing and Society. Available: https://www.tandfonline.com/doi/pdf/10.1080/10439463.2019.1577844?needAccess=true. Access: 28th July, 2020. DOI: 10.1080/10439463.2019.1577844.

RASSOOL, M. R.; DISSANAYAKE, D. (2019) Digital Transformation for Small & Medium Enterprises (SMEs): With Special Focus On Sri Lankan Context as an Emerging Economy. International Journal of Business and Management Review, v. 7, n. 4, p. 59-76. Available: https://www.eajournals.org/wp-content/uploads/Digital-Transformation-for-Small-Medium-Enterprises-SMEs.pdf. Access: 30th July, 2020, 

REIS, J.G.M., NETO, P.L.O.C., FUSCO, J.P.A. & MACHADO, S.T. (2014) Supply chain strategies in the context of an e-commerce chain (e-chain). Independent Journal of Management & Production, v.5, n. 2, p. 438-457. DOI: http://dx.doi.org/10.14807/ijmp.v5i2.148

REASCOS, I.; CARVALHO, J. A.; BOSSANO, S. (2019) Implanting IT Applications in Government Institutions: A Process Model Emerging from a Case Study in a Medium-Sized Municipality, In Proceedings of the 12th International Conference on Theory and Practice of Electronic Governance (ICEGOV’19). Melbourne, Australia, April    3-5, 2019. DOI: 10.1145/3326365.3326376

RUUD, O. (2017) Successful digital transformation projects in public sector with focus on municipalities, In Conference Central and Eastern European e|Dem and e|Gov Days, 2017. Available: https://www.researchgate.net/publication/316715943_Successful_digital_transformation_projects_in_public_sector_with_focus_on_municipalities_research_in_progress. Access: April 16th, 2020.

SEAVER, N. (2017) Algorithms as culture: Some tactics for the ethnography of algorithmic systems. Big Data & Society, v. 4, n. 2. Available: https://journals.sagepub.com/doi/full/10.1177/2053951717738104#articleCitationDownloadContainer. Access 28th July, 2020. DOI: https://doi.org/10.1177/2053951717738104.

SAURWEIN, F; JUST, N; LATZER, M. (2015) Governance of Algorithms: Options and Limitations. The journal of policy, regulation and strategy for telecommunications, information and media, v. 17, n. 6, p. 35–49. Available: https://mediachange.ch/media//pdf/publications/GovernanceOfAlgorithms_.pdf. Access: 26th July, 2020. DOI: 10.1108/info-05-2015-0025.

SIMANJUNTAK, M. (2020) Consumer empowerment on online purchasing. Independent Journal of Management & Production, v. 11, n. 1, p. 236-255. DOI: dx.doi.org/10.14807/ijmp.v11i1.964

SCHMIDT, A.; WIEGAND, M. (2017) A survey on hate speech detection using natural language processing. In Proceedings of the Fifth International Workshop on Natural Language Processing for Social Media. Valencia: Association for Computational Linguistics.  Available: https://www.aclweb.org/anthology/W17-1101. Access 28th July, 2020, DOI: 10.18653/v1/W17-1101.

SCHRAPE, J. F. (2019) The Promise of Technological Decentralization. A Brief Reconstruction. Society, v. 56, n. 1, p. 31–37. Available: https://www.aclweb.org/anthology/W17-1101.pdf. Access 28th July, 2020, DOI:10.1007/s12115-018-00321-w.

SÖDERSTRÖM, F.; MELIN, U. (2019) Creating Local Government Innovation. In LINDGREN I. ET AL. (eds) Electronic Government. EGOV 2019. Lecture Notes in Computer Science, vol 11685. Springer, Cham., p. 125-138. Available: https://doi.org/10.1007/978-3-030-27325-5_10. Access: 2020-04-16.

SUNDBERG, L. (2019) Value Positions and Relationships in the Swedish Digital Government. Administrative Sciences, v. 9, n. 24, p. 1-15, Available: https://www.researchgate.net/publication/331684435_Value_Positions_and_Relationships_in_the_Swedish_Digital_Government. Access: 30th July, 2020, DOI: 10.3390/admsci9010024

UDOVITA, P. V. M. V. D. (2020) Conceptual Review on Dimensions of Digital Transformation in Modern Era. International Journal of Scientific and Research Publications, v. 10, n. 2. Available: http://www.ijsrp.org/research-paper-0220.php?rp=P989697#citation. Access: 26th July, 2020, DOI: 10.29322/IJSRP.10.02.2020.p9873.

UNITED NATIONS (2017) Innovation in the Public Sector, New York and Geneva: United Nations, Available: https://www.unece.org/fileadmin/DAM/ceci/publications/Innovation_in_the_Public_Sector/Public_Sector_Innovation_for_web.pdf. Access: 30th July, 2020.

UNRUH, G.; KIRON, D. (2017) Digital Transformation on Purpose, MIT Sloan Management Review, 2017. Available: https://sloanreview.mit.edu/article/digital-transformation-on-purpose/. Access: 30th July, 2020.

VEALE, M.; BRASS, I. (2019) Administration by Algorithm? Public Management Meets Public Sector Machine Learning, in: YEUNG, K.; LODGE, M., (Eds.), Algorithmic Regulation. Oxford University Press. Available: https://ssrn.com/abstract=3375391. Access 28th July, 2020, 

WADE, M. (2015) Digital business transformation: A conceptual framework. Global Center for Digital Business Transformation, Available: https://www.imd.org/contentassets/d0a4d992d38a41ff85de509156475caa/framework, Access: 30th July, 2020. 

WILLCOCKS, L. P.; LACITY, M. (2016) Service automation robots and the future of work, Ashford: SB Publishing.

YEUNG, K. (2018) Algorithmic regulation: A critical interrogation. Regulation & Governance, v. 12, n. 4, p. 505–523. Available: https://onlinelibrary.wiley.com/doi/abs/10.1111/rego.12158, Access 28th July, 2020, DOI: https://doi.org/10.1111/rego.12158.

ZIEWITZ, M. (2016) Governing Algorithms: Myth, Mess, and Methods. Science, Technology, & Human Values, v. 41, n. 1, p. 3–16. Available: https://journals.sagepub.com/doi/full/10.1177/0162243915608948. Access 28th July, 2020, DOI:10.1177/0162243915608948.