The current issue and full text archive of this journal is available at www.emeraldinsight.com/1741-0398.htm

JEIM 23,4

A comprehensive literature review of the ERP research field over a decade

486

Bjarne Rerup Schlichter

Received July 2009 Revised November 2009 Revised January 2010 Accepted February 2010

Aarhus School of Business, University of Aarhus, Aarhus, Denmark, and

Pernille Kraemmergaard Centre for IS Management, Aalborg University, Aalborg, Denmark Abstract

Journal of Enterprise Information Management Vol. 23 No. 4, 2010 pp. 486-520 q Emerald Group Publishing Limited 1741-0398 DOI 10.1108/17410391011061780

Purpose – The purpose of this paper is first, to develop a methodological framework for conducting a comprehensive literature review on an empirical phenomenon based on a vast amount of papers published. Second, to use this framework to gain an understanding of the current state of the enterprise resource planning (ERP) research field, and third, based on the literature review, to develop a conceptual framework identifying areas of concern with regard to ERP systems. Design/methodology/approach – Abstracts from 885 peer-reviewed journal publications from 2000 to 2009 have been analysed according to journal, authors and year of publication, and further categorised into research discipline, research topic and methods used, using the structured methodological framework. Findings – The body of academic knowledge about ERP systems has reached a certain maturity and several different research disciplines have contributed to the field from different points of view using different methods, showing that the ERP research field is very much an interdisciplinary field. It demonstrates that the number of ERP publications has decreased, and it indicates that the academic interest in ERP is driven by an interest in an empirical phenomenon rather than that ERP is a new research discipline. Different research topics of interest are identified and used in developing a conceptual framework for “areas of concern” regarding ERP systems. Finally the usefulness of the framework is confirmed by analysing one specific aspect of ERP research; business process reengineering (BPR) to establish which theories different authors and journals have used in their efforts to explore BPR and ERP. Research limitations/implications – The findings of the literature study, the structured methodological framework for comprehensive literature review and the conceptual framework identifying different areas of concern are believed to be useful for other researchers in their effort to obtain an overview of the evolution of the ERP research field and in positioning their own ERP research. Practical implications – The paper provides guidance for researchers with insight into what has been published, where to publish ERP-related research and how to study it, and in positioning their own interest in ERP systems in the interdisciplinary research field. Access to the EndNote database containing bibliographical data of more than 880 papers can be used in future research and literature analysis. For managers, the conceptual framework can be useful in increasing their understanding of the complexity and areas of concern with regard to the ERP system. Originality/value – The paper presents a structured methodological framework for analysing a vast amount of academic publications with an interest in an empirical phenomenon, demonstration of how academic interdisciplinary interest in ERP has evolved over time and reached a certain amount of maturity and a conceptual framework of areas of concern with regard to ERP systems. Keywords Manufacturing resource planning, Literature, Research Paper type Literature review

1. Introduction An enterprise resource planning (ERP) system is a business management system that comprises integrated sets of comprehensive software, which can be used to manage and integrate all the business functions within an organisation with a rationalised data architecture characterised by core process integration and shared product and/or customer databases (Ross et al., 2006). Among the most important attributes of ERP are its abilities to automate and integrate business processes, enable the implementation of best business practices, share common data and practices across the entire enterprise and produce and access information in real time (Soh et al., 2000; Nah and Lau, 2001), and often the implementation of ERP has been linked to business process re-engineering (BPR) (Koch, 2001a; Subramoniam et al., 2009). During the 1990s ERP systems became the de-facto standard for the replacement of legacy systems in large companies, particularly multinationals (Shanks, 2000). During the past decade ERP has attracted attention from both academic and industrial communities (Shehab et al., 2004) and we feel that now is an opportune time to ask how the ERP field has evolved and what its present state is (Chen and Hirschheim, 2004). However, several scholars have already argued that research on ERP has reached some maturity (Botta-Genoulaz et al., 2005; Møller, 2005) and others have argued that the studies in ERP systems constitute a separate research domain (Møller, 2005). None of these researchers seem to have statistical documentation for their statements, and we would like to investigate whether they are right. This will be accomplished through a comprehensive literature study of more than 885 peer-reviewed journal publications published from 2000 to 2009. We have chosen to analyse papers published in various disciplines and journals, and have not limited ourselves to papers published “only” on, e.g. information systems, accounting and operation management. The aim is to assist scholars with an insight not just into their own scientific field but also into complementary fields for views on the research related to ERP systems (Botta-Genoulaz et al., 2005). An extensive number of papers have included literature studies focusing on specific aspects of ERP, e.g. business process re-engineering (BPR) (Subramoniam et al., 2009), critical success factors for the implementation of ERP (Al-Mashari, 2001; Nah and Lau, 2001; Al-Mashari et al., 2003), systems justification (McGaughey and Angappa, 2007), risk management (Aloini et al., 2007) and management accounting (Rom and Rohde, 2006), where papers are analysed according to established frameworks. However, only a limited number of literature reviews have been carried out on the ERP research field (Esteves and Pastor, 2001; Møller et al., 2004; Shehab et al., 2004; Botta-Genoulaz et al., 2005). These reviews have either focused on papers published in certain disciplines (Esteves and Pastor, 2001; Cumbie et al., 2005; Esteves and Bohorquez, 2007), only included papers within limited and/or out-dated time frames (Botta-Genoulaz et al., 2005) or not made their method for collecting papers to be included in the review explicit to the reader (Shehab et al., 2004). Even though these reviews bring about some insight into the ERP field, none of the reviews focused on the entire ERP field until 2009. The purpose of this paper is threefold. The first objective is to develop a methodological framework for conducting a comprehensive literature study on an empirical phenomenon based on a vast amount of papers published over a long time span across disciplines. The second objective is to use this framework to gain an understanding of the current state of the ERP field across established disciplines

Review of the ERP research field 487

JEIM 23,4

488

(Hirschheim and Klein, 2003). The third objective is, based on the literature review, to develop a conceptual framework identifying areas of concern in regard to ERP systems. The paper is organised as follows. In section 2 we present existing literature studies on ERP systems to position our own literature study, clarifying which questions we would like to address. In section 3 the methodology framework for carrying out the literature study is presented. In the section 4 the findings of the review are presented; the findings are discussed and the conceptual framework presented in section 5; and finally suggestions for further analysis of the papers included in the review are outlined and the implications for research and praxis presented in the concluding section 6 of the paper. 2. Previous literature studies on ERP In this section the existing literature review studies until 2009 will be presented. The purpose of this section is to position our literature review with regard to existing knowledge about the ERP field, and to formulate specific research questions to be asked and issues to be discussed on the basis of our findings. After an individual presentation of the five ERP literature review publications that we have been able to find, we will discuss the methods used and the shortcomings of the publications with regard to the ability of the papers to give an overview of the ERP field (see Table I). The first review we have been able to find was published in August 2001 (Esteves and Pastor, 2001). This paper presents an annotated bibliography of ERP publications published in ten main IS journals and eight IS conferences during the period 1997-2000. A total of 189 publications are included in the study, of which only a minor portion is journal publications – 21 in total: two were published in 1998, three in 1999 and 16 in 2000. The publications identified in this paper originate from a small number of sources and were at that time quite recent. The publications analysed show that ERP researchers mainly concentrated on issues related to the implementation phase of the ERP life cycle. Until then the other phases had been almost forgotten. The authors conclude their paper by stating that ERP systems offer many potential areas for research and, due to their pervasive nature, ERP systems are of interest to a wide range of scholarly disciplines (from software engineering to accounting), in addition to the IS field. They also suggest that ERP research could or should be interdisciplinary and that the number of publications would grow exponentially in 2001 and 2002. In their review of 76 ERP publications, Shehab et al. (2004) classify the literature according to selection and implementation, and major extracts of each paper are

Table I. Earlier literature reviews

1 2 3 4 5

Year

Author

2001 2004 2005 2005 2007 2010

Esteves and Pastor (2001) Shehab et al. (2004) Botta-Genoulaz et al. (2005) Cumbie et al. (2005) Esteves and Bohorquez (2007) The present review

Papers

Span

189 76 80 49 640 885

1997-2000 1990-2003 2003-2004 1999-2004 1001-2005 2000-2009

Frame Annotated bibliography Selection/implementation Identifies six areas of research Implementation/operation/benefit Life cycle Topic/discipline/method

addressed and analysed. The aim of the paper is to identify fruitful opportunities for further research within ERP, and the authors state that they hope that their paper can reinforce the ongoing research on ERP and provide a broad view of the current status in ERP research. Included in the review are 76 publications – five books, eight conference papers and 63 journal publications published from 1990 to 2003. Taking a closer look at the references, we find that only nine of these papers were published before 2000; the remaining papers were published in the period from 2000 to 2003. The authors conclude their paper by identifying shortcomings in the literature on issues of interest to the authors. Shehab et al. (2004) do not present the method for selection of the publications included in the review, which leads us to question whether the paper actually does provide an overview of the literature in general, or just an overview of publications and disciplines randomly selected by the authors themselves. Additionally, we question the validity of the identified shortcomings, since no information is provided as to why these particular shortcomings are mentioned and not others. Botta-Genoulaz et al. (2005) published a survey on research literature on ERP systems from 2003 and 2004 in which they analyse 80 academic contributions from various disciplines in order to identify the trends of the research literature. Botta-Genoulaz et al. (2005) use web search facilities to identify publications to be included. In their paper the method used for selecting the publications is presented. In their first selection round of publications they find 250 publications; this number is reduced to 80 publications to be included in the analysis. However, no method for excluding the 170 publications is presented in the paper. In order to structure their analysis of the 80 publications, they selected six different areas for classification of the publications: implementation, optimisation, management through ERP, the ERP tools, ERP and supply-chain management software and case studies, which they state have constituted a rather consistent framework for classifying the publications. From their analysis they draw several conclusions, one being that ERP research is published in a variety of journals; another that ERP captures the attention of several research disciplines. At the same time they find very few multi-disciplinary studies. Even though this study provides the reader with an overview of the ERP field in 2003 and 2004, we will question whether the study does give an overview of the ERP field. Another point of criticism is that the reader is not provided with an insight into how the numbers are reduced from 250 to 80. Cumbie et al. (2005) analyse 49 ERP publications published between 1999 and 2004 in eight top information systems (IS) journals and seven top operations management (OM) journals with the aim of identifying gaps and motivating other researchers to close such gaps. They analyse 49 ERP publications published in the journals chosen according to both content and methods, using well-documented methods in three phases: selection, classification and analysis and synthesis. They find an increasing level of activity during the five-year period, with a slightly biased distribution of ERP publications in IS journals compared with OM journals, and also that several research methods are either underrepresented or absent. During their analysis of the publications, three general areas emerge: implementation, operation and benefits. Of the publications, 28 focused on implementation, 14 on operation and seven on benefits. The review presents a well-structured method for collecting and analysing the publications, but only publications published in top journals, 15 in total, from two

Review of the ERP research field 489

JEIM 23,4

490

research disciplines are included, and the review does not provide an overview of the ERP research field. Esteves and Bohorquez (2007) categorise 640 publications mainly published in 23 IS journals and ten IS conferences from 2001 to 2005 through an ERP life-cycle-based framework. The goal of their study is to provide an updated annotated bibliography of ERP publications categorising the publications through an ERP life-cycle framework structured in phases. Of the publications, 25 are categorised as focusing on adoption, 15 on acquisition, 207 on implementation, 68 on usage, 59 on evolution, zero on retirement, 35 on education and finally 40 publications were categorised as general: papers not related to the ERP life cycle. Esteves and Bohorquez (2007) state that ERP systems offer potential areas for research and, due to their pervasive nature, ERP systems are of interest to a wide range of professional and scholarly disciplines (from software engineering to accounting), and not only the field of IS. They further suggest that ERP-related research could and should be interdisciplinary. They classify the papers according to topic, not according to methods, and only look at the IS discipline, providing the reader with only a limited overview of the field. None of the existing literature reviews include publications published after 2005, which leaves the ERP field with a knowledge gap about publications published from 2005 onwards. Additionally, none of the reviews provide an overview of the total number of academic journal publications regardless of and/or across research disciplines, leaving a knowledge gap about the entire ERP field. Our review sets out to fill this gap and aims at providing an overview of the ERP field by analysing ERP peer-reviewed journal publications from 2000 to 2009. In the review we will answer and address the following questions: (1) How many peer-reviewed publications have been published each year and how has the field evolved? (2) Which journals have published ERP peer-reviewed publications and which have published the highest number of publications? (3) Which authors have contributed the most? (4) Which disciplines have contributed to the ERP field? (5) Which topics have been studied? (6) Which methods have been used? We also discuss the questions raised below: (7) (8) (9) (10)

Is it fair to state that the ERP field has matured? Is the ERP research field a new research discipline? Is the ERP research field an interdisciplinary field? Is it possible to develop a conceptual framework for important issues in regard to ERP systems to be used by researchers and practitioners interested in ERP systems? (11) Is the methodological framework usable to analyse a specific aspect of ERP, e.g. BPR? The methodology used for conducting the literature study, making it possible to answer and address the above questions, will be presented in the following.

3. Methodology To be able to gain an overview of a research field and answer the questions above, a structured research methodology is needed. The methodology is divided into two phases (Cumbie et al., 2005) (see Figure 1). The first phase is the search for and selection of papers to include in the review, and the second phase is the classification of the papers. In the first phase has to decide which types of publication, e.g. journal publications, conference papers or books, to include in the review. Additionally, one has to decide in which period and where to search for papers, e.g. in specific journals, bibliography databases or conference proceedings, which keywords one wants to use in the search and where the keywords should appear, e.g. either the title, abstract or keywords of the paper. In the second phase, based on the questions one wants to address in the review, one has to develop a framework to use in the analysis of the publications. To make a comprehensive literature study of a vast amount of publications, the framework includes two different types of analysis, one being strict head counts and the other being the classification of papers (see Figure 1). The head counts are simply a matter of counting, e.g. how many different journals have published papers about the phenomenon in question, how many different publications have been published per year and how many different authors have contributed to the field. To be able to perform a classification analysis one needs first of all the taxonomy according to which the papers will be classified. The content of this taxonomy will depend on the questions one wants to address during the review. After the development of the taxonomy, the classification process of the papers can begin. During the classification process different analysis approaches can be used, e.g. a classification system that includes a quest for regularity and standards as well as topics encompassed by the data (Bogdan and Biklen, 1982), content analysis using a constant comparative method (Cavana et al., 2001) or content analysis using different coding techniques, e.g. open coding, axial

Review of the ERP research field 491

Figure 1. Methodological framework for comprehensive literature studies

JEIM 23,4

492

coding or selective coding (Glaser and Strauss, 1967; Strauss and Corbin, 1994; Webster and Watson, 2002). The choice of analytical approach will depend on the questions one wants to address in the review. Our literature review was carried out in accordance with these two phases: phase 1 – selection and accumulation of a journal publication pool and phase 2 – classification of the publications by research discipline, topic studied and methods used. The two phases will be discussed in the following paragraphs. 3.1 Phase 1: selection and accumulation of a journal publication pool The first decisions we had to make were which period to include in the literature study. Not many journal publications were published prior to 2000, e.g. Esteves and Pastor (2001) and Shehab et al. (2004) were able to find very few published journal papers about ERP prior to 2000, and Aloini et al. (2007) only included literature published after 1999 in their review on ERP and risk management. It therefore seems reasonable to conclude that publications about ERP systems were rather rare before 2000, and that they emerged in 2000 and onwards. We therefore decided to gather publications from the period from 2000 to 2009. We chose to include only journal publications in the review. There are two main reasons for concentrating on journal papers: (1) journal papers contain more up-to-date data than books (Dale et al., 2001); and (2) conference papers can be difficult to access. We chose to search for journal publications in academic journals we had access to through the library web-search facilities. Nine different bibliographies databases were used, which gave us access to a very high number of journals (see Table II). The publications were gathered in three time slots, one in 2004, another at the beginning of 2008 and the last in late December 2009. During the time span between the three time slots in the gathering of publications, the coverage of the databases changed slightly and some databases changed names and publishers, as also illustrated in Table II. The papers were, as mentioned previously, collected in three time slots, one in 2004 (the result of this was previously reported in Møller et al. (2004)) the second at the beginning of 2008 and the last in December 2009. In each of these databases we searched for the keywords “ERP” and “Enterprise Resource Planning” within titles, abstracts or keywords. To exclude editorial comments and, e.g. book reviews, the length of the papers had to be at least four pages. From this initial search we ended up with a total pool of 1,564 journal publications. During the export of these journal publications to our EndNote database[1,2], 176 publications were excluded since they turned out to have been included in the total pool of publications twice and another 139 publications were excluded as it was obvious from their titles that the particular publications did not deal with ERP systems, but had used the acronym ERP for something very different, e.g. event-related brain potential, and 62 papers were excluded since they were published in the 53 different journals not included in the databases before 2008 and to include them would give us data that were not comparable, leaving us with a total pool of 1,196 journal publications for analysis and classification in phase 2.

Emerald

ScienceDirect (Elsevier) Wiley InterScience EBSCO (Business Source Premier)

ProQuest General BusinessFile

Digital Article Database Service (DADS)

ACM Digital Library AIS Library

Emerald publishes a range of management titles and library and information services titles by any publisher worldwide. The subjects covered include management, HRM, marketing, librarianship, mechanical engineering, electronic and electrical engineering ScienceDirect is an electronic collection of science, technology and medicine full text and bibliographic information Wiley InterScience provides access to publications from John Wiley & Sons. It features over 1,000 journals EBSCO Publishing offers a wide range of full text and bibliographic databases, and via EBSCOhost the database Business Source Premier was reached as well The ProQuest online information service provides access to thousands of current periodicals and newspapers General BusinessFile International provides access to a combination of international broker research reports, trade publications, newspapers, journals and company directories. It was later renamed Business & Company Resource Centre DADS provides access to data from several providers, including databases (such as ABI/Inform, COMPENDEX and INSPEC), publishers (such as Academic Press, Blackwell Publishers, Elsevier, Emerald, Karger, Kluwer, Oxford University Press, Springer, Swetscan) and organisations (such as IEEE/IEE Electronic Library – IEL) The library contains 54,000 online articles from 30 journals and 900 proceedings from the Association for Computing Machinery A service from the Association of Information Systems providing full-text access to journals and conferences sponsored by AIS

During phase 2 an additional 303 journal publications were excluded. Their exclusion was based on four different criteria: (1) publications only mentioning ERP or Enterprise Resource Planning systems as an example of one system among other systems; (2) some were excluded if ERP or Enterprise Resource Planning systems were only mentioned as contextual variables; (3) editorial notes were excluded; and finally (4) if no abstract existed, the publication was excluded as well. The final pool of publications had then been reduced to 885 to be included in the literature review.

Review of the ERP research field 493

Table II. Bibliographical databases included

JEIM 23,4

494

3.2 Phase 2: analysis In this phase we started out by making the head count. We were, as mentioned previously, interested in disclosing how the field had evolved during the period, which journals had published ERP papers and finally which authors had contributed to the field. This was a rather easy task. We: . counted the number of papers published per year; . made a list of the journals that had published ERP articles; . made a list of the journals that had published the highest number of papers; and . identified the authors who had contributed the most publications. After the head count, the classification of papers according to the taxonomy, containing in our case contributing research disciplines, dealt-with-topics and used methods (see Section 2), began. To be able to address the first area of interest – which disciplines had contributed – we carried out a preliminary reading of the abstracts. During this preliminary reading five different disciplines emerged (see Table III for the different disciplines according to which we classified the papers). This set of disciplines was to a great extent coherent with earlier observations made by Botta-Genoulaz et al. (2005), who classified ERP research with regard to computer science, information systems, management and operations management/SCM. To classify each journal we either used the discipline that the journal itself refers to on its web page, read the “aim and goal” or classified the journals according to five different disciplines[3]. On account of the subjective nature of classification of the papers according to method and research topic, we decided to carry out a content analysis, thus providing a more rigorous process (Cumbie et al., 2005), and to develop a coding form containing the categories into which to classify the papers. The coding form was created during a joint pilot study of 20 per cent of the papers, equalling 177 papers. During the pilot study we jointly read the abstract and used the techniques from open coding principles (Neuman, 1997) to develop the categories to use in the classification of the papers according to method used and topic of interest. In developing the categories, prior to the pilot study, we gained inspiration from previous studies. For developing categories for the used method, the classification by Piccolo and Ives (2005) – case study(ies), archival, theoretical and survey – served as Discipline

Definition

Information systems

Journals focusing on use or management aspects of information technology Journals focusing on accounting or related themes such as financial matters Journals focusing on organisational and management issues as such, that do not have an explicit technical view Journals focusing on an engineering tradition, e.g. focusing on production planning and control Journals focusing on technical aspects of information technology Journals focusing on aspects not included in the abovementioned five disciplines

Accounting Organisation and management Operation management Computer science Table III. Research disciplines

Other

the inspiration source; for developing the categories for research topic, the categories by Botta-Genoulaz et al. (2005) – implementation, optimisation, management, ERP tool and supply-chain management – served as the inspiration source. During the pilot study we continued to add new categories if the topic or method used in the particular paper was not covered by the categories already identified, until no new categories were found (Glaser and Strauss, 1967; Strauss and Corbin, 1994; Webster and Watson, 2002). After the joint pilot study we had compiled a coding form consisting of nine categories to be used in the classification of papers according to used methods and nine categories for the classification of papers according to research topic (see Tables IV and V). Since analysing and classifying 885 papers based on abstracts is a time-consuming job, we decided to split the total pool of papers into two (including those from the pilot study), analysing and classifying 442 each, using the coding form developed during the pilot study. During the classification, we physically sat in the same room, and when one of us had difficulties in classifying a paper, we both read the abstract and discussed it until we agreed on a classification. With regard to classification according to the method used, various categories and schemes have previously been applied among researchers. As mentioned previously, we set out to classify the publications in accordance with the methodology classification used by Piccolo and Ives (2005). This classification scheme could not, however, cover the whole ERP literature base, and it was necessary to develop more categories. We added: descriptive, experiment, design science, combination of methods and a category that we named “not mentioned”. See Table IV for the methodological categories used and their descriptions. Piccolo and Ives do not define the four categories they use; for this purpose we were inspired by Chen and Hirschheim (2004). As regards classification according to research topic, we set out to classify the papers in accordance with the topic classification used by Botta-Genoulaz et al. (2005): Category

Description

Case study(ies)

Papers reporting on studies that are involved with a single site or a few sites often over a certain period of time are located in this category Papers using secondary data such as public records, existing data sets and statistics fall into this category Papers analysing existing theory, typically with the aim of developing new theory, fall into this category Papers that fall into this category gather data by means of questionnaires This includes papers using either laboratory or field experiments Papers solely describing or arguing for a phenomenon and often very practically oriented Papers that construct systems and/or tools fall into this category Papers using a combination of the above-mentioned categories fall into this category Papers that do not mention any methods either explicitly or implicitly

Archival Theoretical Survey Experiment Descriptive Design science Combined Not mentioned

Review of the ERP research field 495

Table IV. Methodology categories

JEIM 23,4

496

Topic

Issues addressed and description

Implementation

How the ERP system can be introduced into the organisation – including papers concerning selection, the various steps of implementation and related problems, critical success factors, business process alignment during the implementation and organisational diffusion How ERP can be used better in the organisation – including papers concerning post-implementation, usefulness, achievement of competitive advantage through ERP, ERP users, financial benefits of ERP and ERPII in an organisational context How the implementation of ERP affects the management and the organisation – including papers concerning managerial issues of implementation, the ERP impact on the organisation, organisational changes, ERP and best practices, cultural issues in ERP use and finally papers concerning understanding ERP as a phenomenon What are ERP systems and ERP modules and applications? Papers concerned with systems architecture, systems language and integration norms, customisation, add-ons to ERP systems and finally ERPII systems as tools How ERP systems can be used in the context of a group of companies – papers concerning the use of ERP systems in system integration with other information technologies and systems and ERP contribution to cooperation in supply chains are included in this category How ERP systems may be studied – papers concerning how ERP systems can or should be studied, using various frameworks, are included in this category How education and training in ERP systems can be included in university curricula – papers concerning the development of ERP courses, integrating ERP systems into existing university programmes and lessons learned from doing so are included in this category How the ERP systems market evolves – papers concerning market demands, market share of different vendors, macro diffusion of ERP in particular industries and/or geographic areas are included in this category Papers that do not fit into any of the above categories

Optimisation of ERP

Management and ERP issues

The ERP tool

ERP and supply chain management

Studying ERP ERP and education

The ERP market and industry Table V. Topic classification

Others

implementation, optimisation, management, the ERP tool and supply-chain management. We chose to exclude their sixth category – case studies – since we regard this as a method and not a research topic. During the pilot study we found that these five categories did not cover the entire range of topics published within the ERP field. Three additional categories were formulated: studying ERP, ERP and education and the ERP market and industry. Table V describes each topic in more detail. 4. Findings about the ERP field In this section our findings from the literature study will be presented, and we will start by answering the first questions formulated in section 2: how many peer-reviewed

publications have been published each year, how has the field evolved, which journals have published ERP peer-reviewed publications and which have published the highest number of publications? Which authors have contributed? 4.1 Publications and journals The total number of peer-reviewed journal publications was found to be 885. The number of papers published per year was rather steady until 2003 (see Figure 2), when 116 papers were published, the highest number of papers published in one year. After 2003 the number of publications in 2004 was 105, and the number of papers published in 2005 and 2006 reached a similar level as at the beginning of the century. In 2007 the number of publications dropped to 66, the lowest in the period, followed by an increase in 2008 with 96 papers published, finally to reach a yearly publication rate of 66 in 2009. The high increase in number in 2008 can be explained from our data by the introduction of new journals with a special interest in ERP systems, e.g. the International Journal of Enterprise Systems in 2005, and a rather large amount of papers about ERP in developing countries by the end of the period. When we looked at the distribution of published ERP research papers, we found that 226 different journals had published ERP papers from 2000 to 2009 – which equals 3.9 papers on average in each publishing journal over the entire period. Approximately 50 per cent of the papers had been published by 20 journals, and three journals, Industrial Management & Data Systems, the Business Process Management Journal and the Journal of Enterprise Information Management (see Table VI), had each published more than 30 papers: in total these 120 papers equal 13 per cent of the pool. Accounting for 10 per cent of the pool, five journals from various disciplines had published 20-29 papers each, 16 journals had published around ten to 19 ERP papers each, accounting for 23 per cent of the pool, and finally 25 journals had published between five and nine ERP papers, accounting for 18 per cent of the pool. The remaining 348 papers, 37 per cent, had been published in more than 230 different journals (see Table VII). The ten most publishing journals (the ten most publishing journals and the exact number of publications each year can be found in Table VIII) have published approximately 30 per cent of the total pool and they have published 2.7 on average each year. The publication range of numbers and journals publishing ERP papers has changed during the period (see Figure 3). The Business Process Management Journal, which has published 43 papers since 2000, published 13 ERP papers in 2001 and 3.75

Review of the ERP research field 497

Figure 2. Number of ERP journal publications per year

JEIM 23,4

30 þ

Business Process Management Journal Industrial Management & Data Systems Journal of Enterprise Information Management International Journal of Production Economics Communications of the ACM Information & Management Computers in Industry International Journal of Enterprise Information Systems Information Systems Management Strategic Finance Journal of Computer Information Systems European Journal of Operational Research Journal of Information Systems Education International Journal of Operations & Production Management Systems Research and Behavioral Science Decision Support Systems Expert Systems with Applications Information Systems Frontiers International Journal of Production Research Journal of Strategic Information Systems Information Systems Journal Journal of Information Technology

20-29

498

10-19

Table VI. Journals with ten or more papers published

Journals

Table VII. Journals publishing ERP-related research

30 þ 20-29 10-19 5-9 1-4 Total

Papers

n

(%)

n

(%)

3 5 16 25 177 226

1 2 7 11 78 100

120 93 218 167 286 885

14 10 25 19 32 100

Sum (%) 14 24 49 68 100

papers on average in the period from 2002 to 2006, but after that it did not publish any ERP papers; in 2008 and 2009 it again published papers, seven each year. A similar pattern can be found for Industrial Management & Data Systems, which also published 43 ERP papers in the period 2000-2009, niine papers in 2004 and on average 5.33 papers per year until 2006, but did not publish any ERP papers in 2007; in 2008 and 2009 it again published papers, five and six respectively. Another journal, which has published more than 30 papers, the Journal of Enterprise Information Management, did not publish any papers until 2004 and published seven papers on average per year in the period 2004-2006, whereas no publications were found in 2007, and again in 2008 it published five papers and in 2009, eight papers. The most publishing journals in the period did not publish any papers in 2007, but did publish above average ERP publications in 2008 and 2009. The International Journal of Enterprise Information Systems did not publish any papers on ERP before 2007 and published as many as 11 papers in 2008.

13 2 0 0 1 0 1 1 0 0

1 2 0 0 13 1 1 1 0 1

Business Process Management Journal Industrial Management & Data Systems Journal of Enterprise Information Management International Journal of Production Economics Communications of the ACM Information & Management Computers in Industry International Journal of Accounting and Information Systems International Journal of Enterprise and Information Systems Information Systems Management

2001

2000

Journal

0 2

1

2 5 0 2 1 3 1

2002

0 3

2

3 4 0 0 2 2 0

2003

0 1

3

3 9 7 3 3 4 2

2004

0 3

1

7 6 6 5 0 0 11

2005

0 3

5

0 4 8 3 1 1 0

2006

7 1

2

0 0 0 4 0 5 3

2007

11 2

3

7 5 5 5 1 5 1

2008

Total 43 43 34 25 23 23 22 19 19 18

2009 7 6 8 3 1 2 2 0 1 2

Review of the ERP research field 499

Table VIII. Publication in the ten most ERP publishing journals over time

JEIM 23,4

500

Figure 3. Journals over time

In total 1,639 different authors, either as single authors or as co-authors, have contributed to the total pool of papers; 1,297 authors have contributed to a single paper only and 190 to two papers etc. (see Table IX). The most contributing author was S.C. Lenny Koh with 12 publications, followed by E. Bendoly with ten papers. A. Gunasekaran has published nine papers and D.C. Yen, eight papers. Four authors have contributed seven papers each, three contributed six and, finally, seven authors have contributed five papers (see Table X).

Publications

Table IX. Authors and publications

1 2 3 4 5 6 7 8 9 10 11 12 Note: 1,564 different authors

Number of authors 1,297 190 36 21 8 3 5 1 1 1 0 1

4.2 Research disciplines Of the papers, 31 per cent were published in operations management, being the most contributing discipline (see Figure 4), equalling 309 papers (see Table XI for the exact number of papers in each discipline over time). The second most contributing discipline is information systems, which has contributed 233 of the publications, 24 per cent of the pool. Computer science contributed with 15 per cent followed closely by organisation and management with 13 per cent of the publications. Accounting accounts for the smallest number of publications, namely 9 per cent, and finally we were not able to classify 8 per cent of the papers according to the categories used.

Number of publications

Author

12 10 9 8 7 7 7 7 6 6 6 5 5 5 5 5 5 5

S.C. Lenny Koh E. Bendoly A. Gunasekaran D.C. Yen A. Halingten E.T.G. Wang J. Verville T.M. Somers F.F.-H. Nah J. van Hillegersberg M. Al-Mashari B. Light C. Soh G. Klein J.E. Scott J.J. Jiang V.A. Mabert Y.M. Everdingen

Review of the ERP research field 501

Table X. The most publishing authors

Figure 4. Percentage of papers published in different disciplines

Table XI. Number of papers in each discipline over time

Information systems (%) Accounting (%) Organisation and management (%) Operations management (SCM) (%) Computer science (%) Other (%) (%)

17 7 11 16 27 6 84 20 8 13 19 32 7 100

11 12 9 33 11 11 87 13 14 10 38 13 13 100

2001 26 9 11 26 12 9 93 28 10 12 28 13 10 100

2002 26 14 11 35 16 14 116 22 12 9 30 14 12 100

2003 34 8 11 36 10 6 105 32 8 10 34 10 6 100

2004 21 5 12 34 13 3 88 24 6 14 39 15 3 100

2005 18 8 24 24 5 5 84 21 10 29 29 6 6 100

2006

22 2 6 19 11 6 66 33 3 9 29 17 9 100

2007

30 7 4 44 7 5 97 31 7 4 45 7 5 100

2008

502

Information systems Accounting Organisation and management Operations management (SCM) Computer science Other

2000

20 3 5 29 7 2 66 30 5 8 44 11 3 100

2009

225 75 104 296 119 67 886 24 9 13 31 15 8 100

Total

JEIM 23,4

In general the number of publications over time in each discipline (see Figure 5) seems to have been rather stable during 2000 to 2009, with minor exceptions (see Table XI and Figure 6 for the exact number of published papers in each discipline). One exception is the discipline organisation and management, where the highest number of publications was found in 2006, with more than twice as many papers published that year as in 2003 and 2004. The information systems disciplines seem to have kept their rather high number of publications during the period, and the percentage of the total number of papers increased during the period. In 2007 papers published within the information systems discipline accounted for 33 per cent of the total number of papers published, whereas the information systems discipline “only” accounted for 24 per cent on average. The most contributing discipline to the ERP research field is operation management, accounting for 31 per cent of the publications.

Review of the ERP research field 503

4.3 Research topics Of the research within ERP, 80 per cent can be classified as falling into 4 different research topics. The highest percentage of research, 30 per cent, focused on

Figure 5. Disciplines over time

Figure 6. Discipline over time (numbers)

JEIM 23,4

504

Figure 7. Percentage of papers presenting different topics

Figure 8. Topics over time

implementation aspects, 20 per cent on managing and ERP systems, 17 per cent on optimisation of ERP and finally 14 per cent on the ERP tool itself (see Figure 7). The last 19 per cent is divided between the remaining research topics. The changes in research topics of interest (see Figure 8) have only changed slightly during the period. Most research topics – implementation, supply-chain management, how to study and education – have been rather stable with no remarkable variation in the percentage of papers being published within these topics. Research into the ERP tool and the ERP market and industry has changed during the period, in that it has been reduced by 50 per cent from the first half of the period to the second half. The percentage of research in the topic “managing and ERP” increased slightly until 2007, representing as many as 25 per cent of the papers published in 2007, whereas afterwards it dropped to the same level as at the beginning of the period, approximately 15 per cent. Research into the optimisation of ERP has increased

steadily during the period from only representing 11 per cent in 2000 to representing 30 per cent of the publications in 2009 (see Table XII and Figure 9 for detailed numbers of publications within the category research topic). 4.4 Research methods As regards methods used in studying ERP, case studies have been the most prevalent and were used in 22 per cent of the papers (see Figure 10), followed by papers using surveys, which account for 15 per cent. A total of 12 per cent of the papers have used a descriptive and/or normative method; 11 per cent of the papers have been strictly theoretical; 9 per cent have used design-science methods; 8 per cent of the papers have used archival methods; 5 per cent have used combined methods; and only 2 per cent have used experimental methods. We were not able to classify 16 per cent of the papers on the basis of the abstract, since no methodological consideration was mentioned at all (see Table XIII and Figure 11 for detailed numbers of publications within the research method category). The methods used (see Figure 12) have changed during the period. The most remarkable change has taken place in the categories “not mentioned”, “theoretical” and “survey”. Whereas in 2000 as many as 43 per cent of the published papers did not mention the research method in their abstracts, this was only approximately 5 per cent of the papers in 2007, 2008 and 2009. Theoretically based papers increased from only representing 4 per cent of the papers published in 2000 to representing on average 14 per cent of the papers published in the last three years. An even more remarkable change can be found in the category “survey”. In 2000 6 per cent of the published papers used survey data, whereas 29 per cent did in 2009. The percentage use of case studies was the same in 2000 and in 2009, approximately 17 per cent, whereas almost 30 per cent of the papers from 2002 to 2005 used case studies. Experimental studies were not published until 2002, after which the percentage of papers using experimental methods increased to 8 per cent of the published papers in 2009. The rest of the used-method categories have represented a rather stable percentage of the published papers during the period (see Table XIII and Figure 11 for detailed numbers of publications within the category methods). 5. Discussion of the findings In this section we discuss the findings and address the previously raised discussion questions: is it fair to state that the ERP field has matured, has the ERP research field become a new research discipline, is the ERP research field is an interdisciplinary field? Further we present a conceptual framework for important issues in regards to ERP systems and finally we discuss the structured methodological framework usefulness in analysing a specific aspect of interest in regards ERP system, here BPR. In the previous section we raised the question of whether it is fair to state that the ERP field has become mature. To address this question we analysed which methods the different journal publications had used. Our findings suggest that the dominating method used has been case studies with a slight decline in the last part of the period, 15 per cent of the papers in 2009, whereas surveys had already taken over as the most used method in 2006. Only 5 per cent of the publications had used surveys in 2000; this percentage increased remarkably during the time of investigation to 29 per cent in 2009. At the same time there was a dramatic fall in papers that did not mention which

Review of the ERP research field 505

Table XII. Research topic over time

Implementation (%) Optimisation of ERP (%) Managing and ERP systems (%) The ERP tool (%) ERP and supply chain management (%) How to study ERP (%) Education (%) ERP – market and industry (%) Other (combined) (%) (%)

22 9 11 20 6 1 3 7 24 84 26 11 13 24 7 1 4 8 6 100

21 15 20 13 6 1 3 6 2 87 24 17 23 15 7 1 3 7 2 100

2001 25 16 15 16 6 2 5 7 1 93 27 17 16 17 6 2 5 8 1 100

2002 39 14 16 24 5 1 1 13 3 116 34 12 14 21 4 1 1 11 3 100

2003 24 21 16 13 10 2 10 7 2 105 23 20 15 12 10 2 10 7 2 100

2004 29 19 20 8 8 1 0 3 0 88 33 22 23 9 9 1 0 3 0 100

2005 27 16 21 6 4 2 1 7 0 84 32 19 25 7 5 2 1 8 0 100

2006

22 14 14 6 4 3 2 1 0 66 33 21 21 9 6 5 3 2 0 100

2007

35 26 10 11 9 0 3 3 0 97 36 27 10 11 9 0 3 3 0 100

2008

506

Implementation Optimisation of ERP Managing and ERP systems The ERP tool ERP and supply chain management How to study ERP Education ERP – market and industry Other (combined)

2000

18 24 7 7 3 0 2 4 1 66 27 36 11 11 5 0 3 6 2 100

2009

262 174 150 124 61 13 30 58 14 886 30 20 17 14 7 1 3 7 2 100

Total

JEIM 23,4

Review of the ERP research field 507

Figure 9. Research topics over time (numbers)

Figure 10. Percentage of papers based on different methods

method they had used, from 43 per cent to 3 per cent in 2009. When we combine the above with the fact that the number of theoretical papers rose from 4 per cent to 14 per cent, it is fair to state that the ERP field has matured, the amount of theoretical papers has increased and at the same time publication demands for explicating the research methods used have increased remarkably during the period 2000-2009. To address the question of whether the ERP research field is a new research discipline, we analysed our findings according to the number of published papers, contributions from authors and the evolution within numbers of publications in specific journals. The number of published papers reached its highest in 2003 with 116 papers. After 2003 the number reduced year by year (2008 being an exception) to 66 papers in 2009, clearly indicating that the interest has declined. Additionally, our findings show that a lot of different authors and journals have contributed to the ERP research field: 1,654 authors have contributed to the 885 papers published in 227 different journals, a variety of authors have contributed only one or few publications

Table XIII. Research methods over time

Case study(ies) (%) Archival (%) Theoretical (%) Survey (%) Combination (%) Design science (%) Not mentioned (%) Descriptive/normative (%) Experimental (%) (%)

Case study(ies) Archival Theoretical Survey Combination Design science Not mentioned Descriptive/normative Experimental

14 6 3 5 2 7 36 11 0 84 17 7 4 6 2 8 43 13 0 100

2000 18 7 8 5 4 4 25 16 0 87 21 8 9 6 5 5 29 18 0 100

2001 22 7 4 5 3 10 20 20 2 93 24 8 4 5 3 11 22 22 2 100

2002 34 12 4 16 1 16 20 12 1 116 29 10 3 14 1 14 17 10 1 100

2003 22 8 17 13 5 12 13 12 3 105 21 8 16 12 5 11 12 11 3 100

2004 24 11 8 15 5 10 7 8 0 88 27 13 9 17 6 11 8 9 0 100

2005 15 5 14 16 9 6 11 5 3 84 18 6 17 19 11 7 13 6 4 100

2006 11 7 11 19 1 6 3 6 2 66 17 11 17 29 2 9 5 9 3 100

2007

21 4 21 20 6 8 6 8 3 97 22 4 22 21 6 8 6 8 3 100

2008

10 6 9 19 5 4 2 6 5 66 15 9 14 29 8 6 3 9 8 100

2009

191 73 99 133 41 83 143 104 19 886 22 8 11 15 5 9 16 12 2 100

Total

JEIM 23,4

508

Review of the ERP research field 509

Figure 11. Methods over time (numbers)

Figure 12. Methods over time

and fewer than 15 per cent of the authors have contributed three or more papers. Our findings indicate that a great variety of authors have contributed only one or a few papers to the field. The fact that the most publishing journals during the period did not publish any papers in 2007 and that the journals that published the highest amount of papers in 2009 published above their own average leaves us to suggest that the “quick movers” as regards publishing ERP research lost interest in ERP-related research after a while, and that the journals that published ERP papers at the end of the period were “slow starters” and were dominating as the publication channel at the end of the period. These findings leave us to suggest that the publications on ERP were the result of an interest in an empirical phenomenon, from both authors and journals, and that the interest declined during the second half of the period. It seems fair to suggest that

JEIM 23,4

510

the interest in ERP was the result of a temporary widespread interest in an empirical phenomenon, rather than the beginning of a new research discipline. The next discussion point that we want to address is whether the ERP research field is an interdisciplinary field as suggested by Esteves and Bohorquez (2007). Esteves and Bohorquez (2007) further state that ERP-related research could and should be interdisciplinary. It is one thing to suggest and discuss; to reflect on real research practice is another. Our findings show that the ERP research field has been an interdisciplinary field. Our list of five different research disciplines accounts for more than 90 per cent of all the papers, and the distribution of papers among disciplines is quite balanced applying the taxonomy we have used. Even though the two disciplines of operations management (SCM) and information systems (IS) together count for 55 per cent of all the papers, no discipline can be said to be predominant. Based on the findings above our study confirms that the field of ERP is very much an interdisciplinary field. Esteves and Pastor (2001) suggest in their paper that ERP systems offer many potential areas for research and, due to their pervasive nature at that time, they expected ERP systems to be of interest to a wide range of scholarly disciplines (from software engineering to accounting). Their suggestions have “come true” and the ERP research field has indeed been interdisciplinary. The next question that we set out to discuss based on the literature review was the question of whether it is possible to develop a conceptual framework of areas of concern in regard to ERP. Based on the literature study we believe this is indeed possible. Using an open coding technique in the content analysis of the 885 abstracts with the purpose of dividing the categories to be used into the classification of the papers gave us a good indication of the issues of concern (see Figure 13). An indication of the relevant issues in each “area of concern” will be presented in terms of questions to be asked: (1) Implementation: . Which criteria should be used in selecting the ERP system, e.g. how well does the ERP system fit the business strategy (Wei et al., 2005; Wei and Wang, 2004)? . Which strategy should the implementation use, e.g. the “comprehensive”, “middle road” or “vanilla” implementation strategy (Parr and Shanks, 2000)? . Should a business process reengineering process take place before or simultaneously with the ERP implementation (Koch, 2001b)? . Which work tasks and organisational and managerial challenges can be expected in each phase of the implementation (Markus et al., 2000; Kraemmergaard and Rose, 2002)? . Which critical success factors should we have in mind during the implementation (Ngai et al., 2008; Dezdar and Sulaiman, 2009)? (2) Optimisation and post-implementation: . How can we prioritise between the different ERP maintenance initiatives (Ng et al., 2002)? . How can we optimise the use of the ERP system in the organisation? . How can we examine the process of system review during the post-implementation phase (Nicolaou, 2004)?

Review of the ERP research field 511

Figure 13. Conceptual framework for “areas of concern” regarding ERP systems

Which business benefits of ERP systems evolve during the post-implementation period (Staehr, 2010)? . Which strategic, managerial, operational and organisational benefits are the result of the ERP implementation (Shang and Seddon, 2002)? (3) Management and organisation: . Which organisational changes and impact can be expected implementing an ERP system and can they be predicted (Rikhardsson and Kraemmergaard, 2006)? . How do the communities exhibit distinct culture guides but also constrain practice in regard to ERP implementation and use (Wagner and Newell, 2004)? . How do the characteristics of ERP systems (specifically its integration, standardisation, routinisation and centralisation) facilitate and reinforce processes of management accounting change (Scapens and Jazayeri, 2003)? .

JEIM 23,4

To want extent does the ERP-led BPR implementation leads to fundamental changes within an organisation’s structure, culture and management process (Huq et al., 2006)? The ERP tool: . What are ERP systems (Kumar and van Hillegersberg, 2000)? . How is an ERP constructed (Sprott, 2000)? . How can ERP systems be customised and configured (Volkoff, 2003)? . How to integrate ERP systems and other systems (Frank, 2004; Wang et al., 2005; Zhang et al., 2006)? . How can be expected to be the future development of ERP systems (Ford, 2000; Smets-Solanes and de Carvalho, 2003; Møller, 2005)? Supply chain management and ERP: . How can ERP be used as a technology enabler for supply chain management (Boubekri, 2001)? . Which impact will ERP have on supply chain management (Akkermans et al., 2003)? . How well are the integration of the supply chain management and the ERP systems for competing in the future supply chain (Lenny Koh et al., 2006)? . How can ERP and SCM systems be integrated with CRM, PLM, e-procurement and e-marketplaces to foster cooperation and collaboration across the entire value chain (Nah, 2004)? Studying ERP: . What has over time been written about ERP (Botta-Genoulaz et al., 2005; Esteves and Bohorquez, 2007)? . What are the calls for and suggestion on ERP research agendas and issues (Lee, 2000; O’Leary, 2002; Sutton, 2006)? Education and training: . How to teach and compose the content of an ERP course (McComb and Sharifi, 2002; Nielson, 2002; Boyle, 2007)? . How can different courses be integrated using ERP systems (Cannon et al., 2004; Johnson et al., 2004)? . Where and how has ERP influenced the IS curriculum (Becerra-Fernandez et al., 2000; Bradford et al., 2003; Antonucci et al., 2004; Hawking et al., 2004)? Market and industry: . How are ERP systems adopted in specific country, e.g. India or Greece (Tarafdar and Roy, 2003; Kostopoulos et al., 2004)? . How can ERP systems be supplied to customers, e.g. through ASP’s (Bennett and Timbrell, 2000; Ekanayaka et al., 2002)? .

(4)

512

(5)

(6)

(7)

(8)

How are ERP systems adopted in a specific industry or type of companies (Everdingen et al., 2000; Craighead and Laforge, 2003; Yang et al., 2006)? What are the market share and demand of ERP (Arnesen and Thompson, 2003)?

Review of the ERP research field

The last discussion point we want to address is whether the methodological framework is usable to analyse a specific aspect of ERP e.g. BPR? To address this question we had to select the papers that dealt with BPR. To select these papers we searched the ERP EndNote file for papers with “BPR” or “Business Process Re-engineering” in either their titles, abstracts or keywords. This search left us with 42 papers in total. Making the head-count of the papers, showed that more than half of the papers addressed the topic of implementation, almost half were published within the operations management discipline and 38 per cent were using case study as a research method. The papers had been published by 24 different journals and only two authors; S. Subramoniam and M. Tounsi, have contributed with more than one paper. Comparing these findings with the findings of the total pool of 885 papers, indicates that BPR related ERP research to a higher degree than ERP research in general uses case study as a research method and relates it to implementation issues. Next we set out to find out which theoretical lenses researchers have used to studying the link between ERP and BPR. We initially analysed the 42 papers by reading the abstracts. During this initial analysis 22 papers were excluded since they either were strictly descriptive papers or did not mention any link between ERP and BPR. This left us with 20 papers to analyse for theoretical lenses. The result of this analysis can be seen in Table XIV. Using this methodology quickly gave us insight into how the publications link ERP and BPR in the ERP research field. Our findings show that different theoretical lenses have been used, that theory on critical success factors is dominant in eight out of the 20 papers, followed by theory on process modelling. The Business Process Management Journal accounts for almost half of the publications using theoretical lenses. The question as to whether the methodological framework can be used to analyse a specific aspect of ERP, is yes. In a short time we got valuable insight into the aspect of BPR within the ERP research field. This insight is believed to be useful for researchers who want to study the link between BPR and ERP using theoretical lenses and researchers who want to position their own research within the field, e.g. what has already been done and which theoretical lenses will be able to provide new insight. Finally using the methodological framework quickly gave us an understanding of which journals that had published the highest number of papers studying the link between ERP and BPR using theoretical lenses.

513

.

.

6. Conclusion and implications We set out to conduct a comprehensive literature review on ERP based on a vast amount of papers published. To be able to conduct such a review we developed a methodological framework, consisting of two phases: phase one, selecting and accumulating the publication pool, and phase two, analysing the publication pool. Using this framework for conducting the comprehensive literature review provided us with an overview of the ERP research field regardless of research disciplines, research

JEIM 23,4

Theoretical lens

Journal

Author

Critical success factors

Business Process Management Journal International Journal of Operations & Production Management European Journal of Operational Research European Journal of Operational Research International Journal of Enterprise Information Systems Business Process Management Journal Computers in Industry Business Process Management Journal Communications of the ACM

Nah and Lau (2001) Schrenederjans and Kim (2003) Somers and Nelson (2003) Umble et al. (2003) Emad (2007)

514

Formal (business) modelling Connectionist model Innovation processes Organizational sociology Change management Supply chain theory Table XIV. Theoretical lenses used in BPR linked ERP research categorised by journals and authors

Object orientation

Computers & Industrial Engineering Business Process Management Journal Journal of Organizational and End User Computing Industrial Engineer Business Process Management Journal Business Process Management Journal Journal of Change Management International Journal of Production Economics Business Process Management Journal

Organizational memory Business Process Management Journal Adoption model Business Process Management Journal

Ming-Ling and Wade (2008) Ngai et al. (2008) El Sawah et al. (2008) Scheer and Habermann (2000) Chiplunkar et al. (2003) Samaranayake (2009) Burns et al. (2009) Subramoniam (2008) Newman and Zhao (2008) Koch (2001a) Huq et al. (2006) Byrne and Heavey (2006) Subramoniam and Tounsi (2009) Stijn and Wensley (2001) Lee (2008)

topics and research traditions and a conceptual framework of “areas of concern” in regard to ERP systems. Furthermore we have “tested” whether the methodological framework may be useful to analyse a specific aspect of ERP. Our study reveals that more than 250 journals have published papers about ERP, and that the 20 most publishing journals have published approximately 30 per cent of the publications. The operation management discipline has published the largest amount of the papers, 31 per cent, followed by the IS discipline yielding 24 per cent of the publications, but no discipline has predominance. Studies on the implementation of ERP have been the most researched topic, accounting for 29 per cent of the papers, followed by studies on the management (18 per cent) and optimisation of ERP (17 per cent). Case studies have been the most used method, used in 22 per cent of the papers, but in the later part of the decade the use of this method is declining on the expense of, e.g. surveys. Additionally, our review and analysis reveal that the body of academic knowledge about ERP systems has reached a certain maturity, that the ERP research field is very much an interdisciplinary field and that the field has been driven by an interest in an empirical phenomenon more than indicating that the ERP research is a new research discipline. Based on the classification of the papers according to the topic of interest a useful conceptual framework for “areas of concern” with regard to ERP systems has been

developed. Seven areas of concern were identified: implementation, post-implementation, organisational change and managerial implications, the ERP market and industry, education and training, supply-chain management and the ERP system itself, issues that have implications for both managers and researchers. For managers, the conceptual framework can assist in creating an understanding of the broad spectra issues of concern that one has to take into consideration in regard to ERP systems and the questions one needs to deal with and be aware of when involved with ERP systems. For researchers with an interest in ERP systems, the conceptual framework can be used for positioning their own research and interests, and in creating an understanding of the broader context of ERP-related research. The usefulness of the methodological framework developed in the present paper was confirmed by applying it to a specific aspect of ERP research, namely BPR. With a limited amount of efforts the 42 papers published on BPR and ERP were analysed showing that BPR related ERP research to a higher degree than ERP research in general is based on case-studies and is related to implementation issues. The main theoretical lens applied in the papers was that of critical success factors. The results can also be used to identify the journals favouring this type of papers (e.g. Business Process Management Journal ) thus providing guidelines for where to publish and an understanding of the nature of the specific (sub-)field. Some would probably argue that other interesting analyses could have been performed and findings found, based on the total pool of journal publications and the EndNote file, e.g. a citation analysis to see who has had the greatest impact in terms of references within the field; a correlation analysis to see whether there is any correlation between topic and research discipline; a sub-literature review to analyse each discipline to see what the particular discipline has focused on; a sub-literature review to analyse trends and progress in academic knowledge in the different research topics, e.g. implementation during the period, etc. We would certainly support these arguments and hopefully others will take up these challenges. The free access to our EndNote file will hopefully serve as a motivator in this respect. We have provided the reader with an overview of the ERP research field and a conceptual framework of the different areas of concern. The findings can hopefully act as a foundation for researchers for further research in ERP, e.g. where to locate and publish different types of ERP-related research, and assist other researchers in the identification of related studies in the literature review phase of their work. Finally, the bibliographical EndNote database and its rich set of empirical data can hopefully be used by others in future research and analyses.

Notes 1. The EndNote database is available for free download at the web sites: www.asb.dk/article. aspx?pid ¼ 23792 2. Bibliographical data from each paper were organised in an End-Note database fully populated with meta-data and with easy access to a full-text library. 3. We used the term discipline to include (open) groups of scholars who interact, meet at conferences and publish in the same range of journals – and may be members of the same association.

Review of the ERP research field 515

JEIM 23,4

516

References Akkermans, H.A., Bogard, P., Yucesan, E. and van Wasserhove, L.N. (2003), “The impact of ERP on supply chain management: exploratory findings from a European Delphi study”, European Journal of Operational Research, Vol. 146 No. 2, pp. 284-301. Al-Mashari, M. (2001), “Process orientation through enterprise resource planning (ERP): a review of critical issues”, Knowledge and Process Management, Vol. 8 No. 3, pp. 175-85. Al-Mashari, M., Al-Mudimig, A. and Zairi, M. (2003), “Enterprise resource planning: a taxonomy of critical factors”, European Journal of Operational Research, Vol. 146 No. 2, pp. 352-64. Aloini, D., Dulmin, R. and Mininno, V. (2007), “Risk management in ERP project introduction: review of the literature”, Information & Management, Vol. 44 No. 6, pp. 547-67. Antonucci, Y.L., Corbitt, G., Stewart, G. and Harris, A.L. (2004), “Enterprise systems education: where are we? Where are we going?”, Journal of Information Systems Education, Vol. 15 No. 3, pp. 227-34. Arnesen, S. and Thompson, J. (2003), “ERP merger mania”, Strategic Finance, Vol. 85 No. 4, pp. 30-6. Becerra-Fernandez, I., Murphy, K.E. and Simon, S.J. (2000), “Integrating ERP in the business school curriculum”, Communications of the ACM, Vol. 43 No. 4, pp. 39-41. Bennett, C. and Timbrell, G.T. (2000), “Application service providers: will they succeed?”, Information Systems Frontiers, Vol. 2 No. 2, pp. 195-211. Bogdan, R. and Biklen, S. (1982), Qualitative Research for Education, Allyn & Bacon, Boston, MA. Botta-Genoulaz, V., Millet, P.A. and Grabot, B. (2005), “A survey on the recent research literature on ERP systems”, Computers in Industry, Vol. 56 No. 6, pp. 510-22. Boubekri, N. (2001), “Technology enablers for supply chain management”, Integrating Manufacturing Systems, Vol. 12 No. 6, pp. 394-9. Boyle, T.A. (2007), “Technical-oriented enterprise resource planning (ERP) body of knowledge for information systems programs: content and implementation”, Journal of Education for Business, Vol. 82 No. 5, pp. 267-75. Bradford, M., Vijayaraman, B.S. and Chandra, A. (2003), “The status of ERP integration in business school curricula: results of a survey of business schools”, Communications of AIS, No. 12, pp. 437-56. Burns, J., Jung, D. and Hoffman, J.J. (2009), “Capturing and comprehending the behavioral/dynamical interactions within an ERP implementation”, Journal of Organizational and End User Computing, Vol. 21 No. 2, pp. 67-89. Byrne, P.J. and Heavey, C. (2006), “The impact of information sharing and forecasting in capacitated industrial supply chains: a case study”, International Journal of Production Economics., Vol. 103 No. 1, pp. 420-37. Cannon, D.M., Klein, H.A., Koste, L.L. and Magal, S.R. (2004), “Curriculum integration using enterprise resource planning: an integrative case approach”, Journal of Education for Business, Vol. 80 No. 2, pp. 93-101. Cavana, R.Y., Delahaye, B.L. and Sekeran, U. (2001), Applied Business Research: Qualitative and Quantitative Methods, John Wiley & Sons, Brisbane. Chen, W. and Hirschheim, R. (2004), “A paradigmatic and methodological examination of information systems research from 1991 to 2001”, Information Systems Journal, Vol. 14 No. 3, pp. 197-235.

Chiplunkar, C., Deshmukh, S.G. and Chattopadhyay, R. (2003), “Application of principles of event-related open systems to business process reengineering”, Computers & Industrial Engineering, Vol. 45 No. 3, pp. 347-74. Craighead, C.W. and Laforge, R.L. (2003), “Taxonomy of information technology adoption patterns in manufacturing firms”, International Journal of Production Research, Vol. 41 No. 11, pp. 2431-49. Cumbie, B., Jourdan, Z., Peachy, T., Dugo, T.M. and Craighead, C.W. (2005), “Enterprise resource planning research: where are we now and where should we go from here?”, Journal of Information Technology Theory and Application, Vol. 7 No. 2, pp. 21-36. Dale, A.G., Elkjaer, M.B.F., van der Wiele, A. and Williams, A.R.T. (2001), “Fad, fashion and fit: an examination of quality circles, business process re-engineering and statistical process control”, International Journal of Production Economics, Vol. 73 No. 2, pp. 137-52. Dezdar, S. and Sulaiman, A. (2009), “Successful enterprise resource-planning implementation: taxonomy of critical factors”, Industrial Management & Data Systems, Vol. 109 No. 8, pp. 1037-52. Ekanayaka, Y., Currie, W.L. and Seltsikas, P. (2002), “Delivering enterprise resource planning systems through application service providers”, Logistics Information Management, Vol. 15 No. 3, pp. 192-203. El Sawah, S., Tharwat, A.A.E.F. and Rasmy, M.H. (2008), “A quantitative model to predict the Egyptian ERP implementation success index”, Business Process Management Journal, Vol. 14 No. 3, pp. 288-306. Emad, M.K. (2007), “Critical factors for implementation success of ERP systems: an empirical investigation from Bahrain”, International Journal of Enterprise Information Systems, Vol. 3 No. 2, pp. 34-49. Esteves, J. and Bohorquez, V. (2007), “An updated ERP systems annotated bibliography: 2001-2005”, Communications of AIS, No. 19, pp. 386-446. Esteves, J. and Pastor, J. (2001), “Enterprise resource-planning systems research: an annotated bibliography”, The Communications of the AIS, Vol. 7 No. 1, pp. 1-52. Everdingen, Y.V., Hillegersberg, J.V. and Waarts, E. (2000), “ERP adoption by European midsize companies”, Communications of the ACM, Vol. 43 No. 4, pp. 27-31. Ford, D. (2000), “Beyond ERP”, Manufacturing Engineering, Vol. 79 No. 5, pp. 210-13. Frank, L. (2004), “Architecture for integration of distributed ERP systems and e-commerce systems”, Industrial Management & Data Systems, Vol. 104 No. 5, pp. 418-29. Glaser, B.G. and Strauss, A.L. (1967), The Discovery of Grounded Theory, de Gruyter, New York, NY. Hawking, P., McCarthy, B. and Stein, A. (2004), “Second wave ERP education”, Journal of Information Systems Education, Vol. 15 No. 3, pp. 327-32. Hirschheim, R.A. and Klein, H.K. (2003), “Crisis in the IS field? A critical reflection on the state of the discipline”, Journal of AIS, Vol. 4 No. 10, pp. 237-93. Huq, Z., Huq, F. and Cutright, K. (2006), “BPR through ERP: avoiding change management pitfalls”, Journal of Change Management, Vol. 6 No. 1, pp. 67-85. Johnson, T., Lorents, A.C., Morgan, J. and Ozmun, J. (2004), “A customized ERP/SAP model for business curriculum integration”, Journal of Information Systems Education, Vol. 15 No. 3, pp. 245-54. Koch, C. (2001a), “BPR and ERP: realizing a vision of process with IT”, Business Process Management Journal, Vol. 7 No. 3, pp. 258-65.

Review of the ERP research field 517

JEIM 23,4

518

Koch, C. (2001b), “Enterprise resource planning information technology as a steamroller for management politics?”, Journal of Organizational Change Management, Vol. 14 No. 1, p. 64. Kostopoulos, K.C., Brachos, D.A. and Prastacos, G.P. (2004), “Determining factors of ERP adoption: an indicative study in the Greek market”, Engineering Management Conference, Vol. 1, pp. 287-91. Kraemmergaard, P. and Rose, J. (2002), “Managerial competences for ERP journeys”, Information Systems Frontiers, Vol. 4 No. 2, pp. 199-211. Kumar, K. and van Hillegersberg, J. (2000), “Enterprise resource planning: introduction”, Communications of the ACM, Vol. 43 No. 4, pp. 22-6. Lee, A. (2000), “Researchable directions for ERP and other new information technologies”, MIS Quarterly, Vol. 24 No. 1, pp. iii-viii. Lee, E.A. (2008), “Where good ERP implementations go bad: a case for continuity”, Business Process Management Journal, Vol. 14 No. 3, pp. 327-37. Lenny Koh, S.C., Saad, S. and Arunachalam, S. (2006), “Competing in the 21st century supply chain through supply chain management and enterprise integration”, International Journal of Physical Distribution & Logistics Management, Vol. 36 No. 6, pp. 455-65. McComb, G.B. and Sharifi, M. (2002), “Design and implementation of an ERP oracle financials course”, Journal of Computer Information Systems, Vol. 43 No. 2, pp. 71-5. McGaughey, R.E. and Angappa, G. (2007), “Enterprise resource planning (ERP): past, present and future”, International Journal of Enterprise Information Systems, Vol. 3 No. 3, pp. 23-35. Markus, M.L., Tanis, S.C. and van Fenema, P.C. (2000), “Multisite ERP implementations”, Communications of the ACM, Vol. 43 No. 4, pp. 42-6. Ming-Ling, C. and Wade, H.S. (2008), “An empirical study of enterprise resource management systems implementation”, Business Process Management Journal, Vol. 14 No. 5, pp. 675-93. Møller, C. (2005), “ERP II: a conceptual framework for next-generation enterprise systems?”, Journal of Enterprise Information Management, Vol. 18 No. 4, pp. 483-97. Møller, C., Kræmmergaard, P., Rikhardsson, P., Møller, P., Jensen, T.N. and Due, L. (2004), “A comprehensive ERP bibliography – 2000-2004”, IFI working paper, Aarhus School of Business, Aarhus. Nah, F. (2004), “Supply chain and enterprise systems management and solutions”, Information Resource Management Journal, Vol. 17 No. 3, July-September, p. 1. Nah, F.F.-H. and Lau, J.L.-S. (2001), “Critical factors for successful implementation of enterprise systems”, Business Process Management Journal, Vol. 7 No. 3, pp. 285-96. Neuman, W.L. (1997), Social Research Methods: Qualitative and Quantitative Approaches, Allyn & Bacon, Needham Heights, MA. Newman, M. and Zhao, Y. (2008), “The process of enterprise resource-planning implementation and business process re-engineering: tales from two Chinese small and medium-sized enterprises”, Information Systems Journal, Vol. 18 No. 4, pp. 405-26. Ng, S.P.C., Gable, G.G. and Chan, T. (2002), “An ERP-client benefit-oriented maintenance taxonomy”, Journal of Systems and Software, Vol. 64 No. 2, pp. 87-109. Ngai, E.W.T., Law, C.C.H. and Wat, F.K.T. (2008), “Examining the critical success factors in the adoption of enterprise resource planning”, Computers in Industry, Vol. 59 No. 6, pp. 548-64. Nicolaou, A.I. (2004), “Quality of post-implementation review for enterprise resource-planning systems”, International Journal of Accounting Information Systems, Vol. 5 No. 1, pp. 25-49.

Nielson, R. (2002), “The AMCIS 2002 workshops and panels V: teaching ERP and business processes using SAP software”, The Communications of the AIS, Vol. 9 No. 24. O’Leary, D.E. (2002), “Discussion of information system assurance for enterprise resource planning systems: unique risk considerations”, Journal of Information Systems, Vol. 16 No. 1, pp. 115-26. Parr, A. and Shanks, G. (2000), “A model of ERP project implementation”, Journal of Information Technology, Vol. 15 No. 4, pp. 289-303. Piccolo, G. and Ives, B. (2005), “IT-dependent strategic initiatives and sustained competitive advantage: a review and synthesis of the literature”, MIS Quarterly, Vol. 29 No. 4, pp. 747-76. Rikhardsson, P. and Kraemmergaard, P. (2006), “Identifying the impacts of enterprise system implementation and use: examples from Denmark”, International Journal of Accounting Information Systems, Vol. 7 No. 1, pp. 36-49. Rom, A. and Rohde, C. (2006), “Enterprise resource-planning systems, strategic enterprise management systems and management accounting: a Danish study”, Journal of Enterprise Information Management, Vol. 19 No. 1, pp. 50-66. Ross, J.W., Weill, P. and Robertson, D. (2006), Enterprise Architecture as Strategy, Harvard Business School Press, Boston, MA, 1 August. Samaranayake, P. (2009), “Business process integration, automation, and optimization in ERP: integrated approach using enhanced process models”, Business Process Management Journal, Vol. 15 No. 4, pp. 504-26. Scapens, R. and Jazayeri, M. (2003), “ERP systems and management accounting change: opportunies or impacts? A research note”, European Accounting Review, Vol. 12 No. 1, pp. 201-33. Scheer, A.-W. and Habermann, F. (2000), “Making ERP a success”, Communication of the ACM, Vol. 43 No. 4, pp. 57-61. Schrenederjans, M.J. and Kim, G.C. (2003), “Implementing enterprise resource-planning systems with total quality control and business process reengineering survey results”, International Journal of Operations & Production Management, Vol. 23 Nos 3/4, pp. 418-29. Shang, S. and Seddon, P.B. (2002), “Assessing and managing the benefits of enterprise systems: the business manager’s perspective”, Information Systems Journal, Vol. 12 No. 4, pp. 271-300. Shanks, G. (2000), “A model of ERP project implementation”, Journal of Information Technology, Vol. 15 No. 4, pp. 341-71. Shehab, E.M., Sharp, M.W., Supramaniam, L. and Spedding, T.A. (2004), “Enterprise resource planning: an integrative review”, Business Process Management Journal, Vol. 10 No. 4, pp. 359-86. Smets-Solanes, J.P. and de Carvalho, R.A. (2003), “ERP5: a next-generation, open-source ERP architecture”, IT Professional, Vol. 5 No. 4, pp. 38-44. Soh, C., Kien, S.S. and Tay-Yap, J. (2000), “Cultural fits and misfits: is ERP a universal solution?”, Communications of the ACM, Vol. 43 No. 4, pp. 47-51. Somers, T.M. and Nelson, K.G. (2003), “The impact of strategy and integration mechanisms on enterprise system value: empirical evidence from manufacturing firms”, European Journal of Operational Research, Vol. 146 No. 2, pp. 315-38. Sprott, D. (2000), “Componentizing the enterprise application packages”, Communications of the ACM, Vol. 43 No. 4, pp. 63-9.

Review of the ERP research field 519

JEIM 23,4

520

Staehr, L. (2010), “Understanding the role of managerial agency in achieving business benefits from ERP systems”, Information Systems Journal, Vol. 20 No. 3, pp. 213-38. Stijn, E.V. and Wensley, A. (2001), “Organizational memory and the completeness of process modelling in ERP”, Business Process Management Journal, Vol. 7 No. 3, pp. 181-94. Strauss, A. and Corbin, J. (1994), “Grounded theory methodology”, in Denzin, N.K. and Lincoln, Y.S. (Eds), Handbook of Qualitative Research, Sage, London, pp. 217-85. Subramoniam, S. (2008), “Commanding the internet era”, Industrial Engineer: IE, Vol. 40 No. 10, pp. 44-8. Subramoniam, S. and Tounsi, M. (2009), “An object-oriented intelligent environment of ERP systems”, Business Process Management Journal, Vol. 15 No. 1, pp. 109-18. Subramoniam, S., Tounsi, M. and Krishnankutty, K.V. (2009), “The role of BPR in the implementation of ERP systems”, Business Process Management Journal, Vol. 15 No. 5, pp. 653-68. Sutton, S.G. (2006), “Enterprise systems and the re-shaping of accounting systems: a call for research”, International Journal of Accounting Information Systems, Vol. 7 No. 1, pp. 1-6. Tarafdar, M. and Roy, R.K. (2003), “Analyzing the adoption of enterprise resource-planning systems in Indian organizations: a process framework”, Journal of Global Information Technology Management, Vol. 6 No. 1, pp. 31-51. Umble, E.J., Haft, R.R. and Umble, M.M. (2003), “Enterprise resource planning: implementation procedures and critical success factors”, European Journal of Operational Research, Vol. 146 No. 2, pp. 241-57. Volkoff, O. (2003), “Configuring an ERP system: introducing best practices or hampering flexibility?”, Journal of Information Systems Education, Vol. 14 No. 3, pp. 319-24. Wagner, E. and Newell, S. (2004), “Best for whom? The tension between best practice ERP package and diverse epistemic cultures in a university context”, Journal of Strategic Information Systems, Vol. 13 No. 4, pp. 305-28. Wang, C.-B., Chen, T.-Y., C, . and Chen, Y.-M. (2005), “Design of a meta model for integrating enterprise systems”, Computers in Industry, Vol. 56 No. 3, pp. 305-22. Webster, J. and Watson, R.T. (2002), “Analyzing the past to prepare for the future: writing a literature review”, MIS Quarterly, Vol. 26 No. 2, pp. xiii-xxiii. Wei, C.C. and Wang, M.J.J. (2004), “A comprehensive framework for selecting an ERP system”, International Journal of Project Management, Vol. 22 No. 2, pp. 161-9. Wei, C.-C., Chien, C.-F. and Wang, M-J.J. (2005), “An AHP-based approach to ERP system selection”, International Journal of Production Economics, Vol. 96 No. 1, pp. 47-62. Yang, C.-C., Y, ., Lin, W.-T., Lin, M.-Y. and Huang, J.-T. (2006), “A study on applying FMEA to improving ERP introduction: an example of semiconductor-related industries in Taiwan”, International Journal of Quality & Reliability Management, Vol. 23 No. 3, pp. 298-322. Zhang, D.Z., Anosike, A.I. and Akanle, O.M. (2006), “An agent-based approach for e-manufacturing and supply chain integration”, Computers & Industrial Engineering, Vol. 51 No. 2, pp. 343-60. Corresponding author Pernille Kraemmergaard can be contacted at: [email protected]

To purchase reprints of this article please e-mail: [email protected] Or visit our web site for further details: www.emeraldinsight.com/reprints

A comprehensive literature review of the ERP research ...

The current issue and full text archive of this journal is available at ..... 2001) or content analysis using different coding techniques, e.g. open coding, axial. Figure 1 .... the inspiration source; for developing the categories for research topic, the ...... To purchase reprints of this article please e-mail: reprints@emeraldinsight.com.

645KB Sizes 4 Downloads 263 Views

Recommend Documents

a review of the literature
whereas the National Center for PTSD recently released ..... al., 1997). These contradictory results call into question the ..... Psychiatry 157, 911–916. Goldberg ...

diversity research project literature review - WSBA
communities face multiple barriers — linked to larger social, economic and political ..... http://media.dsba.org/Applications/DSBA%20Disabilities%20Survey% ... org/sites/default/files/diversity/Task%20Force%20on%20Diversity%20Report.pdf.

Preceptorship: a review of the literature
Nursing's (UKCC) post-registration and practice recommendations Therefore, there is a great need .... Board teaching and assessment course (998), as su^ested by Ashton .... McGrath B J & Princeton R, (1987) Evaluation of a clmical precep-.

Preceptorship: An integrative review of the literature
Faculty of Nursing, 6-110 Clinical Sciences Building, University of Alberta, Edmonton,. AB, Canada ... ticular subject (Cooper, 1989; Whitmore and Knafl,. 2005).

A literature review on the impact of inventory ... - Semantic Scholar
be adapted by intelligent software agents making distributed decisions meanwhile,. [2] highlights the impact RFID ... ultimately profits of the firm. They support the communication and coordination of the economic activities between separate units of

Preceptorship: a review of the literature - Wiley Online Library
Page 1 ... current literature addressing these themes of role definition, preceptor selection ... these themes and discuss the limitabons of preceptorship m cluueal ...

a literature review of the institutional characteristics ...
application of methods, measures, installation or execution of a plan, design, specification, standard or policy. ... learning; good organizational culture support of task operation, administrative and financial aspects; ... identified features relat

Six Sigma: a literature review
The findings also open up new opportunities to apply Six Sigma in the ... more prevalent as Six Sigma principles have also been implemented in service industries in the context of supply chain (Arnheiter ..... and has emerged as a source of competiti

Systematic Literature Review of the Implementation of ...
Interviews with 5, Analysis with 3 and Research with one related article. 3.2. .... warehouses – Social networking (blogs, twitter) – Virtual communities. – System ...

pdf-1828\a-review-of-literature-on-dendrochronology-and-age ...
There was a problem loading more pages. pdf-1828\a-review-of-literature-on-dendrochronology-an ... nical-bulletin-state-of-colorado-department-of-gam.pdf.

COMPREhEnsivE research - CzechGlobe
infrastructure actions. 10:35 – 11:00. Aleš Farda: Climate change hotspots in. Central Europe. 11:00 – 11:25. Miroslav Trnka: Analysis, monitoring and.

PROTEST IN AN INFORMATION SOCIETY- a review of literature on ...
circumvent state-sanctioned censorship (Hacktivismo 2003), examples of ... SOCIETY- a review of literature on social movements and new ICTs- 31.pdf.

COMPREhEnsivE research - CzechGlobe
Miroslav Trnka: Analysis, monitoring and forecasting weather events for agriculture and forestry – part of climate change adaptation. 11:25 – 11:40 Coffee break.