Showing 1–15 of 15 results for author: Duc, A N

System for systematic literature review using multiple AI agents: Concept and an empirical evaluation

Authors: Abdul Malik Sami, Zeeshan Rasheed, Kai-Kristian Kemell, Muhammad Waseem, Terhi Kilamo, Mika Saari, Anh Nguyen Duc, Kari Systä, Pekka Abrahamsson

Abstract: Systematic Literature Reviews (SLRs) have become the foundation of evidence-based studies, enabling researchers to identify, classify, and combine existing studies based on specific research questions. Conducting an SLR is largely a manual process. Over the previous years, researchers have made significant progress in automating certain phases of the SLR process, aiming to reduce the effort and ti… ▽ More Systematic Literature Reviews (SLRs) have become the foundation of evidence-based studies, enabling researchers to identify, classify, and combine existing studies based on specific research questions. Conducting an SLR is largely a manual process. Over the previous years, researchers have made significant progress in automating certain phases of the SLR process, aiming to reduce the effort and time needed to carry out high-quality SLRs. However, there is still a lack of AI agent-based models that automate the entire SLR process. To this end, we introduce a novel multi-AI agent model designed to fully automate the process of conducting an SLR. By utilizing the capabilities of Large Language Models (LLMs), our proposed model streamlines the review process, enhancing efficiency and accuracy. The model operates through a user-friendly interface where researchers input their topic, and in response, the model generates a search string used to retrieve relevant academic papers. Subsequently, an inclusive and exclusive filtering process is applied, focusing on titles relevant to the specific research area. The model then autonomously summarizes the abstracts of these papers, retaining only those directly related to the field of study. In the final phase, the model conducts a thorough analysis of the selected papers concerning predefined research questions. We also evaluated the proposed model by sharing it with ten competent software engineering researchers for testing and analysis. The researchers expressed strong satisfaction with the proposed model and provided feedback for further improvement. The code for this project can be found on the GitHub repository at https://github.com/GPT-Laboratory/SLR-automation. △ Less

Submitted 13 March, 2024; originally announced March 2024.

Comments: 12 Pages, 7 Figures

Can Large Language Models Serve as Data Analysts? A Multi-Agent Assisted Approach for Qualitative Data Analysis

Authors: Zeeshan Rasheed, Muhammad Waseem, Aakash Ahmad, Kai-Kristian Kemell, Wang Xiaofeng, Anh Nguyen Duc, Pekka Abrahamsson

Abstract: Recent advancements in Large Language Models (LLMs) have enabled collaborative human-bot interactions in Software Engineering (SE), similar to many other professions. However, the potential benefits and implications of incorporating LLMs into qualitative data analysis in SE have not been completely explored. For instance, conducting qualitative data analysis manually can be a time-consuming, effor… ▽ More Recent advancements in Large Language Models (LLMs) have enabled collaborative human-bot interactions in Software Engineering (SE), similar to many other professions. However, the potential benefits and implications of incorporating LLMs into qualitative data analysis in SE have not been completely explored. For instance, conducting qualitative data analysis manually can be a time-consuming, effort-intensive, and error-prone task for researchers. LLM-based solutions, such as generative AI models trained on massive datasets, can be utilized to automate tasks in software development as well as in qualitative data analysis. To this end, we utilized LLMs to automate and expedite the qualitative data analysis processes. We employed a multi-agent model, where each agent was tasked with executing distinct, individual research related activities. Our proposed model interpreted large quantities of textual documents and interview transcripts to perform several common tasks used in qualitative analysis. The results show that this technical assistant speeds up significantly the data analysis process, enabling researchers to manage larger datasets much more effectively. Furthermore, this approach introduces a new dimension of scalability and accuracy in qualitative research, potentially transforming data interpretation methodologies in SE. △ Less

Submitted 2 February, 2024; originally announced February 2024.

Comments: 9 pages and 2 figures

Autonomous Agents in Software Development: A Vision Paper

Authors: Zeeshan Rasheed, Muhammad Waseem, Kai-Kristian Kemell, Wang Xiaofeng, Anh Nguyen Duc, Kari Systä, Pekka Abrahamsson

Abstract: Large Language Models (LLM) and Generative Pre-trained Transformers (GPT), are reshaping the field of Software Engineering (SE). They enable innovative methods for executing many software engineering tasks, including automated code generation, debugging, maintenance, etc. However, only a limited number of existing works have thoroughly explored the potential of GPT agents in SE. This vision paper… ▽ More Large Language Models (LLM) and Generative Pre-trained Transformers (GPT), are reshaping the field of Software Engineering (SE). They enable innovative methods for executing many software engineering tasks, including automated code generation, debugging, maintenance, etc. However, only a limited number of existing works have thoroughly explored the potential of GPT agents in SE. This vision paper inquires about the role of GPT-based agents in SE. Our vision is to leverage the capabilities of multiple GPT agents to contribute to SE tasks and to propose an initial road map for future work. We argue that multiple GPT agents can perform creative and demanding tasks far beyond coding and debugging. GPT agents can also do project planning, requirements engineering, and software design. These can be done through high-level descriptions given by the human developer. We have shown in our initial experimental analysis for simple software (e.g., Snake Game, Tic-Tac-Toe, Notepad) that multiple GPT agents can produce high-quality code and document it carefully. We argue that it shows a promise of unforeseen efficiency and will dramatically reduce lead-times. To this end, we intend to expand our efforts to understand how we can scale these autonomous capabilities further. △ Less

Submitted 30 November, 2023; originally announced November 2023.

Comments: 5 pages, 1 figure

Generative AI in Undergraduate Information Technology Education -- Insights from nine courses

Authors: Anh Nguyen Duc, Tor Lønnestad, Ingrid Sundbø, Marius Rohde Johannessen, Veralia Gabriela, Salah Uddin Ahmed, Rania El-Gazzar

Abstract: The increasing use of digital teaching and emerging technologies, particularly AI-based tools, such as ChatGPT, is presenting an inevitable and significant impact on higher education. The capability of processing and generating text could bring change to several areas, such as learning assessments or learning experiences. Besides the negative impact, i.e exam cheating, we also see a positive side… ▽ More The increasing use of digital teaching and emerging technologies, particularly AI-based tools, such as ChatGPT, is presenting an inevitable and significant impact on higher education. The capability of processing and generating text could bring change to several areas, such as learning assessments or learning experiences. Besides the negative impact, i.e exam cheating, we also see a positive side that ChatGPT can bring to education. This research article aims to contribute to the current debate on ChatGPT by systematic reflection and experience reported from nine bachelor IT courses at a Norwegian university. We conducted inductive empirical research with reflective notes and focused groups of lecturers from nine different IT courses. The findings were thematically organized with numerous use cases in teaching IT subjects. Our discussion highlights the disruptive implications of AI assistant usage in higher education and emphasizes the need for educators to shape this transformation. △ Less

Submitted 16 November, 2023; originally announced November 2023.

Resource and Competence (Internal) View vs. Environment and Market (External) View when defining a Business

Authors: Yngve Dahle, Martin Steinert, Anh Nguyen Duc, Roman Chizhevskiy

Abstract: Startups is a popular phenomenon that has a significant impact on global economy growth, innovation and society development. However, there is still insufficient understanding about startups, particularly, how to start a new business in the relation to consequent performance. Toward this knowledge, we have performed an empirical study regarding the differences between a Resource and Competence Vie… ▽ More Startups is a popular phenomenon that has a significant impact on global economy growth, innovation and society development. However, there is still insufficient understanding about startups, particularly, how to start a new business in the relation to consequent performance. Toward this knowledge, we have performed an empirical study regarding the differences between a Resource and Competence View (Internal) vs Environment and Market View (External) when defining a Business. 701 entrepreneurs have reflected on their startups on nine classes of Resources (values, vision, personal objectives, employees and partners, buildings and rental contracts, cash and credit, patents, IPR's and brands, products and services and finally revenues and grants) and three elements of the Business Mission ("KeyContribution", "KeyMarket" and "Distinction"). It seems to be a tendency to favour the Internal View over the External View. This tendency is clearer in Stable Economies (Europe) than in Emerging Economies (South Africa). There seems to be a co-variation between the tendency to favour the Internal View and the tendency to focus on adding Resources. Finally, we found that an order-based analysis seems to explain the differences between the two views better than a number-based method. △ Less

Submitted 16 August, 2018; originally announced September 2018.

Journal ref: 2018 IEEE International Conference on Engineering, Technology and Innovation (ICE/ITMC)

A preliminary study of agility in business and production - Cases of early-stage hardware startups

Authors: Anh Nguyen Duc, Xiaofang Weng, Pekka Abrahamsson

Abstract: [Context]Advancement in technologies, popularity of small-batch manufacturing and the recent trend of investing in hardware startups are among the factors leading to the rise of hardware startups nowadays. It is essential for hardware startups to be not only agile to develop their business but also efficient to develop the right products. [Objective] We investigate how hardware startups achieve ag… ▽ More [Context]Advancement in technologies, popularity of small-batch manufacturing and the recent trend of investing in hardware startups are among the factors leading to the rise of hardware startups nowadays. It is essential for hardware startups to be not only agile to develop their business but also efficient to develop the right products. [Objective] We investigate how hardware startups achieve agility when developing their products in early stages. [Methods] A qualitative research is conducted with data from 20 hardware startups. [Result] Preliminary results show that agile development is known to hardware entrepreneurs, however it is adopted limitedly. We also found tactics in four domains (1) strategy, (2) personnel, (3) artifact and (4) resource that enable hardware startups agile in their early stage business and product development. [Conclusions] Agile methodologies should be adopted with the consideration of specific features of hardware development, such as up-front design and vendor dependencies. △ Less

Submitted 16 August, 2018; originally announced August 2018.

Journal ref: ESEM conference 2018, Oulu, Finland

A Systematic Mapping Study on Requirements Engineering in Software Ecosystems

Authors: Aparna Vegendla, Anh Nguyen Duc, Shang Gao, Guttorm Sindre

Abstract: Software ecosystems (SECOs) and open innovation processes have been claimed as a way forward for the software industry. A proper understanding of requirements is as important for these IT-systems as for more traditional ones. This paper presents a mapping study on the issues of requirements engineering and quality aspects in SECOs and analyzes emerging ideas. Our findings indicate that among the v… ▽ More Software ecosystems (SECOs) and open innovation processes have been claimed as a way forward for the software industry. A proper understanding of requirements is as important for these IT-systems as for more traditional ones. This paper presents a mapping study on the issues of requirements engineering and quality aspects in SECOs and analyzes emerging ideas. Our findings indicate that among the various phases or subtasks of requirements engineering, most of the SECO specific research has been accomplished on elicitation, analysis, and modeling. On the other hand, requirements selection, prioritization, verification, and traceability has attracted few published studies. Among the various quality attributes, most of the SECOs research has been performed on security, performance and testability. On the other hand, reliability, safety, maintainability, transparency, usability attracted few published studies. The paper provides a review of the academic literature about SECO-related requirements engineering activities, modeling approaches, and quality attributes, positions the source publications in a taxonomy of issues and identifies gaps where there has been little research. △ Less

Submitted 31 December, 2017; originally announced January 2018.

Comments: Journal of Information Technology Research (JITR) 11(1)

Journal ref: Journal of Information Technology Research (JITR) 11(1) (2018)

Exploring the outsourcing relationship in software startups: A multiple case study

Authors: Anh Nguyen Duc, Pekka Abrahamsson

Abstract: Software startups are becoming increasingly popular in software industry as well as other sectors of economy. Startups that lack necessary competences often seek for external resources from outsourcing partners. Little is known how this outsourcing relationship works and whether it makes sense to outsource the technical competence to an external party. This is among the first investigations on the… ▽ More Software startups are becoming increasingly popular in software industry as well as other sectors of economy. Startups that lack necessary competences often seek for external resources from outsourcing partners. Little is known how this outsourcing relationship works and whether it makes sense to outsource the technical competence to an external party. This is among the first investigations on the outsourcing relationships in software startups. By conducting exploratory case studies at six startups, we found a mixed experience with outsourcing. The experimental nature of an early product development makes outsourcing a feasible option, although startups often suffer from its uncertainty and managing commitments from partners. Results further propose that early contract-based activities could be transformed into a long-term partnership by adopting a startup boundary spanner s role, establishing an inter-personal relationship and maintaining a mutual commitment. △ Less

Submitted 2 December, 2017; originally announced December 2017.

Comments: This is the author's version of the work. Copyright owner's version can be accessed at https://doi.org/10.1145/3084226.3084248

A Context-aware Recommender System for Hyperlocal News: A Conceptual Framework

Authors: Anh Nguyen Duc, Hilde Gudvangen

Abstract: Recommender systems (RSs) have been popular in variety of application domains due to the increased demand for filtering and sorting items and information. Today, there is a numerous approaches and algorithms of data filtering and recommendations. This works presents a conceptual framework for constructing a mobile RS in hyper-local news domain. The mobile RS is designed to deal with specific requi… ▽ More Recommender systems (RSs) have been popular in variety of application domains due to the increased demand for filtering and sorting items and information. Today, there is a numerous approaches and algorithms of data filtering and recommendations. This works presents a conceptual framework for constructing a mobile RS in hyper-local news domain. The mobile RS is designed to deal with specific requirements of news readers, such as spatial- temporal relevance, recency, real-time update and validated news. The implementation of the RS in a distributed file system is also discussed. △ Less

Submitted 2 December, 2017; originally announced December 2017.

Comments: This is the author's version of the work, Norwegian Big Data Symposium (NOBIDS) 2016, Trondheim, Norway

What influences the speed of prototyping? An empirical investigation of twenty software startups

Authors: Anh Nguyen Duc, Xiaofeng Wang, Pekka Abrahamsson

Abstract: It is essential for startups to quickly experiment business ideas by building tangible prototypes and collecting user feedback on them. As prototyping is an inevitable part of learning for early stage software startups, how fast startups can learn depends on how fast they can prototype. Despite of the importance, there is a lack of research about prototyping in software startups. In this study, we… ▽ More It is essential for startups to quickly experiment business ideas by building tangible prototypes and collecting user feedback on them. As prototyping is an inevitable part of learning for early stage software startups, how fast startups can learn depends on how fast they can prototype. Despite of the importance, there is a lack of research about prototyping in software startups. In this study, we aimed at understanding what are factors influencing different types of prototyping activities. We conducted a multiple case study on twenty European software startups. The results are two folds, firstly we propose a prototype-centric learning model in early stage software startups. Secondly, we identify factors occur as barriers but also facilitators for prototyping in early stage software startups. The factors are grouped into (1) artifacts, (2) team competence, (3) collaboration, (4) customer and (5) process dimensions. To speed up a startups progress at the early stage, it is important to incorporate the learning objective into a well-defined collaborative approach of prototyping △ Less

Submitted 2 December, 2017; originally announced December 2017.

Comments: This is the author's version of the work. Copyright owner's version can be accessed at doi.org/10.1007/978-3-319-57633-6_2, XP2017, Cologne, Germany

Building an Entrepreneurship Data Warehouse

Authors: Yngve Dahle, Martin Steinert, Anh Nguyen Duc, Pekka Abrahamsson

Abstract: The main principle of the Lean Startup movement is that static business planning should be replaced by a dynamic development, where products, services, business model elements, business objectives and activities are frequently changed based on constant customer feedback. Our ambition is to empirically measure if such changes of the business idea, the business model elements, the project management… ▽ More The main principle of the Lean Startup movement is that static business planning should be replaced by a dynamic development, where products, services, business model elements, business objectives and activities are frequently changed based on constant customer feedback. Our ambition is to empirically measure if such changes of the business idea, the business model elements, the project management and close interaction with customers really increases the success rate of entrepreneurs, and in what way. Our first paper, Does Lean Startup really work? - Foundation for an empirical study presented the first attempt to model the relations we want to measure. This paper will focus on how to build and set up a test harness (from now on called the Entrepreneurship Platform or EP) to gather empirical data from Companies and how to store these data together with demographical and financial data from the PROFF-portal in the Entrepreneurial Data Warehouse (from now called the EDW). We will end the paper by discussing the potential methodological problems with our method, before we document a test run of our set-up to verify that we are actually able to populate the Data Warehouse with time series data △ Less

Submitted 3 December, 2017; v1 submitted 19 November, 2017; originally announced November 2017.

Comments: This is the author's version of the work, 23rd ICE/IEEE International Technology Management Conference 2017, Madeira Island, Portugal (2017)

Coopetition of software firms in Open source software ecosystems

Authors: Anh Nguyen Duc, Daniela S. Cruzes, Geir K. Hanssen, Terje Snarby, Pekka Abrahamsson

Abstract: Software firms participate in an ecosystem as a part of their innovation strategy to extend value creation beyond the firms boundary. Participation in an open and independent environment also implies the competition among firms with similar business models and targeted markets. Hence, firms need to consider potential opportunities and challenges upfront. This study explores how software firms inte… ▽ More Software firms participate in an ecosystem as a part of their innovation strategy to extend value creation beyond the firms boundary. Participation in an open and independent environment also implies the competition among firms with similar business models and targeted markets. Hence, firms need to consider potential opportunities and challenges upfront. This study explores how software firms interact with others in OSS ecosystems from a coopetition perspective. We performed a quantitative and qualitative analysis of three OSS projects. Finding shows that software firms emphasize the co-creation of common value and partly react to the potential competitiveness on OSS ecosystems. Six themes about coopetition were identified, including spanning gatekeepers, securing communication, open-core sourcing and filtering shared code. Our work contributes to software engineering research with a rich description of coopetition in OSS ecosystems. Moreover, we also come up with several implications for software firms in pursing a harmony participation in OSS ecosystems. △ Less

Submitted 3 December, 2017; v1 submitted 19 November, 2017; originally announced November 2017.

Comments: This is the author's version of the work. Copyright owner's version can be accessed at https://link.springer.com/chapter/10.1007/978-3-319-69191-6_10, Coopetition of software firms in Open source software ecosystems, 8th ICSOB 2017, Essen, Germany (2017)

Towards understanding startup product development as effectual entrepreneurial behaviors

Authors: Anh Nguven Duc, Yngve Dahle, Martin Steinert, Pekka Abrahamsson

Abstract: Software startups face with multiple technical and business challenges, which could make the startup journey longer, or even become a failure. Little is known about entrepreneurial decision making as a direct force to startup development outcome. In this study, we attempted to apply a behaviour theory of entrepreneurial firms to understand the root-cause of some software startup s challenges. Six… ▽ More Software startups face with multiple technical and business challenges, which could make the startup journey longer, or even become a failure. Little is known about entrepreneurial decision making as a direct force to startup development outcome. In this study, we attempted to apply a behaviour theory of entrepreneurial firms to understand the root-cause of some software startup s challenges. Six common challenges related to prototyping and product development in twenty software startups were identified. We found the behaviour theory as a useful theoretical lens to explain the technical challenges. Software startups search for local optimal solutions, emphasise on short-run feedback rather than long-run strategies, which results in vague prototype planning, paradox of demonstration and evolving throw-away prototypes. The finding implies that effectual entrepreneurial processes might require a more suitable product development approach than the current state-of-practice. △ Less

Submitted 3 December, 2017; v1 submitted 19 November, 2017; originally announced November 2017.

Comments: This is the author's version of the work. Copyright owner's version can be accessed at https://doi.org/10.1007/978-3-319-69191-6_15, 8th ICSOB 2017, Essen, Germany

How Do Software Startups Pivot? Empirical Results from a Multiple Case Study

Authors: Sohaib Shahid Bajwa, Xiaofeng Wang, Anh Nguven Duc, Pekka Abrahamsson

Abstract: In order to handle intense time pressure and survive in dynamic market, software startups have to make crucial decisions constantly on whether to change directions or stay on chosen courses, or in the terms of Lean Startup, to pivot or to persevere. The existing research and knowledge on software startup pivots are very limited. In this study, we focused on understanding the pivoting processes of… ▽ More In order to handle intense time pressure and survive in dynamic market, software startups have to make crucial decisions constantly on whether to change directions or stay on chosen courses, or in the terms of Lean Startup, to pivot or to persevere. The existing research and knowledge on software startup pivots are very limited. In this study, we focused on understanding the pivoting processes of software startups, and identified the triggering factors and pivot types. To achieve this, we employed a multiple case study approach, and analyzed the data obtained from four software startups. The initial findings show that different software startups make different types of pivots related to business and technology during their product development life cycle. The pivots are triggered by various factors including negative customer feedback. △ Less

Submitted 29 October, 2017; originally announced November 2017.

Comments: Conference publication, International Conference on Software Business (ICSOB'16), Slovenia

Journal ref: In: Maglyas A., Lamprecht AL. (eds) Software Business. Lecture Notes in Business Information Processing, vol 240. Springer, Cham (2016)

Failures to be celebrated: an analysis of major pivots of software startups

Authors: Sohaib Shahid Bajwa, Xiaofeng Wang, Anh Nguyen Duc, Pekka Abrahamsson

Abstract: In the context of software startups, project failure is embraced actively and considered crucial to obtain validated learning that can lead to pivots. A pivot is the strategic change of a business concept, product or the different elements of a business model. A better understanding is needed on different types of pivots and different factors that lead to failures and trigger pivots, for software… ▽ More In the context of software startups, project failure is embraced actively and considered crucial to obtain validated learning that can lead to pivots. A pivot is the strategic change of a business concept, product or the different elements of a business model. A better understanding is needed on different types of pivots and different factors that lead to failures and trigger pivots, for software entrepreneurial teams to make better decisions under chaotic and unpredictable environment. Due to the nascent nature of the topic, the existing research and knowledge on the pivots of software startups are very limited. In this study, we aimed at identifying the major types of pivots that software startups make during their startup processes, and highlighting the factors that fail software projects and trigger pivots. To achieve this, we conducted a case survey study based on the secondary data of the major pivots happened in 49 software startups. 10 pivot types and 14 triggering factors were identified. The findings show that customer need pivot is the most common among all pivot types. Together with customer segment pivot, they are common market related pivots. The major product related pivots are zoom-in and technology pivots. Several new pivot types were identified, including market zoom-in, complete and side project pivots. Our study also demonstrates that negative customer reaction and flawed business model are the most common factors that trigger pivots in software startups. Our study extends the research knowledge on software startup pivot types and pivot triggering factors. Meanwhile it provides practical knowledge to software startups, which they can utilize to guide their effective decisions on pivoting △ Less

Submitted 11 October, 2017; originally announced October 2017.

Comments: This is the author's version of the work. Copyright owner's version can be accessed at https://link.springer.com/article/10.1007/s10664-016-9458-0

Journal ref: Empir Software Eng (2017) 22: 2373