You are required to read and agree to the below before accessing a full-text version of an article in the IDE article repository.
The full-text document you are about to access is subject to national and international copyright laws. In most cases (but not necessarily all) the consequence is that personal use is allowed given that the copyright owner is duly acknowledged and respected. All other use (typically) require an explicit permission (often in writing) by the copyright owner.
For the reports in this repository we specifically note that
- the use of articles under IEEE copyright is governed by the IEEE copyright policy (available at http://www.ieee.org/web/publications/rights/copyrightpolicy.html)
- the use of articles under ACM copyright is governed by the ACM copyright policy (available at http://www.acm.org/pubs/copyright_policy/)
- technical reports and other articles issued by M‰lardalen University is free for personal use. For other use, the explicit consent of the authors is required
- in other cases, please contact the copyright owner for detailed information
By accepting I agree to acknowledge and respect the rights of the copyright owner of the document I am about to access.
If you are in doubt, feel free to contact webmaster@ide.mdh.se
Information Flow in Software Testing -- An Interview Study with Embedded Software Engineering Practitioners
Publication Type:
Journal article
Venue:
Journal of IEEE Access
DOI:
10.1109/ACCESS.2019.2909093
Abstract
Background: In order to make informed decisions, software engineering practitioners need information from testing. However, with the trend of increased automation, there is an exponential growth and increased distribution of this information. This paper aims at exploring the information flow in software testing in the domain of embedded systems.
Method: Data was collected through semi-structured interviews of twelve experienced practitioners with an average work experience of more than fourteen years working at five organizations in the embedded software industry in Sweden. Seventeen hours of audio recordings were transcribed and anonymized into 130 pages of text that was analyzed by means of thematic analysis.
Results: The flow of information in software testing can be represented as feedback loops involving stakeholders, software artifacts, test equipment, and test results. The six themes that affect the information flow are: how organizations conduct testing and trouble shooting, communication, processes, technology, artifacts, and the organization of the company. Seven main challenges for the flow of information in software testing are: comprehending the objectives and details of testing, root cause identification, poor feedback, postponed testing, poor artifacts and traceability, poor tools and test infrastructure, and distances. Finally, five proposed approaches for enhancing the flow are: close collaboration between roles, fast feedback, custom test report automation, test results visualization, and the use of suitable tools and frameworks.
Conclusions: The results indicate that there are many opportunities to improve the flow of information in software testing: a first mitigation step is to better understand the challenges and approaches. Future work is needed to realize this in practice, for example on how to shorten feedback cycles between roles, as well how to enhance exploration and visualization of test results.
Bibtex
@article{Strandberg5493,
author = {Per Erik Strandberg and Eduard Paul Enoiu and Wasif Afzal and Daniel Sundmark and Robert Feldt},
title = {Information Flow in Software Testing -- An Interview Study with Embedded Software Engineering Practitioners},
volume = {2},
number = {1},
pages = {46434--46453},
month = {April},
year = {2019},
journal = {Journal of IEEE Access},
url = {http://www.es.mdu.se/publications/5493-}
}
