ABSTRACT
In this paper, we present the findings of a systematic review of the SRE literature, covering 300 papers in 95 publication venues (conferences and journals) in the last twelve years. We employ statistic techniques to help mining patterns and trends from the analyzed data set. We identified a prevalence of purely theoretical studies in the surveyed period, where no more than 31% are experimental research. Also, the number of research works in "Reliability Assessment" has clearly increased since 2002, and especially during the last three years. On the other hand, works in "Reliability Modeling" and "Fault Analysis" have been gradually reduced during the last decade.
- Lyu, M. R. Software Reliability Engineering: A Roadmap. In Future of Software Engineering. IEEE Computer Society, Washington, DC, USA, 2007, 153--170. Google ScholarDigital Library
- ACM. ACM Digital Library. ACM, http://dl.acm.org.Google Scholar
- IEEE. IEEE Xplore - Home. IEEE, http://ieeexplore.ieee.org/Xplore/home.jsp.Google Scholar
- Elsevier. Science Direct. Elsevier B. V. http://www.sciencedirect.com.Google Scholar
- Google. Google Scholar. Google, http://scholar.google.com.Google Scholar
- Johnson, R. A. and Wichern, D. W. Applied Multivariate Statistical Analysis, Upper Sandler River, New Jersey, 2007.Google Scholar
- Nagappan, N., Murphy, B. and Basili, V. R. The influence of organizational structure on software quality: an empirical case study. In Proc. of the Int'l Conference on Software Engineering. ACM, NY, USA, 2008, 521--530. Google ScholarDigital Library
- Li, Z., Tan, L., Lu, S., Zhou, Y. and Zhai, C. Have things changed now?: an empirical study of bug characteristics in modern open source software. Workshop on Architectural and System Support for Improving Software Dependability. ACM, NY, USA, 2006, 25--33. Google ScholarDigital Library
- Saff, D. and Ernst, M. D. An experimental evaluation of continuous testing during development. In Proc. of the 2004 ACM Int'l Symp. on Software Testing and Analysis. ACM, NY, USA, 2004, 76--85. Google ScholarDigital Library
- Nicol, D. M., Sanders, W. H. and Trivedi, K. S. Model-based evaluation: from dependability to security. IEEE Transactions on Dependable and Secure Computing, 1, 1 (Oct. 2004), 48--65. Google ScholarDigital Library
- Huang, C.-Y., Lyu, M. R.-T. and Kuo, S.-Y. A unified scheme of some Nonhomogenous Poisson process models for software reliability estimation. IEEE Transactions on Software Engineering, 29, 3 (March 2003), 261--269. Google ScholarDigital Library
- Nagappan, N. and Ball, T. Use of relative code churn measures to predict system defect density. In Proc. of the Int'l Conf. on Software Eng. USA, 2005, 284--292. Google ScholarDigital Library
Index Terms
- A survey on research in software reliability engineering in the last decade
Recommendations
Research synthesis in software engineering
ContextComparing and contrasting evidence from multiple studies is necessary to build knowledge and reach conclusions about the empirical support for a phenomenon. Therefore, research synthesis is at the center of the scientific enterprise in the ...
Research issues in software fault categorization
Software faults are a major threat for the dependability of software systems. When we intend to study the impact of software faults on software behavior, examine the quality of fault tolerance mechanisms, or evaluate diagnostic techniques, the issue of ...
Tools to support systematic reviews in software engineering: a cross-domain survey using semi-structured interviews
EASE '15: Proceedings of the 19th International Conference on Evaluation and Assessment in Software EngineeringBackground: A number of software tools are being developed to support systematic reviewers within the software engineering domain. However, at present, we are not sure which aspects of the review process can most usefully be supported by such tools or ...
Comments