DevOps y la Medición de la Calidad del Producto de Software: Hallazgos Preliminares

• Gabriel Alberto García-Mireles ^[1] ; Nerina Peña Olivero ^[2] ; Himer Avila-George ^[2]
  1. [1] Universidad de Sonora

     Universidad de Sonora

     México

     
  2. [2] Universidad de Guadalajara

     Universidad de Guadalajara

     México

     
• Localización: RISTI: Revista Ibérica de Sistemas e Tecnologias de Informação, ISSN-e 1646-9895, Nº. 53, 2024, págs. 37-52
• Idioma: español
• Enlaces
  • Texto completo (pdf)
• Resumen
  • español

    Las organizaciones de desarrollo de software están adoptando el enfoque DevOps como una estrategia para mantenerse competitivas. El impacto de estas iniciativas se relaciona con la reducción del tiempo de desarrollo mientras se mantiene la calidad del software. Sin embargo, pocos trabajos han señalado específicamente que aspectos de la calidad se han medido. En este trabajo, presentamos los resultados de un mapeo sistemático de literatura en donde identificamos las características de calidad del producto de software que se han estudiado en entornos DevOps. Los resultados se complementan con las iniciativas de medición del desempeño general de DevOps y aquellas que miden la calidad del producto de software. Dada la falta de trabajos en esta área, como primer paso en la definición de un proceso de medición de la calidad del producto en entornos DevOps, identificamos algunas métricas de mantenibilidad y factores contextuales por considerar en estas iniciativas.

  • English

    Software development organizations are adopting the DevOps approach as a strategy to stay competitive. The impact of these initiatives is related to reducing development time while maintaining software quality. However, little research work has specifically indicated which aspects of quality have been measured. In this paper, we present the results of a systematic mapping study where we identify software product quality characteristics that have been studied in DevOps settings. The results are complemented by overall DevOps performance measurement initiatives and those that measure software product quality. Given the lack of research work in this area, as a first step in defining a product quality measurement process in DevOps settings, we identified some maintainability metrics and contextual factors to consider in these initiatives.

• Referencias bibliográficas
  • Alnafessah, A., Gias, A.U., Wang, R., Zhu, L., Casale, G., & Filieri, A. (2021). Quality aware DevOps research: Where do we stand? IEEE...
  • Amaro, R., Pereira, R., & da Silva, M. M. (2023). Capabilities and metrics in DevOps: A design science study. Information & Management,...
  • Bermon Angarita, L., Fernández Del Carpio, A. & Osorio Londoño, A. A. (2022). A Bibliometric Analysis of DevOps Metrics. DESIDOC Journal...
  • Bertolino, A., Angelis, G. D., Guerriero, A., Miranda, B., Pietrantuono, R., & Russo, S. (2023). DevOpRET: Continuous reliability testing...
  • Bezemer, C. P., Eismann, S., Ferme, V., Grohmann, J., Heinrich, R., Jamshidi, P., Shang, W., van Hoorn, A., Villavicencia, M., Walter, J....
  • Capizzi, A., Distefano, S. & Mazzara, M. (2019). From devops to devdataops: Data management in devops processes. In International Workshop...
  • Céspedes, D., Angeleri, P., Melendez, K. & Dávila, A. (2020). Software Product Quality in DevOps Contexts: A Systematic Literature Review,...
  • Chae, H. S., Kim, T. Y., Jung, W. S., & Lee, J. S. (2007). Using metrics for estimating maintainability of web applications: An empirical...
  • Chidamber, S.R., Kemerer, C.F. (1994)- A metrics suite for object oriented design. IEEE Trans. Softw. Eng. 20(6), 476–493.
  • Debois, P. (2008). Agile infrastructure and operations: how infra-gile are you?. In Agile 2008 Conference. pp. 202-207.
  • Diamantopoulos, T., Papamichail, M. D., Karanikiotis, T., Chatzidimitriou, K. C., & Symeonidis, A. L. (2020). Employing contribution and...
  • Domínguez-Acosta, M. F. & García-Mireles, G. A. (2021). Identifying Activities for Enhancing Software Quality in DevOps Settings. 10th...
  • Ebert, C., Gallardo, G., Hernantes, J., & Serrano, N. (2016). DevOps, IEEE Software, 33(3), 94-100.
  • Forsgren, N., & Kersten, M. (2018). DevOps metrics. Communications of the ACM, 61(4), 44-48. https://doi.org/10.1145/3159169
  • García-Mireles, G. A., Moraga, M. Á., García, F., & Piattini, M. (2015). Approaches to promote product quality within software process...
  • Garousi, V., Tarhan, A., Pfahl, D., Coşkunçay, A., & Demirörs, O. (2019). Correlation of critical success factors with success of software...
  • Ghosheh, E., Black, S., & Qaddour, J. (2008). Design metrics for web application maintainability measurement. In 2008 IEEE/ACS International...
  • Gunawan, F., & Budiardjo, E. (2021). A quest of software process improvements in DevOps and Kanban: A case study in small software company....
  • Humble, J. & Molesky, J. (2011). Why enterprises must adopt devops to enable continuous delivery. Cutter IT J., 24(8), 6-12.
  • ISO (2011) ISO/IEC 25010: Systems and software engineering – system and software product quality requirements and evaluation (SQuaRE) – System...
  • Kato, D., Shimizu, A., & Ishikawa, H. (2022). Quality classification for testing work in DevOps. In Proceedings of the 14th International...
  • Kitchenham, B. & Pfleeger, S. L. (1996). Software quality: the elusive target, IEEE software, 13(1), 12-21. Kitchenham, B. & Charters,...
  • Lazuardi, M., Raharjo, T., Hardian, B. & Simanungkalit, T. (2021). Perceived Benefits of DevOps Implementation in Organization: A Systematic...
  • Mallouli, W., Cavalli, A. R., Bagnato, A., & De Oca, E. M. (2020). Metrics-driven DevSecOps. In ICSOFT (pp. 228-233).
  • Mishra, A. & Otaiwi, Z. (2020). DevOps and software quality: A systematic mapping, Computer Science Review, 38, 100308.
  • Mohan, V. & Othmane, L. B. (2016). SecDevOps: Is It a Marketing Buzzword? - Mapping Research on Security in DevOps. 2016 11th International...
  • Mohan, V., ben Othmane, L., & Kres, A. (2018). BP: Security concerns and best practices for automation of software deployment processes:...
  • Moyón, F., Soares, R., Pinto-Albuquerque, M., Mendez, D., & Beckers, K. (2020). Integration of security standards in devops pipelines:...
  • Offerman, T., Blinde, R., Stettina, C. J., & Visser, J. (2022). A Study of Adoption and Effects of DevOps Practices. In 2022 IEEE 28th...
  • Peña Olivero, N., Ávila George, H. & García-Mireles, G., (2023). Impacto de las prácticas de DevOps en la calidad de producto de software:...
  • Perera, P., Bandara, M., & Perera, I. (2016). Evaluating the impact of DevOps practice in Sri Lankan software development organizations....
  • Prates, L., Faustino, J., Silva, M., & Pereira, R. (2019). Devsecops metrics. In Information Systems: Research, Development, Applications,...
  • Rahman, A. A. U., & Williams, L. (2016). Software security in DevOps: synthesizing practitioners’ perceptions and practices. In Proceedings...
  • Snyder, B., & Curtis, B. (2017). Using analytics to guide improvement during an Agile– DevOps transformation. IEEE Software, 35(1), 78-83....
  • Tamburri, D. A., Bersani, M. M., Mirandola, R., & Pea, G. (2018). Devops service observability by-design: Experimenting with model-view-controller....
  • Tomas, N., Li, J., & Huang, H. (2019). An empirical study on culture, automation, measurement, and sharing of devsecops. In 2019 International...
  • Visser, T., & Hulstijn, J. (2023). Measuring Agile/DevOps team performance. In AgilISE@ CAiSE (pp. 17-23).
  • Wilkes, B., Milani, A. M. P., & Storey, M. A. (2023). A Framework for Automating the Measurement of DevOps Research and Assessment (DORA)...
  • Zeller, M. (2021). Towards continuous safety assessment in context of devops. In Computer Safety, Reliability, and Security. SAFECOMP 2021...