Methodology evaluation: Inclusion of end users in user-centered development process
Keywords:
Software engineering, User-centered design, Evaluation methods, Tangible user interfaces, GamificationAbstract
User-Centered Design (UCD) has taken great relevance in software development since it allows to know characteristics and particularities of the end users to whom the system is addressed, generating applications with great acceptability. Consequently, many software development methodologies decide to implement this approach, however, it is important to perform evaluation processes to ensure compliance with this feature, for this reason, this paper presents different methods of evaluation of software development methodologies and their final products, identifying a series of criteria that can be applied in future evaluations related to user-centered design, in addition, by means of a software engineering experimentation process proposed by Gómez et al [26] a software methodology evaluation tool is applied to analyze the information related to the UCD it provides, ending with a comparison between the results of the METUIGA and MEDPE methodology. The results obtained demonstrate the need to create an evaluation tool that considers the participation of the end user in the evaluation of the methodological process and the final product, since the data obtained in the experimentation process focused more on the fulfillment of the software engineering process.
Downloads
References
B. Montero, H. Cevallos, and J. Dávila, “Metodologías ágiles frente a las tradicionales en el proceso de desarrollo de software,” Espirales Rev. Multidiscip. Investig., vol. 2, no. 17, 2018.
T. Escobar-Rodriguez and P. Monge-Lozano, “The acceptance of Moodle technology by business administration students,” Comput. Educ., vol. 58, no. 4, 2012, doi: 10.1016/j.compedu.2011.11.012.
N. Reich-Stiebert, F. Eyssel, and C. Hohnemann, “Exploring University Students’ Preferences for Educational Robot Design by Means of a User-Centered Design Approach,” Int. J. Soc. Robot., vol. 12, no. 1, 2020, doi: 10.1007/s12369-019-00554-7.
M. Trujillo Suárez, J. J. Aguilar, and C. Neira, “Los métodos más característicos del diseño centrado en el usuario -DCU-, adaptados para el desarrollo de productos materiales,” Iconofacto, vol. 12, no. 19, 2016, doi: 10.18566/iconofact.v12.n19.a09.
D. Lanter and R. Essinger, “User-centered design,” Int. Encycl. Geogr. People, Earth, Environ. Technol., pp. 1–4, 2017.
R. Galeano, “DISEÑO CENTRADO EN EL USUARIO,” Rev. Educ. Comun. Tecnol., vol. 2, no. 4, 2008, [Online]. Available: http://revistaq.upb.edu.co.
C. Abras, D. Maloney-Krichmar, and et al, “User-Centered Design BT - Bainbridge,” Bainbridge, 2004.
Y. Hassan Montero, G. Iazza, and F. Martín Fernández, “Diseño Web Centrado en el Usuario: Usabilidad y Arquitectura de la Información,” Hipertext.net, no. 2, 2004.
J. Muñiz Fernández and E. Fonseca Pedrero, “Construcción de instrumentos de medida para la evaluación universitaria,” Rev. Investig. en Educ., vol. 5, no. 5, 2008.
J. Herrera and A. Oliveri, “Diseño centrado en el usuario en el desarrollo de accesorios inteligentes,” Actas de diseño, vol. 34, 2021, doi: https://doi.org/10.18682/add.
C. Albornoz and C. Abdelahad, “Construcción de Interfaces Gráficas de Usuario aplicando técnicas de la Ingeniería del Software y utilizando Metodologías Centradas en el Usuario,” XXII Work. Investig. en Ciencias la Comput., 2020, [Online]. Available: http://sedici.unlp.edu.ar/bitstream/handle/10915/104016/Documento_completo.pdf-PDFA.pdf?sequence=1&isAllowed=y.
E. Méndez and R. Garrido, “Modelo de evaluación de metodologías para el desarrollo de software,” Universidad Catolica Andres Bello, 2006.
M. Giugni O. and R. Loaiza B., “Metodología para el desarrollo de portales centrada en el usuario: una evaluación empírica,” Télématique Rev. Electrónica Estud. Telemáticos, vol. 7, no. 3, 2008.
K. Mendes, E. Estevez, and P. Fillottrani, “Evaluación de Metodologías Ágiles para el Desarrollo de Software,” Work. Investig. en Ciencias la Comput., pp. 455–459, 2010.
K. Beck et al., “Manifesto for Agile Software Development,” 2001. http://agilemanifesto.org/ (accessed Mar. 09, 2021).
J. A. B. Montoya, “Comparación de metodologías ágiles y procesos de desarrollo de software mediante un instrumento basado en CMMI,” Sci. Tech., vol. 21, 2016.
J. Díaz Fernández, “Estudio sobre la correspondencia entre prácticas CMMI y prácticas ágiles y su aplicación en Pymes,” 2009.
P. Mohagheghi, “Evaluating software development methodologies based on their practices and promises,” 2008.
D. Araujo, J. Bermúdez Moreno, and S. Nuñez Escobar, “Criterios de evaluación en aplicaciones multimedia en entornos de educación y formación a distancia,” Télématique, vol. 6, no. 2, 2007.
M. Caerio Rodríguez, F. F. Ordoñez Fernández, M. D. Callejón Chinchilla, and E. Castro León, “Diseño de un instrumento de evaluación de aplicaciones digitales (Apps) que permiten desarrollar la competencia artística,” Pixel-Bit, Rev. Medios y Educ., 2020, doi: 10.12795/pixelbit.74071.
Z. Cataldi, “UNA METODOLOGÍA PARA EL DISEÑO, DESARROLLO Y EVALUACIÓN DE SOFTWARE EDUCATIVO,” Universidad Nacional de La Plata, 2000.
M. Capel, “Análisis y evaluación de aplicaciones para desarrollar la comunicación en el alumnado con trastorno del espectro autista,” EDUTEC. Rev. Electrónica Tecnol. Educ., no. 75, pp. 168–187, 2021, doi: https://doi.org/10.21556/edutec.2021.75.1681.
A. L. Iñiguez, L. S. Gaytan, M. A. García-Ruiz, and R. Maciel, “Usability Questionnaires to EvaluateVoice User Interfaces,” IEEE Lat. Am. Trans., vol. 19, no. 9, pp. 1468–1477, 2021, [Online]. Available: https://latamt.ieeer9.org/index.php/transactions/article/view/4771/1120.
L. J. Granollers T, “Esfuerzo de Usabilidad: un nuevo concepto para medir la usabilidad de un sistema interactivo basada en el Diseño Centrado en el Usuario.,” in Actas del Vo Congreso Interacción, vol. 1, 2004.
V. R. Basili, R. W. Selby, and D. H. Hutchens, “Experimentation in Software Engineering,” IEEE Trans. Softw. Eng., vol. SE-12, no. 7, 1986, doi: 10.1109/TSE.1986.6312975.
O. S. Gómez, J. P. Ucán, and G. E. Gómez, “Aplicación del proceso de experimentación a la Ingeniería de Software,” 2013.
O. S. Gómez, R. A. Aguilar, and U. J. P., “Experimentación en Ingeniería de Software,” Ing. Softw. en México Educ. Ind. e Investig., pp. 205–230, 2019.
L. R. Ramos Aguiar and F. J. Álvarez Rodríguez, “Methodology for designing systems based on tangible user interfaces and gamification techniques for blind people,” Appl. Sci., vol. 11, no. 12, 2021, doi: 10.3390/app11125676.
W. K. Bong, W. Chen, and A. Bergland, “Tangible User Interface for Social Interactions for the Elderly: A Review of Literature,” Advances in Human-Computer Interaction, vol. 2018. 2018, doi: 10.1155/2018/7249378.
M. Carreño-León, J. A. Sandoval-Bringas, T. Alvarez-Robles, R. Cosio-Castro, I. Estrada Cota, and A. Leyva Carrillo, “Designing a Tangible User Interface for Braille Teaching,” in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2020, vol. 12426 LNCS, doi: 10.1007/978-3-030-60149-2_16.
M. D. Lozano, V. M. R. Penichet, B. Leporini, and A. Fernando, “Tangible User Interfaces to Ease the Learning Process of Visually-Impaired Children,” Jul. 2018, doi: 10.14236/ewic/HCI2018.87.
F. Somma, R. Di Fuccio, L. Lattanzio, and F. Ferretti, “Multisensorial tangible user interface for immersive storytelling: A usability pilot study with a visually impaired child,” in CEUR Workshop Proceedings, 2021, vol. 2817.
A. Pérez-Manzano and J. Almela-Baeza, “Gamification and transmedia for scientific promotion and for encouraging scientific careers in adolescents,” Comunicar, vol. 26, no. 55, 2018, doi: 10.3916/C55-2018-09.
C. H. Sophie Chang, C. C. Kuo, H. T. Hou, and J. J. Ying Koe, “Design and evaluation of a multi-sensory scaffolding gamification science course with mobile technology for learners with total blindness,” Comput. Human Behav., vol. 128, 2022, doi: 10.1016/j.chb.2021.107085.
Yanfi, Y. Udjaja, and A. C. Sari, “A Gamification Interactive Typing for Primary School Visually Impaired Children in Indonesia,” in Procedia Computer Science, 2017, vol. 116, doi: 10.1016/j.procs.2017.10.032.
A. C. Sari, A. M. Fadillah, J. Jonathan, and M. R. D. Prabowo, “Interactive gamification learning media application for blind children using android smartphone in Indonesia,” in Procedia Computer Science, 2019, vol. 157, doi: 10.1016/j.procs.2019.09.018.
Unity, “Unity3D,” 2020. https://unity.com/ (accessed Aug. 17, 2020).
“Reactivision,” 2020. http://reactivision.sourceforge.net/ (accessed Jan. 02, 2021).
