Search

[ES] Las personas y la sociedad se están volviendo cada vez más dependientes del soft- ware, ya que éste determina cada vez más nuestras actividades de la vida diaria tanto en el ámbito social como en el empresarial. Con el uso cada vez mayor de software, exis- te una creciente necesidad de programadores que desarrollen ese software. Aprender a programar es un proceso complejo que va más allá del aprendizaje de la sintaxis de un lenguaje de programación. Los estudiantes deben aprender a resolver problemas a través de computaciones, es decir, pensamiento computacional. Un proceso de concep- tualización eficiente se convierte en un requisito esencial. Es por esto que la práctica del razonamiento lógico y la resolución de problemas están en el centro de las actividades realizadas por los programadores. La mejor manera de aprender estas habilidades es practicando mucho, y una de las formas más divertidas de hacerlo es usando juegos. La gamificación en la docencia ha mostrado muchos beneficios en todo tipo de áreas, por ejemplo salud, construcción, in- geniería y en programación. En este trabajo de final de grado, se ha desarrollado un juego de navegador simple para que los estudiantes que están comenzando a aprender progra- mación puedan usar para practicar las habilidades de pensamiento computacional. El juego consta de 12 niveles, y consiste en un robot que debe alcanzar una plataforma final para superar cada nivel. Este objetivo lo va a conseguir mediante una serie de instruccio- nes que respetan la sintaxis del lenguaje Python. Para evaluar este juego, se han seleccionado a 30 personas de diferentes perfiles para usar el juego y valorar su posible impacto mediante un cuestionario. Los resultados ob- tenidos evidencian que el juego ha enseñado a las personas inexpertas en pensamiento computacional a desarrollar soluciones para superar los niveles. Aunque los participan- tes sin experiencia en programación no han sido capaces de resolver todos los niveles, ellos sí ha, [EN] People and society are getting more and more dependent on software since it in- creasingly determines our daily live activities on social and business contexts. With the increasing use of software, comes an increasing need for programmers that develop that software. Learning how to program is a complicated process that goes beyond the learn- ing of the syntax of a programming language. Students need to learn how to solve prob- lems with computations, i.e. learn computational thinking. Having a sound concep- tual process becomes a need. For that reason, practicing logical reasoning and problem- solving are at the center of the activities performed by programmers. The best way to learn these skills is by practicing a lot, and one of the most fun way to do that is by using games. Gamification has shown many benefits in all kind of areas, as health, construction sector, engineering and programming. In this final degree work we will develop a simple browser game that students that are starting to learn program- ming can use it to practice with computational thinking skills. The game has 12 different levels, and in order to complete these levels, a robot must reach the final platform in each level. This objective will be accomplished by executing some instructions by using Python syntax. To evaluate the game, we have selected 30 people with different profiles to use the game and evaluate its impact by a questionnaire. The results obtained provide evidence about that the game was useful for inexpert people to start developing a computational thinking in order to accomplish some levels. Altough users not experimented in pro- gramming weren¿t able to complete all the levels, they could solve more than a half of the levels. All players agreed that they spent a funny time playing the game. Finally, we can conclude that games as a learning technique are useful and they allow to generate more interest in programming concepts, for experimented and not experi- mented people., [CA] Les persones i la societat s’estan tornant cada vegada més dependents del software, ja que aquest determina cada vegada més les nostres activitats de la vida diària tant en l’àmbit social com en l’empresarial. Amb l’ús cada vegada major de software, existeix una creixent necessitat de programadors que desenvolupen aqueix programari. Aprendre a programar és un procés complex que va més enllà de l’aprenentatge de la sintaxi d’un llenguatge de programació. Els estudiants han d’aprendre a resoldre problemes a través de computacions, és a dir, pensament computacional. Un procés de conceptualització eficient es converteix en un requisit essencial. La pràctica del raonament lògic i la resolució de problemes estan en el centre de les activitats realitzades pels programadors. La millor manera d’aprendre aquestes habilitats és practicant molt, i una de les formes més divertides de fer-ho és usant jocs. La ludificació en la docència ha mostrat molts beneficis en tota mena d’àrees, per exemple salut, construcció, enginyeria i en programació. En aquest treball final de grau, s’ha desenvolupat un joc de navegador simple que els estudiants que estan començant a aprendre programació poden usar per a practicar amb habilitats de pensament computacional. El joc consta de 12 nivells, i consisteix en un robot que ha d’aconseguir una plataforma final per a superar cada nivell. Aquest objectiu l’aconseguirà mitjançant una sèrie d’instruccions que respecten la sintaxi del llenguatge Python. Per a avaluar aquest joc, s’ha creat un formulari i s’han seleccionat 30 persones de diferents perfils per a veure l’impacte del joc. Pels resultats obtinguts, el joc ha ensenyat a les persones inexpertes en pensament computacional a desenvolupar solucions per a superar els nivells. Encara que els participants sense experiència en programació no han sigut capaces de resoldre tots els nivells, han sigut capaços de resoldre més de la meitat d’ells. En el que coincideixen pràcticament tots els partici

[ES] Las personas y la sociedad se están volviendo cada vez más dependientes del soft- ware, ya que éste determina cada vez más nuestras actividades de la vida diaria tanto en el ámbito social como en el empresarial. Con el uso cada vez mayor de software, exis- te una creciente necesidad de programadores que desarrollen ese software. Aprender a programar es un proceso complejo que va más allá del aprendizaje de la sintaxis de un lenguaje de programación. Los estudiantes deben aprender a resolver problemas a través de computaciones, es decir, pensamiento computacional. Un proceso de concep- tualización eficiente se convierte en un requisito esencial. Es por esto que la práctica del razonamiento lógico y la resolución de problemas están en el centro de las actividades realizadas por los programadores. La mejor manera de aprender estas habilidades es practicando mucho, y una de las formas más divertidas de hacerlo es usando juegos. La gamificación en la docencia ha mostrado muchos beneficios en todo tipo de áreas, por ejemplo salud, construcción, in- geniería y en programación. En este trabajo de final de grado, se ha desarrollado un juego de navegador simple para que los estudiantes que están comenzando a aprender progra- mación puedan usar para practicar las habilidades de pensamiento computacional. El juego consta de 12 niveles, y consiste en un robot que debe alcanzar una plataforma final para superar cada nivel. Este objetivo lo va a conseguir mediante una serie de instruccio- nes que respetan la sintaxis del lenguaje Python. Para evaluar este juego, se han seleccionado a 30 personas de diferentes perfiles para usar el juego y valorar su posible impacto mediante un cuestionario. Los resultados ob- tenidos evidencian que el juego ha enseñado a las personas inexpertas en pensamiento computacional a desarrollar soluciones para superar los niveles. Aunque los participan- tes sin experiencia en programación no han sido capaces de resolver todos los niveles, ellos sí ha, [EN] People and society are getting more and more dependent on software since it in- creasingly determines our daily live activities on social and business contexts. With the increasing use of software, comes an increasing need for programmers that develop that software. Learning how to program is a complicated process that goes beyond the learn- ing of the syntax of a programming language. Students need to learn how to solve prob- lems with computations, i.e. learn computational thinking. Having a sound concep- tual process becomes a need. For that reason, practicing logical reasoning and problem- solving are at the center of the activities performed by programmers. The best way to learn these skills is by practicing a lot, and one of the most fun way to do that is by using games. Gamification has shown many benefits in all kind of areas, as health, construction sector, engineering and programming. In this final degree work we will develop a simple browser game that students that are starting to learn program- ming can use it to practice with computational thinking skills. The game has 12 different levels, and in order to complete these levels, a robot must reach the final platform in each level. This objective will be accomplished by executing some instructions by using Python syntax. To evaluate the game, we have selected 30 people with different profiles to use the game and evaluate its impact by a questionnaire. The results obtained provide evidence about that the game was useful for inexpert people to start developing a computational thinking in order to accomplish some levels. Altough users not experimented in pro- gramming weren¿t able to complete all the levels, they could solve more than a half of the levels. All players agreed that they spent a funny time playing the game. Finally, we can conclude that games as a learning technique are useful and they allow to generate more interest in programming concepts, for experimented and not experi- mented people., [CA] Les persones i la societat s’estan tornant cada vegada més dependents del software, ja que aquest determina cada vegada més les nostres activitats de la vida diària tant en l’àmbit social com en l’empresarial. Amb l’ús cada vegada major de software, existeix una creixent necessitat de programadors que desenvolupen aqueix programari. Aprendre a programar és un procés complex que va més enllà de l’aprenentatge de la sintaxi d’un llenguatge de programació. Els estudiants han d’aprendre a resoldre problemes a través de computacions, és a dir, pensament computacional. Un procés de conceptualització eficient es converteix en un requisit essencial. La pràctica del raonament lògic i la resolució de problemes estan en el centre de les activitats realitzades pels programadors. La millor manera d’aprendre aquestes habilitats és practicant molt, i una de les formes més divertides de fer-ho és usant jocs. La ludificació en la docència ha mostrat molts beneficis en tota mena d’àrees, per exemple salut, construcció, enginyeria i en programació. En aquest treball final de grau, s’ha desenvolupat un joc de navegador simple que els estudiants que estan començant a aprendre programació poden usar per a practicar amb habilitats de pensament computacional. El joc consta de 12 nivells, i consisteix en un robot que ha d’aconseguir una plataforma final per a superar cada nivell. Aquest objectiu l’aconseguirà mitjançant una sèrie d’instruccions que respecten la sintaxi del llenguatge Python. Per a avaluar aquest joc, s’ha creat un formulari i s’han seleccionat 30 persones de diferents perfils per a veure l’impacte del joc. Pels resultats obtinguts, el joc ha ensenyat a les persones inexpertes en pensament computacional a desenvolupar solucions per a superar els nivells. Encara que els participants sense experiència en programació no han sigut capaces de resoldre tots els nivells, han sigut capaços de resoldre més de la meitat d’ells. En el que coincideixen pràcticament tots els partici

[ES] Las personas y la sociedad se están volviendo cada vez más dependientes del soft- ware, ya que éste determina cada vez más nuestras actividades de la vida diaria tanto en el ámbito social como en el empresarial. Con el uso cada vez mayor de software, exis- te una creciente necesidad de programadores que desarrollen ese software. Aprender a programar es un proceso complejo que va más allá del aprendizaje de la sintaxis de un lenguaje de programación. Los estudiantes deben aprender a resolver problemas a través de computaciones, es decir, pensamiento computacional. Un proceso de concep- tualización eficiente se convierte en un requisito esencial. Es por esto que la práctica del razonamiento lógico y la resolución de problemas están en el centro de las actividades realizadas por los programadores. La mejor manera de aprender estas habilidades es practicando mucho, y una de las formas más divertidas de hacerlo es usando juegos. La gamificación en la docencia ha mostrado muchos beneficios en todo tipo de áreas, por ejemplo salud, construcción, in- geniería y en programación. En este trabajo de final de grado, se ha desarrollado un juego de navegador simple para que los estudiantes que están comenzando a aprender progra- mación puedan usar para practicar las habilidades de pensamiento computacional. El juego consta de 12 niveles, y consiste en un robot que debe alcanzar una plataforma final para superar cada nivel. Este objetivo lo va a conseguir mediante una serie de instruccio- nes que respetan la sintaxis del lenguaje Python. Para evaluar este juego, se han seleccionado a 30 personas de diferentes perfiles para usar el juego y valorar su posible impacto mediante un cuestionario. Los resultados ob- tenidos evidencian que el juego ha enseñado a las personas inexpertas en pensamiento computacional a desarrollar soluciones para superar los niveles. Aunque los participan- tes sin experiencia en programación no han sido capaces de resolver todos los niveles, ellos sí ha, [EN] People and society are getting more and more dependent on software since it in- creasingly determines our daily live activities on social and business contexts. With the increasing use of software, comes an increasing need for programmers that develop that software. Learning how to program is a complicated process that goes beyond the learn- ing of the syntax of a programming language. Students need to learn how to solve prob- lems with computations, i.e. learn computational thinking. Having a sound concep- tual process becomes a need. For that reason, practicing logical reasoning and problem- solving are at the center of the activities performed by programmers. The best way to learn these skills is by practicing a lot, and one of the most fun way to do that is by using games. Gamification has shown many benefits in all kind of areas, as health, construction sector, engineering and programming. In this final degree work we will develop a simple browser game that students that are starting to learn program- ming can use it to practice with computational thinking skills. The game has 12 different levels, and in order to complete these levels, a robot must reach the final platform in each level. This objective will be accomplished by executing some instructions by using Python syntax. To evaluate the game, we have selected 30 people with different profiles to use the game and evaluate its impact by a questionnaire. The results obtained provide evidence about that the game was useful for inexpert people to start developing a computational thinking in order to accomplish some levels. Altough users not experimented in pro- gramming weren¿t able to complete all the levels, they could solve more than a half of the levels. All players agreed that they spent a funny time playing the game. Finally, we can conclude that games as a learning technique are useful and they allow to generate more interest in programming concepts, for experimented and not experi- mented people., [CA] Les persones i la societat s’estan tornant cada vegada més dependents del software, ja que aquest determina cada vegada més les nostres activitats de la vida diària tant en l’àmbit social com en l’empresarial. Amb l’ús cada vegada major de software, existeix una creixent necessitat de programadors que desenvolupen aqueix programari. Aprendre a programar és un procés complex que va més enllà de l’aprenentatge de la sintaxi d’un llenguatge de programació. Els estudiants han d’aprendre a resoldre problemes a través de computacions, és a dir, pensament computacional. Un procés de conceptualització eficient es converteix en un requisit essencial. La pràctica del raonament lògic i la resolució de problemes estan en el centre de les activitats realitzades pels programadors. La millor manera d’aprendre aquestes habilitats és practicant molt, i una de les formes més divertides de fer-ho és usant jocs. La ludificació en la docència ha mostrat molts beneficis en tota mena d’àrees, per exemple salut, construcció, enginyeria i en programació. En aquest treball final de grau, s’ha desenvolupat un joc de navegador simple que els estudiants que estan començant a aprendre programació poden usar per a practicar amb habilitats de pensament computacional. El joc consta de 12 nivells, i consisteix en un robot que ha d’aconseguir una plataforma final per a superar cada nivell. Aquest objectiu l’aconseguirà mitjançant una sèrie d’instruccions que respecten la sintaxi del llenguatge Python. Per a avaluar aquest joc, s’ha creat un formulari i s’han seleccionat 30 persones de diferents perfils per a veure l’impacte del joc. Pels resultats obtinguts, el joc ha ensenyat a les persones inexpertes en pensament computacional a desenvolupar solucions per a superar els nivells. Encara que els participants sense experiència en programació no han sigut capaces de resoldre tots els nivells, han sigut capaços de resoldre més de la meitat d’ells. En el que coincideixen pràcticament tots els partici

[ES] El grupo de Software Testing and Quality (STaQ) del centro de investigación PROS de la Universidad Politécnica de Valencia (UPV) ha desarrollado una herramienta, denominada TESTAR (www.testar.org) para el testing automatizada a nivel de Interfaz de Usuaria (IU). TESTAR es una herramienta "scriptless", no hace falta desarrollar scripts para le especificación de test cases. TESTAR genera y ejecuta casos de prueba automáticamente basado en un modelo de árbol derivado automáticamente desde la IU de la aplicación bajo prueba. Este árbol es construido con ayuda del API de accesibilidad del sistema operativo o el Selenium Webdriver que ayuda a reconocer todos los elementos gráficos de la IU (widgets). Varias empresas que han deplorado la herramienta y están muy positivos y lo ven como un cambio de paradigma del testing a largo plazo que tiene el potencial de resolver muchos problemas que tienen las herramientas existentes. En la actualidad hay dos proyectos EU en ejecucion que extienden y evalúan la herramienta. DECODER(https://www.decoder-project.eu/) y iv4XR (https://iv4xr-project.eu/). Este trabajo TFM encajara en uno de los dos proyectos, lo que significa que trabajaras en un entorno internacional. El funcionamiento básico de testeo de la herramienta TESTAR sigue una secuencia de pasos: 1. Arrancar el sistema que estamos testeando. 2. Obtener el estado de la IU (escanear IU y obtener árbol de widgets). Calcular los widgets visibles en la IU actual junto a sus propiedades como la posición, el tamaño, el foco, etc. y representarlos como modelo en forma de un árbol de widgets. 3. Derivar un conjunto de acciones sensibles (p.e. clicks, entrada de datos, gestos, etc.). A partir del estado actual de la IU se determina las acciones que pueden ser ejecutadas. 4. Seleccionar y ejecutar una acción. 5. Aplicar un oráculo para comprobar si el estado del SUT es válido. La última acción ejecutada a través de la IU del estado anterior puede ser comprobada desde el estado actual, [EN] TESTAR is a black box testing tool that performs automated sequences of tests to other applications, in order to find bugs in their behavior. The task of this work is to modify the way in which this tool makes decisions, with the aim of reducing randomness and achieving a more intelligent execution.

[ES] Adecuación de una aplicación desarrollada con Flutter a las prácticas de DevOps. Para ello se realizará un conjunto de test automáticos para la parte de CI (Continuous Integration) con las herramientas "Flutter Driver" (Scripted) y "TESTAR" (Scriptless) estudiando la complementariedad de estas dos herramientas. También se realizará la configuración para que haga un despliegue automático para la parte de CD (Continuous Delivery)., [EN] Adaptation of an application developed with Flutter to DevOps practices. For this purpose, a set of automatic tests will be performed for the part of Continuous Integration with "Flutter Driver" (Scripted) and "TESTAR" (Scriptless) studying the complementarity of these two tools. The configuration will also be made to make an automatic deployment for the Continuous Delivery part.

[EN] Context: Over the last 30 years, GUIs have changed considerably, becoming everyday part of our lives through smart phones and other devices. More complex GUIs and multitude of platforms have increased the challenges when testing software through the GUI. Objective: To visualise how the field of automated GUI testing has evolved by studying the growth of the field; types of publications; influential events, papers and authors; collaboration among authors; and trends on GUI testing. Method: To conduct a bibliometric analysis of automated GUI testing by performing a systematic search of primary studies in Scopus from 1990 to 2020. Results: 744 publications were selected as primary studies. The majority of them were conference papers, the most cited paper was published on 2013, and the most published author has 53 papers. Conclusions: Automated GUI testing has continuously grown. Keywords show that testing applied to mobile interfaces will be the trend in next years, along with the integration of Artificial Intelligence and automated exploration techniques.

[EN] Covering all the possible paths of the graphical user interface (GUI) with test scripts would take too much effort and result in serious maintenance issues. We propose complementing scripted testing with scriptless test automation using the open-source TESTAR tool. This paper gives a comprehensive overview of TESTAR and its latest extensions together with the ongoing and future research. With this paper, we hope we can help and encourage other researchers to use TESTAR for their GUI testing-related research and pave the way for an international research agenda in GUI testing built upon stable and open-source infrastructure. © 2021 The Authors. Software Testing, Verification & Reliability published by John Wiley & Sons Ltd.

[EN] Testing is of paramount importance in assuring the quality of software products. Nevertheless, it is not easy to judge which techniques or tools are the most effective. A commonly used surrogate metric to evaluate the effectiveness of testing tools is code coverage, which has been widely used for unit and integration testing. However, for GUI testing approaches, this metric has not been sufficiently investigated. To fill this gap, we run experiments with the TESTAR tool, a scriptless testing tool that automatically generates test cases at the Graphical User Interface (GUI) level. In the experiment, we analyze and compare the obtained code coverage when using four different action selection mechanisms (ASMs) in TESTAR that are used to test three SUTs

[EN] This industry showcase presents experiences on application of testar, an open source tool for scriptless testing through graphical user interface (GUI), to the web applications of Kuveyt T¿urk Participation Bank in Turkey. Kuveyt T¿urk Bank uses Selenium and Appium for regression testing of mobile and internet banking, but the maintenance cost of the test scripts is increasing day by day. Therefore, scriptless GUI testing with testar was evaluated. To provide better support for testing web-based applications, testar was extended with Selenium WebDriver integration, JavaScript support, and other new features. Results show that testar detects GUI elements much better after the improvements, and it was able to find 2 relevant errors that were not identified by existing scripted test cases.

[EN] Testing is of paramount importance in assuring the quality of software products. Nevertheless, it is not easy to judge which techniques or tools are the most effective. A commonly used surrogate metric to evaluate the effectiveness of testing tools is code coverage, which has been widely used for unit and integration testing. However, for GUI testing approaches, this metric has not been sufficiently investigated. To fill this gap, we run experiments with the TESTAR tool, a scriptless testing tool that automatically generates test cases at the Graphical User Interface (GUI) level. In the experiment, we analyze and compare the obtained code coverage when using four different action selection mechanisms (ASMs) in TESTAR that are used to test three SUTs

[EN] Covering all the possible paths of the graphical user interface (GUI) with test scripts would take too much effort and result in serious maintenance issues. We propose complementing scripted testing with scriptless test automation using the open-source TESTAR tool. This paper gives a comprehensive overview of TESTAR and its latest extensions together with the ongoing and future research. With this paper, we hope we can help and encourage other researchers to use TESTAR for their GUI testing-related research and pave the way for an international research agenda in GUI testing built upon stable and open-source infrastructure. © 2021 The Authors. Software Testing, Verification & Reliability published by John Wiley & Sons Ltd.

[EN] Context: Over the last 30 years, GUIs have changed considerably, becoming everyday part of our lives through smart phones and other devices. More complex GUIs and multitude of platforms have increased the challenges when testing software through the GUI. Objective: To visualise how the field of automated GUI testing has evolved by studying the growth of the field; types of publications; influential events, papers and authors; collaboration among authors; and trends on GUI testing. Method: To conduct a bibliometric analysis of automated GUI testing by performing a systematic search of primary studies in Scopus from 1990 to 2020. Results: 744 publications were selected as primary studies. The majority of them were conference papers, the most cited paper was published on 2013, and the most published author has 53 papers. Conclusions: Automated GUI testing has continuously grown. Keywords show that testing applied to mobile interfaces will be the trend in next years, along with the integration of Artificial Intelligence and automated exploration techniques.

[EN] This industry showcase presents experiences on application of testar, an open source tool for scriptless testing through graphical user interface (GUI), to the web applications of Kuveyt T¿urk Participation Bank in Turkey. Kuveyt T¿urk Bank uses Selenium and Appium for regression testing of mobile and internet banking, but the maintenance cost of the test scripts is increasing day by day. Therefore, scriptless GUI testing with testar was evaluated. To provide better support for testing web-based applications, testar was extended with Selenium WebDriver integration, JavaScript support, and other new features. Results show that testar detects GUI elements much better after the improvements, and it was able to find 2 relevant errors that were not identified by existing scripted test cases.

[ES] Adecuación de una aplicación desarrollada con Flutter a las prácticas de DevOps. Para ello se realizará un conjunto de test automáticos para la parte de CI (Continuous Integration) con las herramientas "Flutter Driver" (Scripted) y "TESTAR" (Scriptless) estudiando la complementariedad de estas dos herramientas. También se realizará la configuración para que haga un despliegue automático para la parte de CD (Continuous Delivery)., [EN] Adaptation of an application developed with Flutter to DevOps practices. For this purpose, a set of automatic tests will be performed for the part of Continuous Integration with "Flutter Driver" (Scripted) and "TESTAR" (Scriptless) studying the complementarity of these two tools. The configuration will also be made to make an automatic deployment for the Continuous Delivery part.

[ES] El grupo de Software Testing and Quality (STaQ) del centro de investigación PROS de la Universidad Politécnica de Valencia (UPV) ha desarrollado una herramienta, denominada TESTAR (www.testar.org) para el testing automatizada a nivel de Interfaz de Usuaria (IU). TESTAR es una herramienta "scriptless", no hace falta desarrollar scripts para le especificación de test cases. TESTAR genera y ejecuta casos de prueba automáticamente basado en un modelo de árbol derivado automáticamente desde la IU de la aplicación bajo prueba. Este árbol es construido con ayuda del API de accesibilidad del sistema operativo o el Selenium Webdriver que ayuda a reconocer todos los elementos gráficos de la IU (widgets). Varias empresas que han deplorado la herramienta y están muy positivos y lo ven como un cambio de paradigma del testing a largo plazo que tiene el potencial de resolver muchos problemas que tienen las herramientas existentes. En la actualidad hay dos proyectos EU en ejecucion que extienden y evalúan la herramienta. DECODER(https://www.decoder-project.eu/) y iv4XR (https://iv4xr-project.eu/). Este trabajo TFM encajara en uno de los dos proyectos, lo que significa que trabajaras en un entorno internacional. El funcionamiento básico de testeo de la herramienta TESTAR sigue una secuencia de pasos: 1. Arrancar el sistema que estamos testeando. 2. Obtener el estado de la IU (escanear IU y obtener árbol de widgets). Calcular los widgets visibles en la IU actual junto a sus propiedades como la posición, el tamaño, el foco, etc. y representarlos como modelo en forma de un árbol de widgets. 3. Derivar un conjunto de acciones sensibles (p.e. clicks, entrada de datos, gestos, etc.). A partir del estado actual de la IU se determina las acciones que pueden ser ejecutadas. 4. Seleccionar y ejecutar una acción. 5. Aplicar un oráculo para comprobar si el estado del SUT es válido. La última acción ejecutada a través de la IU del estado anterior puede ser comprobada desde el estado actual, [EN] TESTAR is a black box testing tool that performs automated sequences of tests to other applications, in order to find bugs in their behavior. The task of this work is to modify the way in which this tool makes decisions, with the aim of reducing randomness and achieving a more intelligent execution.

[ES] El grupo de Software Testing and Quality (STaQ) del centro de investigación PROS de la Universidad Politécnica de Valencia (UPV) ha desarrollado una herramienta, denominada TESTAR (www.testar.org) para el testing automatizada a nivel de Interfaz de Usuaria (IU). TESTAR es una herramienta "scriptless", no hace falta desarrollar scripts para le especificación de test cases. TESTAR genera y ejecuta casos de prueba automáticamente basado en un modelo de árbol derivado automáticamente desde la IU de la aplicación bajo prueba. Este árbol es construido con ayuda del API de accesibilidad del sistema operativo o el Selenium Webdriver que ayuda a reconocer todos los elementos gráficos de la IU (widgets). Varias empresas que han deplorado la herramienta y están muy positivos y lo ven como un cambio de paradigma del testing a largo plazo que tiene el potencial de resolver muchos problemas que tienen las herramientas existentes. En la actualidad hay dos proyectos EU en ejecucion que extienden y evalúan la herramienta. DECODER(https://www.decoder-project.eu/) y iv4XR (https://iv4xr-project.eu/). Este trabajo TFM encajara en uno de los dos proyectos, lo que significa que trabajaras en un entorno internacional. El funcionamiento básico de testeo de la herramienta TESTAR sigue una secuencia de pasos: 1. Arrancar el sistema que estamos testeando. 2. Obtener el estado de la IU (escanear IU y obtener árbol de widgets). Calcular los widgets visibles en la IU actual junto a sus propiedades como la posición, el tamaño, el foco, etc. y representarlos como modelo en forma de un árbol de widgets. 3. Derivar un conjunto de acciones sensibles (p.e. clicks, entrada de datos, gestos, etc.). A partir del estado actual de la IU se determina las acciones que pueden ser ejecutadas. 4. Seleccionar y ejecutar una acción. 5. Aplicar un oráculo para comprobar si el estado del SUT es válido. La última acción ejecutada a través de la IU del estado anterior puede ser comprobada desde el estado actual, [EN] TESTAR is a black box testing tool that performs automated sequences of tests to other applications, in order to find bugs in their behavior. The task of this work is to modify the way in which this tool makes decisions, with the aim of reducing randomness and achieving a more intelligent execution.

[EN] Covering all the possible paths of the graphical user interface (GUI) with test scripts would take too much effort and result in serious maintenance issues. We propose complementing scripted testing with scriptless test automation using the open-source TESTAR tool. This paper gives a comprehensive overview of TESTAR and its latest extensions together with the ongoing and future research. With this paper, we hope we can help and encourage other researchers to use TESTAR for their GUI testing-related research and pave the way for an international research agenda in GUI testing built upon stable and open-source infrastructure. © 2021 The Authors. Software Testing, Verification & Reliability published by John Wiley & Sons Ltd.

[EN] Testing is of paramount importance in assuring the quality of software products. Nevertheless, it is not easy to judge which techniques or tools are the most effective. A commonly used surrogate metric to evaluate the effectiveness of testing tools is code coverage, which has been widely used for unit and integration testing. However, for GUI testing approaches, this metric has not been sufficiently investigated. To fill this gap, we run experiments with the TESTAR tool, a scriptless testing tool that automatically generates test cases at the Graphical User Interface (GUI) level. In the experiment, we analyze and compare the obtained code coverage when using four different action selection mechanisms (ASMs) in TESTAR that are used to test three SUTs

[EN] Context: Over the last 30 years, GUIs have changed considerably, becoming everyday part of our lives through smart phones and other devices. More complex GUIs and multitude of platforms have increased the challenges when testing software through the GUI. Objective: To visualise how the field of automated GUI testing has evolved by studying the growth of the field; types of publications; influential events, papers and authors; collaboration among authors; and trends on GUI testing. Method: To conduct a bibliometric analysis of automated GUI testing by performing a systematic search of primary studies in Scopus from 1990 to 2020. Results: 744 publications were selected as primary studies. The majority of them were conference papers, the most cited paper was published on 2013, and the most published author has 53 papers. Conclusions: Automated GUI testing has continuously grown. Keywords show that testing applied to mobile interfaces will be the trend in next years, along with the integration of Artificial Intelligence and automated exploration techniques.

[EN] This industry showcase presents experiences on application of testar, an open source tool for scriptless testing through graphical user interface (GUI), to the web applications of Kuveyt T¿urk Participation Bank in Turkey. Kuveyt T¿urk Bank uses Selenium and Appium for regression testing of mobile and internet banking, but the maintenance cost of the test scripts is increasing day by day. Therefore, scriptless GUI testing with testar was evaluated. To provide better support for testing web-based applications, testar was extended with Selenium WebDriver integration, JavaScript support, and other new features. Results show that testar detects GUI elements much better after the improvements, and it was able to find 2 relevant errors that were not identified by existing scripted test cases.

[ES] Adecuación de una aplicación desarrollada con Flutter a las prácticas de DevOps. Para ello se realizará un conjunto de test automáticos para la parte de CI (Continuous Integration) con las herramientas "Flutter Driver" (Scripted) y "TESTAR" (Scriptless) estudiando la complementariedad de estas dos herramientas. También se realizará la configuración para que haga un despliegue automático para la parte de CD (Continuous Delivery)., [EN] Adaptation of an application developed with Flutter to DevOps practices. For this purpose, a set of automatic tests will be performed for the part of Continuous Integration with "Flutter Driver" (Scripted) and "TESTAR" (Scriptless) studying the complementarity of these two tools. The configuration will also be made to make an automatic deployment for the Continuous Delivery part.

[EN] Companies are facing constant pressure towards shorter release cycles while still maintaining a high level of quality. Agile development, continuous integration and testing are commonly used quality assurance techniques applied in industry. Increasing the level of test automation is a key ingredient to address the short release cycles. Testing at the graphical user interface (GUI) level is challenging to automate, and therefore many companies still do this manually. To help find solutions for better GUI test automation, academics are researching scriptless GUI testing to complement the script-based approach. In order to better match industrial problems with academic results, more academia-industry collaborations for case-based evaluations are needed. This paper describes such an initiative to improve, transfer and integrate an academic scriptless GUI testing tool TESTAR into the CI pipeline of a Spanish company Prodevelop. The paper describes the steps taken, the outcome, the challenges, and some lessons learned for successful industry-academia collaboration.

[EN] Companies are facing constant pressure towards shorter release cycles while still maintaining a high level of quality. Agile development, continuous integration and testing are commonly used quality assurance techniques applied in industry. Increasing the level of test automation is a key ingredient to address the short release cycles. Testing at the graphical user interface (GUI) level is challenging to automate, and therefore many companies still do this manually. To help find solutions for better GUI test automation, academics are researching scriptless GUI testing to complement the script-based approach. In order to better match industrial problems with academic results, more academia-industry collaborations for case-based evaluations are needed. This paper describes such an initiative to improve, transfer and integrate an academic scriptless GUI testing tool TESTAR into the CI pipeline of a Spanish company Prodevelop. The paper describes the steps taken, the outcome, the challenges, and some lessons learned for successful industry-academia collaboration.

[EN] Traversal-based automated software testing involves testing an application via its graphical user interface (GUI) and thereby taking the user's point of view and executing actions in a human-like manner. These actions are decided on the fly, as the software under test (SUT) is being run, as opposed to being set up in the form of a sequence prior to the testing, a sequence that is then used to exercise the SUT. In practice, random choice is commonly used to decide which action to execute at each state (a procedure commonly referred to as monkey testing), but a number of alternative mechanisms have also been proposed in the literature. Here we propose using genetic programming (GP) to evolve such an action selection strategy, defined as a list of IF-THEN rules. Genetic programming has proved to be suited for evolving all sorts of programs, and rules in particular, provided adequate primitives (functions and terminals) are defined. These primitives must aim to extract the most relevant information from the SUT and the dynamics of the testing process. We introduce a number of such primitives suited to the problem at hand and evaluate their usefulness based on various metrics. We carry out experiments and compare the results with those obtained by random selection and also by Q-learning, a reinforcement learning technique. Three applications are used as Software Under Test (SUT) in the experiments. The analysis shows the potential of GP to evolve action selection strategies.

[EN] Traversal-based automated software testing involves testing an application via its graphical user interface (GUI) and thereby taking the user's point of view and executing actions in a human-like manner. These actions are decided on the fly, as the software under test (SUT) is being run, as opposed to being set up in the form of a sequence prior to the testing, a sequence that is then used to exercise the SUT. In practice, random choice is commonly used to decide which action to execute at each state (a procedure commonly referred to as monkey testing), but a number of alternative mechanisms have also been proposed in the literature. Here we propose using genetic programming (GP) to evolve such an action selection strategy, defined as a list of IF-THEN rules. Genetic programming has proved to be suited for evolving all sorts of programs, and rules in particular, provided adequate primitives (functions and terminals) are defined. These primitives must aim to extract the most relevant information from the SUT and the dynamics of the testing process. We introduce a number of such primitives suited to the problem at hand and evaluate their usefulness based on various metrics. We carry out experiments and compare the results with those obtained by random selection and also by Q-learning, a reinforcement learning technique. Three applications are used as Software Under Test (SUT) in the experiments. The analysis shows the potential of GP to evolve action selection strategies.

We wil describe the current state of the art of GUI test automation with scripts, i.e Capture & Replay and VGT. The scriptless based testing like it is done by TESTAR will be explained.

We will explain what TESTAR can do for you out of the box.

We wil describe the current state of the art of GUI test automation with scripts, i.e Capture & Replay and VGT. The scriptless based testing like it is done by TESTAR will be explained.

This video explains how to get started with the TESTAR tool.

We will show how to set up TESTAR for your own System Under Test.

This video explains how to get started with the TESTAR tool.

We will discuss what Graphical User Interfaces (GUI) are and how they are composed of widgets. We will define GUI states, widget trees and how user actions induce state changes. It will be explained what GUI test suites are composed of and why it is needed to automate the execution of these test suites.

We will explain what TESTAR can do for you out of the box.

We will explain what TESTAR can do for you out of the box.

We wil describe the current state of the art of GUI test automation with scripts, i.e Capture & Replay and VGT. The scriptless based testing like it is done by TESTAR will be explained.

We will discuss what Graphical User Interfaces (GUI) are and how they are composed of widgets. We will define GUI states, widget trees and how user actions induce state changes. It will be explained what GUI test suites are composed of and why it is needed to automate the execution of these test suites.

We will show how to set up TESTAR for your own System Under Test.

We will discuss what Graphical User Interfaces (GUI) are and how they are composed of widgets. We will define GUI states, widget trees and how user actions induce state changes. It will be explained what GUI test suites are composed of and why it is needed to automate the execution of these test suites.

This video explains how to get started with the TESTAR tool.

We will explain what TESTAR can do for you out of the box.

We will show how to set up TESTAR for your own System Under Test.

This video explains how to get started with the TESTAR tool.

We will show how to set up TESTAR for your own System Under Test.

We will discuss what Graphical User Interfaces (GUI) are and how they are composed of widgets. We will define GUI states, widget trees and how user actions induce state changes. It will be explained what GUI test suites are composed of and why it is needed to automate the execution of these test suites.

[ES] El grupo de Software Testing and Quality (STaQ) del centro de investigación PROS de la Universidad Politécnica de Valencia (UPV) ha desarrollado una herramienta, denominada TESTAR (www.testar.org) para el testing automatizada a nivel de Interfaz de Usuario (IU). TESTAR genera y ejecuta casos de prueba automáticamente basado en un modelo de árbol derivado automáticamente desde la IU de la aplicación bajo prueba. Este árbol es construido con ayuda del API de accesibilidad del sistema operativo que ayuda a reconocer todos los elementos gráficos de la IU (widgets). La herramienta no es del tipo capturar/reproducir ni usa reconocimientos de formas. Las empresas que han desplegado la herramienta son muy optimistas y lo ven como un cambio de paradigma del testing a largo plazo, pues tiene potencial para resolver muchos de los problemas de las herramientas existentes. En este proyecto el objetivo es extender e implementar la capacidad de reconocimiento de widgets (elementos gráficos de Interfaz de Usuario) de la herramienta TESTAR para aplicaciones Java en sistemas operativos Microsoft Windows. Esta herramienta facilita el testeo automático de aplicaciones software desde su Interfaz de Usuario (IU), pero actualmente se ha identificado una limitación en el reconocimiento de widgets cuando la tecnología Java utilizada es Swing, funcionando sin problemas para AWT y SWT. TESTAR se sustenta en tecnologías de accesibilidad que exponen los widgets de las aplicaciones software. El carácter “lightweight” en la implementación de Swing provoca que los widgets Swing no sean identificados por tecnologías de accesiblidad. Para apoyar la accesbilidad de aplicaciones Swing existe un puente denominado Java Access Bridge que expone el API de accesibilidad de Java en una librería dinámica (DLL) de Windows: http://www.oracle.com/technetwork/articles/javase/index-jsp-136191.html Por tanto, la labor del proyecto será: • Estudiar el puente Java Access Bridge para facilitar el reconocimiento, [EN] The Software Testing and Quality (STAQ) group of the PROS research center at the Polytechnic University of Valencia (UPV) has developed a tool, called TESTAR (www.testar.org) for automated testing at the user interface level (UI) . TESTAR generates and executes test cases automatically based on a tree model automatically derived from the UI of the application under test. This tree is built using the Accessibility API of the operating system that helps to recognize all graphical UI elements (widgets). The tool is not capture / replay nor uses image recognition. Companies that have deployed the tool are very positive and see it as a paradigm shift for testing. They believe that TESTAR has the potential to solve many problems with existing tools. In this project the aim is to extend and implement the recognizability of widgets (graphical elements of the User Interface) of the TESTAR tool for Java applications in Microsoft Windows operating systems. TESTAR has a limitation regarding the recognition of widgets when the Java technology Swing is used (it runs smoothly for AWT and SWT). TESTAR is based on accessibility technologies that expose widgets of the software application under test. The "lightweight" character of Swing makes that some Swing elements are not correctly identified by accessibility technologies . To support the application accesbilidad for Swing there is a bridge called Java Access Bridge exposes the Java Accessibility API in a dynamic link library (DLL) for Windows: http://www.oracle.com/technetwork/articles/javase/index-jsp-136191.html Therefore, the work of the project will be: • Study the Java Access Bridge bridge to facilitate recognition of widgets automatically in Java / Swing applications. • Implement a plug-in for TESTAR to enrich the tool with recognition of Swing widgets, in addition to the current support for AWT and SWT technologies. • Assess the capacity of TESTAR in Java / Swing with two case studies with industrial applications. (Cu