Search

Chapter 8 presents some techniques for combining basic user experience (UX) metrics, such as task success, time on task, and subjective ratings, to form new metrics or an overall “usability score.” An easy way to combine different usability metrics is to determine the percentage of users who achieve a combination of goals. This tells you the overall percentage of users who had a good experience with your product (based on the target goals). This method can be used with any set of metrics and is easily understood by management. One way of combining different metrics into an overall “usability score” is to convert each of the metrics to a percentage and then average them together. This requires being able to specify, for each metric, an appropriate minimum and maximum value. Another way to combine different metrics is to convert each metric to a z score and then average them together. Using z scores, each metric gets equal weight when they are combined, but the overall average of the z scores will always be 0. This metric is useful in comparing different subsets of the data to each other, such as data from different iterations, different groups, or different conditions. The Single Usability Metric (SUM) technique is another method for combining different metrics, specifically task completion, task time, errors, and task-level satisfaction rating. The method requires entry of individual task and participant data for the four metrics. The calculations yield a SUM score, as a percentage, for each task and across all tasks, including confidence intervals. Various types of graphs and charts can be useful for summarizing the results of a usability test in a “usability scorecard.” A combination line and column chart is useful for summarizing the results of two metrics for the tasks in a test. Radar charts are useful for summarizing the results of three or more metrics overall. A comparison chart using Harvey Balls to represent different levels of the metrics can summarize the results effectively for three or more metrics at the task level. Perhaps the best way to determine the success of a usability test is to compare the results to a set of predefined usability goals. Typically these goals address task completion, time, accuracy, and satisfaction. The percentage of users whose data met the stated goals can be a very effective summary. A reasonable alternative to comparing to predefined goals, especially for time data, is to compare actual performance data to the data for experts. The closer the actual performance is to expert performance, the better.

Risk management is considered as a critical project management activity that needs to be performed for successful software development. Within risk management, risk prioritization is an important process which helps the software team to effectively manage the risks at early stage of the project. In agile-based software environment, it is necessary to prioritize the risks in an effective manner in order to address the risks in shorter duration of time. In recent times, swarm intelligence techniques are widely popular in solving various optimization problems in software development process. The main reason is due to its convergence accuracy toward global optimal solution and faster computational time. In this study, an efficient risk prioritization technique termed as ARP–GWO (agile risk prioritization–grey wolf optimization) has been proposed for prioritizing the risk factors present in the agile software development using grey wolf optimization (GWO). The proposed ARP–GWO method helps the organization to mitigate the risks and ensures successful delivery of software products with good quality, in lesser cost and time. The effectiveness of ARP–GWO is analyzed using two performance metrics, namely Index of Integration and Usability Goals Achievement Metric, for which case studies are performed on five industrial projects from two different organizations. The experimental results indicate that ARP–GWO is most effective in prioritization of risks and offers better enhancement with high degree of satisfaction among developers and users as compared with the existing agile process.

Η παρούσα διατριβή πραγματεύεται το πρόβλημα της αποτελεσματικής αξιολόγησης ευχρηστίας φορητών εφαρμογών. Με τον όρο “φορητές εφαρμογές” περιγράφονται οι ηλεκτρονικές υπηρεσίες που είναι σχεδιασμένες να παρέχονται μέσω φορητών συσκευών και έχουν ως στόχο να βοηθήσουν τον άνθρωπο στις καθημερινές του προσωπικές ή επαγγελματικές δραστηριότητες. Η αλληλεπίδραση ενός χρήστη με μία τέτοια ηλεκτρονική υπηρεσία είναι μια διαδικασία πολύπλοκη που δεν υποστηρίζεται από μία μεμονωμένη εφαρμογή και δεν περιορίζεται πλέον στα στενά όρια ενός γραφείου. Αντίθετα, επιτυγχάνεται με διαμεσολάβηση σύγχρονων και συχνά πολυχρηστικών υπολογιστικών μονάδων (φορητές συσκευές, υπολογιστές) και επιμέρους συσκευών και λαμβάνει χώρα σε διάφορα φυσικά περιβάλλοντα. Σε πολλές περιπτώσεις εμπλέκει περισσότερους από έναν χρήστες οι οποίοι μπορεί να συνεργάζονται είτε εκ του σύνεγγυς είτε εξ αποστάσεως προκειμένου να εκτελέσουν μια εργασία. Η μελέτη αυτής της αλληλεπίδρασης μπορεί να δώσει πολύτιμα συμπεράσματα τόσο για την ευκολία χρήσης των σύγχρονων υπολογιστικών συστημάτων όσο και για τη χρησιμότητά τους και αποτελεί μια σημαντική ερευνητική πρόκληση του επιστημονικού πεδίου Αλληλεπίδρασης Ανθρώπου Υπολογιστή και ιδιαίτερα της Τεχνολογίας Ευχρηστίας. Οι κλασσικές μέθοδοι ευχρηστίας καλούνται να αντιμετωπίσουν την πρόκληση της επιτυχούς αξιολόγησης των φορητών εφαρμογών, δηλαδή της αποτίμησης των χαρακτηριστικών ποιότητάς τους που επηρεάζουν την εμπειρία χρήσης τους. Τόσο τα χαρακτηριστικά των χρησιμοποιούμενων συσκευών όσο και το περιβάλλον χρήσης των εφαρμογών αυτών, τις διαφοροποιούν κατά πολύ από τις εφαρμογές επιτραπέζιου υπολογιστή. Καθώς η διείσδυσή τους στις καθημερινές δραστηριότητες του ανθρώπου είναι ολοένα και αυξανόμενη, η ανάγκη για μεθοδολογίες και εργαλεία που μπορούν να βοηθήσουν την αξιολόγηση της χρήσης τους κρίνεται επιτακτική. Στην παρούσα εργασία καταρχήν περιγράφονται οι κλασσικές μέθοδοι αξιολόγησης υπολογιστικών συστημάτων και στη συνέχεια αξιολογούνται ως προς την επάρκεια των δεδομένων που μπορούν να συλλέξουν και την πληρότητα των αποτελεσμάτων που μπορούν να δώσουν στην περίπτωση χρήσης τους για αξιολόγηση ευχρηστίας φορητών εφαρμογών. Παράλληλα γίνεται επισκόπηση της βιβλιογραφίας που αφορά την αξιολόγηση ευχρηστίας των φορητών εφαρμογών και εξετάζονται τα κυριότερα ζητήματα της μεθόδου αξιολόγησης, περιλαμβάνοντας μεταξύ άλλων την επιλογή του χώρου αξιολόγησης και τα δεδομένα που πρέπει να συλλεγούν και αναλυθούν. Στη συνέχεια προτείνεται η μεθοδολογία αξιολόγησης ευχρηστίας φορητών εφαρμογών MOBELIC (MOBile Evaluation Life Cycle methodology). Η MOBELIC υποστηρίζει την αξιολόγηση ευχρηστίας μιας φορητής εφαρμογής σε όλο τον κύκλο ανάπτυξής της. Αποτελεί συνδυασμό από υπάρχουσες μεθόδους αξιολόγησης λαμβάνοντας όμως υπόψη τη φάση ανάπτυξης στην οποία βρίσκεται η υπό αξιολόγηση φορητή εφαρμογή, την ποιότητα των αποτελεσμάτων που προκύπτουν από κάθε μέθοδο, το χρόνο και τους πόρους που απαιτούνται για τη διεξαγωγή καθεμιάς από αυτές, καθώς και το χρόνο για την ανάλυση των δεδομένων τους και την εξαγωγή πολύτιμων συμπερασμάτων. Η συνεισφορά της μεθοδολογίας MOBELIC έγκειται στο γεγονός ότι βελτιστοποιεί τη διαδικασία αξιολόγησης μιας φορητής εφαρμογής υποστηρίζοντάς την από τις αρχικές φάσεις ανάπτυξης μέχρι τα τελευταία στάδια ολοκλήρωσής της. Προκειμένου να υποστηριχθεί η μεθοδολογία ΜOBELIC, σχεδιάστηκε και αναπτύχθηκε το εργαλείο ActivityLens. Αποτελεί ένα εργαλείο παρατήρησης και ανάλυσης των δεδομένων που συλλέγονται κατά τη διάρκεια μελετών της αλληλεπίδρασης χρηστών με φορητές εφαρμογές. Το εργαλείο παρέχει τη δυνατότητα παρακολούθησης των διακριτών φάσεων ανάπτυξης μιας φορητής εφαρμογής και επιτρέπει τη σύγκριση των προβλημάτων ευχρηστίας που παρατηρούνται σε αυτές, χρησιμοποιώντας κοινό σχήμα κωδικοποίησης των προβλημάτων. Παράλληλα, ενσωματώνοντας κατάλληλα σχεδιασμένες λειτουργίες, βοηθάει τον αναλυτή να απομονώσει συγκεκριμένους τύπους δράσεων που υποδεικνύουν πρόβλημα στη χρήση των εξεταζόμενων εφαρμογών. Τέλος στα πλαίσια της παρούσας διατριβής, εξετάζεται η εφαρμοσιμότητα της προτεινόμενης μεθοδολογίας καθώς και η αποτελεσματικότητα του εργαλείου ανάλυσης, μέσα από μία μελέτη περίπτωσης που περιλαμβάνει τη διενέργεια 3 διακριτών πειραμάτων. Η αξιολόγηση αφορά μία συνεργατική εκπαιδευτική φορητή εφαρμογή προορισμένη να πληροφορεί μαθητές για τα εκθέματα ενός Μουσείου.

Software applications should be secure, usable and privacy-friendly. However, recurring headlines about data leaks in applications show that it is not so easy to develop software that meets these three challenges. Studies show that it is better to think about these challenges during a software development process. Many ideas and approaches exist in the research community that define these challenges as goals within a software development process. In addition, major companies have published their own software development processes and methods addressing these goals in part. But major companies have very different work conditions compared to a work setting faced by an App-Developer (AD), a Small and Medium Company (SMC) and the Open Source Community (OSC) respectively. This leads us to the question: Are work settings of ADs, SMCs, or the OSCs considered sufficiently by research in order to make software development processes with special focus on security, usability and privacy goals work? Therefore we performed a literature review in order to investigate the current state of research. Using an appropriate query, publications relevant for our question were identified and categorised by two independent reviewers. Our work shows that there are some publications proposing software processes supporting usability goals and taking work settings into account. We were not able to identify any contribution that proposes a software development process which addresses privacy, usability and security goals together and differentiates the work setting of ADs or as found in SMCs and in OSCs respectively.

In 1970, the world overcame the special energy crisis of petroleum. However, since then many people have used solar energy as an alternative energy source. As an alternative source, the use of solar power systems can easily spread throughout the world because of its low maintenance and ease of deployment. But the use of solar cells that have been integrated with the user’s will is not widely available, for example, the use of solar cells that are integrated with smartphones. In connection with this, it will be very easy if the process of monitoring or monitoring the use of solar panel power and the application of smart home technology is done with a computerized system, for example by using an Android-based application. When interacting with the Solar Panel Monitoring Application on Android Smartphones the user must get the same comfort by his experience using other systems. This writing aims to design a Solar Panel Monitoring Application system on android smartphones using the User-Centered Design (UCD) method. The user as the center of the design system development process is called the User-Centered Design (UCD) design philosophy. From the 8 parameters of usability goals and user experience, the average percentage stage is 81%. It means that the design of the system is good.

The development of information technology has impacted the education sector. The use of technology in learning is commonly called E-Learning. In the usage of E-Learning for learning, there 1are usability problems encountered from the registration process which is quite difficult, material that does not fit the user's needs, the learning process that doesn't effective, and the difficulties of finding the searched class. This study aims to produce an interface and test the results of the interface interaction design for ITB E-Learning. The approach used is human-centered design with the ISO 9241-210: 2010 methodology and Google Design Sprint. The result of this study is a high-fidelity prototype created using Adobe XD. The tests have been conducted on ITB students with usability testing and SUS Testing methods. The prototype is successful if it meets the SUS Testing value of 62.5, meets usability goals that are easy to use and can be learned easily, and user experience goals to help and satisfy the users. Based on the results of the tests conducted, there were SUS Test results of 94.17 and 5 out of 6 users rated the prototype as easy to use, easy to learn, satisfying, and assisted users in conducting learning activities.

In recent years, a set of usability requirements for e-voting systems have been put into place. However, there is not a coherent perception of the exact content and scope of these requirements as yet. Various e-voting applications have been created with this very purpose, but they have not been totally effective due to their ease of usability. In order to find out what the critical issues are regarding usability for these types of applications, this paper carries out a study based on the user’s behavior while using two e-voting systems applications. This study has been carried out using the eye tracking technique through which it was possible to identify two problematic areas that affect their ease of use. With this technique, a visual tracking of the user’s eyes is done in order to analyze qualitatively (gaze and heat maps) and quantitatively (statistical) the different tasks that must be performed by the user. The results show that the applications have issues displaying non-relevant information as well as an absence in the system of specific steps in order to complete the process of voting successfully and avoid user mistakes. According to the above, the perception about the security of the system increases if the information included is clearer and understandable to the user.

A world becoming more digitally transformed and connected poses significant challenges for IT organizations, requiring increased attention to the usability of their software products and, consequently, to the systematic establishment of usability engineering (UE) processes. Typically, the establishment of software processes is guided by software process capability/maturity models (SPCMMs), such as CMMI or ISO/IEC 15504. However, it seems that these commonly adopted models do not explicitly cover usability engineering (UE) processes. Thus, a question that arises is, if there exist process capability/maturity models focusing explicitly on usability engineering? If yes, to which degree do they assist in the assessment process? To answer this, we conducted a systematic literature review on usability capability/maturity models (UCMMs). A total of 15 UCMMs were identified and analyzed, synthesizing information on their measurement framework and process reference model, usage support and how they have been developed/validated. We observed that most of the models are based on consolidated SPCMMs, such as CMMI or ISO/IEC 15504. Only few UCMMs customized for specific contexts were found. Although all UCMMs propose or reference a measurement framework, only 5 UCMMs define a proper process reference model. Most of the models also do not offer support for their usage, which may hinder their larger scale adoption in practice. Furthermore, we noted a lack of information on how most of the models have been developed and validated, which leaves their validity questionable. These results indicate the need for further research on UCMMs taking into consideration the increased importance of usability in software product quality.

The e-commerce websites utilized in Turkey are examined using their design parameters.An integrated approach is proposed for the assessment of e-commerce websites.A novel approach is proposed to classify design parameters.The classification is performed based on customer expectations using Fuzzy Kano Model. Websites have gained vital importance for organizations along with the growing competition in the world market. It is known that usability requirements heavily depend on the type, audience and purpose of websites. For the e-commerce environment, usability assessment of a website is required to figure out the impact of website design on customer purchases. Thus, usability assessment and design of online pages have become the subject of many scientific studies. However, in any of these studies, design parameters were not identified in such a detailed way, and they were not classified in line with customer expectations to assess the overall usability of an e-commerce website. This study therefore aims to analyze and classify design parameters according to customer expectations in order to evaluate the usability of e-commerce websites in a more comprehensive manner. Four websites are assessed using the proposed novel approach with respect to the identified design parameters and the usability scores of the websites are examined. It is revealed that the websites with high usability score are more preferred by customers. Therefore, it is indicated that usability of e-commerce websites affects customer purchases.

Background Radiology processes are commonly supported by Radiology Information System (RIS), Picture Archiving and Communication System (PACS) and other software for radiology. However, these information technologies can present usability problems that affect the performance of radiologists and physicians, especially considering the complexity of the tasks involved. Objectives The purpose of this study was to extract, classify and analyze qualitatively the usability problems in PACS, RIS and other software for radiology. Method A systematic review was performed to extract usability problems reported in empirical usability studies in the literature. The usability problems were categorized as violations of Nielsen and Molich’s usability heuristics. Results The qualitative analysis indicated the causes and the effects of the identified usability problems. From the 431 papers initially identified, 10 met the study criteria. The analysis of the papers identified 90 instances of usability problems, classified into categories corresponding to established usability heuristics. The five heuristics with the highest number of instances of usability problems were “Flexibility and efficiency of use”, “Consistency and standards”, “Match between system and the real world”, “Recognition rather than recall” and “Help and documentation”, respectively. Conclusion These problems can make the interaction time consuming, causing delays in tasks, dissatisfaction, frustration, preventing users from enjoying all the benefits and functionalities of the system, as well as leading to more errors and difficulties in carrying out clinical analyses. Furthermore, the present paper showed a lack of studies performed on systems for radiology, especially usability evaluations using formal methods of evaluation involving the final users.

Objective The aim of this study is to identify common usability problematic patterns that belong to top-50 academic websites as a whole and then ranking of these identified usability problems is also provided. Methods In this study, a novel approach is proposed that is based upon the integration of conventional usability testing and heuristic evaluation with data-mining knowledge discovery process. An experiment is conducted to evaluate ISO 9241-151 guidelines under 16-different categories by hundred participants who are frequent users of academic websites. After evaluation, the qualitative usability data is collected and different data-mining techniques i.e. association rule and decision tree are applied to recognize fully functional and problematic usability attributes. Identified problematic attributes represent common usability problems patterns related to academic websites from the qualitative viewpoint only. This study further prioritizes these problematic attributes by using the ranking algorithm that represents the order in which usability issues must be resolved. Results In this study, 16-different categories are considered for usability evaluation of academic websites. The results show that no issues are identified in two-categories i.e. {Headings_Titles_Labels and The Home_Page}. In Scrolling and Paging category, horizontal scrolling is identified as a major issue whereas, in Internationalization category, the users do not identify supported languages on most of the academic websites. Users do not find websites to be highly secured under Security category. Our findings investigate that most of the issues are found in Search and Social Media categories. Furthermore, users easily locate 50.53% guidelines on websites as fully functional whereas, 49.46% of characteristics are considered as problematic usability features that are not functional on the academic website as a whole. Conclusions Identification of common usability problems at an early stage can lower substantially the development efforts in cost and time. Software developers can restrain from these potential usability problems during the development of novel systems under the same context. Providing appropriate solutions for these problems can become valuable in software development. The proposed approach concludes that conventional usability evaluation methods can go beyond just than testing of systems. The study is a milestone towards identification and prioritizing problematic usability features for academic websites and helps in providing the wholistic approach of usability problematic patterns for web-domain.

Low provider adoption continues to be a significant barrier to realizing the potential of clinical decision support. "Think Aloud" and "Near Live" usability testing were conducted on two clinical decision support tools. Each was composed of an alert, a clinical prediction rule which estimated risk of either group A Streptococcus pharyngitis or pneumonia and an automatic order set based on risk. The objective of this study was to further understanding of the facilitators of usability and to evaluate the types of additional information gained from proceeding to "Near Live" testing after completing "Think Aloud".This was a qualitative observational study conducted at a large academic health care system with 12 primary care providers. During "Think Aloud" testing, participants were provided with written clinical scenarios and asked to verbalize their thought process while interacting with the tool. During "Near Live" testing participants interacted with a mock patient. Morae usability software was used to record full screen capture and audio during every session. Participant comments were placed into coding categories and analyzed for generalizable themes. Themes were compared across usability methods."Think Aloud" and "Near Live" usability testing generated similar themes under the coding categories visibility, workflow, content, understand-ability and navigation. However, they generated significantly different themes under the coding categories usability, practical usefulness and medical usefulness. During both types of testing participants found the tool easier to use when important text was distinct in its appearance, alerts were passive and appropriately timed, content was up to date, language was clear and simple, and each component of the tool included obvious indicators of next steps. Participant comments reflected higher expectations for usability and usefulness during "Near Live" testing. For example, visit aids, such as automatically generated order sets, were felt to be less useful during "Near-Live" testing because they would not be all inclusive for the visit.These complementary types of usability testing generated unique and generalizable insights. Feedback during "Think Aloud" testing primarily helped to improve the tools' ease of use. The additional feedback from "Near Live" testing, which mimics a real clinical encounter, was helpful for eliciting key barriers and facilitators to provider workflow and adoption.

Usability defects can be found either by formal usability evaluation methods or indirectly during system testing or usage. No matter how they are discovered, these defects must be tracked and reported. However, empirical studies indicate that usability defects are often not clearly and fully described. This study aims to identify the state of the art in reporting of usability defects in the software engineering and usability engineering literature. We conducted a systematic literature review of usability defect reporting drawing from both the usability and software engineering literature from January 2000 until March 2016. As a result, a total of 57 studies were identified, in which we classified the studies into three categories: reporting usability defect information, analysing usability defect data and key challenges . Out of these, 20 were software engineering studies and 37 were usability studies. The results of this systematic literature review show that usability defect reporting processes suffer from a number of limitations, including: mixed data, inconsistency of terms and values of usability defect data, and insufficient attributes to classify usability defects. We make a number of recommendations to improve usability defect reporting and management in software engineering.

The U.S. Department of Veterans Affairs (VA) Human Factors Engineering (HFE) office developed a usability testing method called “Rapid Heuristic Evaluation” (Rapid HE) that offers benefits to users of the Agile development process. Rapid HE addresses the need to combine fast, reliable usability support with feedback from clinical subject matter experts (SMEs) during the design and development of an electronic health record (EHR). The Rapid HE process leverages established EHR heuristics to accelerate wireframe review and approval, and merges a traditional heuristic evaluation (HE) with an expert review by two SMEs. Our application of Rapid HEs has maximized use of resources and minimized the amount of time needed to provide feedback during Agile development cycles. This paper describes the Rapid HE process, deviations from traditional HEs, and reports on data from 16 HEs that our group conducted on an EHR platform currently being developed by VA.

Rationale, aims, and objectives The complexity of an electronic medication administration record (eMAR) has been underestimated by most designers in the past. Usability issues, such as poorly designed user application flow in eMAR, are therefore of vital importance, since they can have a negative impact on nursing activities and result in poor outcomes. The purpose of this study was to evaluate the usability of an eMAR application during its development. Methods A usability evaluation was conducted during the development of the eMAR application. Two usability methods were used: a heuristic evaluation complemented by usability testing. Each eMAR application version provided by the vendor was evaluated by 2 hospital pharmacists, who applied the heuristic method. They reviewed the eMAR tasks, detected usability problems and their heuristic violations, and rated the severity of the usability problems. Usability testing was used to assess the final application version by observing how 3 nurses interacted with the application. Results Thirty-four versions were assessed before the eMAR application was considered usable. During the heuristic evaluation, the usability problems decreased from 46 unique usability problems in version 1 (V1) to 9 in version 34 (V34). In V1, usability problems were categorized into 154 heuristic violations, which decreased to 27 in V34. The average severity rating also decreased from major usability problem (2.96) to no problem (0.23). During usability testing, the 3 nurses did not encounter new usability problems. Conclusion A thorough heuristic evaluation is a good method for obtaining a usable eMAR application. This evaluation points key areas for improvement and decreases usability problems and their severity.

Successfully engaging in a health- or medical-related activity is a matter of understanding what one needs to do. This means information used in this context needs to be easy to use. Accomplishing the goals laid out in the essay will facilitate understanding and allow for effective use. Thus, successful medical and health communication are connected to one central concept: usability. But how to achieve this goal? The answer is through patient-focused design practices that help mirror the experiences of patients who are using such materials. This entry overviews such an approach - which I call patient experience design (PXD) - and explains why such an approach is central to best health and medical communication practices.

Numerous sets of usability heuristics have been designed for specific domains, as traditional heuristics do not evaluate the specific features of particular applications. A substantial portion of the existing research focuses on designing new sets of heuristics, demonstrating the interest in heuristics that might identify specific usability problems for specific application domains. This article presents an exhaustive review of 73 studies related to usability heuristics for specific domains and methodologies; the objective is to identify the approach that is used to create usability heuristics and whether a formal and systematic process is involved. We conducted a systematic literature review of papers published between 2006 and 2016. The review was based on the guidelines proposed by Kitchenham (2007) [13] and shows that most studies use an informal process to develop usability heuristics. The creation of heuristics is mainly based on existing heuristics, literature reviews, usability problems, and guidelines. However, a few studies apply a methodology to define, validate and refine the set of heuristics proposed. Nevertheless, these methodologies should be formalized in order to help the process of creating usability heuristics. Traditional usability heuristics do not evaluate specific features of specific applications.Numerous sets of usability heuristics have been designed for specific domains.The article presents a review of 73 studies related to usability heuristics for specific domains, and their creation.Most studies reviewed use an informal process to develop usability heuristics.A few studies apply formal methodologies to establish usability heuristics.

Considering the importance associated with e-commerce website accessibility and usability, a study on one of the most relevant Portuguese e-commerce websites has been performed using both automatic and manual assessment procedures. In an initial stage, we evaluated the chosen website with a Web accessibility and usability automatic tool called SortSite; after that, we performed a manual evaluation to verify each previously detected error and present possible solutions to overcome those faults. In a third phase, three usability specialists have been used to perform a heuristic evaluation of the chosen website. Finally, user tests with blind people were carried out in order to fully assess the compliance with accessibility and usability guidelines and standards. The results showed that the platform had a good score regarding the automatic evaluation; however, when the heuristic and manual evaluations were performed, some accessibility and usability problems were discovered. Moreover, the user test results showed bad marks regarding efficiency, effectiveness, and satisfaction by the group of participants. As a conclusion, we highlight user interaction problems and propose seven recommendations focused on enhancing accessibility and usability of not only the evaluated e-commerce website, but also of other similar ones.

The Business Process Management field addresses design, improvement, management, support, and execution of business processes. In doing so, we argue that it focuses more on developing modeling notations and process design approaches than on the needs and preferences of the individual who is modeling (i.e., the user). New data-centric process modeling approaches are taken as a relevant and timely stream of process design approaches to test our argument. First, we provide a review of existing data-centric process approaches, culminating in a theoretical classification framework. Next, we empirically evaluate three specific approaches with regard to the claims they make. We had participants representative of actual users try out these approaches on realistic scenarios via a series of workshops. Participants assessed to what extent quality claims from the literature could be recognized within the workshop sessions. The results of this evaluation substantiate a number of claims behind the approaches, but also identify opportunities to further improve them. Most prominently, we found that the usability aspects of all considered approaches are a source of concern. This leads us to the insight that usability aspects of process design approaches are crucial and, in the perception of groups representative of actual users, leave much to be desired. In that sense, our research can be seen as a wake-up call for process modeling notation designers to consider the usability side—and as such, the interest of the human modeler—more than is currently the case.

When an evaluation for detecting usability problems is conducted in low-cost thermostat interfaces, several usability problems can show up in one evaluation, and sometimes results are difficult to interpret to correct those problems. If an expert is not implementing, evaluating, and analyzing the test, part of the information could be lost. In addition, designers of interfaces need support in order to provide the most important usability problems. On the other hand, it is important that consumers of low-cost thermostat interfaces use the interface in a correct manner to save energy and time when they are installing and programming the thermostat. Therefore, the usability problems must be eliminated in interfaces before the consumer uses the interface. Thus, the critical usability problems, which drive thermostats to a catastrophe usability problem in the interfaces, have to be found and solved during the design stage to get a successful interface design in the early stages. This paper presents a framework based on information from experts and consumers to solve usability problems. Moreover, it gives a structure and guidelines for designing and evaluating thermostat interfaces. This proposal assumes that it is possible to use information from experts and consumers for detecting and solving usability problems. The framework includes information from experts who rank the usability problems, and then this information is used to design the time on task and success rate evaluations for end users during the design process.

This article presents an evaluation of novel display concepts for an emergency department information system (EDIS) designed using cognitive systems engineering methods. EDISs assist emergency medicine staff with tracking patient care and ED resource allocation. Participants performed patient planning and orientation tasks using the EDIS displays and rated the display’s ability to support various cognitive performance objectives along with the usability, usefulness, and predicted frequency of use for 18 system components. Mean ratings were positive for cognitive performance support objectives, usability, usefulness, and frequency of use, demonstrating the successful application of design methods to create useful and usable EDIS concepts that provide cognitive support for emergency medicine staff. Nurse and provider roles had significantly different perceptions of the usability and usefulness of certain EDIS components, suggesting that they have different information needs while working.

Carrying out and monitoring Final Year Projects are challenging processes for all the actors involved: lecturers and students. Those projects exhibit problems regarding their evaluation, supervision and the lack of appropriate communication channels between the actors. The use of information and communication technologies can help to overcome those problems. This paper presents TraMeA, a system developed to support both lecturers and students and lighten the problems mentioned above. The usability evaluation conducted on the tool and its results are also described.

This entry defines value from users' perspectives and discusses the need to consider "user value" as an important framework for enhancing product usability in technical communication. Arguing it is essential to involve users in the process of product design, the paper emphasizes the need to recognize users as value co-creators. To further enhance and extend the study of usability, this article proposes a value proposition approach to design and notes such an approach can help communication designers effectively design, test, and deliver materials end users want and value.

By increasing the number of young people who choose the academic way of life, large-scale universities are faced with information administrative challenges. A Student Information System (SIS) is one of the solutions that provide management facilities for educational and financial aspects. An SIS can be accessed and used by university students as well as all levels of academic staff and university stakeholders. Determining the usability level of the SIS from a Human Computer Interaction perspective is an important consideration for universities. The aim of this paper is to evaluate the usability of the Near East University (NEU) SIS by using ISO/IEC 9126 standards. The ISO/IEC 9126 model has the most suitable metrics for evaluating the internal usability of the systems. The result of this study will be helpful for the NEU SIS developer team when considering improvement possibilities for future versions of the system.Keywords: usability; ISO/IEC 9126; human computer interaction; student information system; quality model

Convenience and the ability to perform advanced transactions encourage banks clients to use e-banking systems. As security and usability are two growing concerns for e-banking users, banks have invested heavily in improving their web portals security and user experience and trust in them. Despite considerable efforts to evaluate particular security and usability features in e-banking systems, a dedicated security and usability evaluation model that can be used as a guide in the development of e-banking assets remains much less explored. To build a comprehensive security and usability evaluation framework, we first extract security and usability evaluation metrics from the conducted literature review and then include several other evaluation metrics that were not previously identified in the literature. We then propose a structured inspection model for thoroughly evaluating the usability and security of internal and external e-banking assets. We argue that the proposed e-banking security and usability evaluation frameworks in the literature in addition to the existing standards of security best practices (e.g., NIST and ISO) are by no means comprehensive and lack some essential and key evaluation metrics that are of particular interest to e-banking portals. In order to demonstrate the inadequacy of existing models, we use the proposed framework to evaluate five major banks. The evaluation reveals several shortcomings in identifying both missing or incorrectly implemented security and privacy features. Our goal is to encourage other researchers to build upon our work.

The worldwide mobile software market has grown dramatically since feature phones became popular in the early 1990s. In practice, mobile usability — which can be defined for a resource-constrained device in two ways, namely, User eXperience (UX) and User Interface (UI) — has been regarded as the key to gaining superiority in terms of both market share and customer loyalty. Unfortunately, de facto standards for software design and the development process, such as Unified Modeling Language (UML) and Rational Unified Process (RUP), do not seem to promote mobile usability in a systematic manner in practice. This paper proposes a systematic and generalizable approach to modeling and evaluating the properties of mobile usability, herein treating it as a first-class software quality from the perspective of software engineering. We devise a UX evaluation framework for mobile usability, which we call UX Evaluation Framework (UEF) throughout this paper. A UX is specified by inter-scene interactions between users and terminals of software products using Extended Menu Navigation Viewpoints (EMNVs); then, a model checker, NuSMV, is adopted to observe whether the EMNV model meets a set of given UX properties. Importantly, the analysis and design of RUP is extended to support the co-design of UX and UI so that major roles, activities and artifacts in the UX and UI can be explicitly monitored and controlled by stakeholders. Through case studies, we demonstrate that UEF works properly to treat software products that prioritize mobile usability. Consequently, UEF plays a key role in filling the gap between two research disciplines to address usability: software engineering and human–computer interactions.

Recently, the modelling of whole process of software (SW) development is performed using extended waterfall and agile models. The further advancement of extended waterfall and agile models in the main phases like communication, planning, modelling, construction and deployment can improve the overall quality of the product. Accordingly, in this study, artificial intelligence (AI) activities are integrated into SW development processes. The important AI activities like intelligent agents, machine learning (ML), knowledge representation, statistical model, probabilistic methods, and fuzzy are integrated into the extended waterfall model. Again, AI activities like intelligent decision making, ML, Turing test, search and optimisation are integrated into the agile model. Two metrics such as, Usability Goals Achievement Metric and Index of Integration are evaluated in five independent SW projects. Once SW projects are developed using these models, feedback queries have been collected formally and the collected data are extensively analysed to identify the individual characteristics of products, identifying correlation behaviour of products with respect to model and metrics.

With the fast growth of the Latin America electronic commerce (e-Commerce), it is indispensable to design effective websites. Evaluating usability issues allows improving the design. One popular method for detecting usability problems is the heuristic evaluation, in which evaluators employ a set of usability heuristics as a guide. Using proper heuristics is highly relevant. In this paper, we present a set of 12 cultural-oriented usability heuristics, developed iteratively, and validated, in their final step, on e-Commerce websites. The evidence supports our argument that websites which display characteristics relevant to specific issues of the four Hofstede's cultural dimensions improve their usability. We present a set of 12 cultural-oriented usability heuristics.The methodology was developed iteratively, and validated in this step on e-Commerce websites.We explore the relationship between usability evaluation, cultural factors and interfaces design.

The development of Recommender Systems in universities students’ portal provides a significant impact on the student study plan and grades. Such systems are more beneficial when they match the software interface usability goals. Henceforth, the students will be more likely to use them. To the best of our knowledge, there are no proposed prototypes neither research works for Courses Recommender Systems in universities students’ portal. Hence, this paper will present a prototype proposal for such a system. The proposed prototype evaluation achieved 4.8643 on the Likert scale reflecting a system with high usability.

The development of information technology that transforms traditional technological processes into modern ones is called digital transformation. Various industries in the world, including Indonesia, have been disrupted by digital transformation. One industry that has been disrupted by digital transformation is the application of information technology in financial services, namely financial technology in the digital payment section. The ease and convenience provided by financial technology needs to be followed by responsible use, financial technology services need to facilitate their users to have a healthy financial behavior. After conducting user research using questionnaire, users feel that the ease that comes with the application can result in consumerism. In this paper, we present the result of our observation in designing the user interactions of a financial technology mobile application added with a new feature called budget control. The user-centered design approach is used to design the high-fidelity prototype of the application based on the users' needs. The prototype is designed based on usability goals and user-experience goals defined for the users. We conduct a usability testing to evaluate the prototype using system usability scale questionnaire, single easy question questionnaire, and user interviews. The results show that the prototype fulfills the usability and user-experience goals.

Children with autism have communication disorder that affects the children face difficulty interacting and communicating with their environment both verbally and non-verbally. To facilitate it, learning visual communication was needed because children with autism were better at receiving information visually than orally. The application of visual communication learning for children with autism developed in digital media used the Picture Exchange Communication System (PECS) method. However, there was still a weakness in the development of digital media for example; there were no stages in the communication learning process. Therefore, this study modeled a prototype of “Belajar Komunikasi” (BERAKSI) on a mobile application to correct deficiencies in the development of communication learning. The method used to produce an interface that fits the needs and ability of the children with autism was the Goal-Directed Design (GDD) method. To find out the level of success of usability from the prototype, then testing used by usability goals needed for children with autism, namely easy to use, learnability, feedback and good error messages, adequate help and document, appealing interface with the result of usability testing 78% in the excellent category. This category proves that autistic children are satisfied in using the BERAKSI application.

The lack of attention to the correlation between the attributes of usability requirements leads to several problems with software development. This paper presents a novel framework that focuses on the mapping of usability requirements attributes to the linguistic assessment from the users using fuzzy logic. Our proposed framework prioritizes conflicting usability requirements attributes. For implementation, we have used MATLAB Fuzzy Logic Tool box. This proposed framework is aimed at helping the requirement analyst in taking better decisions by automating the whole process of identifying and resolving usability requirements conflicts. The major task in the proposed system involves determining the numerical value for each attribute considering their respective importance in different quantitative and qualitative evaluation standards. On the basis of numerical value, conflicts and their respective severities are identified.

There is a need for appropriate evaluation methods to efficiently identify and counteract usability issues early in the development process. The aim of this study was to investigate how product developers assessed a new theoretical method for identifying usability problems and use errors. Two cases where the method had been applied were selected and the users of the method in them were asked to fill in a questionnaire and were then interviewed about their experiences of using the method. Overall, the participants (students and professionals) found the methods useful and their outcome trustworthy. At the same time, the methods were assessed as difficult to learn and as cumbersome and tedious to use. Nevertheless, both students and professionals thought that the methods would be useful in future development work. Suggestions for further improvement included provision of further instructions, for example, on how to adapt the methods and development of an IT-support tool.

Successful usability evaluation of interactive adaptive systems requires the use of appropriate methods. Different usability evaluation methods exist in the literature. These methods can be applied in association with the individual layers and with the whole adaptive system. In each situation, it is essential to apply the appropriate evaluation methods. In this paper, we propose a novel decision support approach called EvalCHOICE. It guides evaluators in the choice of appropriate usability evaluation methods for individual layers and the adaptive system as a whole. Our proposal is applied to determine the suitable evaluation methods for a given Web-based adaptive system in the field of transport.

This research aims to determine the status of usability evaluation methods in academic and industry settings in various Ibero-American countries. The authors conducted a survey taking into account four important aspects: personal information, information about usability evaluation methods, information about equipment, and main problems found. Their results suggest that it is important to propose alternatives that allow both academia and industry to implement well-designed usability evaluation studies.

Aiming at the problems of strong subjectivity and uncertain fuzziness of attribute weights in the software usability evaluation approach, an evaluation approach based on mixed intelligent optimization was proposed, which combines subjective and objective methods to measure software usability for educational resources software. Firstly, the usability evaluation index system of educational resources software was established, and the basic probability assignment was generated by the interval method from the historical sample data. Then the weight optimization problem was adapted to the smooth optimization problem by the maximum entropy function method, and the hybrid social cognitive optimization (HSCO) algorithm was introduced to solve the optimal weights of evidence. Finally, the software usability level was fused by DS evidence theory. The experimental results show that the educational resources software usability evaluation approach can objectively and truly reflect the usability of the software. It provides an efficient way to evaluate the usability of the software.

Nowadays simple usability is one of the key tasks of web portals, especially if these are main information portals of the government. The aim of this paper is to evaluate the usability of a web portal eAGRI (eagri.cz) in terms of unregistered users. This means in terms of general public in particular. The main purpose of the testing is to highlight the issues that users may encounter on this portal and determine the level of portal usability. Our usability testing was focused on a public part of the portal. The main idea of eAGRI portal is to create a central access point to information resources of the Ministry of Agriculture of the Czech Republic and its subordinate organizations. Qualitative research methods were applied. Specifically, we used Heuristic evaluation as a usability inspection method and three methods of usability testing: 5 second test, 30 second test and Formalized think-aloud test.

The aim of this paper is to establish the foundations for developing a mental model that bridges the gap between usability and security in user-centred designs. To this purpose, a meta-model has been developed to align design features with the users’ requirements through tacit knowledge elicitation. The meta-model describes the combinatorial relationships of Security, Usability and Mental SUM and how these components can be used to design a usable and secure system. The SUM meta-model led to the conclusion that there is no antagonism between usability and security. However, the degree of usable security depends on the ability of the designer to capture and implement the user’s tacit knowledge. In fact, the SUM meta-model seeks the dilution of the trading-off effects between security and usability through compensating synergism of the tacit knowledge. A usability security cognitive map has been developed for the major constituents of usability and security to clarify the interactions and their influences on the meta-model stipulations. The three intersecting areas of the three components’ relationships are manipulated to expand the Optimal Equilibrium Solution OES δ expanse. To put the SUM meta-model into practice, knowledge management principles have been proposed for implementing user-centred security and user-centred design. This is accomplished by using collaborative brainpower from various knowledge constellations to design a system within the user’s current and future perception boundaries. Therefore, different knowledge groups, processes, techniques, tactics and practices have been proposed for knowledge transfer and transformation during the mental model development.

Internet is the in-trend of aquiring knowledge and informations especially for services from various government agencies. Thus, the focus on quality of the portal interface in ensuring smoothest and flexibility of user interaction is highly important. Usability issue that arise on development phases does affect the user interface functions. Developers that refuse to comply with usability guidelines, complex references and having limited existing criterias has been the causes of failure in achieving a desireable and usable design. In order to strengthen the model of usable criterias, a research on improving the existing guidelines was develop to find solutions resolving these issues. Seven new usability criterias; Suitability and Functionality, Guide and Support, Recovery and Error, Stability and Control, Hardware and Software, Assessment and Design Process, also Confidentiality. These criterias are also not listed as the compulsory criterias compliance by law enforcement agency and it is expected to influence the current usability portal design of public sector.

In this article, the authors describe a collaborative usability evaluation (CUE) model based on a participatory ergonomics framework. The model was applied to an organization’s health IT design and implementation processes. Individuals received education on usability evaluation principles and methods and had an opportunity for hands-on experience with usability testing. Actual usability evaluations increased participant confidence in their ability to independently design and lead such evaluations. The CUE model has since been applied to the organization’s iterative process of health IT design, has been institutionalized by the health IT department, and is integrated in its health IT implementation timelines.

In recent years, researchers have attempted to shift patient decision aids (PDAs) from paper-based to web-based to increase its accessibility. Insulin decision aids help diabetes patients, most of whom are elderly to make an informed decision to start insulin. However, the lack of usability guidelines applicable for such target group causes developers to struggle to answer the challenging question ‘How can such web service be made usable, and, ultimately, acceptable and accessible for elderly patients?’. Hence, the purpose of this study is to identify the common usability requirements that may facilitate good practices to empower elderly diabetes patients in utilizing a web-based insulin decision aid for their benefit. We set out an approach to use prototyping and retrospective think-aloud techniques to explore web usability barriers that elderly patients may encounter when using an insulin decision aid web site and use the feedback for improving the prototype. Usability requirements were captured iteratively through scoping, brainstorming, prototype, testing and evaluating. The study suggests that the insights from experts and users are equally important to assure the validity of the identified usability guidelines; they reflect the accessibility needs of the aging community while complementing the key requirements of an insulin decision aid. The study contributes to recommend web usability guidelines backed by a series of expert and user evaluations which could be a proactive resource to improve usability, acceptability and accessibility of online insulin decision aids for elderly with diabetes.