Search

La investigación se basa en una metodología para la estimación de esfuerzo para la evaluación de software, teniendo como objetivo principal realizar un análisis de una metodología para la valoración del sistema informático de la asociación de emprendedores 8 de septiembre del terminal terrestre “xipixapa”. Para la ejecución de este artículo se realizó la investigación cumpliendo con el objetivo planteado; en el cual se emplearon métodos investigativos. Se hizo uso de la investigación exploratoria y explicativa, lo que permitió conocer más sobre el tema tratado; lo que consintió en familiarizarse con esta investigación. Y además se utilizó instrumentos con el estudio de fuentes y consultas de investigación. Como resultado se desarrolló un análisis de una metodología para la estimación de esfuerzo del sistema, que les permitirá mejorar las métricas del software de la asociación.

Software engineering employs different benchmarks for a software evaluation. This enables software developers to continuously improve their product. The same needs are intrinsic for software tools in the semantic web field. While there are many different benchmarks already available, there has not been their overview and categorization yet. This work provides such an overview and categorization of benchmarks specifically oriented on benchmarks where an ontology plays an important role. Benchmarks are naturally categorized in line with ontology tool categorization along with an indication which activities those benchmarks are deliberate and which are non-deliberative. Although the article itself can already navigate a reader to an adequate benchmark, we moreover automatically designed a flexible rule-based recommendation tool based on the analysis of existing benchmarks.

The aim of this study is to build an evaluation framework for the user-centric testing of the Data Curation Tool. The tool was developed in the scope of the FAIR4Health project to make health data FAIR by transforming them from legacy formats into a Common Data Model based on HL7 FHIR. The end user evaluation framework was built by following a methodology inspired from the Delphi method. We applied a series of questionnaires to a group of experts not only in different roles and skills, but also from various parts of Europe. Overall, 26 questions were formulated for 16 participants. The results showed that the users are satisfied with the capabilities and performance of the tool. The feedbacks were considered as recommendations for technical improvement and fed back into the software development cycle of the Data Curation Tool.

Due to the rapid growth of software field, there is a tremendous increase in the building a software, websites and also applications. Eventually with the increase of the software products, the standards of the product also play a vital role. Based on the good standards of the product, the level of that particular product will always be high. Software evaluation is a method whose main objective is to judge a product and to verify whether the software meets all the prerequisites. Cognitive computing is a combination of several different fields and it imitates the human intellectual capacity in making decisions. The proposed work describes about the software evaluation using cognitive computing which is very inventive with wide range of benefits and provides excellent result. It also improves the efficiency of the company and helps to build advanced software's. The results are very accurate and saves lot of time in performing the software processes.

International audience; This book constitutes the proceedings of the 28th International Conference on Automated Reasoning with Analytic Tableaux and Related Methods, TABLEAUX 2019, held in London, UK, in September 2019, colocated with the 12th International Symposium on Frontiers on Combining Systems, FroCoS 2019. The 25 full papers presented were carefully reviewed and selected from 43 submissions.They present research on all aspects of the mechanization of tableaux-based reasoning and related methods, including theoretical foundations, implementation techniques, systems development and applications. The papers are organized in the following topical sections: tableau calculi, sequent calculi, semantics and combinatorial proofs, non-wellfounded proof systems, automated theorem provers, and logics for program or system verification.

The research literature identifies the limitations of pre-service teacher training in the evaluation and assessment of educational software for classroom use. This study investigated the enhancement of IT pre-service teacher training in educational software evaluation through the incorporation of software evaluation techniques from the software engineering discipline. Participants in this study were 25 final year pre-service IT teachers at Faculty of Education at a public university in Turkey. The pre-service teachers were introduced to the software engineering evaluation methods and an instructional educational software evaluation method. The results illustrated that the software engineering evaluation methods enhanced the technical evaluation skills of pre-service teachers and increased their confidence. Pre-service teachers reported that they considered themselves more professional after applying these methods. We believe this work highlighted a method to enhance the educational software evaluation skills of IT pre-service teachers through combining technical evaluation skills with traditional educational methods.

The evaluation of Open Source software for testing performance in Web applications is accomplished. In order to achieve the objective, the research model was followed: literature review, strategy, methods to generate data and the analysis of the data. This study was conducted based on measures of the ISO/IEC 25023 standard, and the software test process proposed by ISTQB. Regarding the software evaluation, it was done considering the characteristics described by their official developers and experimentation. The tool that obtained the best results was JMeter, covering 80% of the selection criteria. It is applied to a case study. This evaluation allowed to know the performance measures of a real web application.

The paper proposes a new approach to software evaluation, which takes into consideration cultural factors. We use Profile Theory to develop a model that captures the essential technical and cultural characteristics of contextually effective software evaluators. These evaluator-defining characteristics include cultural, organizational, technical, and individual attributes, and relationships among them. We used surveys and literature to identify the prevalent characteristics and then defined a formal model. An illustrative example is elaborated to show how our model can be integrated in a CASE tool. We surmise that identifying the profile of software evaluators is a necessary step to ensure the effectiveness and validity of the evaluation of software systems.

The main goal of this paper is to perform an analysis of Educational Robotics software environments. For that, a simple, practical and reproducible approach for assessment named EducAval is introduced. The key contribution is the proposal of some homogeneous and universal criteria for software evaluation in this area. Basically, simple assessment steps are followed including survey application and data collection and analysis, with specific questions about didactic and technical issues that are formulated separately for professors and students. After questionnaire application, data are collected and mapped into verification, qualification, and validation parameters. This strategy makes it simpler to evaluate Educational Robotics tools, thus verifying if they attend the requirements of the users and if they can be used as well by schools or other institutions interested in the application of such methodology. The software environments used in the finals of Brazilian Robotics Olympiad have been verified, qualified, and validated using this methodology and the results are presented

Software evaluation is needed to determine the usability level of the software. Good usability is having the following characteristics: effective to use (effectiveness), efficient to use (efficiency), safe to use (safety), having good utility (utility), easy to learn (learnability) and easy to remember how to use (memorability). Analytical evaluation is one evaluation approach that does not involve users. The evaluation is conducted by experts associated with the product. One method used in the analytical evaluation is GOMS, a method to analyze a task related to human computer interaction. GOMS does not provide accurate calculation of how users interact with the system, yet it estimates the time need to do a task dealing with the system. With the evaluation of UML users are expected to be able to use UML tools that appropriate to particular needs based on open source.

Funded by the Department of Homeland Security (DHS), the National Institute of Standards and Technology (NIST) started a long-term, ambitious project to identify, enhance and develop software assurance tools. The Software Assurance Metrics And Tool Evaluation (SAMATE) project is leading in (A) developing tests for software evaluation tools, (B) measuring the effectiveness of tools, and (C) identifying gaps in tools and methods. See the workshop web site at http://samate.nist.gov/ SASII.

In this paper we propose a quantitative model for evaluation and selection of integrated development environments (IDEs) for Java enterprise applications. Our goal is to determine the extent to which major IDEs satisfy typical software developer requirements. Our evaluation model is based on the Logic Scoring of Preference (LSP) method for system evaluation. We present an overview of the LSP method, the structure of IDE evaluation criterion, and a sample evaluation and comparison of three competitive systems: IBM WebSphere Studio Application Developer, Borland JBuilder, and SUN ONE Studio. In this paper we also introduce rectangular diagrams, an efficient new notation of LSP criteria.

Herman J. Bierens' EasyReg International is a convenient and efficient tool for researchers, teachers and students. It is free of charge, easy to use and offers many popular econometric tools. We reviewed the most recent (October 6, 2004) version. We present the evaluation according to Berk's (1987) [Berk, K., 1987. Effective microcomputer statistical software, The American Statistician, 41, 222–228] list of criteria for statistical software. We also discuss the numerical accuracy of EasyReg International.

A software on TRIZ and/or Innovation can certainly supplement human brain and memory in order to speed up an innovation job. There are various TRIZ and Innovation software available in market. Some are too complex to use, some deal with only limited number of TRIZ techniques and some are having good features of innovation without much emphasis on TRIZ. An obvious task remains to evaluate them and find which software can help you best in inventing. This article does not recommend or reject any TRIZ software per se. It only describes the expected features of a good TRIZ software and lays out the parameters of evaluating TRIZ software. The objective of this article is to help the TRIZ users understand what should they expect from a TRIZ software and how to choose a software that is really useful to solve inventive problems.

Evaluation, comparison, and selection of software products are frequent decision problems. Soft computing offers efficient methodology for solving such problems. Our evaluation models are based on the Logic Scoring of Preference (LSP) method for system evaluation. We present an overview of the LSP method, and techniques for building evaluation criteria compatible with the ISO 9126 standard for software product evaluation. To exemplify our methodology we present the design and use of criteria for evaluation and comparison of search engines, Java IDEs, and windowed environments.

MOTIVATION: Homology modeling is rapidly becoming the method of choice for obtaining three-dimensional coordinates for proteins because genome projects produce sequences at a much higher rate than NMR and X-ray laboratories can solve the three-dimensional structures. The quality of protein models will not be immediately clear to novices and support with the evaluation seems to be needed. Expert users are sometimes interested in evaluating the quality of modeling programs rather than the quality of the models themselves. RESULTS: Three servers have been made available to the scientific community: a homology modeling server, a model quality evaluation server and a server that evaluates models built of proteins for which the structure is already known, thereby implicitly evaluating the quality of the modeling program. AVAILABILITY: The modeling-related servers and several structure analysis servers are freely available at http://swift.embl-heidelberg.de/servers/ CONTACT: gert.vriend@embl-heidelberg.de

It is suggested that the use of educational software can only be evaluated by considering the use of a package in particular learning situations. This requirement poses an inherent problem for predictive evaluation where, by definition, the evaluation is conducted out of context. Current predictive evaluation tools, checklists and frameworks, fail to address this problem. A novel evaluation paradigm is proposed which does provide a situated approach to predictive evaluation. This paradigm generates context specific evaluation issues by considering the interactions between the three principal actors associated with the development and use of educational software — the teacher, the designer and the student(s). The use of the paradigm is illustrated by the predictive evaluation of a recent CD-ROM package. In conclusion, the paradigm may offer an improved approach to interpretative evaluation, leading to the notion of its use as a comprehensive evaluation tool.

Choosing the right Business Intelligence (BI) software is critical to increasing productivity and effectiveness in organizations today. At the same time it is a very elaborating and complex process to choose the right software due to the fact that a large number of BI products exist on the market, which are quite different and updated frequently. The objective of this study is to develop and test a model for the evaluation of BI Software. The findings of the study revealed that it is difficult to declare what is the most competitive BI software as what is good for one user might not be good for another depending on their different business needs. Having said that the study initiated a new classification of BI Software vendors depending on the degree to which they comply with the functions in the Competitive Intelligence (CI) cycle. The software tested was divided into five categories: Fully complete, Complete, Semi Complete, Incomplete and Insubstantial. We conclude that the SSAV (Solberg Søilen, Amara, Vriens) Model Together with some proposed non technological variables and a classification developed can be used as a user's selection tool for deciding which BI Software to purchase.

The use of object-oriented (OO) architecture knowledge such as patterns, heuristics, principles, refactorings and bad smells improve the quality of designs, as Garzás and Piattini (2005) state in their study; according to it, the application of those elements impact on the quality of an OO design and can serve as basis to establish some kind of software design improvement (SDI) method. But how can we measure the level of improvement? Is there a set of accepted internal attributes to measure the quality of a design? Furthermore, if such a set exists will it be possible to use a measurement model to guide the SDI in the same way software process improvement models (Humphrey, 1989; Paulk, Curtis, Chrissis, & Weber, 1993) are guided by process metrics (Fenton & Pfleeger, 1998)? Since (Chidamber & Kemerer, 1991) several OO metrics suites have been proposed to measure OO properties, such as encapsulation, cohesion, coupling and abstraction, both in designs and in code, in this chapter we review the literature to find out to which high level quality properties are mapped and if an OO design evaluation model has been formally proposed or even is possible.

Software quality evaluation is the focus problem of software product development, which is the lifeline of software industry. Toward the problem, in this paper, a software evaluation model is introduced, an evaluation method based on information axiom is proposed, and the evaluation procedure is given. Finally, an application case study is given, and the experimental result shows the feasibility and practicality of the proposed method. Compared with other methods, the evaluation process is conducted with non-weight information, and the proposed method has noticeable characteristic.

As a result of increasing demands on COTS technology, there is an increasingly huge market of COTS software. Therefore, one of the most critical activities in COTS-based system development is the COTS evaluation and selection. Unfortunately, most existing methods that have been proposed in previous studies for evaluating and selecting COTS software are still have many limitations to be applicable and used in the industry. So without an effective method to select and evaluate COTS software, the time spent for selecting the correct COTS software may offset the advantages of using it. This paper outlines and discusses the common problems in existing methods and the main processes and criteria (non-functional requirements) that are required for evaluating and selecting COTS software through theoretical and empirical studies which goal is to develop new framework to evaluate and select COTS software.

Evaluation and selection of the software packages is complicated and time consuming decision making process. Selection of inappropriate software package can turn out to be costly and adversely affects business processes and functioning of the organization. In this paper we describe (i) generic methodology for software selection, (ii) software evaluation criteria, and (iii) hybrid knowledge based system (HKBS) approach to assist decision makers in evaluation and selection of the software packages. The proposed HKBS approach employs an integrated rule based and case based reasoning techniques. Rule based reasoning is used to capture user needs of the software package and formulate a problem case. Case based reasoning is used to retrieve and compare candidate software packages with the user needs of the package. This paper also evaluates and compares HKBS approach with the widely used existing software evaluation techniques such as analytic hierarchy process (AHP) and weighted scoring method (WSM). (C) 2011 Elsevier Inc. All rights reserved.

This article presents a rubric for the evaluation of Computer-Assisted Language Learning (CALL) software based on international recommendations for effective CALL. After a brief overview of the pedagogical and implementation fundamentals of CALL, and a discussion of what should be included in a needs analysis for CALL evaluation, the rubric is presented. The author then illustrates how the evaluation criteria in the rubric can be used in the design of a new CALL system. Keywords: Software evaluation, CALL, language laboratory, MarkWrite, writing across the curriculum, software development

Den här uppsatsen behandlar skapandet och designen av en arkitektur över ett system för behandling av depression och andra psykiska sjukdomar via internet, kallat Melencolia. Ett av kraven för detta projekt är att skapa ett system som kan utökas i framtiden. Vi har härlett detta krav till begreppet modularitet och för att skapa en modulär arkitektur för Melencolia har vi undersökt vad begreppet innebär och härlett det till att vara ett kvalitetsdrag hos flera kvalitetsattribut däribland ”maintainability” och ”reusability”. Med hjälp av ”Attribute Driven Design” kan en arkitektur skapas som fokuserar kring en viss typ av kvalitetsattribut. Eftersom modularitet inte är ett kvalitetsattribut utan en kvalitetsegenskap har vi varit tvungna att ändra indata till denna metod, från kvalitetsattribut till kvalitetsegenskap. Vidare har vi härlett och lagt fram en ny metod för att mäta kvalitetsegenskaper i en mjukvaruarkikektur.Slutligen har vi använt vår metod för att mäta graden av modularitet i Melencolias arkitektur. This thesis considers the problem of creating and designing an architecture for a software project that will result in a system for treatment of depression on the Internet. One of the requirements for this project, named by Melencolia, is to create a system which can be extended in the future. From this requirement we have derived the concept of modularity. In order to create a modular architecture we have concluded that modularity is a quality characteristic of multiple quality attributes such as "maintainability" and "reusability".We deploy Attribute-Driven Design (ADD) in this Melencolia project. By doing this, an architecture that is focused around modularity can be created. Since modularity is not a quality attribute, but rather a quality characteristic, we had to change the input to ADD from a quality attribute to a quality characteristic.Furthermore, we derive and propose a new method for quality characteristic evaluation of software architectures.Finally we apply our aforementioned method on the architecture of Melencolia and by doing this we get an indication on how well our proposed architecture satisfies modularity.

Feature-centric comprehension of software is a prerequisite to incorporating modifications requested by users during software evolution and maintenance. However, feature-centric understanding of large object-oriented programs is difficult to achieve due to size, complexity and implicit cha-racter of mappings between features and source code. In this paper, we address these issues through our unified approach to feature-centric analysis of object-oriented software. Our approach supports discovery of feature-code traceability links and their analysis from three perspectives and at three levels of abstraction. We further improve scalability of analysis by partitioning features into canonical groups. To demonstrate feasibility our approach, we use our NetBeans-integrated tool Featureous for conducting a case study of feature-centric analysis of the JHotDraw project. Lastly, we discuss how Featureous supports program comprehension by means of concrete cognitive design elements.

This Software Configuration Management Plan (SCMP) describes the software configuration management procedures used to ensure that the HotSpot dispersion model meets the requirements of its user base, which includes: (1) Users of the PC version of HotSpot for consequence assessment, hazard assessment and safety analysis calculations; and (2) Users of the NARAC Web and iClient software tools, which allow users to run HotSpot for consequence assessment modeling These users and sponsors of the HotSpot software and the organizations they represent constitute the intended audience for this document. This plan is intended to meet Critical Recommendations 1 and 3 from the Software Evaluation of HotSpot and DOE Safety Software Toolbox Recommendation for inclusion of HotSpot in the Department of Energy (DOE) Safety Software Toolbox. HotSpot software is maintained for the Department of Energy Office of Emergency Operations by the National Atmospheric Release Advisory Center (NARAC) at Lawrence Livermore National Laboratory (LLNL). An overview of HotSpot and NARAC are provided.

This Software Test Plan (STP) describes the procedures used to verify and validate that the HotSpot Health Physics Codes meet the requirements of its user base, which includes: (1) Users of the PC version of HotSpot conducting consequence assessment, hazard assessment and safety analysis calculations; and (2) Users of the NARAC Web and iClient software tools, which allow users to run HotSpot for consequence assessment modeling. This plan is intended to meet Critical Recommendation 2 from the Software Evaluation of HotSpot and DOE Safety Software Toolbox Recommendation for inclusion of HotSpot in the Department of Energy (DOE) Safety Software Toolbox. These users and sponsors of the HotSpot software and the organizations they represent constitute the intended audience for this document. HotSpot software is maintained for the Department of Energy Office of Emergency Operations by the National Atmospheric Release Advisory Center (NARAC) at Lawrence Livermore National Laboratory (LLNL). An overview of HotSpot and NARAC are provided.

Evaluating and selecting software packages that meet an organization's requirements is a difficult software engineering process. Selection of a wrong software package can turn out to be costly and adversely affect business processes. The aim of this paper is to provide a basis to improve the process of evaluation and selection of the software packages. This paper reports a systematic review of papers published in journals and conference proceedings. The review investigates methodologies for selecting software packages, software evaluation techniques, software evaluation criteria, and systems that support decision makers in evaluating software packages. The key findings of the review are: (1)analytic hierarchy process has been widely used for evaluation of the software packages, (2) there is lack of a common list of generic software evaluation criteria and its meaning, and (3) there is need to develop a framework comprising of software selection methodology, evaluation technique, evaluation criteria, and system to assist decision makers in software selection. (C) 2008

LODE is a web tool for deaf children, which aims at stimulating global reasoning on written e-stories. This paper reports on an initial prototype application of LODE. First, we motivate the need of an e-tool such as LODE for deaf children, then we report on the assessment of the prototype with expert users and two deaf children, laying the groundwork for the final evaluation and development of LODE.

The concept of a scenario has long been utilized in military procurement as a means of evaluating capability in an operational context. With the advent of initiatives such as the USA Department of Defence's Network-Centric Operations and the UK Ministry of Defence's Network Enabled Capability, research into the application of service-oriented architectures (SOA) as a means of delivering capability is being undertaken. A promising output of this research is the definition of scenario based evaluation models that can be applied to SOA. This paper examines the application of a military scenario framework to more conventional software evaluation situations by means of case studies. This demonstrates that similar techniques can be used in their construction and thus provides a basis for the application of scenario based evaluation models in future research.

IBM first proposed the conception of autonomic computing (AC) which provides a new way for computer technology. At present there are many researches on AC system, but less research on AC theory and evaluation. However it is the most import for the development of AC domain. In this paper, we mainly summarize present evaluation criteria, evaluation tools and evaluation methods about AC system. Then we analyses defects to perfect AC system evaluation. Finally proposes an Autonomic-Trust software evaluation model, which can quantificationally calculate autonomic maturity of AC system. It is very useful, in the future we will optimize it and boost it in application.

The field of automated ECG analysis was one of the earliest topics in Medical Informatics and may be regarded as a model both for computer-assisted medical diagnosis and for evaluating medical diagnostic programs. The CSE project has set reference standards of two kinds: In a broad sense, a standard how to perform a comprehensive evaluation study, in a narrow sense, standards as specific references for evaluating computer ECG programs. The evaluation methodology used within the CSE project is described as a basis for presentation of results which are published elsewhere in this issue.

PurposeTo adapt general principles used for evaluating software quality to more specific requirements characteristic of information retrieval and educational applications in library environments.Design/methodology/approachA conceptual paper based on existing software evaluation models, but one which tries to add some important refinements to key aspects of these received concepts.FindingsThat the application of engineering concepts to technologically mediated tasks where crucial system outputs consist of the facilitation of specific mental events in the user of the system (e.g. “learning outcomes”) can be problematic. In such scenarios it may be valuable to avoid incorporating the production of specific mental events into the “objective functionality” of the software in question. Rather, it is suggested that the creation of these outputs should be left to the user, not to the mechanised routines of the system (i.e. these mental system outputs should be facilitated by the system as part of the “subjective functionality” of the overall design).Research limitations/implicationsThese are purely conceptual approaches to library and e‐learning software that should be tested by practical case study investigation (e.g. comparative user evaluations both of software designed along general quality models standards, and of software designed to the model suggested here).Practical implicationsYou can get better results in terms of human outputs and benefits (i.e. better learning outcomes, or a higher level of engagement with effective information retrieval) by means of simple, minimalist implementations of information technology and educational technology‐based systems.Originality/valueThis library and information science paper attempts to use ideas from software engineering and software evaluation to create an original perspective on real‐life problems in the sphere of information retrieval technology and educational technology.

Metrics for the architectural quality of Internet businesses are essential in measuring the success and failure of e-commerce. This chapter proposes six dimensions of architectural metrics for Internet businesses: internal stability, external security, information gathering, order processing, system interface, and communication interface. For each of the six metrics, we have constructed questionnaires to measure the perceived level of architectural quality and identified feature lists that might be closely related to the perceived quality level. Large-scale empirical studies were conducted both to validate the proposed metrics and to explore their relevance across four Internet business domains. The results indicate that metrics have high validities and reliabilities in three different domains. The relevance of the metrics was also proved by the meaningful relations between design features and customer loyalty. This chapter ends with the implications and limitations of the study results.

The primary objective of this paper was to present a study on the metrics which can be applied to the Software Evaluation Framework. The paper presents the results of a preliminary study, which focuses on the measurements applied to the framework. It provides a description of the metrics used and an analysis of how they compare to each other in the measurement of the software characteristics. This objective was accomplished by empirically testing the model with quantitative techniques. An earlier qualitative study provided a list of metrics, which were then tested with the quantitative study described in this paper. The results of this study are important as it identifies the metrics, perceived by stakeholders as essential for applying the Software Evaluation Framework to software evaluation.

Armadillo Power & Light Company (AP&L), headquartered in Hondo (TX), provides electric service to the lower half of the Lone Star State. AP&L is a wholly owned subsidiary of Texas Power Corporation, an electric utility holding company. The General Accounting (GA) Department of AP&L is primarily responsible for closing the company books on a monthly basis. After the books are closed, GA is responsible for providing senior management with data relating to key operating results. This data includes a comparative income statement, analysis of rate of return on common equity, analysis of operating revenues and megawatt hours (MWH) sales (as shown in Figure 1), analysis of sources and disposition of energy, and analysis of operation and maintenance expenses by function.

The results of a recent survey of experienced CASE-tool users in the Netherlands are described. The subjects of the survey were a general evaluation of the tools used, a comparison of the objectives envisaged when acquiring the tools to the objectives that were seen to be attained, selection criteria, impact on the organization, and future use. Conclusions are drawn regarding the benefits of CASE-tools and their likely future.

A methodology is described to link instructional objectives to CAI software and to evaluate the software in regard to such objectives. The proposed taxonomy codifies instructional objectives into a format which is suited for machine readability. Elements of the taxonomy include subject, function, skill hierarchies, capability level, and complexity. The software evaluation criteria revolve around adequacy of instructional objectives coverage and inherent effectiveness of the software. Some suggestions are made for general evaluation of CAI systems as well as for a standard for the construction of computer support systems.