Search

We present case studies which show how the paradigm of learning-based testing (LBT) can be successfully applied to black-box requirements testing of industrial reactive systems. For this, we apply a new testing tool LBTest, which combines algorithms for incremental black-box learning of Kripke structures with model checking technology. We show how test requirements can be modeled in propositional linear temporal logic extended by finite data types.We then provide benchmark performance results for LBTest applied to three industrial case studies., QC 20140320

We present case studies which show how the paradigm of learning-based testing (LBT) can be successfully applied to black-box requirements testing of industrial reactive systems. For this, we apply a new testing tool LBTest, which combines algorithms for incremental black-box learning of Kripke structures with model checking technology. We show how test requirements can be modeled in propositional linear temporal logic extended by finite data types.We then provide benchmark performance results for LBTest applied to three industrial case studies., QC 20140320

We present case studies which show how the paradigm of learning-based testing (LBT) can be successfully applied to black-box requirements testing of industrial reactive systems. For this, we apply a new testing tool LBTest, which combines algorithms for incremental black-box learning of Kripke structures with model checking technology. We show how test requirements can be modeled in propositional linear temporal logic extended by finite data types.We then provide benchmark performance results for LBTest applied to three industrial case studies., QC 20140320

We present case studies which show how the paradigm of learning-based testing (LBT) can be successfully applied to black-box requirements testing of industrial reactive systems. For this, we apply a new testing tool LBTest, which combines algorithms for incremental black-box learning of Kripke structures with model checking technology. We show how test requirements can be modeled in propositional linear temporal logic extended by finite data types.We then provide benchmark performance results for LBTest applied to three industrial case studies., QC 20140320

We present case studies which show how the paradigm of learning-based testing (LBT) can be successfully applied to black-box requirements testing of industrial reactive systems. For this, we apply a new testing tool LBTest, which combines algorithms for incremental black-box learning of Kripke structures with model checking technology. We show how test requirements can be modeled in propositional linear temporal logic extended by finite data types.We then provide benchmark performance results for LBTest applied to three industrial case studies., QC 20140320

Most Model-Driven Development projects focus on model-level functional testing. However, our recent study found an average of 67% additional logic-based test requirements from the code compared to the design model. The fact that full coverage at the design model level does not guarantee full coverage at the code level indicates that there are semantic behaviors in the model that model-based tests might miss, e.g., conditional behaviors that are not explicitly expressed as predicates and therefore not tested by logic-based coverage criteria. Avionics standards require that the structure of safety critical software is covered according to logic-based coverage criteria, including MCDC for the highest safety level. However, the standards also require that each test must be derived from the requirements. This combination makes designing tests hard, time-consuming and expensive to design. This paper defines a new model that uses transformation rules to help testers define tests at the platform independent model level. The transformation rules have been applied to six large avionic applications. The results show that the new model reduced the difference between model and code with respect to the number of additional test requirements from an average of67% to 0% in most cases and less than 1% for all applications. © 2013 IEEE.

Testing is inefficient for the detection and removal of requirements and design defects. As a result, lessons learned in testing can only help prevent defects in the development of subsequent software and subsequent process improvement. Instead of testing out defects to achieve quality measures, quality should be designed into software. Thus test development should parallel the development of the software it tests., Published in CROSSTALK: The Journal of Defense Software Engineering, p27-29, Jul 2001.

This report addresses the reliability prediction conducted on the two Navy owned and operated heat recovery incinerator systems. The prediction was based on a part counts methods and the original designs of the two HRI systems. Based on this prediction, long term data collected at Mayport and Jacksonville HRI systems and mission requirements, testing procedures for HRI systems have been identified. Included in this report is a failure modes and effects analysis conducted at these HRIs.

Pro účel zajištění bezpečného a stabilního internetu potřebují administrátoři nástroje k monitorování sítě, které jim umožní analyzovat probíhající provoz a reagovat včas na nastalé situace. Jedním z prostředků, jak provoz monitorovat je nasazení síťových sond. Tato práce se zaměřuje na důkladné ověření parametrů existujících sond IPFIX probe a FlexProbe. FlexProbe je sonda určená k realizaci zákonných odposlechů vyvíjená na FIT VUT v Brně ve spolupráci s Policií ČR. Sondu IPFIX probe vyvíjí sdružení CESNET a v rámci sondy FlexProbe se využívá k monitorování síťových toků. Aby bylo možné sondy dlouhodobě provozovat v cílovém prostředí, je nezbytné zařízení důkladně otestovat. Přesné chování sondy bylo definováno specifikací požadavků, které jsou vypracovány pro obě sondy. Na základě požadavků byl navržen ucelený systém testů pokrývající funkční i výkonnostní aspekty sond. Testy jsou sjednoceny pomocí testovacího frameworku a zařazeny do automatizovaných scénářů implementovaných v aplikaci Jenkins. V závěru práce je vyhodnoceno pokrytí požadovaných vlastností sond a jejich výkon., In order to ensure a secure and stable Internet, administrators need tools for network monitoring which will allow them to analyze ongoing network traffic and respond to situations in a timely manner. One way to monitor traffic is to use monitoring probes. This thesis focuses on a thorough verification of the parameters of existing probes IPFIX probe and FlexProbe. FlexProbe is a network probe designed for the implementation of lawful interceptions developed at FIT BUT in cooperation with the Police of the Czech Republic. The IPFIX probe is developed by the CESNET association and is used for flow monitoring within the FlexProbe probe. In order to be able to operate the probes in the target environment for a long time, it is necessary to thoroughly test the device. The exact behavior of the probe is defined by the specification requirements that are developed for both probes. Based on the requirements, a comprehensive test system covering functional and performance parameters of the probes was designed. The tests are unified using a test framework and included in automated scenarios implemented in system Jenkins. At the end of the thesis, the coverage of the required properties of the probes and their performance is evaluated.

Pro účel zajištění bezpečného a stabilního internetu potřebují administrátoři nástroje k monitorování sítě, které jim umožní analyzovat probíhající provoz a reagovat včas na nastalé situace. Jedním z prostředků, jak provoz monitorovat je nasazení síťových sond. Tato práce se zaměřuje na důkladné ověření parametrů existujících sond IPFIX probe a FlexProbe. FlexProbe je sonda určená k realizaci zákonných odposlechů vyvíjená na FIT VUT v Brně ve spolupráci s Policií ČR. Sondu IPFIX probe vyvíjí sdružení CESNET a v rámci sondy FlexProbe se využívá k monitorování síťových toků. Aby bylo možné sondy dlouhodobě provozovat v cílovém prostředí, je nezbytné zařízení důkladně otestovat. Přesné chování sondy bylo definováno specifikací požadavků, které jsou vypracovány pro obě sondy. Na základě požadavků byl navržen ucelený systém testů pokrývající funkční i výkonnostní aspekty sond. Testy jsou sjednoceny pomocí testovacího frameworku a zařazeny do automatizovaných scénářů implementovaných v aplikaci Jenkins. V závěru práce je vyhodnoceno pokrytí požadovaných vlastností sond a jejich výkon., In order to ensure a secure and stable Internet, administrators need tools for network monitoring which will allow them to analyze ongoing network traffic and respond to situations in a timely manner. One way to monitor traffic is to use monitoring probes. This thesis focuses on a thorough verification of the parameters of existing probes IPFIX probe and FlexProbe. FlexProbe is a network probe designed for the implementation of lawful interceptions developed at FIT BUT in cooperation with the Police of the Czech Republic. The IPFIX probe is developed by the CESNET association and is used for flow monitoring within the FlexProbe probe. In order to be able to operate the probes in the target environment for a long time, it is necessary to thoroughly test the device. The exact behavior of the probe is defined by the specification requirements that are developed for both probes. Based on the requirements, a comprehensive test system covering functional and performance parameters of the probes was designed. The tests are unified using a test framework and included in automated scenarios implemented in system Jenkins. At the end of the thesis, the coverage of the required properties of the probes and their performance is evaluated.

Pro účel zajištění bezpečného a stabilního internetu potřebují administrátoři nástroje k monitorování sítě, které jim umožní analyzovat probíhající provoz a reagovat včas na nastalé situace. Jedním z prostředků, jak provoz monitorovat je nasazení síťových sond. Tato práce se zaměřuje na důkladné ověření parametrů existujících sond IPFIX probe a FlexProbe. FlexProbe je sonda určená k realizaci zákonných odposlechů vyvíjená na FIT VUT v Brně ve spolupráci s Policií ČR. Sondu IPFIX probe vyvíjí sdružení CESNET a v rámci sondy FlexProbe se využívá k monitorování síťových toků. Aby bylo možné sondy dlouhodobě provozovat v cílovém prostředí, je nezbytné zařízení důkladně otestovat. Přesné chování sondy bylo definováno specifikací požadavků, které jsou vypracovány pro obě sondy. Na základě požadavků byl navržen ucelený systém testů pokrývající funkční i výkonnostní aspekty sond. Testy jsou sjednoceny pomocí testovacího frameworku a zařazeny do automatizovaných scénářů implementovaných v aplikaci Jenkins. V závěru práce je vyhodnoceno pokrytí požadovaných vlastností sond a jejich výkon., In order to ensure a secure and stable Internet, administrators need tools for network monitoring which will allow them to analyze ongoing network traffic and respond to situations in a timely manner. One way to monitor traffic is to use monitoring probes. This thesis focuses on a thorough verification of the parameters of existing probes IPFIX probe and FlexProbe. FlexProbe is a network probe designed for the implementation of lawful interceptions developed at FIT BUT in cooperation with the Police of the Czech Republic. The IPFIX probe is developed by the CESNET association and is used for flow monitoring within the FlexProbe probe. In order to be able to operate the probes in the target environment for a long time, it is necessary to thoroughly test the device. The exact behavior of the probe is defined by the specification requirements that are developed for both probes. Based on the requirements, a comprehensive test system covering functional and performance parameters of the probes was designed. The tests are unified using a test framework and included in automated scenarios implemented in system Jenkins. At the end of the thesis, the coverage of the required properties of the probes and their performance is evaluated.