Search

Most research in design of experiments focuses on appropriate designs for a system with just one type of response, rather than multiple responses. In a decision‐making process, relying on only one objective can lead to oversimplified, suboptimal choices that ignore important considerations. Consequently, the problem of constructing a design for an experiment when multiple types of responses are of interest often does not have a single definitive answer, particularly when the response variables have different distributions. Each of these response distributions imposes different requirements on the experimental design. Computer‐generated optimal designs are popular design choices for less standard scenarios where classical designs are not ideal. This work presents a new approach to experimental designs for dual‐response systems. The normal and binomial distributions are considered as potential responses. Using the D‐criterion for the linear model and the Bayesian D‐criterion for the logistic regression model, a weighted criterion is implemented in a coordinate‐exchange algorithm. Designs are evaluated and compared across different weights. The sensitivity of the designs to the priors supplied for the Bayesian D‐criterion is also explored. [ABSTRACT FROM AUTHOR]

The average prediction variance for an I‐optimal design for a specified normal theory linear model decreases nonlinearly with respect to sample size. In this paper, we develop a prediction equation to explain the relationship between average prediction variance and sample size. We investigate methods for determining what sample size is efficient for a given experiment using the average prediction variance (APV) versus sample size curves. The sample size determination is studied assuming a variety of cost structures for the trials in each experiment. For example, in practice, the length of time before an experiment is complete may be considered an implicit cost of experimentation. We provide results for designs and models based on two to five factors. We also present a potential application of the methods using a military system experiment. [ABSTRACT FROM AUTHOR]

When experimental resources are significantly constrained, resolution V fractional factorial designs are often prohibitively large for experiments with 6 or more factors. Resolution IV designs may also be cost prohibitive, as additional experimentation may be required to de-alias active 2-factor interactions (2FI). This paper introduces 20-run no-confounding screening designs for 6 to 12 factors as alternatives to resolution IV designs. No-confounding designs have orthogonal main effects, and since no 2FI is completely confounded with another main effects or 2FI, the experimental results can be analyzed without follow-on experimentation. The paper concludes with the results of a Monte Carlo simulation used to assess the model-fitting accuracy of the recommended designs. [ABSTRACT FROM AUTHOR]

This paper discusses an application of confidence intervals to the threshold decision value used in logistic regres]sion and discusses its effect on changing the quantification of false positive and false negative errors. In doing this a grey area, in which observations are not classified as success (1) or failure (0), but rather 'uncertain' is developed. The size of this grey area is related to the level of confidence chosen to create the interval around the threshold as well as the quality of logistic regression model fit. This method shows that potential errors may be mitigated. Monte Carlo simulation and an experimental design approach are used to study the relationship between a number of responses relating to classification of observations and the following factors: threshold level, confidence level, noise in the data, and number of observations collected. Copyright © 2015 John Wiley & Sons, Ltd. [ABSTRACT FROM AUTHOR]

In this paper, we study the relationship between the fitted parameters in a Gaussian process (kriging) model and the complexity of the resulting response surface. This study is done for models with one response and two input variables. An analytical calculation of surface roughness is used as a measure of the complexity of the response surface fit by the Gaussian process model. Our findings indicate that the size of the fitted model parameters as measured across different fits and data sets do not give indication as to the complexity of the surface. We do, however, show that the magnitude of each of the parameters in a single fitted model gives indication about the amount of variability in the direction of that fitted parameter. Copyright © 2015 John Wiley & Sons, Ltd. [ABSTRACT FROM AUTHOR]

Classical D-optimal design is used to create experimental designs for situations in which an underlying system model is known or assumed known. The D-optimal strategy can also be used to add additional experimental runs to an existing design. This paper demonstrates a study of variable choices related to sequential D-optimal design and how those choices influence the D-efficiency of the resulting complete design. The variables studied are total sample size, initial experimental design size, step size, whether or not to include center points in the initial design, and complexity of initial model assumption. The results indicate that increasing total sample size improves the D-efficiency of the design, less effort should be placed in the initial design, especially when the true underlying system model isn't known, and it is better to start off with assuming a simpler model form, rather than a complex model, assuming that the experimenter can reach the true model form during the sequential experiments. Copyright © 2013 John Wiley & Sons, Ltd. [ABSTRACT FROM AUTHOR]

Today's military operating environments are more operationally diverse and technically challenging. Fielding relevant weapons systems to meet the demands of this environment is increasingly difficult, prompting policy shifts that mandate a focus on systems capable of combating a wide threat range. The capabilities-based test and evaluation construct is the Department of the Navy's effort to concentrate on integrated system design with the objective of satisfying a particular operational response (capability) under a robust range of operating conditions. One aspect of capabilities-based test and evaluation is the increased employment of advanced mathematical and statistical techniques in the test and evaluation (T&E) process. This case study illustrates advantages of incorporating these invaluable techniques, like design of experiments and modeling and simulation, within the T&E process. We found through statistical analysis that the application of design of experiment concepts to the System Under Test throughout three primary phases of T&E quantifiably improved the accomplishment of the selected response variable of interest. Copyright © 2012 John Wiley & Sons, Ltd. [ABSTRACT FROM AUTHOR]