Search

In this paper we study a class of multivariate partially linear regression models. Various estimators for the parametric component and the nonparametric component are constructed and their asymptotic normality established. In particular, we propose an estimator of the contemporaneous correlation among the multiple responses and develop a test for detecting the existence of such contemporaneous correlation without using any nonparametric estimation. The performance of the proposed estimators and test is evaluated through some simulation studies and an analysis of a real data set is used to illustrate the developed methodology. The Canadian Journal of Statistics 41: 1–22; 2013 © 2013 Statistical Society of Canada Dans cet article, nous etudions une classe de modeles de regression multivariee partiellement lineaires. Nous developpons plusieurs estimateurs des composantes parametrique et non parametrique et etablissons leur normalite asymptotique. Nous proposons notamment un estimateur de la correlation contemporaine parmi les reponses multiples et nous construisons un test pour detecter l'existence d'une telle correlation sans utiliser aucune estimation non parametrique. La performance des estimateurs et du test proposes est evaluee par le biais d'etudes de simulation et la methodologie elaboree est illustree par l'analyse d'un ensemble de donnees reelles. La revue canadienne de statistique 41: 1–22; 2013 © 2013 Societe statistique du Canada

Deletion, replacement and mean-shift model are three approaches frequently used to detect influential observations and outliers. For general linear model with known covariance matrix, it is known that these three approaches lead to the same update formulae for the estimates of the regression coefficients. However if the covariance matrix is indexed by some unknown parameters which also need to be estimated, the situation is unclear. In this paper, we show under a common subclass of linear mixed models that the three approaches are no longer equivalent. For maximum likelihood estimation, replacement is equivalent to mean-shift model but both are not equivalent to case deletion. For restricted maximum likelihood estimation, mean-shift model is equivalent to case deletion but both are not equivalent to replacement. We also demonstrate with real data that misuse of replacement and mean-shift model in place of case deletion can lead to incorrect results.

The authors study the local influence of observations in multilevel regression models. To this end, they perturb simultaneously the variances, responses and design matrix. To measure the local change caused by these perturbations, they use generalized Cook statistics for the fixed and random parameter estimates. Closed form local influence measures also allow them to assess the joint influence of various observations. They suggest a simple computation method and illustrate their results using two examples. Etude de I'influence locale dans les modeles multi-niveaux Les auteurs etudient l'influence locale des observations dans les modeles de regression multi-niveaux. A cette fin, ils perturbent a la fois les variances, les variables endogenes et la matrice d'incidence. Pour mesurer le changement local cause par ces perturbations, ils se servent des statistiques de Cook generalisees associees aux estimations des effets fixes et aleatoires. Des formules explicites leur permettent aussi de mesurer l'influence locale conjuguee de diverses observations. Ils suggerent une methode de calcul simple et illustrent leurs resultats a l'aide de deux exemples.

The authors consider a semiparametric partially linear regression model with serially correlated errors. They propose a new way of estimating the error structure which has the advantage that it does not involve any nonparametric estimation. This allows them to develop an inference procedure consisting of a bandwidth selection method, an efficient semiparametric generalized least squares estimator of the parametric component, a goodness-of-fit test based on the bootstrap, and a technique for selecting significant covariates in the parametric component. They assess their approach through simulation studies and illustrate it with a concrete application. L'inference dans le cadre d'un modele de regression semiparametrique partiellement lineaire a termes d'erreur correles en serie Les auteurs s'interessent a un modele de regression semiparametrique partiellement lineaire a termes d'erreur correles en serie. Ils proposent une facon originale d'estimer la structure d'erreur qui a l'avantage de ne faire intervenir aucune estimation non parametrique. Ceci leur permet de developper une procedure d'inference comportant un choix de fenětre, l'emploi de la methode des moindres carres generalises pour l'estimation semiparametrique efficace de la composante parametrique, un test d'adequation fonde sur le reechantillonnage et une technique de selection des covariables significatives de la composante parametrique. Ils evaluent leur approche par voie de simulation et en donnent une illustration concrete.

The quantile regression has several useful features and therefore is gradually developing into a comprehensive approach to the statistical analysis of linear and nonlinear response models, but it cannot deal effectively with the data with a hierarchical structure. In practice, the existence of such data hierarchies is neither accidental nor ignorable, it is a common phenomenon. To ignore this hierarchical data structure risks overlooking the importance of group effects, and may also render many of the traditional statistical analysis techniques used for studying data relationships invalid. On the other hand, the hierarchical models take a hierarchical data structure into account and have also many applications in statistics, ranging from overdispersion to constructing min-max estimators. However, the hierarchical models are virtually the mean regression, therefore, they cannot be used to characterize the entire conditional distribution of a dependent variable given high-dimensional covariates. Furthermore, the estimated coefficient vector (marginal effects) is sensitive to an outlier observation on the dependent variable. In this article, a new approach, which is based on the Gauss-Seidel iteration and taking a full advantage of the quantile regression and hierarchical models, is developed. On the theoretical front, we also consider the asymptotic properties of the new method, obtaining the simple conditions for an n1/2-convergence and an asymptotic normality. We also illustrate the use of the technique with the real educational data which is hierarchical and how the results can be explained.

The authors propose a block empirical likelihood procedure to accommodate the within-group correlation in longitudinal partially linear regression models. This leads them to prove a nonparametric version of the Wilks theorem. In comparison with normal approximations, their method does not require a consistent estimator for the asymptotic covariance matrix, which makes it easier to conduct inference on the parametric component of the model. An application to a longitudinal study on fluctuations of progesterone level in a menstrual cycle is used to illustrate the procedure developed here. Une vraisemblance empirique par bloc pour les modeles de regression partiellernent lineaires longitudinaux Les auteurs proposent une procedure a base de vraisemblance empirique par bloc pour tenir compte de la correlation intra-groupe dans des modeles de regression partiellement lineaires longitudinaux. Ceci les ameneo a demontrer une version non parametrique du theoreme de Wilks. A la difference des approximations normales, leur methode ne fait pas appel a un estimateur convergent de la matrice des cova-riances asymptotiques, ce qui facilite l'inference concernant la composante parametrique du modele. Une etude longitudinale sur la fluctuation du niveau de progesterone pendant le cycle menstruel sert a illustrer le propos.

This paper uses the wild bootstrap technique in the estimation of a heteroscedastic partially linear regression model. We show that this approach provides reliable approximation to the asymptotic distribution of the semiparametric least-square estimators of the linear regression coefficients and consistent estimators of the asymptotic covariance matrices even when the error variances are unequal. In comparison, this robustness property is not shared by the bootstrap estimation proposed in Liang et al. (2000. Bootstrap approximation in a partially linear regression model. J. Statist. Plann. Inference, 91, 413–426).

Efficient inference for regression models requires that heteroscedasticity be taken into account if it exists. For partially linear regression models, however, the problem of detecting heteroscedasticity has received very little attention. The aim of this paper is to propose a test of heteroscedasticity for partially linear regression models.

The authors extend the block external bootstrap to partially linear regression models with strongly mixing, nonstationary error terms. In addition to providing an approximate distribution for the semiparametric least square estimator of the parametric component, they propose a consistent estimator of the co-variance matrix of this estimator. Les auteurs etendent le bootstrap externe par bloc aux modeles partiellement lineaires dont les termes d'erreur sont fortement melangeants et non stationnaires. En plus de donner une approximation de la loi de l'estimateur des moindres carres semiparametrique de la composante parametrique, ils proposent un estimateur convergent de la matrice de covariance de cet estimateur.

Consider the partly linear regression model $$ y_{i} = {x}'_{i} \beta + g{\left( {t_{i} } \right)} + \varepsilon _{i} ,\;\;{\kern 1pt} 1 \leqslant i \leqslant n $$ , where y i ’s are responses, $$ x_{i} = {\left( {x_{{i1}} ,x_{{i2}} , \cdots ,x_{{ip}} } \right)}^{\prime } \;\;\;{\text{and}}\;\;\;t_{i} \in {\cal T} $$ are known and nonrandom design points, $$ {\cal T} $$ is a compact set in the real line $$ {\cal R} $$ , β = (β 1, ··· , β p )' is an unknown parameter vector, g(·) is an unknown function and {e i } is a linear process, i.e., $$ \varepsilon _{i} {\kern 1pt} = {\kern 1pt} {\sum\limits_{j = 0}^\infty {\psi _{j} e_{{i - j}} ,{\kern 1pt} \;\psi _{0} {\kern 1pt} = {\kern 1pt} 1,\;{\kern 1pt} {\sum\limits_{j = 0}^\infty {{\left| {\psi _{j} } \right|} < \infty } }} } $$ , where e j are i.i.d. random variables with zero mean and variance $$ \sigma ^{2}_{e} $$ . Drawing upon B-spline estimation of g(·) and least squares estimation of β, we construct estimators of the autocovariances of {e i }. The uniform strong convergence rate of these estimators to their true values is then established. These results not only are a compensation for those of [23], but also have some application in modeling error structure. When the errors {e i } are an ARMA process, our result can be used to develop a consistent procedure for determining the order of the ARMA process and identifying the non-zero coeffcients of the process. Moreover, our result can be used to construct the asymptotically effcient estimators for parameters in the ARMA error process.

The authors provide a rigorous large sample theory for linear models whose response variable has been subjected to the Box-Cox transformation. They provide a continuous asymptotic approximation to the distribution of estimators of natural parameters of the model. They show, in particular, that the maximum likelihood estimator of the ratio of slope to residual standard deviation is consistent and relatively stable. The authors further show the importance for inference of normality of the errors and give tests for normality based on the estimated residuals. For non-normal errors, they give adjustments to the log-likelihood and to asymptotic standard errors.

We give simple and concise expressions of influence measures for general linear models with correlated errors. We show that the commonly used influence measures can be expressed as functions of the generalized leverages and residuals and have the same forms as those in standard linear regression models.

This paper is concerned with a partial linear regression model with serially correlated random errors which are unobservable and modeled by a moving-average process of infinite order. We study a class of estimators for the linear regression coefficients as well as the function characterizing the non-linear part of the model, constructed based on general kernel smoothing and least squares methods. The law of iterated logarithm and strong convergence rates of these estimator are derived by truncating the moving-average error process, a procedure widely applied in the analysis of time series. Our results can be used to establish uniform strong convergence rate of the estimators of autocovariance and autocorrelation functions of the error process.