Search

Generalized linear models, introduced by Nelder and Wedderburn, allowed to model the regression of normal and nonnormal data. While doing so, the analysis of these models could not be obtained without the explicit form of the variance function. In this paper, we determine the link and variance functions of the natural exponential family generated by the class of subordinated Lévy processes. In this framework, we introduce a class of variance functions that depends on the Lambert function. In this regard, we call it the Lambert class, which covers the variance functions of the natural exponential families generated by the subordinated gamma processes and the subordinated Lévy processes by the Poisson subordinator. Notice that the gamma process subordinated by the Poisson one is excluded from this class. The concept of reciprocity in natural exponential families was given in order to obtain an exponential family from another one. In this context, we get the reciprocal class of the natural exponential family generated by the class of subordinated Lévy processes. It is well known that the variance function represents an essential element for the determination of the quasi‐likelihood and deviance functions. Then, we use the expression of our variance function in order to maintain them. This leads us to analyze the proposed generalized linear model. We illustrate some of our models with applications to the daily exchange rate returns of the Tunisian Dinar against the U.S. Dollar and the damage incidents of ships. [ABSTRACT FROM AUTHOR]

We investigate a generalized semiparametric regression. Such a model can avoid the risk of wrongly choosing the base measure function. We propose a profile likelihood to efficiently estimate both parameter and nonparametric function. The main difference from the classical profile likelihood is that the profile likelihood proposed is a functional of the base measure function, instead of a function of a real variable. By making the most of the structure information of the semiparametric exponential family, we get an explicit expression of the estimator of the least favorable curve. It ensures that the new profile likelihood is computationally simple. Due to the use of the least favorable curve, the semiparametric efficiency is achieved successfully and the estimation bias is reduced significantly. Simulation studies can illustrate that our proposal is much better than the existing methodologies for most cases under study, and is robust to the different model conditions. [ABSTRACT FROM AUTHOR]

In nonignorable missing response problems, we study a semiparametric model with unspecified missingness mechanism model and a exponential family model for response conditional density. Even though existing methods are available to estimate the parameters in exponential family, estimation or testing of the missingness mechanism model nonparametrically remains to be an open problem. By defining a "synthesis" density involving the unknown missingness mechanism model and the known baseline "carrier" density in the exponential family model, we treat this "synthesis" density as a legitimate one with biased sampling version. We develop maximum pseudo likelihood estimation procedures and the resultant estimators are consistent and asymptotically normal. Since the "synthesis" cumulative distribution is a functional of the missingness mechanism model and the known carrier density, proposed method can be used to test the correctness of the missingness mechanism model nonparametrically andindirectly. Simulation studies and real example demonstrate the proposed methods perform very well. [ABSTRACT FROM AUTHOR]

Let X be lognormal( μ, σ2) with density f( x); let θ > 0 and define [ABSTRACT FROM AUTHOR]

The paper describes a generalized iterative proportional fitting procedure that can be used for maximum likelihood estimation in a special class of the general log-linear model. The models in this class, called relational, apply to multivariate discrete sample spaces that do not necessarily have a Cartesian product structure and may not contain an overall effect. When applied to the cell probabilities, the models without the overall effect are curved exponential families and the values of the sufficient statistics are reproduced by the MLE only up to a constant of proportionality. The paper shows that Iterative Proportional Fitting, Generalized Iterative Scaling, and Improved Iterative Scaling fail to work for such models. The algorithm proposed here is based on iterated Bregman projections. As a by-product, estimates of the multiplicative parameters are also obtained. An implementation of the algorithm is available as an R-package. [ABSTRACT FROM AUTHOR]

Two methods to distinguish between polynomial and exponential tails are introduced. The methods are based on the properties of the residual coefficient of variation for the exponential and non-exponential distributions. A graphical method, called a CV-plot, shows departures from exponentiality in the tails. The plot is applied to the daily log-returns of exchange rates of US dollar and Japanese yen. New statistics are introduced for testing the exponentiality of tails using multiple thresholds. They give better control of the significance level than previous tests. The powers of the new tests are compared with those of some others for various sample sizes. [ABSTRACT FROM AUTHOR]

The local specification of priors in non-decomposable graphical models does not necessarily yield a proper joint prior for all the parameters of the model. Using results concerning general exponential families with cuts, we derive specific results for the multivariate Gamma distribution (conjugate prior for Poisson counts) and the Wishart distribution (conjugate prior for Gaussian models). These results link the existence of a locally specified joint prior to the solvability of a related marginal problem over the cliques of the graph. [ABSTRACT FROM AUTHOR]

A semiparametric mixture model is characterized by a non-parametric mixing distribution (with respect to a parameter θ) and a structural parameter β common to all components. Much of the literature on mixture models has focused on fixing β and estimating . However, this can lead to inconsistent estimation of both and the order of the model m. Creating a framework for consistent estimation remains an open problem and is the focus of this article. We formulate a class of generalized exponential family (GEF) models and establish sufficient conditions for the identifiability of finite mixtures formed from a GEF along with sufficient conditions for a nesting structure. Finite identifiability and nesting structure lead to the central result that semiparametric maximum likelihood estimation of and β fails. However, consistent estimation is possible if we restrict the class of mixing distributions and employ an information-theoretic approach. This article provides a foundation for inference in semiparametric mixture models, in which GEFs and their structural properties play an instrumental role. [ABSTRACT FROM AUTHOR]

It is well known that Jeffreys’ prior is asymptotically least favorable under the entropy risk, i.e. it asymptotically maximizes the mutual information between the sample and the parameter. However, in this paper we show that the prior that minimizes (subject to certain constraints) the mutual information between the sample and the parameter is natural conjugate when the model belongs to a natural exponential family. A conjugate prior can thus be regarded as maximally informative in the sense that it minimizes the weight of the observations on inferences about the parameter; in other words, the expected relative entropy between prior and posterior is minimized when a conjugate prior is used. [ABSTRACT FROM AUTHOR]

Abstract We explore the structure of one-parameter exponential families admitting an unbiased estimator for a positive integral power of the natural parameter. It is seen that only exponential families dominated by Lebesgue measure can have this property. It is outlined that similar results can be obtained for other functions of the natural parameter. [ABSTRACT FROM AUTHOR]

Uses a maximim argument based on information theory to derive a new approach to density approximation from summary statistics which is not restircted by the assumption of validity of an underlying exponential family. Assessment of loss of predictive power of summary statistics under such minimal knowledge; Conditions for existence of optimal density approximations.

Analyzes the use of independence structure of natural conjugate densities to exponential families in designing a Gibbs' sampler with block updates. Focus on Bayesian inference problems for exponential families; Utilization of the Monte Carlo Markov chain algorithms; Consideration of the sampler as an Iterative Proportional Fitting algorithm with random inputs.

ABSTRACT. For curved (k + 1, k)-exponential families of stochastic processes a natural and often studied sequential procedure is to stop observation when a linear combination of the coordinates of the canonical process crosses a prescribed level. For such procedures the model is, approximately or exactly, a non-curved exponential family. Subfamilies of these stopping rules defined by having the same Fisher (expected) information are considered. Within a subfamily the Bartlett correction for a point hypothesis is also constant. Methods for comparing the durations of the sampling periods for the stopping rules in such a subfamily are discussed. It turns out that some stopping times tend to be smaller than others. For exponential families of diffusions and of counting processes the probability that one such stopping time is smaller than another can be given explicity. More generally, an Edgeworth expansion of this probability is given. [ABSTRACT FROM AUTHOR]

ABSTRACT. The maximum-likelihood estimator for the curved exponential family given by continuous branching processes with immigration is investigated. These processes originated from population biology but also model the dynamics of interest rates and development of the state of technology in economics. It is proved that in contrast to branching processes with discrete space and/or time the MLE gives a unified approach to the inference. In order to include singular subdomains of the parameter space we modify the MLE slightly. Consistency and asymptotic normality for the MLE are considered. Concerning the asymptotic theory of the experiments, all three properties LAQ, LAN, and LAMN occur for different submodels. [ABSTRACT FROM AUTHOR]

ABSTRACT. Standard and fully exponential form Laplace approximations to marginal densities are described and conditions under which these give exact answers are investigated. A general result is obtained and is subsequently applied in the case of natural exponential families with cuts, in order to derive the marginal posterior density of the mean parameter corresponding to the cut, the canonical parameter corresponding to the complement of the cut and transformations of these. Important cases of families for which a cut exists and the approximations are exact are presented as examples. [ABSTRACT FROM AUTHOR]

Consider a standard conjugate family of prior distributions for a vector-parameter indexing an exponential family. Two distinct model parameterizations may well lead to standard conjugate families which are not consistent, i.e. one family cannot be derived from the other by the usual change-of-variable technique. This raises the problem of finding suitable parameterizations that may lead to enriched conjugate families which are more flexible than the traditional ones. The previous remark motivates the definition of a new property for an exponential family, named conditional reducibility. Features of conditionally-reducible natural exponential families are investigated thoroughly. In particular, we relate this new property to the notion of cut, and show that conditionally-reducible families admit a reparameterization in terms of a vector having likelihood-independent components. A general methodology to obtain enriched conjugate distributions for conditionally-reducible families is described in detail, generalizing previous works and more recent contributions in the area. The theory is illustrated with reference to natural exponential families having simple quadratic variance function. [ABSTRACT FROM AUTHOR]