Search

A class of games for finding a leader among a group of candidates is studied in detail. This class covers games based on coin tossing and rock-paper-scissors as special cases and its complexity exhibits similar stochastic behaviors: either of logarithmic mean and bounded variance or of exponential mean and exponential variance. Many applications are also discussed.

In this note we re-examine the analysis of the paper "On the martingale property of stochastic exponentials" by B. Wong and C.C. Heyde, Journal of Applied Probability, 41(3):654-664, 2004. Some counterexamples are presented and alternative formulations are discussed., Comment: To appear in Journal of Applied Probability, 11 pages

In a recent paper Weiss (1965) has suggested a simple model for a carrier-borne epidemic such as typhoid. He considers a population (of size m) of susceptibles into which a number (k) of carriers is introduced. These carriers exhibit no overt symptoms and are only detectable by the discovery of infected persons. He supposed that after the initial introduction of the carriers, the population remains entirely closed and no new carriers arise. The epidemic then progresses until either all the carriers have been traced and isolated or until the entire population has succumbed to the disease.

In this paper, to model cascading failures, a new stochastic failure model is proposed. In a system subject to cascading failures, after each failure of the component, the remaining component suffers from increased load or stress. This results in shortened residual lifetimes of the remaining components. In this paper, to model this effect, the concept of the usual stochastic order is employed along with the accelerated life test model, and a new general class of stochastic failure models is generated.

In this paper, we first use the distribution of the number of records to demonstrate that the right tail probabilities of counts of rare events are generally better approximated by the right tail probabilities of Poisson distribution than {those} of normal distribution. We then show the moderate deviations in Poisson approximation generally require an adjustment and, with suitable adjustment, we establish better error estimates of the moderate deviations in Poisson approximation than those in \cite{CFS}. Our estimates contain no unspecified constants and are easy to apply. We illustrate the use of the theorems in six applications: Poisson-binomial distribution, matching problem, occupancy problem, birthday problem, random graphs and 2-runs. The paper complements the works of \cite{CC92,BCC95,CFS}., 29 pages and 5 figures

This paper generalizes the Kunita–Watanabe decomposition of an $L^2$ space. The generalization comes from using nonlinear stochastic integrals where the integrator is a family of continuous martingales bounded in $L^2$ . This result is also the solution of an optimization problem in $L^2$ . First, martingales are assumed to be stochastic integrals. Then, to get the general result, it is shown that the regularity of the family of martingales with respect to its spatial parameter is inherited by the integrands in the integral representation of the martingales. Finally, an example showing how the results of this paper, with the Clark–Ocone formula, can be applied to polynomial functions of Brownian integrals.

This paper considers two variants of M/G/1 queues with impatient customers, which are denoted by M/G/1+Gw and M/G/1+Gs. In the M/G/1+Gw queue customers have deadlines for their waiting times, and they leave the system immediately if their services do not start before the expiration of their deadlines. On the other hand, in the M/G/1+Gs queue customers have deadlines for their sojourn times, where customers in service also immediately leave the system when their deadlines expire. In this paper we derive comparison results for performance measures of these models. In particular, we show that if the service time distribution is new better than used in expectation, then the loss probability in the M/G/1+Gs queue is greater than that in the M/G/1+Gw queue.

The Ginibre point process (GPP) is one of the main examples of determinantal point processes on the complex plane. It is a recurring distribution of random matrix theory as well as a useful model in applied mathematics. In this paper we briefly overview the usual methods for the simulation of the GPP. Then we introduce a modified version of the GPP which constitutes a determinantal point process more suited for certain applications, and we detail its simulation. This modified GPP has the property of having a fixed number of points and having its support on a compact subset of the plane. See Decreusefond et al. (2013) for an extended version of this paper.

In a defaultable market, an investor trades having only partial information about the behavior of the market. Taking into account the intraday stock movements, the risky asset prices are modelled by marked point processes. Their dynamics depend on an unobservable process, representing the amount of news reaching the market. This is a marked point process, which may have common jump times with the risky asset price processes. The problem of hedging a defaultable claim is studied. In order to discuss all these topics, in this paper we examine stochastic control problems using backward stochastic differential equations (BSDEs) and filtering techniques. The goal of this paper is to construct a sequence of functions converging to the value function, each of these is the unique solution of a suitable BSDE.

In this paper we investigate the limiting behavior of the failure rate for the convolution of two or more life distributions. In a previous paper on mixtures, Block, Mi and Savits (1993) showed that the failure rate behaves like the limiting behavior of the strongest component. We show a similar result here for convolutions. We also show by example that unlike a mixture population, the ultimate direction of monotonicity does not necessarily follow that of the strongest component.

Let 𝓈 be a finite or countable set. Given a matrix F = (F ij ) i,j∈𝓈 of distribution functions on R and a quasistochastic matrix Q = (q ij ) i,j∈𝓈 , i.e. an irreducible nonnegative matrix with maximal eigenvalue 1 and associated unique (modulo scaling) positive left and right eigenvectors u and v, the matrix renewal measure ∑ n≥0 Q n ⊗ F *n associated with Q ⊗ F := (q ij F ij ) i,j∈𝓈 (see below for precise definitions) and a related Markov renewal equation are studied. This was done earlier by de Saporta (2003) and Sgibnev (2006, 2010) by drawing on potential theory, matrix-analytic methods, and Wiener-Hopf techniques. In this paper we describe a probabilistic approach which is quite different and starts from the observation that Q ⊗ F becomes an ordinary semi-Markov matrix after a harmonic transform. This allows us to relate Q ⊗ F to a Markov random walk {(M n , S n )} n≥0 with discrete recurrent driving chain {M n } n≥0. It is then shown that renewal theorems including a Choquet-Deny-type lemma may be easily established by resorting to standard renewal theory for ordinary random walks. The paper concludes with two typical examples.

Suppose that X 1, …, X n are random variables with the same known marginal distribution F but unknown dependence structure. In this paper we study the smallest possible value of P(X 1 + · · · + X n < s) over all possible dependence structures, denoted by m n,F (s). We show that m n,F (ns) → 0 for s no more than the mean of F under weak assumptions. We also derive a limit of m n,F (ns) for any s ∈ R with an error of at most n -1/6 for general continuous distributions. An application of our result to risk management confirms that the worst-case value at risk is asymptotically equivalent to the worst-case expected shortfall for risk aggregation with dependence uncertainty. In the last part of this paper we present a dual presentation of the theory of complete mixability and give dual proofs of theorems in the literature on this concept.

This paper provides a simple proof for the fact that the hitting time to an infrequently visited subset for a one-dependent regenerative process converges weakly to an exponential distribution. Special cases are positive recurrent Harris chains and Harris processes. The paper further extends this class of limit theorems to ‘rewards’ that are cumulated to the hitting time of such a rare set.

In this paper, the componentwise increasing convex order, the upper orthant order, the upper orthant convex order, and the increasing directionally convex order for random vectors are generalized to hierarchical classes of integral stochastic order relations. The elements of the generating classes of functions possess nonnegative partial derivatives up to some given degrees. Some properties of these new stochastic order relations are studied. Particular attention is paid to the comparison of weighted sums of the respective components of ordered random vectors. By providing a unified derivation of standard multivariate stochastic orderings, the present paper shows how some well-known results derive from a common principle.

In this paper, the componentwise increasing convex order, the upper orthant order, the upper orthant convex order, and the increasing directionally convex order for random vectors are generalized to hierarchical classes of integral stochastic order relations. The elements of the generating classes of functions possess nonnegative partial derivatives up to some given degrees. Some properties of these new stochastic order relations are studied. Particular attention is paid to the comparison of weighted sums of the respective components of ordered random vectors. By providing a unified derivation of standard multivariate stochastic orderings, the present paper shows how some well-known results derive from a common principle.

This work is concerned with the existence of an optimal control strategy for the long-run average continuous control problem of piecewise-deterministic Markov processes (PDMPs). In Costa and Dufour (2008), sufficient conditions were derived to ensure the existence of an optimal control by using the vanishing discount approach. These conditions were mainly expressed in terms of the relative difference of the α-discount value functions. The main goal of this paper is to derive tractable conditions directly related to the primitive data of the PDMP to ensure the existence of an optimal control. The present work can be seen as a continuation of the results derived in Costa and Dufour (2008). Our main assumptions are written in terms of some integro-differential inequalities related to the so-called expected growth condition, and geometric convergence of the post-jump location kernel associated to the PDMP. An example based on the capacity expansion problem is presented, illustrating the possible applications of the results developed in the paper.

This thesis is concerned with the study of stochastic epidemic models for infectious diseases in heterogeneous populations. All diseases treated are of SIR type, i.e. individuals are either Susceptible, Infectious or Recovered (and immune). The transitions between these states are according to S to I to R. The thesis consists of five papers. Papers I and II treat approximations for the distribution of the time to extinction. In Paper I, a sub-community version of the SIR model with demography is considered. The interest is in how the distribution of the time to extinction is affected by varying the degree of interaction between the sub-communities. Paper II is concerned with a two-type version of Bartlett's model. The distribution of the time to extinction is studied when the difference in susceptibility/infectivity between the types of individuals is varied. Papers III and IV treat random intersection graphs with tunable clustering. In Paper III a Reed-Frost epidemic is run on such a random intersection graph. The critical parameter R_0 and the probability of a large outbreak are derived and it is investigated how these quantities are affected by the clustering in the graph. In Paper IV the interest is in the component structure of such a graph, i.e. the size and the emergence of a giant component is studied. The last paper, Paper V, treats the situation when a simple epidemic is running in a varying environment. A varying environment is in this context any external factor that affects the contact rate in the population, but is itself unaffected by the population. The model treated is a term-time forced version of the stochastic general epidemic where the contact rate is modelled by an alternating renewal process. A threshold parameter R_* and the probability of a large outbreak are derived and studied.

A large dam model is the object of study of this paper. The parametersLlowerandLupperdefine its lower and upper levels,L=Lupper-Lloweris large, and if the current level of water is between these bounds, the dam is assumed to be in a normal state. Passage across one or other of the levels leads to damage. LetJ1andJ2denote the damage costs of crossing the lower and, respectively, the upper levels. It is assumed that the input stream of water is described by a Poisson process, while the output stream is state dependent. LetLtdenote the dam level at timet, and letp1= limt→∞P{Lt=Llower} andp2= limt→∞P{Lt>Lupper} exist. The long-run average cost,J=p1J1+p2J2, is a performance measure. The aim of the paper is to choose the parameter controlling the output stream so as to minimizeJ.

This paper is concerned with the analysis of Markov decision processes in which a natural form of termination ensures that the expected future costs are bounded, at least under some policies. Whereas most previous analyses have restricted attention to the case where the set of states is finite, this paper analyses the case where the set of states is not necessarily finite or even countable. It is shown that all the existence, uniqueness, and convergence results of the finite-state case hold when the set of states is a general Borel space, provided we make the additional assumption that the optimal value function is bounded below. We give a sufficient condition for the optimal value function to be bounded below which holds, in particular, if the set of states is countable.

Let X = (X1, X2, …, Xn) be an exchangeable random vector, and write X(1:i) = min{X1, X2, …, Xi}, 1 ≤ i ≤ n. In this paper we obtain conditions under which X(1:i) decreases in i in the hazard rate order. A result involving more general (that is, not necessarily exchangeable) random vectors is also derived. These results are applied to obtain the limiting behaviour of the hazard rate function of the lifetimes of various coherent systems in reliability theory. The notions of the Samaniego signatures and the minimal signatures of such systems are extensively used in the paper. An interesting relationship between these two signatures is obtained. The results are illustrated in a series of examples.

We study the uncertain dichotomous choice model. In this model, a group of expert decision makers is required to select one of two alternatives. The applications of this model are relevant to a wide variety of areas. A decision rule translates the individual opinions of the members into a group decision, and is optimal if it maximizes the probability of the group making a correct choice. In this paper, we assume the correctness probabilities of the experts to be independent random variables selected from some given distribution. Moreover, the ranking of the members in the group is (at least partly) known. Thus, one can follow rules based on this ranking. The extremes are the expert rule and the majority rule. The probabilities of the two extreme rules being optimal were compared in a series of early papers, for a variety of distributions. In most cases, the asymptotic behaviours of the probabilities of the two extreme rules followed the same patterns. Do these patterns hold in general? If not, what are the ranges of possible asymptotic behaviours of the probabilities of the two extreme rules being optimal? In this paper, we provide satisfactory answers to these questions.

This thesis consists of four papers.In paper 1, we prove central limit theorems for Markov chains under (local) contraction conditions. As a corollary we obtain a central limit theorem for Markov chains associated with iterated function systems with contractive maps and place-dependent Dini-continuous probabilities.In paper 2, properties of inverse subordinators are investigated, in particular similarities with renewal processes. The main tool is a theorem on processes that are both renewal and Cox processes.In paper 3, distributional properties of supercritical and especially immortal branching processes are derived. The marginal distributions of immortal branching processes are found to be compound geometric.In paper 4, a description of a dynamic population model is presented, such that samples from the population have genealogies as given by a Lambda-coalescent with mutations. Depending on whether the sample is grouped according to litters or families, the sampling distribution is either regenerative or non-regenerative.

In this paper, we describe a class of Wiener functionals that are ‘indeterminate by their moments’, that is, whose distributions are not uniquely determined by their moments. In particular, it is proved that the integral of a geometric Brownian motion is indeterminate by its moments and, moreover, shown that previous proofs of this result are incorrect. The main result of this paper is based on geometric inequalities in Gauss space and on a generalization of the Krein criterion due to H. L. Pedersen.

This paper studies a discrete-time single-server queue with two independent inputs and service interruptions. One of the inputs to the queue is an independent and identically distributed process. The other is a much more general process and it is not required to be Markov nor is it required to be stationary. The service interruption process is also general and it is not required to be Markov or to be stationary. This paper shows that a stochastic decomposition property for the virtual waiting-time process holds in the discrete-time single-server queue with service interruptions. To the best of the author's knowledge, no stochastic decomposition results for virtual waiting-time processes in non-work-conserving queues, such as queues with service interruptions, have been obtained before and only work-conserving queues have been studied in the literature.

In this paper, we study the on-line parameter estimation problem for a partially observable system subject to deterioration and random failure. The state of the system evolves according to a continuous-time homogeneous Markov process with a finite state space. The state of the system is hidden except for the failure state. When the system is operating, only the information obtained by condition monitoring, which is related to the working state of the system, is available. The condition monitoring observations are assumed to be in continuous range, so that no discretization is required. A recursive maximum likelihood (RML) algorithm is proposed for the on-line parameter estimation of the model. The new RML algorithm proposed in the paper is superior to other RML algorithms in the literature in that no projection is needed and no calculation of the gradient on the surface of the constraint manifolds is required. A numerical example is provided to illustrate the algorithm.

This thesis, consisting of six papers and a summary, studies the area of continuous time financial mathematics. A unifying theme for many of the problems studied is the implications of possible mis-specifications of models. Intimately connected with this question is, perhaps surprisingly, convexity properties of option prices. We also study qualitative behavior of different optimal stopping boundaries appearing in option pricing.In Paper I a new condition on the contract function of an American option is provided under which the option price increases monotonically in the volatility. It is also shown that American option prices are continuous in the volatility.In Paper II an explicit pricing formula for the perpetual American put option in the Constant Elasticity of Variance model is derived. Moreover, different properties of this price are studied.Paper III deals with the Russian option with a finite time horizon. It is shown that the value of the Russian option solves a certain free boundary problem. This information is used to analyze the optimal stopping boundary.A study of perpetual game options is performed in Paper IV. One of the main results provides a condition under which the value of the option is increasing in the volatility.In Paper V options written on several underlying assets are considered. It is shown that, within a large class of models, the only model for the stock prices that assigns convex option prices to all convex contract functions is geometric Brownian motion.Finally, in Paper VI it is shown that the optimal stopping boundary for the American put option is convex in the standard Black-Scholes model.

Suppose that {X s , 0 ≤ s ≤ T} is an m-dimensional geometric Brownian motion with drift, μ is a bounded positive Borel measure on [0,T], and ϕ : ℝ m → [0,∞) is a (weighted) l q (ℝ m )-norm, 1 ≤ q ≤ ∞. The purpose of this paper is to study the distribution and the moments of the random variable Y given by the L p (μ)-norm, 1 ≤ p ≤ ∞, of the function s ↦ ϕ(X s ), 0 ≤ s ≤ T. By using various geometric inequalities in Wiener space, this paper gives upper and lower bounds for the distribution function of Y and proves that the distribution function is log-concave and absolutely continuous on every open subset of the distribution's support. Moreover, the paper derives tail probabilities, presents sharp moment inequalities, and shows that Y is indetermined by its moments. The paper will also discuss the so-called moment-matching method for the pricing of Asian-styled basket options.

In this paper, we study the classification of matrix GI/M/1-type Markov chains with a tree structure. We show that the Perron–Frobenius eigenvalue of a Jacobian matrix provides information for classifying these Markov chains. A fixed-point approach is utilized. A queueing application is presented to show the usefulness of the classification method developed in this paper.

In this paper, we consider denumerable-state continuous-time Markov decision processes with (possibly unbounded) transition and reward rates and general action space under the discounted criterion. We provide a set of conditions weaker than those previously known and then prove the existence of optimal stationary policies within the class of all possibly randomized Markov policies. Moreover, the results in this paper are illustrated by considering the birth-and-death processes with controlled immigration in which the conditions in this paper are satisfied, whereas the earlier conditions fail to hold.

This paper presents an algorithmic procedure to calculate the delay distribution of a type k customer in a first-come-first-served (FCFS) discrete-time queueing system with multiple types of customers, where each type has different service requirements (the MMAP[K]/PH[K]/1 queue). First, we develop a procedure, using matrix analytical methods, to handle arrival processes that do not allow batch arrivals to occur. Next, we show that this technique can be generalized to arrival processes that do allow batch arrivals to occur. We end the paper by presenting some numerical examples.

Consider a renewal process. The renewal events partition the process into i.i.d. renewal cycles. Assume that on each cycle, a rare event called 'success’ can occur. Such successes lend themselves naturally to approximation by Poisson point processes. If each success occurs after a random delay, however, Poisson convergence may be relatively slow, because each success corresponds to a time interval, not a point. In 1996, Altschul and Gish proposed a finite-size correction to a particular approximation by a Poisson point process. Their correction is now used routinely (about once a second) when computers compare biological sequences, although it lacks a mathematical foundation. This paper generalizes their correction. For a single renewal process or several renewal processes operating in parallel, this paper gives an asymptotic expansion that contains in successive terms a Poisson point approximation, a generalization of the Altschul-Gish correction, and a correction term beyond that.

The paper considers one of the standard processes for modeling returns in finance, the stochastic volatility process with regularly varying innovations. The aim of the paper is to show how point process techniques can be used to derive the asymptotic behavior of the sample autocorrelation function of this process with heavy-tailed marginal distributions. Unlike other non-linear models used in finance, such as GARCH and bilinear models, sample autocorrelations of a stochastic volatility process have attractive asymptotic properties. Specifically, in the infinite variance case, the sample autocorrelation function converges to zero in probability at a rate that is faster the heavier the tails of the marginal distribution. This behavior is analogous to the asymptotic behavior of the sample autocorrelations of independent identically distributed random variables.

This paper studies the dependence structure and bounds of several basic prototypical parallel queueing systems with correlated arrival processes to different queues. The marked feature of our systems is that each queue viewed alone is a standard single-server queuing system extensively studied in the literature, but those queues are statistically dependent due to correlated arrival streams. The major difficulty in analysing those systems is that the presence of correlation makes the explicit computation of a joint performance measure either intractable or computationally intensive. In addition, it is not well understood how and in what sense arrival correlation will improve or deteriorate a system performance measure. The objective of this paper is to provide a better understanding of the dependence structure of correlated queueing systems and to derive computable bounds for the statistics of a joint performance measure. In this paper, we obtain conditions on arrival processes under which a performance measure in two systems can be compared, in the sense of orthant and supermodular orders, among different queues and over different arrival times. Such strong comparison results enable us to study both spatial dependence (dependence among different queues) and temporal dependence (dependence over different time instances) for a joint performance measure. Further, we derive a variety of upper and lower bounds for the statistics of a stationary joint performance measure. Finally, we apply our results to synchronized queueing systems, using the ideas combined from the theory of orthant and supermodular dependence orders and majorization with respect to weighted trees (Xu and Li (2000)). Our results reveal how a performance measure can be affected, favourably or adversely, by different types of dependencies.

This paper arose from interest in assessing the quality of random number generators. The problem of testing randomness of a string of binary bits produced by such a generator gained importance with the wide use of public key cryptography and the need for secure encryption algorithms. All such algorithms are based on a generator of (pseudo) random numbers; the testing of such generators for randomness became crucial for the communications industry where digital signatures and key management are vital for information processing. The concept of approximate entropy has been introduced in a series of papers by S. Pincus and co-authors. The corresponding statistic is designed to measure the degree of randomness of observed sequences. It is based on incremental contrasts of empirical entropies based on the frequencies of different patterns in the sequence. Sequences with large approximate entropy must have substantial fluctuation or irregularity. Alternatively, small values of this characteristic imply strong regularity, or lack of randomness, in a sequence. Pincus and Kalman (1997) evaluated approximate entropies for binary and decimal expansions of e, π, √2 and √3 with the surprising conclusion that the expansion of √3 demonstrated much less irregularity than that of π. Tractable small sample distributions are hardly available, and testing randomness is based, as a rule, on fairly long strings. Therefore, to have rigorous statistical tests of randomness based on this approximate entropy statistic, one needs the limiting distribution of this characteristic under the randomness assumption. Until now this distribution remained unknown and was thought to be difficult to obtain. To derive the limiting distribution of approximate entropy we modify its definition. It is shown that the approximate entropy as well as its modified version converges in distribution to a χ2-random variable. The P-values of approximate entropy test statistics for binary expansions of e, π and √3 are plotted. Although some of these values for √3 digits are small, they do not provide enough statistical significance against the randomness hypothesis.

In this paper, we give necessary and sufficient conditions to ensure the validity of confidence intervals, based on the central limit theorem, in simulations of highly reliable Markovian systems. We resort to simulations because of the frequently huge state space in practical systems. So far the literature has focused on the property of bounded relative error. In this paper we focus on ‘bounded normal approximation’ which asserts that the approximation of the normal law, suggested by the central limit theorem, does not deteriorate as the reliability of the system increases. Here we see that the set of systems with bounded normal approximation is (strictly) included in the set of systems with bounded relative error.

On the basis of the Karlin and McGregor result, which states that the transition probability functions of a birth and death process can be expressed via the introduction of an orthogonal polynomial system and a spectral measure, we investigate in this paper how the Laplace transforms and the distributions of different transient characteristics related to excursions of a birth and death process can be expressed by means of the basic orthogonal polynomial system and the spectral measure. This allows us in particular to give a probabilistic interpretation of the series introduced by Stieltjes to study the convergence of the fundamental continued fraction associated with the system. Throughout the paper, we pay special attention to the case when the birth and death process is ergodic. Under the assumption that the spectrum of the spectral measure is discrete, we show how the distributions of different random variables associated with excursions depend on the fundamental continued fraction, the orthogonal polynomial system and the spectral measure.

This paper consists of two parts. The first part provides a more elementary proof of the asymptotic theorem of the refusals stream for an M/GI/1/n queueing system discussed in Abramov (1991a). The central property of the refusals stream discussed in the second part of this paper is that, if the expectations of interarrival and service time of an M/GI/1/n queueing system are equal to each other, then the expectation of the number of refusals during a busy period is equal to 1. This property is extended for a wide family of single-server queueing systems with refusals including, for example, queueing systems with bounded waiting time.

In this paper we analyze a single server two-queue model with Bernoulli schedules. This discipline is very flexible and contains the exhaustive and 1-limited disciplines as special cases. We formulate the queueing system as a Riemann boundary value problem with shift. The boundary value problem is solved by exploring a Fredholm integral equation around the unit circle. Some numerical examples are presented at the end of the paper.

A number of recent papers have exhibited classes of queueing networks, with batches of customers served and routed through the network, which have generalised product-form equilibrium distributions. In this paper we look at these from a new viewpoint. In particular we show that, under standard assumptions, for a network to possess an equilibrium distribution that factorises into a product form over the nodes of the network for all possible transition rates, it is necessary and sufficient that it be equivalent to a suitably-defined single-movement network. We consider also the form of the state space for such networks.

In a famous paper, Dwass (1967) proposed a method to deal with rank order statistics, which constitutes a unifying framework to derive various distributional results. In the present paper an alternative method is presented, which allows us to extend Dwass's results in several ways, namely arbitrary endpoints, horizontal steps and arbitrary probabilities for the three step types. Regarding these extensions the pertaining rank order statistics are extended as well to simple random walk statistics. This method has proved appropriate to generalize all results given by Dwass. Moreover, these discrete time results can be taken as a starting point to derive the corresponding results for randomized random walks by means of a limiting process.

We consider the exact distribution of the number of peaks in a random permutation of the integers 1, 2, ···, n. This arises from a test of whether n successive observations from a continuous distribution are i.i.d. The Eulerian numbers, which figure in the p.g.f., are then shown to provide a link between the simpler problem of ascents (which has been thoroughly analysed) and both our problem of peaks and similar problems on the circle. This link then permits easy deduction of certain general properties, such as linearity in n of the cumulants, in the more complex settings. Since the focus of the paper is on exact distributional results, a uniform bound on the deviation from the limiting normal is included. A secondary purpose of the paper is synthesis, beginning with the more familiar setting of peaks and troughs.

This paper considers risk-sensitive average optimization for denumerable continuous-time Markov decision processes (CTMDPs), in which the transition and cost rates are allowed to be unbounded, and the policies can be randomized history dependent. We first derive the multiplicative dynamic programming principle and some new facts for risk-sensitive finite-horizon CTMDPs. Then, we establish the existence and uniqueness of a solution to the risk-sensitive average optimality equation (RS-AOE) through the results for risk-sensitive finite-horizon CTMDPs developed here, and also prove the existence of an optimal stationary policy via the RS-AOE. Furthermore, for the case of finite actions available at each state, we construct a sequence of models of finite-state CTMDPs with optimal stationary policies which can be obtained by a policy iteration algorithm in a finite number of iterations, and prove that an average optimal policy for the case of infinitely countable states can be approximated by those of the finite-state models. Finally, we illustrate the conditions and the iteration algorithm with an example.

In this paper, we study a large system of $N$ servers each with capacity to process at most $C$ simultaneous jobs and an incoming job is routed to a server if it has the lowest occupancy amongst $d$ (out of N) randomly selected servers. A job that is routed to a server with no vacancy is assumed to be blocked and lost. Such randomized policies are referred to JSQ(d) (Join the Shortest Queue out of $d$) policies. Under the assumption that jobs arrive according to a Poisson process with rate $N\lambda^{(N)}$ where $\lambda^{(N)}=\sigma-\frac{\beta}{\sqrt{N}}$, $\sigma\in\mb{R}_+$ and $\beta\in\mb{R}$, we establish functional central limit theorems (FCLTs) for the fluctuation process in both the transient and stationary regimes when service time distributions are exponential. In particular, we show that the limit is an Ornstein-Uhlenbeck process whose mean and variance depend on the mean-field of the considered model. Using this, we obtain approximations to the blocking probabilities for large $N$, where we can precisely estimate the accuracy of first-order approximations., Comment: 29 pages

This paper is concerned with the distibutions and the moments of the area and the local time of a random walk, called the Bernoulli meander. The limit behavior of the distributions and the moments is determined in the case where the number of steps in the random walk tends to infinity. The results of this paper yield explicit formulas for the distributions and the moments of the area and the local time for the Brownian meander.

This paper considers the asymptotic distribution of the maximum number of infectives in an epidemic model by showing that, as the initial number of susceptibles converges to infinity, the process of infectives converges almost surely to a birth and death process. The model studied here is more general than usual (see e.g. Bailey (1975), Bharucha-Reid (1960), Keilson (1979)) in that it incorporates immigration and the limiting birth and death process is non-linear. The main novelty of the present paper is the martingale approach used to prove the above-mentioned convergence. MAXIMUM NUMBER OF INFECTIVES; GAMBLER'S RUIN PROBLEM; MARTINGALE; BIRTH AND DEATH PROCESS AMS 1991 SUBJECT CLASSIFICATION: PRIMARY 92D30 SECONDARY 60J20; 60G42; 60G40; 60J80

The hazard rate ordering is an ordering for random variables which compares lifetimes with respect to their hazard rate functions. It is stronger than the usual stochastic order for random variables, yet is weaker than the likelihood ratio ordering. The hazard rate ordering is particularly useful in reliability theory and survival analysis, owing to the importance of the hazard rate function in these areas. In this paper earlier work on the hazard rate ordering is reviewed, and extensive new results related to coherent systems are derived. Initially we fix the form of a coherent structure and investigate the effect on the hazard rate function of the system when we switch the lifetimes of its components from the vector (T 1, · ··, Tn ) to the vector (T′ 1, · ··, T′n ), where the hazard rate functions of the two vectors are assumed to be comparable in some sense. Although the hazard rate ordering is closed under the formation of series systems, we see that this is not the case for parallel systems even when the system is a two-component parallel system with exponentially distributed lifetimes. A positive result shows that for two-component parallel systems with proportional hazards (λ 1 r(t), λ 2 r(t))), the more diverse (λ 1, λ2 ) is in the sense of majorization the stronger is the system in the hazard rate ordering. Unfortunately even this result does not extend to parallel systems with more than two components, demonstrating again the delicate nature of the hazard rate ordering. The principal result of the paper concerns the hazard rate ordering for the lifetime of a k-out-of-n system. It is shown that if τ k|n is the lifetime of a k-out-of-n system, then τ k|n is greater than τ k+ 1|n in the hazard rate ordering for any k. This has an interesting interpretation in the language of order statistics. For independent (not necessarily identically distributed) lifetimes T 1, · ··, Tn , we let Tk:n represent the kth order statistic (in increasing order). Then it is shown that Tk + 1:n is greater than Tk:n in the hazard rate ordering for all k = 1, ···, n − 1. The result does not, however, extend to the stronger likelihood ratio order.

A number of papers have recently appeared in the literature in which customers, in moving from node to node in the network arrive as either a positive customer or as a batch of negative customers. A positive customer joining its queue increases the number of customers at the queue by 1 and each negative customer decreases the queue length by 1, if possible. It has been shown that the equilibrium distribution for these networks assumes a geometric product form, that certain partial balance equations prevail and that the parameters of the geometric distributions are, as in Jackson networks, the service facility throughputs of customers. In this paper the previous work is generalised by allowing state dependence into both the service and routing intensities and by allowing the possibility, although not the necessity, for negative customers to build up at the nodes.

Two recent papers by Petruccelli and Woolford (1984) and Chan et al. (1985) showed that the key element governing ergodicity of a threshold AR(1) model is the joint behavior of the two linear AR(1) pieces falling in the two boundary threshold regimes. They used essentially the necessary and sufficient conditions for ergodicity of a general Markov chain of Tweedie (1974), (1975) in a rather clever manner. However, it is difficult to extend the results to the more general threshold ARMA models. Besides, irreducibility is also required to apply Tweedie's results. In this paper, instead of pursuing the ideas in Tweedie's results, we shall develop a criterion similar in spirit to the technique used by Beneš (1967) in the context of continuous-time Markov chains. Consequently, we derive a necessary and sufficient condition for existence of a strictly stationary solution of a general non-linear ARMA model to be introduced in Section 2 of this paper. This condition is then applied to the threshold ARMA(1, q) model to yield a sufficient condition for strict stationarity which is identical to the condition given by Petruccelli and Woolford (1984) for the threshold AR(1). Hence, the conjecture that the moving average component does not affect stationarity is partially verified. Furthermore, under an additional irreducibility assumption, ergodicity of a non-linear ARMA model is established. The paper then concludes with a necessary condition for stationarity of the threshold ARMA(1, q) model.

Comparison results for Markov processes with respect to function-class-induced (integral) stochastic orders have a long history. The most general results so far for this problem have been obtained based on the theory of evolution systems on Banach spaces. In this paper we transfer the martingale comparison method, known for the comparison of semimartingales to Markovian semimartingales, to general Markov processes. The basic step of this martingale approach is the derivation of the supermartingale property of the linking process, giving a link between the processes to be compared. This property is achieved using the characterization of Markov processes by the associated martingale problem in an essential way. As a result, the martingale comparison method gives a comparison result for Markov processes under a general alternative but related set of regularity conditions compared to the evolution system approach.

This paper investigates a financial market where stock returns depend on an unobservable Gaussian mean reverting drift process. Information on the drift is obtained from returns and randomly arriving discrete-time expert opinions. Drift estimates are based on Kalman filter techniques. We study the asymptotic behavior of the filter for high-frequency experts with variances that grow linearly with the arrival intensity. The derived limit theorems state that the information provided by discrete-time expert opinions is asymptotically the same as that from observing a certain diffusion process. These diffusion approximations are extremely helpful for deriving simplified approximate solutions of utility maximization problems.