Search

Testing covariance matrices is crucial in high-dimensional statistics. Traditional methods based on the Frobenius and supremum norms are widely used but often treat the covariance matrix as a vector and neglect its inherent matrix structure. This paper introduces a new testing framework based on the operator norm, designed to capture the spectral properties of the covariance matrix more accurately. The commonly used empirical bootstrap and multiplier bootstrap methods are shown to fail for operator norm-based statistics. To derive the critical values of this type of statistics, we propose a universal bootstrap procedure, utilizing the concept of universality from random matrix theory. Our method demonstrates consistency across both high- and ultra-high-dimensional regimes, accommodating scenarios where the dimension-to-sample-size ratio $p/n$ converges to a nonzero constant or diverges to infinity. As a byproduct, we provide the first proof of the Tracy-Widom law for the largest eigenvalue of sample covariances with non-Gaussian entries as $p/n \to \infty$. We also show such universality does not hold for the Frobenius norm and supremum norm statistics. Extensive simulations and a real-world data study support our findings, highlighting the favorable finite sample performance of the proposed operator norm-based statistics.

In wireless communication systems, the accurate and reliable evaluation of channel capacity is believed to be a fundamental and critical issue for terminals. However, with the rapid development of wireless technology, large-scale communication networks with significant random interference have emerged, resulting in extremely high computational costs for capacity calculation. In ultra-dense wireless networks with extremely large numbers of base stations (BSs) and users, we provide fast estimation methods for determining the capacity. We consider two scenarios according to the ratio of the number of users to the number of BSs, $\beta_m$. First, when $\beta_m\leq1$, the FIsher-Spiked Estimation (FISE) algorithm is proposed to determine the capacity by modeling the channel matrix with random interference as a Fisher matrix. Second, when $\beta_m>1$, based on a closed-form expression for capacity estimation requiring solely simple computations, we prove that this estimation stabilizes and remains invariant with increasing $\beta_m$. Our methods can guarantee high accuracy on capacity estimation with low complexity, which is faster than the existing methods. Furthermore, our approaches exhibit excellent generality, free of network area shapes, BS and user distributions, and sub-network locations. Extensive simulation experiments across various scenarios demonstrate the high accuracy and robustness of our methods.

Two-sample spiked model is an important issue in multivariate statistical inference. This paper focuses on testing the number of spikes in a high-dimensional generalized two-sample spiked model, which is free of Gaussian population assumption and the diagonal or block-wise diagonal restriction of population covariance matrix, and the spiked eigenvalues are not necessary required to be bounded. In order to determine the number of spikes, we first propose a general test, which relies on the partial linear spectral statistics. We establish its asymptotic normality under the null hypothesis. Then we apply the conclusion to two statistical problem, variable selection in large-dimensional linear regression and change point detection when change points and additive outliers exist simultaneously. Simulations and empirical analysis are conducted to illustrate the good performance of our methods.

Capacity is one of the most important performance metrics for wireless communication networks. It describes the maximum rate at which the information can be transmitted of a wireless communication system. To support the growing demand for wireless traffic, wireless networks are becoming more dense and complicated, leading to a higher difficulty to derive the capacity. Unfortunately, most existing methods for the capacity calculation take a polynomial time complexity. This will become unaffordable for future ultra-dense networks, where both the number of base stations (BSs) and the number of users are extremely large. In this paper, we propose a fast algorithm TOSE to estimate the capacity for ultra-dense wireless networks. Based on the spiked model of random matrix theory (RMT), our algorithm can avoid the exact eigenvalue derivations of large dimensional matrices, which are complicated and inevitable in conventional capacity calculation methods. Instead, fast eigenvalue estimations can be realized based on the spike approximations in our TOSE algorithm. Our simulation results show that TOSE is an accurate and fast capacity approximation algorithm. Its estimation error is below 5%, and it runs in linear time, which is much lower than the polynomial time complexity of existing methods. In addition, TOSE has superior generality, since it is independent of the distributions of BSs and users, and the shape of network areas., Comment: 6 pages, 4 figures. arXiv admin note: text overlap with arXiv:2204.03393

Wireless network capacity can be regarded as the most important performance metric for wireless communication systems. With the fast development of wireless communication technology, future wireless systems will become more and more complicated. As a result, the channel gain matrix will become a large-dimensional random matrix, leading to an extremely high computational cost to obtain the capacity. In this paper, we propose a moment passing method (MPM) to realize the fast and accurate capacity estimation for future ultra-dense wireless systems. It can determine the capacity with quadratic complexity, which is optimal considering that the cost of a single matrix operation is not less than quadratic complexity. Moreover, it has high accuracy. The simulation results show that the estimation error of this method is below 2 percent. Finally, our method is highly general, as it is independent of the distributions of BSs and users, and the shape of network areas. More importantly, it can be applied not only to the conventional multi-user multiple input and multiple output (MU-MIMO) networks, but also to the capacity-centric networks designed for B5G/6G.

Abnormal event detection is critical in the safe operation of power system. In this paper, using the data collected from phasor measurement units (PMUs), two methods based on Fisher random matrix are proposed to detect faults in power grids. Firstly, the fault detection matrix is constructed and the event detection problem is reformatted as a two-sample covariance matrices test problem. Secondly, the central limit theorem for the linear spectral statistic of the Fisher matrix is derived and a test statistic for testing faults is proposed. To save computing resources, the screening step of fault interval based on the test statistic is designed to check the existence of faults. Then two point-by-point methods are proposed to determine the time of the fault in the interval. One method detects faults by checking whether the largest sample eigenvalue falls outside the supporting set of limiting spectral distribution of the standard Fisher matrix, which can detect the faults with higher accuracy. The other method tests the faults based on the statistic proposed, which has a faster detection speed. Compared with existing works, the simulation results illustrate that two methods proposed in this paper cost less computational time and provide a higher degree of accuracy.

Wireless network capacity is one of the most important performance metrics for wireless communication networks. Future wireless networks will be composed of extremely large number of base stations (BSs) and users, and organized in the form of multiple clusters. Unfortunately, the determination of average cluster capacity for such future wireless networks is difficult, and lacks of both analytical expressions and fast algorithms. In this paper, we propose a fast algorithm TOSE to estimate the average cluster capacity based on the random matrix theory (RMT). It can avoid the exact eigenvalue derivations of large dimensional matrices, which are complicated and inevitable in conventional capacity determination methods. Instead, fast eigenvalue estimations can be realized based on RMT in our TOSE algorithm. In addition, we derive the analytical upper and lower bounds of the average cluster capacity. Our numerical experiments show that TOSE is faster than the conventional Cholesky decomposition method, by at least three orders of magnitude. Besides, TOSE has superior generality, since it is independent of the distributions of BSs and users, and the shape of network areas., Comment: Another version of this paper has been uploaded by another author

This paper proposes new estimators of the number of factors for a generalised factor model with more relaxed assumptions than the strict factor model. Under the framework of large cross-sections $N$ and large time dimensions $T$, we first derive the bias-corrected estimator $\hat \sigma^2_*$ of the noise variance in a generalised factor model by random matrix theory. Then we construct three information criteria based on $\hat \sigma^2_*$, further propose the consistent estimators of the number of factors. Finally, simulations and real data analysis illustrate that our proposed estimations are more accurate and avoid the overestimation in some existing works., Comment: 28 pages, 2 figures

This paper aims to derive asymptotical distributions of the spiked eigenvalues of the large-dimensional spiked Fisher matrices without Gaussian assumption and the restrictive assumptions on covariance matrices. We first establish invariance principle for the spiked eigenvalues of the Fisher matrix. That is, we show that the limiting distributions of the spiked eigenvalues are invariant over a large class of population distributions satisfying certain conditions. Using the invariance principle, we further established a central limit theorem (CLT) for the spiked eigenvalues. As some interesting applications, we use the CLT to derive the power functions of Roy Maximum root test for linear hypothesis in linear models and the test in signal detection. We conduct some Monte Carlo simulation to compare the proposed test with existing ones., Comment: 19 pages; 3 figures. arXiv admin note: text overlap with arXiv:1904.09236

This paper aims to test the number of spikes in a generalized spiked covariance matrix, the spiked eigenvalues of which may be extremely larger or smaller than the non-spiked ones. For a high-dimensional problem, we first propose a general test statistic and derive its central limit theorem by random matrix theory without a Gaussian population constraint. We then apply the result to estimate the noise variance and test the equality of the smallest roots in generalized spiked models. Simulation studies showed that the proposed test method was correctly sized, and the power outcomes showed the robustness of our statistic to deviations from a Gaussian population. Moreover, our estimator of the noise variance resulted in much smaller mean absolute errors and mean squared errors than existing methods. In contrast to previously developed methods, we eliminated the strict conditions of diagonal or block-wise diagonal form of the population covariance matrix and extend the work to a wider range without the assumption of normality. Thus, the proposed method is more suitable for real problems., Comment: 23 pages,3 figures

A generalized spiked Fisher matrix is considered in this paper. We establish a criterion for the description of the support of the limiting spectral distribution of high-dimensional generalized Fisher matrix and study the almost sure limits of the sample spiked eigenvalues where the population covariance matrices are arbitrary which successively removed an unrealistic condition posed in the previous works, that is, the covariance matrices are assumed to be diagonal or diagonal block-wise structure. In addition, we also give a consistent estimator of the population spiked eigenvalues. A series of simulations are conducted that support the theoretical results and illustrate the accuracy of our estimators., Comment: 21 pages, 36 figures

The universality for the local spiked eigenvalues is a powerful tool to deal with the problems of the asymptotic law for the bulks of spiked eigenvalues of high-dimensional generalized Fisher matrices. In this paper, we focus on a more generalized spiked Fisher matrix, where $\Sigma_1\Sigma_2^{-1}$ is free of the restriction of diagonal independence, and both of the spiked eigenvalues and the population 4th moments are not necessary required to be bounded. By reducing the matching four moments constraint to a tail probability, we propose a Generalized Four Moment Theorem (G4MT) for the bulks of spiked eigenvalues of high-dimensional generalized Fisher matrices, which shows that the limiting distribution of the spiked eigenvalues of a generalized spiked Fisher matrix is independent of the actual distributions of the samples provided to satisfy the our relaxed assumptions. Furthermore, as an illustration, we also apply the G4MT to the Central Limit Theorem for the spiked eigenvalues of generalized spiked Fisher matrix, which removes the strict condition of the diagonal block independence given in Wang and Yao (2017) and extends their result to a wider usage without the requirements of the bounded 4th moments and the diagonal block independent structure, meeting the actual cases better., Comment: 29pages, 4 figures

We consider a more generalized spiked covariance matrix $\Sigma$, which is a general non-definite matrix with the spiked eigenvalues scattered into a few bulks and the largest ones allowed to tend to infinity. By relaxing the matching of the 4th moment to a tail probability decay, a {\it Generalized Four Moment Theorem} (G4MT) is proposed to show the universality of the asymptotic law for the local spectral statistics of generalized spiked covariance matrices, which implies the limiting distribution of the spiked eigenvalues of the generalized spiked covariance matrix is independent of the actual distributions of the samples satisfying our relaxed assumptions. Moreover, by applying it to the Central Limit Theorem (CLT) for the spiked eigenvalues of the generalized spiked covariance matrix, we also extend the result of Bai and Yao (2012) to a general form of the population covariance matrix, where the 4th moment is not necessarily required to exist and the spiked eigenvalues are allowed to be dependent on the non-spiked ones, thus meeting the actual cases better., Comment: 48 pages, 4 figures,5 tables