Search

CG_DESCENT is a state-of-the-art algorithm to solve large-scale unconstrained minimization problems. However, research activities on CG_DESCENT in some other scenarios are relatively fewer. In this paper, by combining with the projection method of Solodov and Svaiter, we extend CG_DESCENT to solve large-scale nonlinear convex constrained monotone equations. The proposed method does not require the Jacobian information, even though it does not store any matrix at each iteration. It thus has the potential to solve large-scale non-smooth problems. Under some mild conditions, we show that the proposed method converges globally. Primary numerical results illustrate that the proposed method works quite well. Moreover, we also extend this method to solve the -norm regularized problems to decode a sparse signal in compressive sensing. Performance comparisons show that the proposed method is practical, efficient and competitive with the compared ones. [ABSTRACT FROM AUTHOR]

Abstract: Previous works describing the generalization performance of bipartite ranking algorithms are usually based on the assumption of (0–1) loss or the area under the receiver operating characteristic (ROC) curve. In this paper we go far beyond this classical framework by investigating the generalization performance of bipartite ranking algorithms with convex losses over reproducing kernel Hilbert spaces. Based on the McDiarmid inequality and Rademacher complexity, we establish the upper bound on the generalization error for a bipartite ranking algorithm. The theoretical analysis is different from the previous results on error analysis and shows the attractive uniform convergence property of regularized bipartite ranking algorithms. [Copyright &y& Elsevier]

Abstract: This paper presents variable neighborhood search (VNS) for the problem of finding the global minimum of a nonconvex function. The variable neighborhood search, which changes systematically neighborhood structures in the search for finding a better solution, is used to guide a set of standard improvement heuristics. This algorithm was tested on some standard test functions, and successful results were obtained. Its performance was compared with the other algorithms, and observed to be better. [Copyright &y& Elsevier]