The geometry of algorithms using hierarchical tensors.

Abstract: In this paper, the differential geometry of the novel hierarchical Tucker format for tensors is derived. The set of tensors with fixed tree T and hierarchical rank is shown to be a smooth quotient manifold, namely the set of orbits of a Lie group action corresponding to the non-unique basis representation of these hierarchical tensors. Explicit characterizations of the quotient manifold, its tangent space and the tangent space of are derived, suitable for high-dimensional problems. The usefulness of a complete geometric description is demonstrated by two typical applications. First, new convergence results for the nonlinear Gauss–Seidel method on are given. Notably and in contrast to earlier works on this subject, the task of minimizing the Rayleigh quotient is also addressed. Second, evolution equations for dynamic tensor approximation are formulated in terms of an explicit projection operator onto the tangent space of . In addition, a numerical comparison is made between this dynamical approach and the standard one based on truncated singular value decompositions. [Copyright &y& Elsevier]