Search

The field of artificial neural network (ANN) training has garnered significant attention in recent years, with researchers exploring various mathematical techniques for optimizing the training process. In particular, this paper focuses on advancing the current understanding of gradient flow and gradient descent optimization methods. Our aim is to establish a solid mathematical convergence theory for continuous-time gradient flow equations and gradient descent processes based on mathematical anaylsis tools.

In this paper, we study the optimal control of a discrete-time stochastic differential equation (SDE) of mean-field type, where the coefficients can depend on both a function of the law and the state of the process. We establish a new version of the maximum principle for discrete-time stochastic optimal control problems. Moreover, the cost functional is also of the mean-field type. This maximum principle differs from the classical principle since we introduce new discrete-time backward (matrix) stochastic equations. Based on the discrete-time backward stochastic equations where the adjoint equations turn out to be discrete backward SDEs with mean field, we obtain necessary first-order and sufficient optimality conditions for the stochastic discrete optimal control problem. To verify, we apply the result to production and consumption choice optimization problem.

In this paper, we consider linear quadratic optimal control with mean-field type for discrete-time stochastic systems with state and control dependent noise. An optimal control problem is studied for a linear mean-field stochastic differential equation with a quadratic cost functional. The coefficients and the weighting matrices in the cost functional are all assumed to be deterministic., Comment: arXiv admin note: text overlap with arXiv:2210.01197

Perturbation theory has long been a very useful tool in the hands of mathematicians and physicists. The purpose of this paper is to prove some perturbation results for infinitesimal generators of fractional strongly continuous cosine families. That is, we impose sufficient conditions such that $\mathscr{A}$ is the infinitesimal generator of a fractional strongly continuous cosine family in a Banach space $\mathcal{X}$, and $\mathscr{B}$ is a bounded linear operator in $\mathcal{X}$, then $\mathscr{A}+\mathscr{B}$ is also the infinitesimal generator of a fractional strongly continuous cosine family in $\mathcal{X}$. Our results coincide with the classical ones when $\alpha=2$.

The novelty of our paper is to establish results on asymptotic stability of mild solutions in $p$th moment to Riemann-Liouville fractional stochastic neutral differential equations (for short Riemann-Liouville FSNDEs) of order $\alpha \in (\frac{1}{2},1)$ using a Banach's contraction mapping principle. The core point of this paper is to derive the mild solution of FSNDEs involving Riemann-Liouville fractional time-derivative by applying the stochastic version of variation of constants formula. The results are obtained with the help of the theory of fractional differential equations, some properties of Mittag-Leffler functions and asymptotic analysis under the assumption that the corresponding fractional stochastic neutral dynamical system is asymptotically stable., Comment: This article has been published in Miskolc Mathematical Notes. arXiv admin note: text overlap with arXiv:2103.07690

In this article, we deal with fractional stochastic differential equations, so-called Caputo type fractional backward stochastic differential equations (Caputo fBSDEs, for short), and study the well-posedness of an adapted solution to Caputo fBSDEs of order $\alpha \in (\frac{1}{2},1)$ whose coefficients satisfy a Lipschitz condition. A novelty of the article is that we introduce a new weighted norm in the square integrable measurable function space that is useful for proving a fundamental lemma and its well-posedness. For this class of systems, we then show the coincidence between the notion of stochastic Volterra integral equation and the mild solution., Comment: arXiv admin note: substantial text overlap with arXiv:2109.08950

Backward stochastic differential equations (BSDEs) belong nowadays to the most frequently studied equations in stochastic analysis and computational stochastics. In this paper we prove that Picard iterations of BSDEs with globally Lipschitz continuous nonlinearities converge exponentially fast to the solution. Our main result in this paper is to establish a fundamental lemma to prove the global existence and uniqueness of an adapted solution to a singular backward stochastic nonlinear Volterra integral equation (for short singular BSVIE) of order $\alpha \in (\frac{1}{2},1)$ under a weaker condition than Lipschitz one in a Hilbert space.

A strong inspiration for studying perturbation theory for fractional evolution equations comes from the fact that they have proven to be useful tools in modeling many physical processes. In this paper, we study fractional evolution equations of order $\alpha\in (1,2]$ associated with the infinitesimal generator of an operator fractional cosine function generated by bounded time-dependent perturbations in a Banach space. We show that the abstract fractional Cauchy problem associated with the infinitesimal generator $A$ of a strongly continuous fractional cosine function remains uniformly well-posed under bounded time-dependent perturbation of $A$. We also provide some necessary special cases.

In this paper, we study the exact asymptotic separation rate of two distinct solutions of Caputo stochastic multi-term differential equations (Caputo SMTDEs for short). Our goal in this paper is to establish results on the global existence and uniqueness and continuity dependence of the initial values of the solutions to Caputo SMTDEs with non-permutable matrices of order $\alpha \in (\frac{1}{2},1)$ and $\beta \in (0,1)$ whose coefficients satisfy a standard Lipschitz condition. For this class of systems, we then show the asymptotic separation property between two different solutions of Caputo SMTDEs with a more general condition based on $\lambda$. Also, the asymptotic separation rate for the two distinct mild solutions reveals that our asymptotic results are general.

A strong inspiration for studying Sobolev type fractional evolution equations comes from the fact that have been verified to be useful tools in the modeling of many physical processes. We introduce a novel technique for solving Sobolev type fractional evolution equations with multi-orders in a Banach space. We propose a new Mittag-Leffler type function which is generated by linear bounded operators and investigate their properties which are productive for checking the candidate solutions for multi-term fractional differential equations. Furthermore, we propose an exact analytical representation of solutions for multi-dimensional fractional-order dynamical systems with nonpermutable and permutable matrices.

In recent years, the theory for Leibniz integral rule in the fractional sense has not been able to get substantial development. As an urgent problem to be solved, we study a Leibniz integral rule for Riemann-Liouville and Caputo type differentiation operators with general fractional-order of $n-1 <\alpha \leq n$, $n \in \mathbb{N}$ . A rule of fractional differentiation under integral sign with general order is necessary and applicable tool for verification by substitution for candidate solutions of inhomogeneous multi-term fractional differential equations. We derive explicit analytical solutions of generalized Bagley-Torvik equations in terms of recently defined bivariate Mittag-Leffler type functions that based on fractional Green's function method and verified solutions by substitution in accordance by applying the fractional Leibniz integral rule. Furthermore, we study an oscillator equation as a special case of differential equations with multi-orders via the Leibniz integral rule.

In this paper, we consider Caputo type fractional stochastic time-delay system with permutable matrices. We derive stochastic analogue of variation of constants formula via a newly defined delayed Mittag-Leffer type matrix function. Thus, we investigate new results on existence and uniqueness of mild solutions with the help of weighted maximum norm to fractional stochastic time-delay differential equations whose coefficients satisfy standard Lipschitz conditions. The main points in the proof are to apply Ito's isometry and martingale representation theorem, and to show the notion of a coincidence between the integral equation and the mild solution. Finally, we study complete controllability results for linear and nonlinear fractional stochastic delay dynamical systems with Wiener noise.