Search

With the development of recent artificial intelligence technology, especially after the great success of AlphaGo, there has been a growing interest in applying reinforcement learning (RL) to solve energy management strategy (EMS) problems for hybrid electric vehicles. However, the issues of current RL algorithms including deployment inefficiency, safety constraint, and simulation-to-real gap make it inapplicable to many industrial EMS tasks. With these in mind and considering the fact that there exists many suboptimal EMS controllers which can generate plentiful amounts of interactive data containing informative behaviors, an offline RL training framework that tries to extract policies with the maximum possible utility out of the available offline data is proposed. Furthermore, with connected vehicle technology standard in many new cars, rather than bringing all the data to the storage and analytics, a scheduled training framework is put forward. This cloud-based approach not only alleviates the computational burden of edge devices, but also more importantly provides a deployment-efficient solution to EMS tasks that have to adapt to changes of driving cycle. To evaluate the effectiveness of the proposed algorithm on real controllers, a hardware-in-the-loop (HIL) test is performed and the superiority of the proposed algorithm in contrast to dynamic programming, behavior cloning, rule-based, and vanilla off-policy RL algorithms is given. [ABSTRACT FROM AUTHOR]

Due to the outstanding performance, composite materials are widely used and analyzing their properties and designing them based on performance has become a crucial task in the field of many manufacturing industries. Composite materials possess complex multiscale structures, and traditional fine-scale finite element modeling and analysis may lead to severe computational resource challenges. To overcome this difficulty, breakthroughs in key technologies of multiscale accelerated analysis algorithms are required. In this study, an innovative approach based on artificial intelligence and multiscale finite element method is presented. This approach involves partitioning the entire composite material structure into coarse grids that resemble homogenous structures of similar size, providing results consistent to fine-grid finite element analysis. By utilizing CNN for image feature recognition and employing the CGAN adversarial method, coarse-grid equivalent stiffness matrices and multiscale shape functions from completely random microstructures of composite materials can be obtained. Consequently, this enables a rapid response process from microstructure to low-resolution grid to high-resolution physical field, with remarkably accurate physical field results. Moreover, compared to traditional fine-grid finite element methods, this approach significantly reduces memory usage and computation time. This method is applicable to composite materials with varying shaped inclusions, different component properties, and diverse geometric distributions, allowing these materials to perform high-fidelity finite element calculations on coarse grids and predict their mechanical behavior. Furthermore, this breakthrough opens avenues for accelerating the optimization design of composite materials with diverse mechanical functionalities, by employing a bottom-up approach. [ABSTRACT FROM AUTHOR]

For the ongoing revolution in developing intelligent and connected vehicles (ICVs), there is a lack of research for powertrain control systems using the latest artificial intelligence and vehicle-to-everything technology that have already been widely adopted in the autonomous driving systems. In this context, recent development of deep reinforcement learning (DRL) and one of the latest computing frameworks are coupled to facilitate an onboard-based intelligent powertrain control. Taking the boost control of a diesel engine equipped with variable geometry turbocharger as an example, the results show that the final control behavior indicated by the cumulated rewards is improved by 50.43% and the learning efficiency is improved by 74.29% for the proposed curiosity-driven DRL algorithm, compared with the same structure DRL algorithm with classic random exploration policy. In addition, unlike most of the DRL-based powertrain optimization algorithms, which have only been applied to single-machine architecture, this work manages the proposed DRL algorithm in parallel and, more importantly, from an edge computing perspective. This, in addition to greatly speeding up the algorithm training, can also realize a good balance of control accuracy and generality depending upon the selected training scenario. Moreover, unlike most of the cloud computing frameworks, which require low network latency, the proposed architecture can achieve a similar final control performance even if good network communication is not allowed. Compared with other existing powertrain control methods, the proposed algorithm is able to approximate a global powertrain control optimization autonomously in a connected manner, making it attractive to current ICVs with advanced automated driving and traditional powertrain control. [ABSTRACT FROM AUTHOR]