Search

Advanced internal combustion engine technologies have afforded an increase in the number of controllable variables and the ability to optimize engine operation. Values for these variables are determined during engine calibration by means of a tabular static correlation between the controllable variables and the corresponding steady-state engine operating points to achieve desirable engine performance, for example, in fuel economy, pollutant emissions, and engine acceleration. In engine use, table values are interpolated to match actual operating points. State-of-the-art calibration methods cannot guarantee continuously the optimal engine operation for the entire operating domain, especially in transient cases encountered in the driving styles of different drivers. This article presents brief theory and algorithmic implementation that make the engine an autonomous intelligent system capable of learning the required values of controllable variables in real time while operating a vehicle. The engine controller progressively perceives the driver's driving style and eventually learns to operate in a manner that optimizes specified performance criteria. A gasoline engine model, which learns to optimize fuel economy with respect to spark ignition timing, demonstrates the approach. [ABSTRACT FROM AUTHOR]

Modeling dynamic systems incurring stochastic disturbances for deriving a control policy is a ubiquitous task in engineering. However, in some instances obtaining a model of a system may be impractical or impossible. Alternative approaches have been developed using a simulation-based stochastic framework, in which the system interacts with its environment in real time and obtains information that can be processed to produce an optimal control policy. In this context, the problem of developing a policy for controlling the system's behavior is formulated as a sequential decision-making problem under uncertainty. This paper considers the problem of deriving a control policy for a dynamic system with unknown dynamics in real time, formulated as a sequential decision-making under uncertainty. The evolution of the system is modeled as a controlled Markov chain. A new state-space representation model and a learning mechanism are proposed that can be used to improve system performance over time. The major difference between the existing methods and the proposed learning model is that the latter utilizes an evaluation function, which considers the expected cost that can be achieved by state transitions forward in time. The model allows decision-making based on gradually enhanced knowledge of system response as it transitions from one state to another, in conjunction with actions taken at each state. The proposed model is demonstrated on the single cart-pole balancing problem and a vehicle cruise-control problem. [ABSTRACT FROM AUTHOR]