Search

Your search keyword '"Zhao, Yangyang"' showing total 1,223 results
Start Over Author "Zhao, Yangyang" Search Limiters Peer Reviewed
1,223 results on '"Zhao, Yangyang"'

1. Comparison of PM-HIP to Forged SA508 Pressure Vessel Steel Under High-Dose Neutron Irradiation

Author

Jiang, Wen, Zhao, Yangyang, Lu, Yu, Wu, Yaqiao, Frazer, David, Guillen, Donna P., Gandy, David W., and Wharry, Janelle P.

Subjects
Condensed Matter - Materials Science
Abstract

Powder metallurgy with hot isostatic pressing (PM-HIP) is an advanced manufacturing process that is envisioned to replace forging for heavy nuclear components, including the reactor pressure vessel (RPV). But PM-HIP products must at least demonstrate comparable irradiation tolerance than forgings in order to be qualified for nuclear applications. The objective of this study is to directly compare PM-HIP to forged SA508 Grade 3 Class 1 low-alloy RPV steel at two neutron irradiation conditions: ~0.5-1.0 displacements per atom (dpa) at ~270C and ~370C. PM-HIP SA508 experiences greater irradiation hardening and embrittlement (total elongation) than forged SA508. However, uniform elongation and approximate toughness are comparable across all irradiated materials, suggesting irradiated PM-HIP SA508 exhibits superior ductility at maximum load-bearing capacity. The irradiation hardening mechanism is linked to composition rather than fabrication method. Since PM-HIP SA508 has higher Mn and Ni concentration, it is more susceptible to irradiation-induced nucleation of Mn-Ni-Si-P (MNSP) nanoprecipitates and dislocation loops, which both contribute to hardening. Conversely, the forged material nucleates fewer MNSPs, causing dislocation loops to control irradiation hardening. These results show promise for the irradiation performance of PM-HIP SA508 and can motivate future nuclear code qualification of PM-HIP fabrication for RPVs.

Published
2023

7. Rescue Conversations from Dead-ends: Efficient Exploration for Task-oriented Dialogue Policy Optimization

Author

Zhao, Yangyang, Wang, Zhenyu, Dastani, Mehdi, and Wang, Shihan

Subjects
Computer Science - Human-Computer Interaction, Computer Science - Computation and Language
Abstract

Training a dialogue policy using deep reinforcement learning requires a lot of exploration of the environment. The amount of wasted invalid exploration makes their learning inefficient. In this paper, we find and define an important reason for the invalid exploration: dead-ends. When a conversation enters a dead-end state, regardless of the actions taken afterward, it will continue in a dead-end trajectory until the agent reaches a termination state or maximum turn. We propose a dead-end resurrection (DDR) algorithm that detects the initial dead-end state in a timely and efficient manner and provides a rescue action to guide and correct the exploration direction. To prevent dialogue policies from repeatedly making the same mistake, DDR also performs dialogue data augmentation by adding relevant experiences containing dead-end states. We first validate the dead-end detection reliability and then demonstrate the effectiveness and generality of the method by reporting experimental results on several dialogue datasets from different domains.

Published
2023

8. Multi-targets Formation Tracking for Lipschitz-Type Nonlinear Systems via Event-Triggered Scheme

Author

Zhang, Wenfei, Li, Haiqing, Zhao, Yangyang, Jing, Luqi, Zhao, Yu, Angrisani, Leopoldo, Series Editor, Arteaga, Marco, Series Editor, Chakraborty, Samarjit, Series Editor, Chen, Shanben, Series Editor, Chen, Tan Kay, Series Editor, Dillmann, Rüdiger, Series Editor, Duan, Haibin, Series Editor, Ferrari, Gianluigi, Series Editor, Ferre, Manuel, Series Editor, Hirche, Sandra, Series Editor, Jabbari, Faryar, Series Editor, Jia, Limin, Series Editor, Kacprzyk, Janusz, Series Editor, Khamis, Alaa, Series Editor, Kroeger, Torsten, Series Editor, Li, Yong, Series Editor, Liang, Qilian, Series Editor, Martín, Ferran, Series Editor, Ming, Tan Cher, Series Editor, Minker, Wolfgang, Series Editor, Misra, Pradeep, Series Editor, Mukhopadhyay, Subhas, Series Editor, Ning, Cun-Zheng, Series Editor, Nishida, Toyoaki, Series Editor, Oneto, Luca, Series Editor, Panigrahi, Bijaya Ketan, Series Editor, Pascucci, Federica, Series Editor, Qin, Yong, Series Editor, Seng, Gan Woon, Series Editor, Speidel, Joachim, Series Editor, Veiga, Germano, Series Editor, Wu, Haitao, Series Editor, Zamboni, Walter, Series Editor, Tan, Kay Chen, Series Editor, Jiang, Guo-Ping, editor, Wang, Mengyi, editor, and Ren, Zhang, editor

Published
2024
Full Text
View/download PDF

9. Research on State Detection Method of Complex System Based on Unknown Input

Author

Niu, Wei, Bai, Jie, Zhao, Yangyang, Wang, Sen, Angrisani, Leopoldo, Series Editor, Arteaga, Marco, Series Editor, Chakraborty, Samarjit, Series Editor, Chen, Shanben, Series Editor, Chen, Tan Kay, Series Editor, Dillmann, Rüdiger, Series Editor, Duan, Haibin, Series Editor, Ferrari, Gianluigi, Series Editor, Ferre, Manuel, Series Editor, Hirche, Sandra, Series Editor, Jabbari, Faryar, Series Editor, Jia, Limin, Series Editor, Kacprzyk, Janusz, Series Editor, Khamis, Alaa, Series Editor, Kroeger, Torsten, Series Editor, Li, Yong, Series Editor, Liang, Qilian, Series Editor, Martín, Ferran, Series Editor, Ming, Tan Cher, Series Editor, Minker, Wolfgang, Series Editor, Misra, Pradeep, Series Editor, Mukhopadhyay, Subhas, Series Editor, Ning, Cun-Zheng, Series Editor, Nishida, Toyoaki, Series Editor, Oneto, Luca, Series Editor, Panigrahi, Bijaya Ketan, Series Editor, Pascucci, Federica, Series Editor, Qin, Yong, Series Editor, Seng, Gan Woon, Series Editor, Speidel, Joachim, Series Editor, Veiga, Germano, Series Editor, Wu, Haitao, Series Editor, Zamboni, Walter, Series Editor, Tan, Kay Chen, Series Editor, and Fu, Song, editor

Published
2024
Full Text
View/download PDF

10. Research on Data Standardization of Airborne Embedded Equipment Based on IPMI

Author

Zhao, Yangyang, Niu, Wei, Liu, Yuan, Ma, Zhenhua, Wu, Ziyu, Angrisani, Leopoldo, Series Editor, Arteaga, Marco, Series Editor, Chakraborty, Samarjit, Series Editor, Chen, Shanben, Series Editor, Chen, Tan Kay, Series Editor, Dillmann, Rüdiger, Series Editor, Duan, Haibin, Series Editor, Ferrari, Gianluigi, Series Editor, Ferre, Manuel, Series Editor, Hirche, Sandra, Series Editor, Jabbari, Faryar, Series Editor, Jia, Limin, Series Editor, Kacprzyk, Janusz, Series Editor, Khamis, Alaa, Series Editor, Kroeger, Torsten, Series Editor, Li, Yong, Series Editor, Liang, Qilian, Series Editor, Martín, Ferran, Series Editor, Ming, Tan Cher, Series Editor, Minker, Wolfgang, Series Editor, Misra, Pradeep, Series Editor, Mukhopadhyay, Subhas, Series Editor, Ning, Cun-Zheng, Series Editor, Nishida, Toyoaki, Series Editor, Oneto, Luca, Series Editor, Panigrahi, Bijaya Ketan, Series Editor, Pascucci, Federica, Series Editor, Qin, Yong, Series Editor, Seng, Gan Woon, Series Editor, Speidel, Joachim, Series Editor, Veiga, Germano, Series Editor, Wu, Haitao, Series Editor, Zamboni, Walter, Series Editor, Tan, Kay Chen, Series Editor, and Fu, Song, editor

Published
2024
Full Text
View/download PDF

11. Adaptive Fault-Tolerant Formation Control for Multiple UAVs Under Unknown Actuator Faults

Author

Wang, Gen, Liu, Zhong, Yang, Kaiwen, Zhao, Yangyang, Jing, Luqi, Wang, Bohang, Angrisani, Leopoldo, Series Editor, Arteaga, Marco, Series Editor, Chakraborty, Samarjit, Series Editor, Chen, Shanben, Series Editor, Chen, Tan Kay, Series Editor, Dillmann, Rüdiger, Series Editor, Duan, Haibin, Series Editor, Ferrari, Gianluigi, Series Editor, Ferre, Manuel, Series Editor, Hirche, Sandra, Series Editor, Jabbari, Faryar, Series Editor, Jia, Limin, Series Editor, Kacprzyk, Janusz, Series Editor, Khamis, Alaa, Series Editor, Kroeger, Torsten, Series Editor, Li, Yong, Series Editor, Liang, Qilian, Series Editor, Martín, Ferran, Series Editor, Ming, Tan Cher, Series Editor, Minker, Wolfgang, Series Editor, Misra, Pradeep, Series Editor, Mukhopadhyay, Subhas, Series Editor, Ning, Cun-Zheng, Series Editor, Nishida, Toyoaki, Series Editor, Oneto, Luca, Series Editor, Panigrahi, Bijaya Ketan, Series Editor, Pascucci, Federica, Series Editor, Qin, Yong, Series Editor, Seng, Gan Woon, Series Editor, Speidel, Joachim, Series Editor, Veiga, Germano, Series Editor, Wu, Haitao, Series Editor, Zamboni, Walter, Series Editor, Tan, Kay Chen, Series Editor, Wang, Qing, editor, Dong, Xiwang, editor, and Song, Peng, editor

Published
2024
Full Text
View/download PDF

12. Research on Embedded Device Data Standardization Technology Based on OSA-CBM

Author

Zhao, Yangyang, Niu, Wei, Gao, Bo, Ma, Zhenhua, Yan, TanBao, Cheng, Qianxiao, Chinese Society of Aeronautics and Astronautics, Chaari, Fakher, Series Editor, Gherardini, Francesco, Series Editor, Ivanov, Vitalii, Series Editor, Haddar, Mohamed, Series Editor, Cavas-Martínez, Francisco, Editorial Board Member, di Mare, Francesca, Editorial Board Member, Kwon, Young W., Editorial Board Member, Trojanowska, Justyna, Editorial Board Member, and Xu, Jinyang, Editorial Board Member

Published
2024
Full Text
View/download PDF

14. Risk factors of postoperative airway obstruction complications in children with oral floor mass

Author

Liu Ying, Zhuo Chen, Guo Yujiao, Jiang Yang, Li Mingzhe, Zhao Yangyang, Wu Xiaolu, and Yu Guoxia

Subjects
floor-of-mouth mass, airway obstruction, risk factors, surgical treatment, children, Medicine
Abstract

The aim of the present study was to explore the risk factors of postoperative airway complications in children with oral floor mass. The first choice of auxiliary examination method for children with oral floor mass is also proposed. This retrospective study included 50 children with floor-of-mouth (FOM) masses. Medical records were reviewed, and information on age of onset, functional impacts present, age at consultation, imaging findings, history of preoperative aspiration, pathology findings, properties of biopsied fluid, treatment modality, postoperative outcomes, and operation were recorded. A total of 20 patients exhibited functional impacts such as difficulty in breathing and feeding. Ultrasound examination was performed in 28 cases; and magnetic resonance imaging, in 38 cases. The diagnosis was lymphatic malformation in 12 cases, developmental cyst in 29 cases, and solid mass in 7 cases. There were 28 cases of surgical resection, 9 cases underwent multiple puncture volume reduction followed by surgery, 11 cases treated using sclerotherapy injection, and 1 case treated using sclerotherapy injection and surgical resection. Young age, functional impact, and high grade of lymphatic duct malformation increased the risk of surgical treatment. B-scan ultrasound is the first choice for the diagnosis of FOM masses in children.

Published
2024
Full Text
View/download PDF

15. Cluster randomized trial of influenza vaccination in patients with acute heart failure in China: A mixed-methods feasibility study.

Author

Liu, Rong, Du, Xin, Patel, Anushka, Di Tanna, Gian Luca, Zhao, Yangyang, Wang, Zhiyan, Fan, Yihang, Zhang, Hao, Yi, Yang, Dong, Jianzeng, Anderson, Craig, and Liu, Hueiming

Subjects
Cardiovascular, Pneumonia & Influenza, Emerging Infectious Diseases, Prevention, Infectious Diseases, Influenza, Clinical Research, Clinical Trials and Supportive Activities, Heart Disease, Vaccine Related, Health Services, Immunization, Prevention of disease and conditions, and promotion of well-being, 3.4 Vaccines, Infection, Good Health and Well Being, Quality Education
Abstract

Uncertainties about the efficacy of influenza vaccination for populations with heart failure (HF) in preventing cardiovascular outcomes, as well as lack of effective vaccination strategies, may contribute to low vaccine coverage rate (VCR) in China and globally. We assessed the feasibility of a strategy to promote influenza vaccines in patients hospitalized with acute HF in China and to inform the design of a hybrid effectiveness-implementation cluster randomized trial to evaluate this strategy on mortality and hospital re-admission. We conducted a cluster randomized pilot trial involving 11 hospitals in Henan Province in China, with mixed-methods evaluation between December 2020 and April 2021. A process evaluation involved interviews with 51 key informants (patients, health professionals, policy makers). The intervention included education about influenza vaccination and availability of free vaccines administered prior to hospital discharge for HF patients, while usual care included attending community-based points of vaccination (PoV) for screening and vaccination. Implementation outcomes focused on reach, fidelity, adoption, and acceptability. Recruitment rates were assessed for trial feasibility. Effectiveness outcomes were influenza VCR, HF-specific rehospitalizations and mortality at 90 days. A total of 518 HF patients were recruited from 7 intervention and 4 usual care hospitals (mean of 45 participants per hospital per month). VCR was 89.9% (311/346, 86.1-92.8%) in the intervention group and 0.6% (1/172, 0.0-3.7%) in the control group. The process evaluation demonstrated reach to patients with lower socioeconomic and education status. There was good fidelity of the intervention components, with education and PoV set up processes being adapted to local hospital workflow and workforce capacity. Intervention was acceptable and adopted by patients and health professionals. However, outside of a trial setting, concerns were raised around vaccination reimbursement costs, workforce accountability and capacity. The intervention strategy appears feasible and acceptable for improving VCR in HF patients at county-level hospitals in China. Trial registration: This pilot trial is registered with the acronym PANDA II Pilot (Population Assessment of Influenza and Disease Activity) at ChiCTR.org.cn (ChiCTR2000039081).

Published
2023

25. Springback Control of DP1180 Steel Stamping by Variable Closing Pressure

Author

DING Yuejie, WANG Yiwen, WANG Wurong, WEI Xicheng, ZHAO Yangyang

Subjects
dp1180 steel, bending springback, variable closing pressure (vcp), residual stress, dislocation, Engineering (General). Civil engineering (General), TA1-2040, Chemical engineering, TP155-156, Naval architecture. Shipbuilding. Marine engineering, VM1-989
Abstract

In order to further control the springback of advanced high-strength steel in stamping,a method to reduce the bending springback by increasing the variable closing pressure (VCP) through servo hydraulic equipment without increasing the material forming margin was proposed. For U-shaped benchmark parts of 1 180 MPa dual-phase (DP1180) steel formed by stamping, the feasibility of increasing VCP to control springback was analyzed by using the finite element method, and the mechanism of increasing VCP to reduce springback was studied from the perspective of residual stress and dislocation. The results show that the proposed method can reduce the residual stress and the dislocation density of the formed material, thus increasing the inelastic recovery and achieving the effect of reducing the springback angle of the target part by 22.3%. Because this method is only applied at the end of part forming, which does not affect the plastic flow in the material forming process, there is no need to increase the additional material forming ability and shaping process, which can be applied to actual industry without changing the production rhythm, and has a broad application prospect.

Published
2023
Full Text
View/download PDF

31. Longitudinal Control Method for Full-Wing UAVs Based on Vector Field and Active Disturbance Rejection Control Method

Author

Ma, Zhenyu, Wang, Gen, Luo, Sheng, Luo, Qiang, Zhang, Bao, Zhao, Yangyang, Angrisani, Leopoldo, Series Editor, Arteaga, Marco, Series Editor, Panigrahi, Bijaya Ketan, Series Editor, Chakraborty, Samarjit, Series Editor, Chen, Jiming, Series Editor, Chen, Shanben, Series Editor, Chen, Tan Kay, Series Editor, Dillmann, Rüdiger, Series Editor, Duan, Haibin, Series Editor, Ferrari, Gianluigi, Series Editor, Ferre, Manuel, Series Editor, Hirche, Sandra, Series Editor, Jabbari, Faryar, Series Editor, Jia, Limin, Series Editor, Kacprzyk, Janusz, Series Editor, Khamis, Alaa, Series Editor, Kroeger, Torsten, Series Editor, Li, Yong, Series Editor, Liang, Qilian, Series Editor, Martín, Ferran, Series Editor, Ming, Tan Cher, Series Editor, Minker, Wolfgang, Series Editor, Misra, Pradeep, Series Editor, Möller, Sebastian, Series Editor, Mukhopadhyay, Subhas, Series Editor, Ning, Cun-Zheng, Series Editor, Nishida, Toyoaki, Series Editor, Oneto, Luca, Series Editor, Pascucci, Federica, Series Editor, Qin, Yong, Series Editor, Seng, Gan Woon, Series Editor, Speidel, Joachim, Series Editor, Veiga, Germano, Series Editor, Wu, Haitao, Series Editor, Zamboni, Walter, Series Editor, Zhang, Junjie James, Series Editor, Fu, Wenxing, editor, Gu, Mancang, editor, and Niu, Yifeng, editor

Published
2023
Full Text
View/download PDF

32. Continuous Region-Following Formation Control of Multi-agent Systems

Author

Zhang, Wenfei, Wang, Gen, Zhao, Yangyang, Zhao, Yu, Angrisani, Leopoldo, Series Editor, Arteaga, Marco, Series Editor, Panigrahi, Bijaya Ketan, Series Editor, Chakraborty, Samarjit, Series Editor, Chen, Jiming, Series Editor, Chen, Shanben, Series Editor, Chen, Tan Kay, Series Editor, Dillmann, Rüdiger, Series Editor, Duan, Haibin, Series Editor, Ferrari, Gianluigi, Series Editor, Ferre, Manuel, Series Editor, Hirche, Sandra, Series Editor, Jabbari, Faryar, Series Editor, Jia, Limin, Series Editor, Kacprzyk, Janusz, Series Editor, Khamis, Alaa, Series Editor, Kroeger, Torsten, Series Editor, Li, Yong, Series Editor, Liang, Qilian, Series Editor, Martín, Ferran, Series Editor, Ming, Tan Cher, Series Editor, Minker, Wolfgang, Series Editor, Misra, Pradeep, Series Editor, Möller, Sebastian, Series Editor, Mukhopadhyay, Subhas, Series Editor, Ning, Cun-Zheng, Series Editor, Nishida, Toyoaki, Series Editor, Oneto, Luca, Series Editor, Pascucci, Federica, Series Editor, Qin, Yong, Series Editor, Seng, Gan Woon, Series Editor, Speidel, Joachim, Series Editor, Veiga, Germano, Series Editor, Wu, Haitao, Series Editor, Zamboni, Walter, Series Editor, Zhang, Junjie James, Series Editor, Fu, Wenxing, editor, Gu, Mancang, editor, and Niu, Yifeng, editor

Published
2023
Full Text
View/download PDF

33. Formation Consistency Correction Strategy for UAV Formation

Author

Wang, Bohang, Wang, Gen, Zhao, Yangyang, Xia, Jitian, Angrisani, Leopoldo, Series Editor, Arteaga, Marco, Series Editor, Panigrahi, Bijaya Ketan, Series Editor, Chakraborty, Samarjit, Series Editor, Chen, Jiming, Series Editor, Chen, Shanben, Series Editor, Chen, Tan Kay, Series Editor, Dillmann, Rüdiger, Series Editor, Duan, Haibin, Series Editor, Ferrari, Gianluigi, Series Editor, Ferre, Manuel, Series Editor, Hirche, Sandra, Series Editor, Jabbari, Faryar, Series Editor, Jia, Limin, Series Editor, Kacprzyk, Janusz, Series Editor, Khamis, Alaa, Series Editor, Kroeger, Torsten, Series Editor, Li, Yong, Series Editor, Liang, Qilian, Series Editor, Martín, Ferran, Series Editor, Ming, Tan Cher, Series Editor, Minker, Wolfgang, Series Editor, Misra, Pradeep, Series Editor, Möller, Sebastian, Series Editor, Mukhopadhyay, Subhas, Series Editor, Ning, Cun-Zheng, Series Editor, Nishida, Toyoaki, Series Editor, Oneto, Luca, Series Editor, Pascucci, Federica, Series Editor, Qin, Yong, Series Editor, Seng, Gan Woon, Series Editor, Speidel, Joachim, Series Editor, Veiga, Germano, Series Editor, Wu, Haitao, Series Editor, Zamboni, Walter, Series Editor, Zhang, Junjie James, Series Editor, Fu, Wenxing, editor, Gu, Mancang, editor, and Niu, Yifeng, editor

Published
2023
Full Text
View/download PDF

34. CIFD: A Distance for Complex Intuitionistic Fuzzy Set

Author

Zhao, Yangyang, Xiao, Fuyuan, Goos, Gerhard, Founding Editor, Hartmanis, Juris, Founding Editor, Bertino, Elisa, Editorial Board Member, Gao, Wen, Editorial Board Member, Steffen, Bernhard, Editorial Board Member, Yung, Moti, Editorial Board Member, Xu, Yuan, editor, Yan, Hongyang, editor, Teng, Huang, editor, Cai, Jun, editor, and Li, Jin, editor

Published
2023
Full Text
View/download PDF

35. Robust Fault-Tolerant Formation Control for Multiple UAVs Under Bounded Actuator Faults

Author

Liu, Zhong, Zhao, Yangyang, Wang, Shaoqi, Wang, Gen, Angrisani, Leopoldo, Series Editor, Arteaga, Marco, Series Editor, Panigrahi, Bijaya Ketan, Series Editor, Chakraborty, Samarjit, Series Editor, Chen, Jiming, Series Editor, Chen, Shanben, Series Editor, Chen, Tan Kay, Series Editor, Dillmann, Rüdiger, Series Editor, Duan, Haibin, Series Editor, Ferrari, Gianluigi, Series Editor, Ferre, Manuel, Series Editor, Hirche, Sandra, Series Editor, Jabbari, Faryar, Series Editor, Jia, Limin, Series Editor, Kacprzyk, Janusz, Series Editor, Khamis, Alaa, Series Editor, Kroeger, Torsten, Series Editor, Li, Yong, Series Editor, Liang, Qilian, Series Editor, Martín, Ferran, Series Editor, Ming, Tan Cher, Series Editor, Minker, Wolfgang, Series Editor, Misra, Pradeep, Series Editor, Möller, Sebastian, Series Editor, Mukhopadhyay, Subhas, Series Editor, Ning, Cun-Zheng, Series Editor, Nishida, Toyoaki, Series Editor, Oneto, Luca, Series Editor, Pascucci, Federica, Series Editor, Qin, Yong, Series Editor, Seng, Gan Woon, Series Editor, Speidel, Joachim, Series Editor, Veiga, Germano, Series Editor, Wu, Haitao, Series Editor, Zamboni, Walter, Series Editor, Zhang, Junjie James, Series Editor, Ren, Zhang, editor, Wang, Mengyi, editor, and Hua, Yongzhao, editor

Published
2023
Full Text
View/download PDF

36. Cooperative Path Planning Algorithm of UAV in Urban Environment Based on Improved Pigeon Swarm Algorithm

Author

Wang, Bohang, Zhao, Yangyang, Li, Rui, Jing, Luqi, Liu, Zhong, Angrisani, Leopoldo, Series Editor, Arteaga, Marco, Series Editor, Panigrahi, Bijaya Ketan, Series Editor, Chakraborty, Samarjit, Series Editor, Chen, Jiming, Series Editor, Chen, Shanben, Series Editor, Chen, Tan Kay, Series Editor, Dillmann, Rüdiger, Series Editor, Duan, Haibin, Series Editor, Ferrari, Gianluigi, Series Editor, Ferre, Manuel, Series Editor, Hirche, Sandra, Series Editor, Jabbari, Faryar, Series Editor, Jia, Limin, Series Editor, Kacprzyk, Janusz, Series Editor, Khamis, Alaa, Series Editor, Kroeger, Torsten, Series Editor, Li, Yong, Series Editor, Liang, Qilian, Series Editor, Martín, Ferran, Series Editor, Ming, Tan Cher, Series Editor, Minker, Wolfgang, Series Editor, Misra, Pradeep, Series Editor, Möller, Sebastian, Series Editor, Mukhopadhyay, Subhas, Series Editor, Ning, Cun-Zheng, Series Editor, Nishida, Toyoaki, Series Editor, Oneto, Luca, Series Editor, Pascucci, Federica, Series Editor, Qin, Yong, Series Editor, Seng, Gan Woon, Series Editor, Speidel, Joachim, Series Editor, Veiga, Germano, Series Editor, Wu, Haitao, Series Editor, Zamboni, Walter, Series Editor, Zhang, Junjie James, Series Editor, Ren, Zhang, editor, Wang, Mengyi, editor, and Hua, Yongzhao, editor

Published
2023
Full Text
View/download PDF

44. Automatic Curriculum Learning With Over-repetition Penalty for Dialogue Policy Learning

Author

Zhao, Yangyang, Wang, Zhenyu, and Huang, Zhenhua

Subjects
Computer Science - Computation and Language, Computer Science - Artificial Intelligence
Abstract

Dialogue policy learning based on reinforcement learning is difficult to be applied to real users to train dialogue agents from scratch because of the high cost. User simulators, which choose random user goals for the dialogue agent to train on, have been considered as an affordable substitute for real users. However, this random sampling method ignores the law of human learning, making the learned dialogue policy inefficient and unstable. We propose a novel framework, Automatic Curriculum Learning-based Deep Q-Network (ACL-DQN), which replaces the traditional random sampling method with a teacher policy model to realize the dialogue policy for automatic curriculum learning. The teacher model arranges a meaningful ordered curriculum and automatically adjusts it by monitoring the learning progress of the dialogue agent and the over-repetition penalty without any requirement of prior knowledge. The learning progress of the dialogue agent reflects the relationship between the dialogue agent's ability and the sampled goals' difficulty for sample efficiency. The over-repetition penalty guarantees the sampled diversity. Experiments show that the ACL-DQN significantly improves the effectiveness and stability of dialogue tasks with a statistically significant margin. Furthermore, the framework can be further improved by equipping with different curriculum schedules, which demonstrates that the framework has strong generalizability.

Published
2020

46. Combinatorial Analysis for Pseudoknot RNA with Complex Structure

Author

Zhao, Yangyang

Subjects
Mathematics - Combinatorics
Abstract

There exists many complicated $k$-noncrossing pseudoknot RNA structures in nature based on some special conditions. The special characteristic of RNA structures gives us great challenges in researching the enumeration, prediction and the analysis of prediction algorithm. We will study two kinds of typical $k$-noncrossing pseudoknot RNAs with complex structures separately., Comment: 117 pages, 79 figures. The thesis has been defended and published in summer of 2012. This version is updated for correcting several unmeant mistakes and clerical error. It is very thankful for Prof. Christian Reidys and Prof. Qinghu Hou's guidance

Published
2019

Catalog

Books, media, physical & digital resources
See catalog results