Precision HER2: a comprehensive AI system for accurate and consistent evaluation of HER2 expression in invasive breast Cancer

Abstract Background With the development of novel anti-HER2 targeted drugs, such as ADCs, it has become increasingly important to accurately interpret HER2 expression in breast cancer. Previous studies have demonstrated high intra-observer and inter-observer variabilities in evaluating HER2 staining by human eyes. There exists a strong requirement to develop artificial intelligence (AI) systems to achieve high-precision HER2 expression scoring for better clinical therapy. Methods In the present study, we collected breast cancer tissue samples and stained consecutive sections with anti-Calponin and anti-HER2 antibodies. High-quality digital images were selected from immunohistochemical slides and interpreted as HER2 3+, 2+, 1+, and 0. AI models were trained and assessed using annotated training and testing sets. The AI model was trained to automatically identify ductal carcinoma in situ (DCIS) by Calponin staining and myoepithelial annotation and filter out DCIS components in HER2-stained slides using image-overlapping techniques. Furthermore, we organized two-phase validation studies. In phase one, pathologists interpreted 112 HER2 whole-slide images (WSIs) without AI assistance, whereas in phase two, pathologists read the same slides using the AI system after a washing period of 2 weeks. Results Our AI model greatly improved the accuracy of reading (0.902 vs. 0.710). The number of HER2 1 + patients misdiagnosed as HER2 0 was significantly reduced (32/279 vs. 65/279), and they benefitted from ADC drugs. In addition, the AI algorithm improved the intra-group consistency of HER2 readings by pathologists with different years of experience (intra-class correlation coefficient [ICC]: 0.872–0.926 vs. 0.818–0.908), with the improvement most pronounced among junior pathologists (0.885 vs. 0.818). Conclusions We proposed a high-precision AI system to identify and filter out DCIS components and automatically evaluate HER2 expression in invasive breast cancer.