Evaluation of CINA® LVO artificial intelligence software for detection of large vessel occlusion in brain CT angiography

Objective: To systematically evaluate the ability of the CINA® LVO software to detect large vessel occlusions eligible for mechanical thrombectomy on CTA using conventional neuroradiological assessment as gold standard. Methods: Retrospectively, two hundred consecutive patients referred for a brain CTA and two hundred patients that had been subject for endovascular thrombectomy, with an accessible preceding CTA, were assessed for large vessel occlusions (LVO) using the CINA® LVO software. The patients were sub-grouped by occlusion site. The original radiology report was used as ground truth and cases with disagreement were reassessed. Two-by-two tables were created and measures for LVO detection were calculated. Results: A total of four-hundred patients were included; 221 LVOs were present in 215 patients (54 %). The overall specificity was high for LVOs in the anterior circulation (93 %). The overall sensitivity for LVOs in the anterior circulation was 54 % with the highest sensitivity for the M1 segment of the middle cerebral artery (87 %) and T-type internal carotid occlusions (84 %). The sensitivity was low for occlusions in the M2 segment of the middle cerebral artery (13 % and 0 % for proximal and distal M2 occlusions respectively) and in posterior circulation occlusions (0 %, not included in the intended use of the software). Conclusions: LVO detection sensitivity for the CINA® LVO software differs largely depending on the location of the occlusion, with low sensitivity for detection of some LVOs potentially eligible for mechanical thrombectomy. Further development of the software to increase sensitivity to all LVO locations would increase the clinical usefulness.