Search

Your search keyword '"Qiu, Jianing"' showing total 10 results
Start Over Author "Qiu, Jianing" Search Limiters Full Text Publication Year Range This year
10 results on '"Qiu, Jianing"'

1. MEDCO: Medical Education Copilots Based on A Multi-Agent Framework

Author

Wei, Hao, Qiu, Jianing, Yu, Haibao, and Yuan, Wu

Subjects
Computer Science - Artificial Intelligence, Computer Science - Multiagent Systems
Abstract

Large language models (LLMs) have had a significant impact on diverse research domains, including medicine and healthcare. However, the potential of LLMs as copilots in medical education remains underexplored. Current AI-assisted educational tools are limited by their solitary learning approach and inability to simulate the multi-disciplinary and interactive nature of actual medical training. To address these limitations, we propose MEDCO (Medical EDucation COpilots), a novel multi-agent-based copilot system specially developed to emulate real-world medical training environments. MEDCO incorporates three primary agents: an agentic patient, an expert doctor, and a radiologist, facilitating a multi-modal and interactive learning environment. Our framework emphasizes the learning of proficient question-asking skills, multi-disciplinary collaboration, and peer discussions between students. Our experiments show that simulated virtual students who underwent training with MEDCO not only achieved substantial performance enhancements comparable to those of advanced models, but also demonstrated human-like learning behaviors and improvements, coupled with an increase in the number of learning samples. This work contributes to medical education by introducing a copilot that implements an interactive and collaborative learning approach. It also provides valuable insights into the effectiveness of AI-integrated training paradigms.

Published
2024

2. One Prompt Word is Enough to Boost Adversarial Robustness for Pre-trained Vision-Language Models

Author

Li, Lin, Guan, Haoyan, Qiu, Jianing, and Spratling, Michael

Subjects
Computer Science - Computer Vision and Pattern Recognition, Computer Science - Artificial Intelligence, Computer Science - Machine Learning
Abstract

Large pre-trained Vision-Language Models (VLMs) like CLIP, despite having remarkable generalization ability, are highly vulnerable to adversarial examples. This work studies the adversarial robustness of VLMs from the novel perspective of the text prompt instead of the extensively studied model weights (frozen in this work). We first show that the effectiveness of both adversarial attack and defense are sensitive to the used text prompt. Inspired by this, we propose a method to improve resilience to adversarial attacks by learning a robust text prompt for VLMs. The proposed method, named Adversarial Prompt Tuning (APT), is effective while being both computationally and data efficient. Extensive experiments are conducted across 15 datasets and 4 data sparsity schemes (from 1-shot to full training data settings) to show APT's superiority over hand-engineered prompts and other state-of-the-art adaption methods. APT demonstrated excellent abilities in terms of the in-distribution performance and the generalization under input distribution shift and across datasets. Surprisingly, by simply adding one learned word to the prompts, APT can significantly boost the accuracy and robustness (epsilon=4/255) over the hand-engineered prompts by +13% and +8.5% on average respectively. The improvement further increases, in our most effective setting, to +26.4% for accuracy and +16.7% for robustness. Code is available at https://github.com/TreeLLi/APT., Comment: CVPR2024

Published
2024

4. Machine Learning and Optical-Coherence-Tomography-Derived Radiomics Analysis to Predict the Postoperative Anatomical Outcome of Full-Thickness Macular Hole.

Author

Hu, Yuqian, Meng, Yongan, Liang, Youling, Zhang, Yiwei, Chen, Biying, Qiu, Jianing, Meng, Zhishang, and Luo, Jing

Abstract

Full-thickness macular hole (FTMH) leads to central vision loss. It is essential to identify patients with FTMH at high risk of postoperative failure accurately to achieve anatomical closure. This study aimed to construct a predictive model for the anatomical outcome of FTMH after surgery. A retrospective study was performed, analyzing 200 eyes from 197 patients diagnosed with FTMH. Radiomics features were extracted from optical coherence tomography (OCT) images. Logistic regression, support vector machine (SVM), and backpropagation neural network (BPNN) classifiers were trained and evaluated. Decision curve analysis and survival analysis were performed to assess the clinical implications. Sensitivity, specificity, F1 score, and area under the receiver operating characteristic curve (AUC) were calculated to assess the model effectiveness. In the training set, the AUC values were 0.998, 0.988, and 0.995, respectively. In the test set, the AUC values were 0.941, 0.943, and 0.968, respectively. The OCT-omics scores were significantly higher in the "Open" group than in the "Closed" group and were positively correlated with the minimum diameter (MIN) and base diameter (BASE) of FTMH. Therefore, in this study, we developed a model with robust discriminative ability to predict the postoperative anatomical outcome of FTMH. [ABSTRACT FROM AUTHOR]

Published
2024
Full Text
View/download PDF

7. Development and validation of machine learning models to predict the need for haemostatic therapy in acute upper gastrointestinal bleeding.

Author

Nazarian, Scarlet, Lo, Frank Po Wen, Qiu, Jianing, Patel, Nisha, Lo, Benny, and Ayaru, Lakshmana

Subjects
HEMOSTATICS, RISK assessment, RANDOM forest algorithms, PREDICTIVE tests, GASTROINTESTINAL hemorrhage, ACUTE diseases, PREDICTION models, HUMAN services programs, RECEIVER operating characteristic curves, RESEARCH funding, EVALUATION of human services programs, RETROSPECTIVE studies, DESCRIPTIVE statistics, LONGITUDINAL method, OPERATIVE surgery, ENDOSCOPIC gastrointestinal surgery, INTERVENTIONAL radiology, MACHINE learning, COMPARATIVE studies, CONFIDENCE intervals, DATA analysis software, SENSITIVITY & specificity (Statistics)
Abstract

Background: Acute upper gastrointestinal bleeding (AUGIB) is a major cause of morbidity and mortality. This presentation however is not universally high risk as only 20–30% of bleeds require urgent haemostatic therapy. Nevertheless, the current standard of care is for all patients admitted to an inpatient bed to undergo endoscopy within 24 h for risk stratification which is invasive, costly and difficult to achieve in routine clinical practice. Objectives: To develop novel non-endoscopic machine learning models for AUGIB to predict the need for haemostatic therapy by endoscopic, radiological or surgical intervention. Design: A retrospective cohort study Method: We analysed data from patients admitted with AUGIB to hospitals from 2015 to 2020 (n = 970). Machine learning models were internally validated to predict the need for haemostatic therapy. The performance of the models was compared to the Glasgow-Blatchford score (GBS) using the area under receiver operating characteristic (AUROC) curves. Results: The random forest classifier [AUROC 0.84 (0.80–0.87)] had the best performance and was superior to the GBS [AUROC 0.75 (0.72–0.78), p < 0.001] in predicting the need for haemostatic therapy in patients with AUGIB. A GBS cut-off of ⩾12 was associated with an accuracy, sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) of 0.74, 0.49, 0.81, 0.41 and 0.85, respectively. The Random Forrest model performed better with an accuracy, sensitivity, specificity, PPV and NPV of 0.82, 0.54, 0.90, 0.60 and 0.88, respectively. Conclusion: We developed and validated a machine learning algorithm with high accuracy and specificity in predicting the need for haemostatic therapy in AUGIB. This could be used to risk stratify high-risk patients to urgent endoscopy. [ABSTRACT FROM AUTHOR]

Published
2024
Full Text
View/download PDF

8. Egocentric Image Captioning for Privacy-Preserved Passive Dietary Intake Monitoring

Author

Qiu, Jianing, Lo, Frank P.-W., Gu, Xiao, Jobarteh, Modou L., Jia, Wenyan, Baranowski, Tom, Steiner-Asiedu, Matilda, Anderson, Alex K., McCrory, Megan A., Sazonov, Edward, Sun, Mingui, Frost, Gary, and Lo, Benny

Abstract

Camera-based passive dietary intake monitoring is able to continuously capture the eating episodes of a subject, recording rich visual information, such as the type and volume of food being consumed, as well as the eating behaviors of the subject. However, there currently is no method that is able to incorporate these visual clues and provide a comprehensive context of dietary intake from passive recording (e.g., is the subject sharing food with others, what food the subject is eating, and how much food is left in the bowl). On the other hand, privacy is a major concern while egocentric wearable cameras are used for capturing. In this article, we propose a privacy-preserved secure solution (i.e., egocentric image captioning) for dietary assessment with passive monitoring, which unifies food recognition, volume estimation, and scene understanding. By converting images into rich text descriptions, nutritionists can assess individual dietary intake based on the captions instead of the original images, reducing the risk of privacy leakage from images. To this end, an egocentric dietary image captioning dataset has been built, which consists of in-the-wild images captured by head-worn and chest-worn cameras in field studies in Ghana. A novel transformer-based architecture is designed to caption egocentric dietary images. Comprehensive experiments have been conducted to evaluate the effectiveness and to justify the design of the proposed architecture for egocentric dietary image captioning. To the best of our knowledge, this is the first work that applies image captioning for dietary intake assessment in real-life settings.

Published
2024
Full Text
View/download PDF

9. Localization and recognition of human action in 3D using transformers.

Author

Sun J, Huang L, Wang H, Zheng C, Qiu J, Islam MT, Xie E, Zhou B, Xing L, Chandrasekaran A, and Black MJ

Abstract

Understanding a person's behavior from their 3D motion sequence is a fundamental problem in computer vision with many applications. An important component of this problem is 3D action localization, which involves recognizing what actions a person is performing, and when the actions occur in the sequence. To promote the progress of the 3D action localization community, we introduce a new, challenging, and more complex benchmark dataset, BABEL-TAL (BT), for 3D action localization. Important baselines and evaluating metrics, as well as human evaluations, are carefully established on this benchmark. We also propose a strong baseline model, i.e., Localizing Actions with Transformers (LocATe), that jointly localizes and recognizes actions in a 3D sequence. The proposed LocATe shows superior performance on BABEL-TAL as well as on the large-scale PKU-MMD dataset, achieving state-of-the-art performance by using only 10% of the labeled training data. Our research could advance the development of more accurate and efficient systems for human behavior analysis, with potential applications in areas such as human-computer interaction and healthcare., (© 2024. The Author(s).)

Published
2024
Full Text
View/download PDF

Catalog

Books, media, physical & digital resources
See catalog results