Back to Search Start Over

Scideator: Human-LLM Scientific Idea Generation Grounded in Research-Paper Facet Recombination

Authors :
Radensky, Marissa
Shahid, Simra
Fok, Raymond
Siangliulue, Pao
Hope, Tom
Weld, Daniel S.
Publication Year :
2024

Abstract

The scientific ideation process often involves blending salient aspects of existing papers to create new ideas. To see if large language models (LLMs) can assist this process, we contribute Scideator, a novel mixed-initiative tool for scientific ideation. Starting from a user-provided set of papers, Scideator extracts key facets (purposes, mechanisms, and evaluations) from these and relevant papers, allowing users to explore the idea space by interactively recombining facets to synthesize inventive ideas. Scideator also helps users to gauge idea novelty by searching the literature for potential overlaps and showing automated novelty assessments and explanations. To support these tasks, Scideator introduces four LLM-powered retrieval-augmented generation (RAG) modules: Analogous Paper Facet Finder, Faceted Idea Generator, Idea Novelty Checker, and Idea Novelty Iterator. In a within-subjects user study, 19 computer-science researchers identified significantly more interesting ideas using Scideator compared to a strong baseline combining a scientific search engine with LLM interaction.

Details

Database :
arXiv
Publication Type :
Report
Accession number :
edsarx.2409.14634
Document Type :
Working Paper