Search

In the field of content generation by machine, the state-of-the-art text-to-image model, DALL⋅E, has advanced and diverse capacities for the combinational image generation with specific textual prompts. The images generated by DALL⋅E seem to exhibit an appreciable level of combinational creativity close to that of humans in terms of visualizing a combinational idea. Although there are several common metrics which can be applied to assess the quality of the images generated by generative models, such as IS, FID, GIQA, and CLIP, it is unclear whether these metrics are equally applicable to assessing images containing combinational creativity. In this study, we collected the generated image data from machine (DALL⋅E) and human designers, respectively. The results of group ranking in the Consensual Assessment Technique (CAT) and the Turing Test (TT) were used as the benchmarks to assess the combinational creativity. Considering the metrics' mathematical principles and different starting points in evaluating image quality, we introduced coincident rate (CR) and average rank variation (ARV) which are two comparable spaces. An experiment to calculate the consistency of group ranking of each metric by comparing the benchmarks then was conducted. By comparing the consistency results of CR and ARV on group ranking, we summarized the applicability of the existing evaluation metrics in assessing generative images containing combinational creativity. In the four metrics, GIQA performed the closest consistency to the CAT and TT. It shows the potential as an automated assessment for images containing combinational creativity, which can be used to evaluate the images containing combinational creativity in the relevant task of design and engineering such as conceptual sketch, digital design image, and prototyping image. [ABSTRACT FROM AUTHOR]

Analogy is a core cognition process used to produce inferences as well as new ideas using previous knowledge and experience. Ontology is a formal representation of a set of domain concepts and their relationships. The use of analogy and ontology in design activities to support design creativity have previously been explored. This paper explores an approach to construct ontologies with sufficient richness and coverage to support reasoning over real-world datasets for prompting creative idea generation. This approach has been implemented into a computational tool for assisting designers in generating creative ideas during the early stages of design. The tool, called "the Retriever", has been developed based on ontology by embracing the aspects of analogical reasoning. A case study has indicated that the tool can be effective and useful for idea generation. The results have indicated that the tool, in its current formulation, can significantly improve the fluency and flexibility of idea generation and the usefulness of ideas, as well as slightly increase the originality of ideas, for the case study concerned. [ABSTRACT FROM AUTHOR]