Grimm in Wonderland: Prompt Engineering with Midjourney to Illustrate Fairytales
Contributo in Atti di convegno
Data di Pubblicazione:
2023
Citazione:
Grimm in Wonderland: Prompt Engineering with Midjourney to Illustrate Fairytales / M. Ruskov (CEUR WORKSHOP PROCEEDINGS). - In: IRCDL 2023 : Information and Research Science Connecting to Digital and Library Science 2023 / [a cura di] A. Bardi, A. Falcon, S. Ferilli, S. Marchesin, D. Redavid. - Aachen : CEUR-WS, 2023 Mar 28. - pp. 180-191 (( Intervento presentato al 19. convegno Information and Research Science Connecting to Digital and Library Science tenutosi a Bari nel 2023.
Abstract:
The quality of text-to-image generation is continuously improving, yet the boundaries of its applicability are still unclear. In particular, refinement of the text input with the objective of achieving better results – commonly called prompt engineering – so far seems to have not been geared towards work with preexisting texts. We investigate whether text-to-image generation and prompt engineering could be used to generate basic illustrations of popular fairytales. Using Midjourney v4, we engage in action research with a dual aim: to attempt to generate 5 believable illustrations for each of 5 popular fairytales, and to define a prompt engineering process that starts from a pre-existing text and arrives at an illustration of it. We arrive at a tentative 4-stage process: i) initial prompt, ii) composition adjustment, iii) style refinement, and iv) variation selection. We also discuss three reasons why the generation model struggles with certain illustrations: difficulties with counts, bias from stereotypical configurations and inability to
depict overly fantastic situations. Our findings are not limited to the specific generation model and are intended to be generalisable to future ones.
Tipologia IRIS:
03 - Contributo in volume
Keywords:
text-to-image generation; prompt engineering; action research; fairytales
Elenco autori:
M. Ruskov
Link alla scheda completa:
Link al Full Text:
Titolo del libro:
IRCDL 2023 : Information and Research Science Connecting to Digital and Library Science 2023
Progetto: