An Experience Report on Leveraging LLMs for GUI Generation: Automating Coding to Prioritize Creativity
The design of graphical user interfaces (GUIs) is a complex and time-consuming process that begins with identifying user roles and gathering requirements through interviews, surveys, or workshops. Designers then create low-fidelity sketches or digital wireframes, organising information into logical sections and selecting visual elements to enhance usability. This iterative process often demands extensive refinement based on stakeholder feedback, making mockup creation—especially for interactive prototypes—a time-consuming task. In particular, the mockup development process often entails spending significant effort on clerical activities, such as programming and debugging tasks, rather than concentrating on creativity, human interaction, and quick feedback cycles with stakeholders.
This paper investigates whether large language models (LLMs) can assist GUI designers in streamlining the design process—reducing time and effort while maintaining design quality—enabling them to focus on the human aspects of creativity and user interaction by offloading technical programming tasks to the machine. We document our experience designing a dashboard for predictive maintenance in railways, illustrating how LLMs can support key tasks such as requirement analysis, information organisation, and mockup generation and refinement. We discuss insights and lessons learned, including the importance of clear requirements, the impact of LLM choice, and the benefits of iterative refinement in achieving stakeholder alignment. Our study shows that LLMs can support the GUI design process by automating specific tasks, thereby reducing design effort and enhancing the overall quality and satisfaction of the final product.
(CreaRE25_paper15_preprint.pdf) | 652KiB |
Mon 7 AprDisplayed time zone: Brussels, Copenhagen, Madrid, Paris change
11:00 - 12:30 | CreaRE / ViVa RE! - Session 2Workshops at C1 - Sala Tesines Chair(s): Andrea Herrmann Herrmann & Ehrlich | ||
11:00 30mPaper | Choosing a Creativity Technique for Requirements Elicitation: an updated framework Workshops Luisa Mich University of Trento | ||
11:30 30mPaper | How reliance on GenAI might limit human creativity and critical thinking in different fields Workshops Beatriz Cabrero-Daniel University of Gothenburg | ||
12:00 30mPaper | An Experience Report on Leveraging LLMs for GUI Generation: Automating Coding to Prioritize Creativity Workshops Giovanna Broccia ISTI-CNR, FMT Lab File Attached |