REFSQ 2025
Mon 7 - Thu 10 April 2025 Spain

This program is tentative and subject to change.

Context and Motivation: Software must be improved continuously to meet the users’ expectations. User feedback from online sources allows developers to include the users in the development process when direct communication is impossible. To address the issues raised by feedback, developers must understand which functionalities the users are discussing. Question/Problem: However, manually relating feedback to requirements is too time-consuming. Automatic classification, on the other hand, struggles with the problem that developers and users use different languages when writing feedback and requirements. Principal Ideas/Results: In this paper, we introduce the FeReRe approach for feedback requirements relation. The approach uses a BERT classifier to perform feedback requirements relation on a per-sentence basis. We also provide tool support to facilitate access to the classifier’s recommendations. We evaluate the BERT classifier’s performance on multiple datasets and compare it to the performance of the generative LLM GPT4o. BERT achieves a precision of 0.82 and recall of 0.94 when trained on all available datasets. GPT4o, on the other hand, performs the task poorly, achieving only 0.15 in precision and 0.40 in recall. Contribution: The paper presents a novel approach for feedback requirements relation along with multiple manually created datasets for training and testing of the presented approach.

This program is tentative and subject to change.

Tue 8 Apr

Displayed time zone: Brussels, Copenhagen, Madrid, Paris change

14:00 - 15:30
Research Track - Session R3 - Crowd and Large-Scale RE IIResearch Track at C2 - Sala Actes
14:00
30m
Talk
FeReRe: Feedback Requirements Relation using Large Language ModelsEvaluation Paper
Research Track
Michael Anders Heidelberg University, Barbara Paech Heidelberg University
14:30
30m
Talk
How Does Users' App Knowledge Influence the Preferred Level of Detail and Format of Software Explanations?Technical Paper
Research Track
Martin Obaidi Leibniz Universität Hannover, Jannik Fischbach Netlight Consulting GmbH and fortiss GmbH, Marc Herrmann Leibniz Universität Hannover, Hannah Deters Leibniz University Hannover, Jakob Droste Leibniz Universität Hannover, Jil Klünder University of Applied Sciences | FHDW Hannover, Kurt Schneider Leibniz Universität Hannover, Software Engineering Group
15:00
30m
Talk
How Effectively Do LLMs Extract Feature-Sentiment Pairs from App Reviews?Evaluation Paper
Research Track
Faiz Ali Shah University of Tartu, Estonia, Ahmed Sabir Institute of Computer Science, University of Tartu, Tartu, Estonia, Rajesh Sharma Institute of Computer Science, University of Tartu, Tartu, Estonia, Dietmar Pfahl University of Tartu