EQUISA2025: Evaluation of Qualitative Aspects of Intelligent Software Assistants Istanbul, Turkey, June 20, 2025 |
Conference website | https://conf.researchr.org/home/ease-2025/equisa-2025 |
Submission link | https://easychair.org/conferences/?conf=equisa2025 |
Submission deadline | March 16, 2025 |
Intelligent software assistants have been defined as automated approaches based on advanced artificial intelligence (AI) models that aim to support end users in several aspects of software development lifecycles. While traditional systems are based on a curated knowledge base that represents the main source of the recommendation process, the advent of cutting-edge AI models, e.g., foundation and pre-trained models, is dramatically changing how those systems are designed, developed, and evaluated.
Motivated by the need to ensure quality in advanced systems, EQUISA is a dedicated forum for discussing the qualitative aspects of intelligent software assistants, from their design to their deployment in real-world applications.
Topics of interest include, but are not limited to, the following:
- Re-usage of AI-based tools, techniques, and methodologies in developing intelligent software assistants.
- Foundational theories for software assistant to understand the underlying principles that can drive the development of more robust and generalizable recommendation systems in software engineering, with a focus on their evaluation.
- Evaluating quality aspects of software assistants, e.g., explainability, transparency, and fairness, ensuring that software assistants produce reliable results.
- New methods, tools, and frameworks to support development tasks, e.g., code-related tasks, automated classification of software artifacts, or code generation leveraging generative AI models.
- Designing specific prompt engineering techniques for intelligent software assistants based on large language models to ensure quality aspects.
- Data-driven approaches for software assistant: Leveraging large-scale data from open-source software (OSS) repositories, Q&A forums, and issue trackers to enhance the effectiveness of software assistants.
- Integration with human-in-the-loop systems: Balancing automated recommendations with human expertise to improve decision-making in complex SE scenarios.
- Adoption of advanced generative AI models, including LLMs, pre-trained models (PTMs) for software assistance, particularly emphasizing the quality effects.
- Empirical studies and controlled experiments to assess qualitative aspects of intelligent systems.
- Evolution of software systems and long-term recommendations, e.g., how software assistants can cope with the evolving nature of software systems and provide recommendations that consider long-term system maintainability and evolution.
- Cross-disciplinary applications of software assistant: Studying how techniques from other domains, e.g., human-computer interaction, natural language processing, and social network analysis, can enhance their effectiveness and usability.
- Surveys and experience reports on software assistants to support software engineering tasks both in academic and industry use cases.
The aim of this workshop is to provide a forum for researchers and practitioners to present and discuss novel methods and techniques for designing, developing, and assessing intelligent software assistants according to notable qualitative aspects. We expect that the workshop will help to:
- Provide researchers with a comprehensive landscape of recent intelligent software assistants.
- Investigate how generative AI models can be used in developing software assistants.
- Reinforce the foundational knowledge around software assistants, with a focus on empirical evaluation, trustworthiness, and ethical considerations.
- Identify new opportunities for applying software assistant research to address the most pressing challenges in modern software engineering.
- Proposing new empirical methodologies, protocols, and metrics to evaluate qualitative aspects.
- Analyze intelligent software assistants in industries and measure their conformity to recent qualitative standards.
Submission Format
All papers must be submitted in PDF format through EasyChair. The page limit is set to 10 for full papers and 5 for short papers, including all figures, tables, references, and appendices. All submissions must use the official ACM Primary Article Template (https://www.acm.org/publications/proceedings-template). Deviating from the ACM formatting instructions may lead to a desk rejection.
Authors must comply with the SIGSOFT Open Science Policy (https://github.com/acmsigsoft/open-science-policies/blob/master/sigsoft-open-science-policies.md), i.e., to archive data and artifacts in a permanent repository---e.g., Zenodo, not GitHub---and include links in the submission.
By submitting to EQUISA, authors agree to the ACM Policy and Procedures on Plagiarism, Misrepresentation, and Falsification (https://www.acm.org/publications/policies/plagiarism-overview). Papers submitted must not be published or under review elsewhere. The Program Chairs may use plagiarism detection software under contract to the ACM. If the research involves human subjects, the authors must adhere to the ACM Publications Policy (https://www.acm.org/publications/policies/research-involving-human-participants-and-subjects).
Review Criteria
All papers will be subjected to a thorough peer review, focusing on originality, quality, soundness, and relevance, each reviewed by three program committee members. The review process will follow the same criteria as the main conference, namely:
- Soundness: The extent to which the papers' contributions address their research questions and are supported by rigorous application of appropriate research methods.
- Significance: The extent to which the paper’s contributions can impact the field of software engineering and under which assumptions (if any).
- Novelty: The extent to which the contributions are sufficiently original with respect to the state-of-the-art.
- Verifiability and Transparency: The extent to which the paper includes sufficient information to understand how an innovation works, how data was obtained, analyzed, and interpreted, and how the paper supports independent verification or replication of the paper’s claimed contributions.
- Presentation: The extent to which the quality of writing meets the high standards, including clear descriptions, adequate use of the English language, absence of major ambiguity, clearly readable figures and tables, and adherence to the formatting instructions provided above.
Important Dates
- Submission deadline: March 16th, 2025.
- Notification to authors: April 13th, 2025.
- Camera-ready due: April 26th, 2025.
- Early registration deadline for authors: May 5th, 2025.