Architecture in the Cradle: Early Warning of Architectural Decay with ArchGuard

Abstract

Architectural decay can manifest as the evolution of architectural smells, degrading integrity, and increasing maintenance costs. Existing techniques capture smells post hoc or predict on component level, acting too late or on too coarse a granularity. We investigate if the risk of introducing architectural smells can already be predicted when issues are opened. Thus, we propose an issue-level prediction approach that utilizes the semantic representations of Large Language Models (LLMs).

To enable training and evaluation, we construct a dataset from three GitLab-hosted projects by linking issues to smells via smell-inducing changes. On this dataset, we train classifiers to identify high-risk issues and conduct an empirical study comparing seven different representations and nine classifiers.

Our best-performing classifier (SVM with OpenAI embeddings) achieves F1-scores of up to 0.506, with a recall of about 0.74. This means that our approach can identify approximately 74% of smell-inducing issues before implementation begins. When design alternatives are still being considered. Our approach provides early warnings of potential architectural risks. This work shifts from reactive remediation to proactive quality assurance, raising awareness of potential architectural risks.

@inproceedings{liu_architecture_2026,
  title        = {Architecture in the Cradle: Early Warning of Architectural Decay with ArchGuard},
  author       = {Liu, Haoyu and Fuch{\ss}, Dominik and Corallo, Sophie and Hummel, Maximilian and Keim, Jan and Hey, Tobias},
  booktitle    = {2026 IEEE 23rd International Conference on Software Architecture (ICSA)},
  eventdate    = {2026-06-22/2026-06-26},
  eventtitle   = {23rd IEEE International Conference on Software Architecture},
  eventtitleaddon = {ICSA 2026},
  language     = {english},
  month        = {6},
  publisher    = {IEEE},
  venue        = {Amsterdam, Netherlands},
  year         = {2026}
}