Reactive maintenance management in Small and Medium-sized Enterprises (SMEs) is often hindered by technical knowledge fragmentation and reliance on senior experts. Although generative Artificial Intelligence (AI) offers new perspectives for decision support, adopting generalist models introduces operational risks linked to hallucinations and a lack of specific context. This study analyses the effectiveness of a domain-specific Retrieval-Augmented Generation (RAG) framework, designed to encode historical corporate know-how into reliable operating procedures. Through a field validation conducted on a significant sample of real assistance requests, the research compares the proposed system with a generalist Large Language Model. The methodology adopts an evaluation protocol based on the LLM-as-a-judge technique, validated through analyses conducted with a maintenance engineer, to ensure accuracy. The results highlight how targeted context integration reduces factual inaccuracies, ensuring superior technical relevance. Such accuracy emerges as a fundamental enabling factor to speed up fault diagnosis, laying the foundations for intervention time optimization and greater overall maintenance process effectiveness.

Leccea, M., Bioddob, A., Dadone, L., Falchi, G., Cesarotti, V. (2027). Enabling smart maintenance in SMEs via Domain-Specific RAG: An industrial field study [Working paper] [10.20944/preprints202611.0169.v1].

Enabling smart maintenance in SMEs via Domain-Specific RAG: An industrial field study

Gaia Falchi
Writing – Review & Editing
;
Vittorio Cesarotti
Supervision
2027-01-01

Abstract

Reactive maintenance management in Small and Medium-sized Enterprises (SMEs) is often hindered by technical knowledge fragmentation and reliance on senior experts. Although generative Artificial Intelligence (AI) offers new perspectives for decision support, adopting generalist models introduces operational risks linked to hallucinations and a lack of specific context. This study analyses the effectiveness of a domain-specific Retrieval-Augmented Generation (RAG) framework, designed to encode historical corporate know-how into reliable operating procedures. Through a field validation conducted on a significant sample of real assistance requests, the research compares the proposed system with a generalist Large Language Model. The methodology adopts an evaluation protocol based on the LLM-as-a-judge technique, validated through analyses conducted with a maintenance engineer, to ensure accuracy. The results highlight how targeted context integration reduces factual inaccuracies, ensuring superior technical relevance. Such accuracy emerges as a fundamental enabling factor to speed up fault diagnosis, laying the foundations for intervention time optimization and greater overall maintenance process effectiveness.
Working paper
2027
Rilevanza internazionale
Settore IIND-05/A - Impianti industriali meccanici
English
Retrieval-Augmented Generation; Smart Maintenance; Large Language Models; Industrial AI; LLM-as-a-judge; Human-AI Collaboration
Leccea, M., Bioddob, A., Dadone, L., Falchi, G., Cesarotti, V. (2027). Enabling smart maintenance in SMEs via Domain-Specific RAG: An industrial field study [Working paper] [10.20944/preprints202611.0169.v1].
Leccea, M; Bioddob, A; Dadone, L; Falchi, G; Cesarotti, V
Altro
File in questo prodotto:
File Dimensione Formato  
0. Preprints-Enabling smart maintenance in SMEs via Domain-Specific RAG An industrial field study.pdf

accesso aperto

Tipologia: Documento in Pre-print
Licenza: Creative commons
Dimensione 1.89 MB
Formato Adobe PDF
1.89 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2108/475684
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact