Skip to the main content

Original scientific paper

https://doi.org/10.24138/jcomss-2026-0036

A Novel Approach Based on Integrating Small Language Models and Retrieval-Augmented Generation for Medical Question Answering

Bao-Gia Nguyen ; Quy Nhon University, Vietnam
Quang-Hung Le ; Quy Nhon University, Vietnam


Full text: english pdf 1.693 Kb

page 356-366

downloads: 0

cite


Abstract

This paper proposes a novel approach which com bines small language models with retrieval-augmented gener ation in medical question answering to provide accurate and comprehensible information. Our method extracts relevant evi dence from external knowledge and converts them into vector embeddings which are used for high-fidelity semantic retrieval. The small language model subsequently synthesizes the retrieved evidence into fluent, context-aware responses. Extensive experi ments conducted on the PubMed benchmark dataset, the results show competitive performance to larger language models while being far more suitable for deployment in resource-constrained environments. Moreover, the proposed method supports efficient domain knowledge updates without the need for extensive re training. Our implementation is available in the following GitHub repository: https://github.com/LeoBaoNguyen12/RagSLM-MQA.

Keywords

Small Language Models; Retrieval-Augmented Generation; Medical Question Answering; RagSLM-MQA

Hrčak ID:

353723

URI

https://hrcak.srce.hr/353723

Publication date:

20.11.2026.

Visits: 0 *