Faculty, Staff and Student Publications
Language
English
Publication Date
8-7-2025
Journal
Studies in Health Technology and Informatics
DOI
10.3233/SHTI251039
PMID
40776057
Abstract
The objective is to create an automated knowledge extraction tool for cancer research that builds high-quality academic corpora for LLM fine-tuning while investigating its effectiveness in interleukin-6 and bladder cancer domains. To address the current gap in knowledge retrieval techniques for cancer research data collection, we propose KnowledgePipeline, a novel automated tool that incorporates diverse aspects of academic papers and metadata. Our tool integrates content, co-citations, and co-authorship networks to construct domain-specific academic corpora suitable for fine-tuning LLMs. We leverage two LLMs (GPTJ-6.7B and Galactica30B) trained on domain-specific question-answer pairs from the refined data. The system's evaluation focuses on both the quality of extracted knowledge and the performance of fine-tuned models in open-ended question-answering tasks. We see that KnowledgePipeline offers a scalable, automated framework for domain-specific knowledge retrieval and fine-tuned applications in cancer research, advancing literature discovery and addressing critical biomedical challenges. It achieved high relevance scores of 68% for IL-6 and 74.5% for bladder cancer, with a fine-tuned Galactica-30B model demonstrating promising capabilities.
Keywords
Humans, Natural Language Processing, Urinary Bladder Neoplasms, Neoplasms, Data Mining, Interleukin-6, Information Storage and Retrieval, Large Language Models
Published Open-Access
yes
Recommended Citation
Das, Avisha; Diala, Chiamaka; Chen, Guocai; et al., "Efficient Training Corpus Retrieval for Large Language Model Fine Tuning: A Case Study in Cancer." (2025). Faculty, Staff and Student Publications. 820.
https://digitalcommons.library.tmc.edu/uthshis_docs/820