Faculty, Staff and Student Publications

Authors

    Language

    English

    Publication Date

    11-29-2024

    Journal

    Scientific Reports

    DOI

    10.1038/s41598-024-81170-y

    PMID

    39613846

    PMCID

    PMC11607336

    PubMedCentral® Posted Date

    11-29-2024

    PubMedCentral® Full Text Version

    Post-print

    Abstract

    For sharing privacy-sensitive data, de-identification is commonly regarded as adequate for safeguarding privacy. Synthetic data is also being considered as a privacy-preserving alternative. Recent successes with numerical and tabular data generative models and the breakthroughs in large generative language models raise the question of whether synthetically generated clinical notes could be a viable alternative to real notes for research purposes. In this work, we demonstrated that (i) de-identification of real clinical notes does not protect records against a membership inference attack, (ii) proposed a novel approach to generate synthetic clinical notes using the current state-of-the-art large language models, (iii) evaluated the performance of the synthetically generated notes in a clinical domain task, and (iv) proposed a way to mount a membership inference attack where the target model is trained with synthetic data. We observed that when synthetically generated notes closely match the performance of real data, they also exhibit similar privacy concerns to the real data. Whether other approaches to synthetically generated clinical notes could offer better trade-offs and become a better alternative to sensitive real notes warrants further investigation.

    Keywords

    Humans, Electronic Health Records, Confidentiality, Computer Security, Privacy, Algorithms

    Published Open-Access

    yes

    Share

    COinS
     
     

    To view the content in your browser, please download Adobe Reader or, alternately,
    you may Download the file to your hard drive.

    NOTE: The latest versions of Adobe Reader do not support viewing PDF files within Firefox on Mac OS and if you are using a modern (Intel) Mac, there is no official plugin for viewing PDF files within the browser window.