NSF/FDA: Towards an active surveillance framework to detect AI/ML-enabled Software as a Medical Device (SaMD) data and performance drift in clinical flow

Information

  • NSF Award
  • 2326034
Owner
  • Award Id
    2326034
  • Award Effective Date
    10/1/2023 - 8 months ago
  • Award Expiration Date
    9/30/2025 - a year from now
  • Award Amount
    $ 199,792.00
  • Award Instrument
    Standard Grant

NSF/FDA: Towards an active surveillance framework to detect AI/ML-enabled Software as a Medical Device (SaMD) data and performance drift in clinical flow

The increasing use of Clinical Artificial Intelligence/Machine Learning (AI/ML)-enabled Software as a Medical Device (SaMD) for healthcare applications, including medical imaging, is posing significant challenges for regulatory bodies in ensuring that these devices are valid, robust, transparent, explainable, fair, safe, and accurate. One of the major challenges is the phenomenon of data shift, which refers to a mismatch between the distribution of the data that was used for model training/testing and the distribution of the data to which the model was applied. This makes it difficult to generalize AI/ML-enabled SaMD across different healthcare institutions, different medical devices, and disease patterns, resulting in AI model performance deterioration, erroneous outputs, and adverse patient outcomes.<br/><br/>This grant focuses on developing novel methodologies for detecting data shifts in AI/ML-enabled SaMDs in medical cyber-physical systems for healthcare, using lung cancer nodule prediction with research and commercially available AI tools in controlled experimental settings. The project's objective is to create a framework that allows SaMDs to adapt through real-world learning, enhancing their safety and effectiveness in detecting lung cancer nodules. The innovative data shift detection algorithms will advance AI/ML-enabled medical cyber-physical systems, improving model accuracy and reliability to address real-world challenges in the adoption of medical AI/ML applications. Moreover, this grant is committed to promote diversity, equity, and inclusion in STEM fields by providing opportunities for underrepresented minority groups and female scholars-in-residence to work as research scholars at the FDA.<br/><br/>This research is supported by the Computer and Information Science and Engineering Directorate's Division of Computer and Network Systems (CISE/CNS) under the NSF Cyber-Physical Systems (CPS) program.<br/><br/>This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

  • Program Officer
    Ralph Wachterrwachter@nsf.gov7032928950
  • Min Amd Letter Date
    9/13/2023 - 9 months ago
  • Max Amd Letter Date
    9/13/2023 - 9 months ago
  • ARRA Amount

Institutions

  • Name
    University of Miami
  • City
    CORAL GABLES
  • State
    FL
  • Country
    United States
  • Address
    1320 SOUTH DIXIE HIGHWAY STE 650
  • Postal Code
    331462919
  • Phone Number
    3052843924

Investigators

  • First Name
    Phuong
  • Last Name
    Nguyen
  • Email Address
    pxn208@med.miami.edu
  • Start Date
    9/13/2023 12:00:00 AM
  • First Name
    Yelena
  • Last Name
    Yesha
  • Email Address
    yxy806@miami.edu
  • Start Date
    9/13/2023 12:00:00 AM

Program Element

  • Text
    Special Projects - CNS
  • Code
    1714

Program Reference

  • Text
    Artificial Intelligence (AI)
  • Text
    CYBER-PHYSICAL SYSTEMS (CPS)
  • Code
    7918
  • Text
    Smart and Connected Health
  • Code
    8018