Effectiveness of an artificial intelligence clinical decision support system for early detection of sepsis

ISRCTN ISRCTN83789437
DOI https://doi.org/10.1186/ISRCTN83789437
Secondary identifying numbers NIL
Submission date
09/07/2024
Registration date
12/07/2024
Last edited
10/07/2024
Recruitment status
No longer recruiting
Overall study status
Completed
Condition category
Infections and Infestations
Prospectively registered
Protocol
Statistical analysis plan
Results
Individual participant data
Record updated in last year

Plain English Summary

Background and study aims
Sepsis is a life-threatening response to infection that can lead to tissue damage, organ failure, and death if not recognized and treated promptly. The mortality rate associated with sepsis remains distressingly high, recorded at 32.2%. This rate escalates to 38.5% in cases that progress to septic shock, according to findings from a comprehensive meta-analysis. Rapid and accurate diagnosis is crucial in managing sepsis effectively. Traditional methods for diagnosing sepsis can be slow and may delay the initiation of treatment. This study introduces an artificial intelligence-clinical decision support system (AI-CDSS) that uses machine learning algorithms to analyze blood test data (complete blood count with differential, or CBC + DIFF) to quickly assess the risk of sepsis. This system aims to support health professionals by providing timely information that could lead to faster and more accurate sepsis management. The study will examine how the AI-CDSS influences clinical decision-making and assess the confidence health professionals have in their sepsis diagnoses based on the system’s assessments.

Who can participate?
Adults aged 18 years old and over who are licensed health professionals, including postgraduate year residents, residents, fellows, or attending physicians, are involved in diagnosing and managing sepsis and have at least one year of clinical experience.

What does the study involve?
Participants in this randomized controlled trial are divided into two groups: an intervention group using the AI-CDSS for sepsis diagnosis and management, and a control group following standard practices. Both groups will complete surveys assessing their confidence in sepsis management. Additionally, they will provide feedback on their experience, focusing on decision-making efficiency, ease of use, and satisfaction. This setup allows the study to compare the impact of the AI-CDSS with traditional sepsis management methods, capturing data on the effectiveness and acceptability of both approaches.

What are the possible benefits and risks of participating?
Participants may benefit from using the AI-CDSS by making more accurate and timely decisions in sepsis management, which could lead to better patient outcomes. There are no significant risks associated with participating in this study, as patient care will continue to be guided by clinical judgment and standards. The use of the AI tool is intended to support, not replace, the professional decision-making process.

Where is the study run from?
The study is being conducted at Tri-Service General Hospital, which has agreed to implement and test this new technology.

When is the study starting and how long is it expected to run for?
June 2024 to January 2025

Who is funding the study?
Tri-Service General Hospital

Who is the main contact?
Dr. Hung-Sheng Shang, iamkeith@mail.ndmctsgh.edu.tw

Contact information

Dr Hung-Sheng Shang
Public, Scientific, Principal Investigator

No. 325
Sec. 2
Chenggong Rd.
Neihu Dist.
Taipei City
114202
Taiwan

ORCiD logoORCID ID 0000-0002-4831-1866
Phone +886 920713130
Email iamkeith@mail.ndmctsgh.edu.tw

Study information

Study designRandomized controlled trial
Primary study designInterventional
Secondary study designRandomised controlled trial
Study setting(s)Internet/virtual
Study typeEfficacy
Participant information sheet 45758_PIS.pdf
Scientific titleEffectiveness of an artificial intelligence-clinical decision support system for early detection of sepsis: a randomized controlled trial
Study hypothesisPrimary Hypothesis:
The use of the artificial intelligence-clinical decision support system (AI-CDSS) for sepsis diagnosis and management enhances the confidence of healthcare professionals compared to those using standard diagnostic practices. This hypothesis assesses whether the intervention leads to increased confidence in clinical decisions related to sepsis management.

Secondary Hypothesis:
The implementation of AI-CDSS improves decision-making efficiency, increases user satisfaction, and enhances the overall effectiveness of sepsis management compared to conventional methods. This hypothesis evaluates the broader impact of the AI tool on improving clinical workflows and patient care outcomes.
Ethics approval(s)

Approved 17/06/2024, Institutional Review Board of Tri-Service General Hospital (No.325, Sec.2, Cheng-Kung Rd. Neihu, Taipei City, 114202, Taiwan, Taipei City, 114202, Taiwan; +88687923311 ext 17763; tsghirb@ndmctsgh.edu.tw), ref: C202305073

ConditionSepsis
InterventionRandomized Comparison of Artificial Intelligence-Clinical Decision Support System (AI-CDSS) Use with Standard Sepsis Diagnostic Practices

This randomized controlled trial compares two groups: one using the AI-CDSS and the other following standard sepsis diagnostic practices. The intervention group receives support from the AI-CDSS, which integrates machine learning algorithms with complete blood count with differential (CBC + DIFF) data to assess the risk of sepsis. This system is designed to provide sepsis risk assessments using real-time CBC + DIFF data, supporting health professionals throughout the patient's care.

Participants are randomly assigned to either the intervention group (AI-CDSS assisted) or the control group (standard diagnostic practices) using a computer-generated sequence to ensure blinding and reduce allocation bias. Both groups undergo follow-up questionnaire assessments on days 1, 2, 4, and 7 after sepsis treatment is initiated to evaluate the impact of the diagnostic approach on clinical decision-making and patient outcomes.
Intervention typeOther
Primary outcome measurePhysician confidence in their sepsis diagnosis measured using a questionnaire on days on day 1, 2, 4, and 7 after the initial diagnosis or risk identification
Secondary outcome measuresThe following secondary outcome measures will be assessed using a questionnaire administered on days 1, 2, 4, and 7 after the initial sepsis diagnosis:
1. Satisfaction with the Diagnostic Process to evaluate factors influencing physician satisfaction, including decision-making efficiency (time required and ease of accessing necessary information) and overall satisfaction with the diagnostic process as used in their clinical practice
2. Effectiveness of Sepsis Management Decisions. This involves assessing the effectiveness of the decisions made following the sepsis diagnosis in managing patient care and improving health outcomes, such as recovery rates and prevention of sepsis progression.
Overall study start date01/06/2024
Overall study end date15/01/2025

Eligibility

Participant type(s)Health professional
Age groupAdult
Lower age limit18 Years
SexBoth
Target number of participants400
Participant inclusion criteria1. Professional Status: Must be a licensed health professional authorized to diagnose and manage sepsis, including postgraduate year residents, residents, fellows, or attending physicians in relevant departments such as emergency medicine, intensive care, and infectious diseases.
2. Clinical Experience: Must have a minimum of one year of clinical experience, ensuring familiarity with sepsis diagnosis and management protocols.
3. Access to Technology: Must have regular access to the necessary technological infrastructure to use the AI-CDSS, including computers or tablets with internet connectivity. This infrastructure should also be integrated into the hospital’s electronic health record system where feasible.
4. Training Willingness: Must be willing to undergo a brief training session on the use of the AI-CDSS to ensure proper understanding and effective utilization of the system, focusing on how it integrates with sepsis diagnostic and management protocols.
Participant exclusion criteria1. Non-Diagnostic Roles: Health professionals who are not directly involved in diagnosing or managing patient care, such as administrative staff, nurses without diagnostic responsibilities, or medical students who do not participate in clinical decision-making.
2. Inexperience in Sepsis Management: Health professionals with less than one year of clinical experience in departments relevant to sepsis care, ensuring that all participants have adequate exposure to sepsis management practices.
Recruitment start date01/08/2024
Recruitment end date31/12/2024

Locations

Countries of recruitment

  • Taiwan

Study participating centre

Tri-Service General Hospital
No. 325, Sec. 2, Chenggong Rd., Neihu Dist.
Taipei City
114202
Taiwan

Sponsor information

Tri-Service General Hospital
Hospital/treatment centre

No. 325
Sec. 2
Chenggong Rd.
Neihu Dist.
Taipei City
114202
Taiwan

Phone +886 287923311
Email medr@mail.ndmctsgh.edu.tw
Website https://www.tsgh.ndmctsgh.edu.tw/
ROR logo "ROR" https://ror.org/007h4qe29

Funders

Funder type

Hospital/treatment centre

Tri-Service General Hospital
Private sector organisation / Other non-profit organizations
Alternative name(s)
Sānjun Zongyīyuàn, Tri-Service General Hospital, Taiwan, TSGH
Location
Taiwan

Results and Publications

Intention to publish date31/12/2025
Individual participant data (IPD) Intention to shareYes
IPD sharing plan summaryPublished as a supplement to the results publication
Publication and dissemination planPlanned publication in a peer-reviewed journal
IPD sharing planThe datasets generated and/or analysed during the current study will be published as a supplement to the results publication

Study outputs

Output type Details Date created Date added Peer reviewed? Patient-facing?
Participant information sheet 10/07/2024 No Yes

Additional files

45758_PIS.pdf

Editorial Notes

09/07/2024: Study's existence confirmed by the Institutional Review Board of Tri-Service General Hospital.