The use of a machine-learning algorithm that predicts hypotension during surgery in combination with personalized treatment guidance: study protocol for a randomized clinical trial
Intraoperative hypotension is associated with increased morbidity and mortality. Current treatment is mostly reactive. The Hypotension Prediction Index (HPI) algorithm is able to predict hypotension minutes before the blood pressure actually decreases. Internal and external validation of this algorithm has shown good sensitivity and specificity. We hypothesize that the use of this algorithm in combination with a personalized treatment protocol will reduce the time weighted average (TWA) in hypotension during surgery spent in hypotension intraoperatively.
We aim to include 100 adult patients undergoing non-cardiac surgery with an anticipated duration of more than 2 h, necessitating the use of an arterial line, and an intraoperatively targeted mean arterial pressure (MAP) of > 65 mmHg. This study is divided into two parts; in phase A baseline TWA data from 40 patients will be collected prospectively. A device (HemoSphere) with HPI software will be connected but fully covered. Phase B is designed as a single-center, randomized controlled trial were 60 patients will be randomized with computer-generated blocks of four, six or eight, with an allocation ratio of 1:1. In the intervention arm the HemoSphere with HPI will be used to guide treatment; in the control arm the HemoSphere with HPI software will be connected but fully covered. The primary outcome is the TWA in hypotension during surgery.
The aim of this trial is to explore whether the use of a machine-learning algorithm intraoperatively can result in less hypotension. To test this, the treating anesthesiologist will need to change treatment behavior from reactive to proactive.
This trial has been registered with the NIH, U.S. National Library of Medicine at ClinicalTrials.gov, ID: NCT03376347. The trial was submitted on 4 November 2017 and accepted for registration on 18 December 2017.
KeywordsArtificial intelligence Blood pressure Perioperative care Anesthesiology Hemodynamics
Area above the threshold
Academic Medical Center
American Society of Anesthesiologists
Area under the threshold
Goal Directed Fluid Therapy
Hypotension Prediction Index
Mean arterial pressure
Post Anesthesia Care Unit
Worldwide, an estimated 313 million people have to undergo surgical procedures every year . Intraoperatively, patients often suffer from episodes of hypotension. Hypotension, defined as a mean arterial pressure (MAP) < 65 mmHg, occurs in 65% of surgeries . Intraoperative hypotension is usually caused by anesthetics, pre-operative use of medication, existing comorbidities or by the surgery itself .
Since both pressure and flow are required to deliver oxygen to the tissues, hypotension can negatively affect organ function . Clinical cohort studies and one randomized controlled clinical trial have shown intraoperative hypotension to be associated with postoperative complications such as myocardial ischemia, renal insufficiency and increased mortality [5, 6, 7, 8, 9, 10, 11]. Not only the time spent in hypotension but also the severity (the depth) of hypotension may be important for postoperative outcome . The time-weighted average (TWA) combines the time and depth of hypotension [13, 14].
Hypotension is most often preventable; however, current management of the hypotensive episodes is predominantly reactive and often occurs with some delay. Machine learning was used to develop an algorithm to predict hypotension minutes before the blood pressure actually decreases, the Hypotension Probability Indicator (HPI) . The HPI algorithm is developed using continuously measured waveform data from 1334 patients, internally validated on a cohort of 350 patients and externally validated on a cohort of 204 patients. The HPI algorithm is able to predict hypotension with 88% sensitivity and 87% specificity minutes before a hypotensive event occurs .
We hypothesize that the use of the HPI algorithm in combination with a personalized treatment protocol will reduce the amount of time spent in hypotension measured by the TWA during non-cardiac surgery.
This investigator-initiated trial is divided into two phases. Phase A consists of prospective data collection in 40 patients to gain insight into the normal TWA in our study population. Phase-A data are collected to check our sample size for phase B and to verify if the control group is a representative sample. Phase B is a single-center, randomized controlled (1:1), superiority trial including 60 patients. The study takes place in the Academic Medical Center (AMC) Amsterdam, The Netherlands, a tertiary academic center. The study started with inclusion of the first patient in November 2017, the planned duration of the trial is 18 months. This trial has been registered with the NIH, U.S. National Library of Medicine at ClinicalTrials.gov (NCT03376347). This manuscript was written in accordance with the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) guideline (Additional file 1) on reporting of intervention trial protocols .
Adult patients (aged 18 years or older) scheduled to undergo an elective, clinical, non-cardiac, surgical procedure under general anesthesia and requiring an arterial line will be eligible for inclusion. A desired target MAP of 65 mmHg during surgery is used as an inclusion criterion, to ensure that both study arms will be similar in this aspect. Patients undergoing emergency surgery are not eligible. Patients with cardiac failure, severe cardiac shunts, severe aortic stenosis and severe cardiac arrhythmias will be excluded in accordance with the summary of product characteristics of the HPI algorithm. Patients enduring significant hypotension before surgery and patients requiring dialysis will be excluded. Patients planned to undergo liver surgery or vascular surgery will be excluded because of the use of vascular clamping. For this trial, anesthesiologists are not allowed to use a different hemodynamics treatment protocol besides our study protocol; therefore, an exclusion criterion is the planned usage of a perioperative Goal Directed Fluid Therapy (GDFT) protocol.
Researchers will screen all patients presenting for elective, non-cardiac, non-day-case surgery. Patients will be contacted and informed in case of eligibility. Patient informed consent will be obtained the day prior to surgery.
Patients will be contacted on the surgical ward or at the pre-operative assessment clinic, and written information and oral explanation will be provided. Patient characteristics, medical history, medication use and American Society of Anesthesiologists (ASA) physical score classification will be collected from the medical records. Blood pressure measured at the outpatient clinic, blood pressure measured the day before surgery on the ward and blood pressure measured in the operating theater before induction will also be registered.
Phase A: TWA and normal treatment behavior of anesthesiologists in the AMC will be collected prospectively as baseline data. These data will be used to verify our sample size calculation for phase B and to study whether our control group is representative for the study population by comparing the baseline group versus the control group. During this phase of the study the treating anesthesiologist and anesthesia nurse will not be informed about the aim of the study or the endpoints measured.
Phase B: in this phase, patients will be randomized. The treating anesthesiologist and the anesthesia nurse will be informed about the study protocol and the usage of the HPI algorithm (with the secondary screen) the day before the surgery. All study interventions are to be performed by trained study personnel or the treating anesthesiologist, following instructions from the researchers.
In both study phases a researcher will be present – continuously – during all surgeries to note surgical and anesthetic details.
Randomization and blinding
In phase B, patients will be randomized to either use of the HPI algorithm intraoperatively (intervention arm) or standard care (control arm). We will use a computer-generated, permutated block randomization, with a 1:1 allocation ratio. This will result in concealed and varying permutated block sizes of four, six or eight patients.
Randomization will be performed by a designated researcher. An independent researcher (not involved in collecting study data), blinded for the randomization, will perform the statistical analysis for the primary outcome.
Study procedures and interventions
The HPI algorithm was previously internally and externally validated . The HPI algorithm is only available on the HemoSphere and Flotrac monitoring systems and requires the use of a FlotracIQ sensor connected to an arterial line (Edwards Lifesciences Corp., Irvine, CA, USA). The FlotracIQ sensor has a splitter which enables the splitting of the arterial blood pressure signal to facilitate a blood pressure signal on both the Philips monitor (standard care) and the HemoSphere monitor (study).
Example: a MAP of 50 mmHg for 5 min results in an AUC of 75 (15 × 5). The total duration of the operation in minutes is 120 min. TWA = 75/120 = 0.625.
Hypotension is defined as a MAP < 65 mmHg for 1 min. An HPI alarm is defined as an HPI value of 85% and above during at least 1 min. A subsequent hypotensive episode, as well as an HPI alarm only counts as two separate events when respectively the MAP or the HPI will be normal for at least 1 min.
The secondary outcome measures include incidence of hypotension, time in hypotension, the percentage of time in hypotension and the AUC of a MAP < 65 mmHg. The above-mentioned parameters including TWA will also be assessed for hypertension (defined as MAP > 100 mmHg for at least 1 min) and for the HPI alarms. For hypertension and HPI alarm the area above the curve (AAT) will be calculated instead of the AUC, see Fig. 4. We will assess the treatment behavior of hypotension and HPI. This includes treatment choice (i.e., vasopressors, fluids, inotropes, position changes), treatment dose, time to treatment and feasibility of working with HPI based on the number of protocol violations.
Exploratory outcomes include underlying cause(s) of intraoperative hypotension and we will assess whether the use of HPI intraoperatively will result in less hypotension (measured in TWA) postoperatively at the Post Anesthesia Care Unit (PACU).
All adverse and serious adverse events, irrespective of causality, will be collected and reviewed by the principal investigator and reported to the Medical Ethics Committee of the AMC Amsterdam. Adverse events are defined as any undesirable experience occurring to a subject during the study, whether or not considered related to the experimental intervention. All adverse events reported spontaneously by the subject or observed by the investigator or his staff will be recorded.
Serious adverse events are defined as any untoward medical occurrence or effect that: results in death; is life-threatening (at the time of the event); requires hospitalization or prolongation of existing inpatients’ hospitalization; results in persistent or significant disability or incapacity; is a congenital anomaly or birth defect; or any other important medical event that did not result in any of the outcomes listed above due to medical or surgical intervention but could have been based upon appropriate judgment by the investigator. An elective hospital admission will not be considered as a serious adverse event.
We cover the potential harm of overtreatment by assessing the cumulative treatment dose during surgery and by assessing the amount of hypertension (in TWA, AUC, incidence, total time and percentage of time spent in hypertension). We will compare the outcomes between the control and intervention groups.
Insurance is provided for all participating subjects by the AMC Amsterdam.
Sample size calculation (phase B)
Difference in primary outcome will be compared using the Student’s t test or the Mann-Whitney U test, based on normality. A statistician performed the sample-size analysis. Based on previously published blood pressure data during surgery, it was estimated that our control group would have a TWA of 0.50 and a difference of 0.38 or larger between two study groups would be clinically relevant . An effect size of 0.74 was calculated by dividing the estimated difference of 0.38 (mean experimental group − mean control group) by the standard deviation of 0.51. A sample size of 30 in each group in the randomized phase will have 80% power to detect an effect size of 0.74 using a two-group t test with a 0.05 two-sided significance level. Sample size was calculated using R 2017 .
The baseline data collection enables us to calculate the normal TWA spent in hypotension in our hospital and will be used to verify our sample-size analysis.
Patients who are randomized but in whom no study measurement was started, no arterial line was placed or when technical failure of the HemoSphere device prevented data collection will be excluded and replaced.
We will analyze the data based on an intention-to-treat principle. The intention-to-treat population is defined as all patients who meet the inclusion criteria at the end of the study period.
Continuous data will be presented as median with range and/or interquartile range (IQR), or mean with standard deviation and range when normally distributed. Normality of distribution will be assessed visually with histograms and Q-Q plots. Categorical data were given as frequencies with percentages. For each of the analyses a probability value of p < 0.05 will be considered statistically significant.
Our primary outcome is TWA in hypotension (phase B). We will compare the TWA of each arm using the Student’s t test or Mann-Whitney U test, depending on the distribution of the data. The baseline data collection enables us to calculate the normal TWA spent in hypotension in our hospital and will be used to verify the representativeness of our control group. We will compare the TWA in the baseline group (phase A) to the TWA in the control arm (phase B).
The secondary and exploratory research questions involving categorical data will be analyzed using the χ2 test/Fisher’s exact test and secondary research questions involving continuous (numerical) data will be analyzed using the Student’s t test or the Mann-Whitney U test. Feasibility of working with HPI will be analyzed using qualitative research methods, reporting the number of protocol violations with reasons. Underlying causes of intraoperative hypotension will be analyzed using our study flowchart (Fig. 2) on all 100 patients. To assess whether use of HPI intraoperatively results in less postoperative hypotension at the PACU the TWA in hypotension during PACU stay will be analyzed. The exploratory questions will not be addressed in the primary article. All analyses for the primary article will be done using Matlab (R2018b) and SPSS (version 25).
In accordance with the decision of our Medical Ethics Committee this trial is scored “low risk” and will, therefore, not need to be monitored by a Data Monitoring Committee.
Ethical approval and registration
This study protocol has been approved by the Medical Ethics Committee of the AMC in Amsterdam. All protocol amendments will be communicated to the Medical Ethics Committee. The study protocol is in adherence with the Declaration of Helsinki and the guideline of Good Clinical Practice. Written informed consent will be obtained by trained researchers the day prior to surgery. A subject-screening and enrollment log will be kept on a secure server only accessible to study personnel. This trial has been registered with the NIH, U.S. National Library of Medicine at ClinicalTrials.gov (NCT03376347).
Definition of intraoperative hypotension
Intraoperative hypotension is clearly associated with adverse postoperative outcomes . Controversially, a universally accepted definition of intraoperative hypotension does not yet exist . In this study, we define hypotension as a MAP below 65 mmHg which is in line with some large clinical trials and with our hospital’s protocol .
For a machine-learning algorithm-based tool to help prevent intraoperative hypotension the treating anesthesiologists need to be willing to change their treatment behavior from reactive to proactive. Furthermore, the anesthesiologists will need to get used to diagnosing the underlying cause of hypotension based on the extra hemodynamic variables.
The algorithm was developed using continuously measured waveform data from 1334 patients, internally validated on a cohort of 350 patients and externally validated on a cohort of 204 patients . This is the first randomized controlled trial using this algorithm intraoperatively. This trial is powered on the TWA in hypotension. If this trial is successful in reducing intraoperative hypotension, future studies are needed and they will need to be powered to anticipated changes in clinical outcomes.
The study started with inclusion of the first patient in November 2017, the planned duration of the trial is 18 months. Last amendment of protocol: version 4.0 March 2018.
We would like to thank the study participants for their support of this study.
MW: design of study, writing of the manuscript, future acquisition and interpretation of study data. JS and LET: future acquisition of study data and critically reviewing the manuscript. MPM: independent blinded analysis of study data. MWH, BFG, APV and DPV: conception and design of study, critically reviewing the manuscript and interpretation of study data. All authors approved this final version of the manuscript to be published and are accountable for all aspects of the work. There will be no use of professional writers.
This work is supported by Edward Lifesciences. Edwards Lifesciences, the manufacturer of the HPI, was contacted after design of the trial. The AMC Amsterdam is the trial sponsor and will remain owner of all data and rights to publication. No publication restrictions apply. The manuscript will be drafted by the investigators from the AMC Amsterdam.
Ethics approval and consent to participate
This study protocol has been approved by the Medical Ethics Committee of the AMC in Amsterdam. The study protocol is in adherence with the Declaration of Helsinki and the guideline of Good Clinical Practice. Informed consent will be obtained by trained researchers the day prior to surgery. A subject screening and enrollment log will be kept on a secure server only accessible to study personnel. This trial has been registered with the NIH, U.S. National Library of Medicine at ClinicalTrials.gov (NCT03376347).
Consent for publication
As noted in the study protocol, study participants will consent to having their data and results published anonymously.
The Department of Anesthesiology of the Academic Medical Center (AMC) received financial support for this project from Edwards Lifesciences. DPV, APV, MW and BFG receive consultancy fees from Edwards Lifesciences.
- 8.Hallqvist L, Granath F, Huldt E, et al. Intraoperative hypotension is associated with acute kidney injury in noncardiac surgery: an observational study. Eur J Anaesthesiol. 2018;35(4):273–9. https://doi.org/10.1097/eja.0000000000000735 [published Online First: 7 Dec 2017].CrossRefPubMedGoogle Scholar
- 11.Futier E, Lefrant JY, Guinot PG, et al. Effect of individualized vs standard blood pressure management strategies on postoperative organ dysfunction among high-risk patients undergoing major surgery: a randomized clinical trial. JAMA. 2017;318(14):1346–57. https://doi.org/10.1001/jama.2017.14172.CrossRefPubMedPubMedCentralGoogle Scholar
- 17.Castor EDC. Castor Electronic Data Capture. 2019. [online] Available at: https://castoredc.com. See; https://helpdesk.castoredc.com/article/172-how-do-i-cite-castor-edc-in-my-paper.
- 18.Maheshwari K, Khanna S, Bajracharya GR, et al. A randomized trial of continuous noninvasive blood pressure monitoring during noncardiac surgery. Anesth Analg. 2018;127(2):424–31. https://doi.org/10.1213/ane.0000000000003482 [published Online First: 20 Jun 2018].CrossRefPubMedPubMedCentralGoogle Scholar
- 19.R Core Team. R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2017. Available from https://www.R-project.org/. Accessed 24 July 2017.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.