Application US20200353271

SELECTION OF PROBABILITY THRESHOLDS FOR GENERATING CARDIAC ARRHYTHMIA NOTIFICATIONS
[+] Show Details

US20200353271

1. A method comprising: (8) (8)

generating, by a computing system that comprises processing circuitry and a storage medium, a set of sample probability values by applying a machine learning model to a sample set of patient data, wherein: the machine learning model is trained using patient data for a plurality of patients,

the sample set comprises a plurality of temporal windows, and

for each respective temporal window of the plurality of temporal windows, the machine learning model is configured to determine a respective probability value in the set of sample probability values that indicates a probability that a cardiac arrhythmia occurred during the respective temporal window;

generating, by the computing system, graphical data based on the sample probability values;

outputting, by the computing system, a user interface for display on a display device, the user interface comprising the graphical data;

receiving, by the computing system, via the user interface, an indication of user input to select a probability threshold for a patient;

receiving, by the computing system, patient data for the patient, wherein the patient data is collected by one or more medical devices;

applying, by the computing system, the machine learning model to the patient data to determine a current probability value that indicates a probability that the patient has experienced an occurrence of a cardiac arrhythmia;

determining, by the computing system, that the current probability value exceeds the probability threshold for the patient; and

in response to determining that the current probability value is greater than or equal to the probability threshold for the patient, generating, by the computing system, a notification indicating that the patient has likely experienced the occurrence of the cardiac arrhythmia.

2. The method of claim 1, wherein: (0) (2)

generating the graphical data comprises generating, by the computing system, a receiver operating curve (ROC), wherein generating the ROC comprises: for each evaluation probability threshold of a plurality of evaluation probability thresholds: determining, by the computing system, a sensitivity value for the respective evaluation probability threshold as a ratio of: (i) a total number of sample probability values in the set of sample probability values that are greater than or equal to the respective evaluation probability threshold to (ii) a total number of the temporal windows in the sample set that actually contain occurrences of the cardiac arrhythmia that actually occurred in the sample set;

determining, by the computing system, a specificity value for the respective probability value as a ratio of: (i) a total number of the sample probability values that are not greater than or equal to the respective evaluation probability threshold to (ii) a total number of the temporal windows in the sample set that do not actually contain occurrences of the cardiac arrhythmia; and

determining, by the computing system, a point on the ROC that corresponds to the respective probability value, wherein the point on the ROC that corresponds to the respective probability value is based on the sensitivity value for the respective evaluation probability threshold and the specificity value for the respective evaluation probability threshold; and

receiving the indication of user input to select the probability threshold for the patient comprises: receiving, by the computing system, an indication of user input to select a point on the ROC that corresponds to the probability threshold for the patient.

3. The method of claim 1, wherein: (1) (2)

5. The method of claim 1, wherein receiving the patient data for the patient comprises receiving, by the computing system, cardiac electrical waveform data for the patient. (0)

6. The method of claim 1, further comprising receiving, by the computing system, an indication of user input to update the probability threshold for the patient. (0)

7. The method of claim 1, wherein the medical device comprises a wearable medical device or an implantable medical device (IMD). (0)

8. The method of claim 1, wherein: (0) (2)

the cardiac arrhythmia is a first cardiac arrhythmia in a plurality of cardiac arrhythmias, and

the method comprises, for each respective cardiac arrhythmia of the plurality of cardiac arrhythmias: generating, by the computing system, a respective set of sample probability values by applying a respective machine learning model to a respective sample set of patient data, wherein: the respective machine learning model is trained using patient data for the plurality of patients,

the respective sample set comprises a respective plurality of temporal windows, and

for each respective temporal window of the respective plurality of temporal windows, the respective machine learning model is configured to determine a respective probability value in the respective set of sample probability values that indicates a probability that the respective cardiac arrhythmia occurred during the respective temporal window;

generating, by the computing system, respective graphical data based on the respective set of sample probability values;

outputting, by the computing system, the user interface for display on the display device such that the user interface comprises the respective graphical data;

receiving, by the computing system, via the user interface, an indication of user input to select a respective probability threshold for the patient;

applying, by the computing system, the machine learning model to the patient data to determine a respective probability value that indicates a probability that the patient has experienced an occurrence of the respective cardiac arrhythmia;

determining, by the computing system, that the respective probability value exceeds the respective probability threshold; and

in response to determining that the respective probability value is greater than or equal to the respective probability threshold, generating, by the computing system, a notification indicating that the patient has likely experienced the occurrence of the respective cardiac arrhythmia.

9. The method of claim 1, further comprising presenting, by the computing system, data indicating the anticipated review burden versus the anticipated diagnostic yield for the probability threshold for the patient. (0)

10. The method of claim 1, wherein the patient is a first patient, the patient data is first patient data, the current probability value is a first current probability value, and the one or more medical devices are one or more first medical devices, and the method further comprises: (0) (4)

receiving, by the computing system, second patient data for a second patient, wherein the second patient data is collected by one or more second medical devices;

applying, by the computing system, the machine learning model to the second patient data to determine a second current probability value that indicates a probability that the second patient has experienced an occurrence of the cardiac arrhythmia;

determining, by the computing system, that the second current probability value exceeds a default probability threshold, wherein the default probability threshold is set to maximize diagnostic yield; and

in response to determining that the second current probability value is greater than or equal to the default probability threshold, generating, by the computing system, a second notification indicating that the second patient has likely experienced the occurrence of the cardiac arrhythmia.

11. A computing system comprising: (7) (2)

one or more processing circuits; and

a storage medium storing instructions that, when executed, configure the one or more processing circuits to: generate a set of sample probability values by applying a machine learning model to a sample set of patient data, wherein: the machine learning model is trained using patient data for a plurality of patients,

the sample set comprises a plurality of temporal windows, and

generate graphical data based on the sample probability values;

output a user interface for display on a display device, the user interface comprising the graphical data;

receive, via the user interface, an indication of user input to select a probability threshold for a patient;

receive patient data for the patient, wherein the patient data is collected by one or more medical devices;

apply the machine learning model to the patient data to determine a current probability value that indicates a probability that the patient has experienced an occurrence of a cardiac arrhythmia;

determine that the current probability value exceeds the probability threshold for the patient; and

in response to determining that the current probability value is greater than or equal to the probability threshold for the patient, generate a notification indicating that the patient has likely experienced the occurrence of the cardiac arrhythmia.

12. The computing system of claim 11, wherein: (0) (2)

the one or more processing circuits are configured such that, as part of generating the graphical data, the one or more processing circuits generate a receiver operating curve (ROC), wherein, the one or more processing circuits are configured such that, as part of generating the ROC, the one or more processing circuits: for each evaluation probability threshold of a plurality of evaluation probability thresholds: determine a sensitivity value for the respective evaluation probability threshold as a ratio of: (i) a total number of sample probability values in the set of sample probability values that are greater than or equal to the respective evaluation probability threshold to (ii) a total number of the temporal windows in the sample set that actually contain occurrences of the cardiac arrhythmia that actually occurred in the sample set;

determine a specificity value for the respective probability value as a ratio of: (i) a total number of the sample probability values that are not greater than or equal to the respective evaluation probability threshold to (ii) a total number of the temporal windows in the sample set that do not actually contain occurrences of the cardiac arrhythmia; and

determine a point on the ROC that corresponds to the respective probability value, wherein the point on the ROC that corresponds to the respective probability value is based on the sensitivity value for the respective evaluation probability threshold and the specificity value for the respective evaluation probability threshold; and

the one or more processing circuits are configured such that, as part of receiving the indication of user input to select the probability threshold for the patient, the one or more processing circuits receive an indication of user input to select a point on the ROC that corresponds to the probability threshold for the patient.

13. The computing system of claim 11, wherein: (1) (2)

15. The computing system of claim 11, wherein the one or more processing circuits are configured such that, as part of receiving the patient data for the patient, the one or more processing circuits are configured to receive cardiac electrical waveform data for the patient. (0)

16. The computing system of claim 11, wherein the one or more processing circuits are further configured to receive an indication of user input to update the probability threshold for the patient. (0)

17. The computing system of claim 11, wherein the medical device comprises a wearable medical device or an implantable medical device (IMD). (0)

18. The computing system of claim 11, wherein: (0) (2)

the cardiac arrhythmia is a first cardiac arrhythmia in a plurality of cardiac arrhythmias, and

the respective sample set comprises a respective plurality of temporal windows, and

generating, by the computing system, respective graphical data based on the respective set of sample probability values;

outputting, by the computing system, the user interface for display on the display device such that the user interface comprises the respective graphical data;

receiving, by the computing system, via the user interface, an indication of user input to select a respective probability threshold for the patient;

determining, by the computing system, that the respective probability value exceeds the respective probability threshold; and

19. The computing system of claim 11, wherein the one or more processing circuits are further configured to present data indicating the anticipated review burden versus the anticipated diagnostic yield for the probability threshold for the patient. (0)

20. A computer-readable data storage medium having instructions stored thereon that, when executed, cause one or more processing circuits of a computing system to: (0) (8)

generate a set of sample probability values by applying a machine learning model to a sample set of patient data, wherein: the machine learning model is trained using patient data for a plurality of patients, the sample set comprises a plurality of temporal windows, and