Patent US10365716

Wearable computing apparatus and method
[+] Show Details

US10365716

1. A method, performed by a wearable eyeglass frame comprising at least one bio-signal measuring sensor and a display, the at least one bio-signal measuring sensor including at least one electrophysiological sensor, the at least one electrophysiological sensor including at least one EOG sensor and at least one EEG sensor, comprising: (11) (8)

displaying at least one item on the display;

acquiring bio-signal data from a user using the at least one bio-signal measuring sensor, the bio-signal data comprising electrophysiological data from the at least one electrophysiological sensor;

processing the bio-signal data, in accordance with a profile associated with the user to compute at least one brainwave state measurement and at least one eye activity measurement, the at least one eye activity measurement computed using the electrophysiological data from the at least one EOG sensor, the at least one eye activity measurement based on changes in an electrical potential of the bio-signal data from the at least one EOG sensor, wherein the processing comprises detecting, within the at least one brainwave state measurement, an event related potential associated with the display of the at least one item;

determining, using the at least one eye activity measurement, positions and times of eye movements between points of focus on elements in a scene, the scene including the display, and positions and times of eye gaze fixations on points of focus on elements in the scene;

identifying a pattern of saccadic eye movement based on the eye movements and the eye gaze fixations;

upon identification of the pattern, associating the pattern with a condition of saliences of elements of the scene to the user;

determining a correspondence between the at least one brainwave state measurement, the eye movements, the eye gaze fixations, the saliences of elements of the scene to the user, and at least one predefined device control action; and

in accordance with the determined correspondence, controlling operation of at least one component of the eyeglass frame by modifying or initiating the modification of an image displayed on the display.

2. The method of claim 1 further comprising establishing the profile by calibration using a pre-determined set of exercises and acquiring baseline bio-signal data from the user using the at least one bio-signal measuring sensor. (0)

3. The method of claim 1 further comprising establishing the profile using historical bio-signal data from the user. (0)

4. The method of claim 1 wherein the eye activity measurement is based on at least one of EOG, EEG, event related potentials, and steady state visual evoked potential. (0)

5. The method of claim 1 further comprising: (0) (3)

6. The method of claim 1 further comprising: (0) (3)

7. The method of claim 1 further comprising: (0) (1)

8. The method of claim 1 further comprising: (0) (3)

9. The method of claim 1 further comprising: (0) (1)

10. The method of claim 1 wherein each of the at least one item flashes, independently, at a respective predetermined frequency, wherein the processing comprises detecting, within the at least one brainwave state measurement, for a steady state visually evoked potential having a frequency associated with any of the respective predetermined frequencies. (0)

11. The method of claim 1 further comprising displaying an application interface on the display with at least one indicator, wherein the determining of the correspondence between the at least one brainwave state measurement, the eye movements, the eye gaze fixations, the saliences of elements of the scene to the user, and at least one predefined device control action includes: (0) (1)

12. The method of claim 1, wherein the eyeglass frame further comprises at least one orientation sensor selected from an accelerometer, a gyroscopic sensor, and a compass; (0) (2)

13. A non-transitory computer program product tangibly embodying code that, when executed by a processor, causes the processor to: (0) (8)

display at least one object on a display of a wearable eyeglass frame;

acquire bio-signal data from a user using at least one bio-signal measuring sensor, the at least one bio-signal measuring sensor including at least one electrophysiological sensor, the at least one electrophysiological sensor including at least one EOG sensor and at least one EEG sensor, the bio-signal data comprising electrophysiological data from the at least one electrophysiological sensor;

process the bio-signal data in accordance with a profile associated with the user to compute at least one brainwave state measurement and at least one eye activity measurement, the at least one eye activity measurement computed using the electrophysiological data from the at least one EOG sensor, the at least one eye activity measurement based on changes in an electrical potential of the bio-signal data from the at least one EOG sensor, wherein the processing comprises detecting, within the at least one brainwave state measurement, an event related potential associated with the display of the at least one object;

determine, using the at least one eye activity measurement, positions and times of eye movements between points of focus on elements in a scene, the scene including the display, and positions and times of eye gaze fixations on points of focus on elements in the scene;

identify a pattern of saccadic eye movement based on the eye movements and the eye gaze fixations;

upon identification of the pattern, associate the pattern with a condition of saliences of elements of the scene to the user;

determine a correspondence between the at least one brainwave state measurement, the eye movements, the eye gaze fixations, the saliences of elements of the scene to the user, and at least one predefined device control action; and

in accordance with the determined correspondence, control operation of at least one component of the wearable eyeglass frame by modifying or initiating the modification of an image displayed on the display.

14. A wearable eyeglass frame comprising: (1) (4)

at least one bio-signal measuring sensor, the at least one bio-signal measuring sensor including at least one electrophysiological sensor, the at least one electrophysiological sensor including at least one EOG sensor and at least one EEG sensor;

a display;

at least one data processor coupled to the at least one bio-signal measuring sensor; and

a non-transitory computer-readable medium or media comprising computer-executable instructions configured to cause the at least one data processor to: display at least one item on the display;

acquire bio-signal data from a user using the at least one bio-signal measuring sensor, the bio-signal data comprising electrophysiological data from the at least one electrophysiological sensor;

identify a pattern of saccadic eye movement based on the eye movements and the eye gaze fixations;

upon identification of the pattern, associate the pattern with a condition of saliences of elements of the scene to the user;

in accordance with the determined correspondence, control operation of at least one component of the eyeglass frame by modifying or initiating the modification of an image displayed on the display.

15. The eyeglass frame of claim 14 further comprising at least one eye-tracking sensor, the non-transitory computer-readable medium or media comprising the computer-executable instructions configured to cause the at least one data processor to: (0) (3)

View Abstract and Specification Size

PDF with Images and Document Face >

Full Text Publication >

Patent US10365716

Wearable computing apparatus and method

Patent Matrix® Search