WO2012102675A1 - A method and system for detecting attention - Google Patents

A method and system for detecting attention Download PDF

Info

Publication number
WO2012102675A1
WO2012102675A1 PCT/SG2011/000042 SG2011000042W WO2012102675A1 WO 2012102675 A1 WO2012102675 A1 WO 2012102675A1 SG 2011000042 W SG2011000042 W SG 2011000042W WO 2012102675 A1 WO2012102675 A1 WO 2012102675A1
Authority
WO
WIPO (PCT)
Prior art keywords
feature
attention
subject
eeg
features
Prior art date
Application number
PCT/SG2011/000042
Other languages
French (fr)
Inventor
Haihong Zhang
Cuntai Guan
Chuanchu Wang
Original Assignee
Agency For Science, Technology And Research
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Agency For Science, Technology And Research filed Critical Agency For Science, Technology And Research
Priority to US13/982,204 priority Critical patent/US20130331727A1/en
Priority to PCT/SG2011/000042 priority patent/WO2012102675A1/en
Priority to SG2013057229A priority patent/SG192175A1/en
Publication of WO2012102675A1 publication Critical patent/WO2012102675A1/en

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/168Evaluating attention deficit, hyperactivity
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/369Electroencephalography [EEG]

Definitions

  • the present invention relates broadly to a method and system for detecting
  • ADHD Attention-deficit/hyperactivity disorder
  • Stimulant medication is typically used for treatment but concerns over medication are increasing in terms of, for example, effect size, adverse effects as well as long-term efficacy. Therefore, alternative interventions for ADHD are desired.
  • Electroencephalographic (EEG) biofeedback also known as neurofeedback
  • EEG Electroencephalographic
  • Neurofeedback is an operant conditioning procedure in which a patient learns to self-control certain EEG patterns while guided by real-time visual or acoustic representations of the EEG patterns. This is discussed in D.J. Fox et. al., Neurofeedback: An alternative and efficacious treatment for attention deficit hyperactivity disorder, Applied Psychophysiology and Biofeedback, 30:365-373, 2005. Recent reviews can be found in, for example, L. Thompson et.
  • the attention detection model is sensitive to eye movement artefacts. That is, if a user biinks his/her eyes in a concentration state, the algorithm produces false negatives. Thus, the user must minimize eye blinks during playing of attention-driven video games, which can typically be frustrating, especially during relatively long time sessions.
  • the classification accuracy of the algorithm is relatively low for some subjects, such that the specificity of attention detection outcomes and the treatment effects may be significantly limited.
  • a method of detecting attention of a subject comprising determining one or more user specific feature sets from Electroencephalographic (EEG) signals of the subject; determining one or more pool data feature sets from the EEG signals of the subject; identifying one or more features from each feature set for differentiating attention/non-attention signals; determining respective classification scores for each feature set based on the identified one or more features; and combining the classification scores to obtain a combined attention score for said detecting attention.
  • EEG Electroencephalographic
  • a first one of the user specific feature sets may be based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject and a second one of the user specific feature sets may be based on each feature of the feature set being an average band- power over a time-window of a differential potential between two EEG channels coupled to the subject after normalization to uni-variance.
  • a first one of the pool data feature sets may be based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject as compared to EEG data of a pool of subjects and a second one of the pool data feature sets may be based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject as compared to said EEG data of the pool of subjects after normalization to uni-variance.
  • the step of identifying one or more features from each feature set may comprise maximising mutual information / between brain conditions C (either attention or in- attentiveness) and EEG features A from the features sets using:
  • H(C) is an attention condition variable co
  • ⁇ 4) is a conditional entropy of an attention condition if the features are known
  • a is a feature vector
  • P (or p) denotes a probability (or probability density) function.
  • the step of combining the classification scores may comprise using a Fishier linear discriminant (FLD) to combine the classification scores.
  • FLD Fishier linear discriminant
  • a system for attention detection of a subject comprising a processing module, the processing module capable of determination of one or more user specific feature sets from Electroencephalographic (EEG) signals of the subject; determination of one or more pool data feature sets from the EEG signals of the subject; identification of one or more features from each feature set for differentiating attention/npn-attention signals; determination of respective classification scores for each feature set based on identified one or more features; and combination of the classification scores to obtain a combined attention score for said attention detection.
  • EEG Electroencephalographic
  • a first one of the user specific feature sets may be based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject and a second one of the user specific feature sets may be based on each feature of the feature set being an average band- power over a time-window of a differential potential between two EEG channels coupled to the subject after normalization to uni-variance.
  • a first one of the pool data feature sets may be based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject as compared to EEG data of a pool of subjects and a second one of the pool data feature sets may be based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject as compared to said EEG data of the pool of subjects after normalization to uni-variance.
  • the processing module may identify one or more features from each feature set by maximisation of mutual information / between brain conditions C (either attention or in-attentiveness) and EEG features A from the features sets by utilisation of: da
  • H(C) is an attention condition variable ⁇ , and a conditional entropy of an attention condition if the features are known, and a represents a feature vector, and P (or p) denotes a probability (or probability density) function.
  • the processing module may combine the classification scores by utilisation of a Fishier linear discriminant (FLD).
  • FLD Fishier linear discriminant
  • a computer readable data storage medium having stored thereon computer code means for instructing a computer processor to execute a method of detecting attention of a subject, the method comprising determining one or more user specific feature sets from Electroencephalographic (EEG) signals of the subject; determining one or more pool data feature sets from the EEG signals of the subject; identifying one or more features from each feature set for differentiating attention/non-attention signals; determining respective classification scores for each feature set based on the identified one or more features; and combining the classification scores to obtain a combined attention score for said detecting attention.
  • EEG Electroencephalographic
  • a method of detecting attention of a subject comprising determining a plurality of feature sets from Electroencephalographic (EEG) signals of the subject; identifying one or more features from each feature set for differentiating attention/non- attention signals; determining respective classification scores for each feature set based on the identified one or more features; combining the classification scores to obtain a combined attention score for said detecting attention; and wherein a first one of the feature sets is based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject and a second one of the feature sets is based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject after normalization to uni-variance.
  • the feature sets may comprise user specific feature sets associated to the subject.
  • the feature sets may comprise pool data feature sets based on EEG data from a pool of subjects.
  • the step of identifying one or more features from each feature set may comprise maximising mutual information / between brain conditions C (either attention or in- attentiveness) and EEG features A from the features sets using:
  • H(C) is an attention condition variable ⁇
  • ⁇ 4) is a conditional entropy of an attention condition if the features are known
  • a is a feature vector
  • P (or p) denotes a probability (or probability density) function.
  • the step of combining the classification scores may comprise using a Fishier linear discriminant (FLD) to combine the classification scores.
  • FLD Fishier linear discriminant
  • a system for attention detection of a subject comprising a processing module, the processing module capable of determination of a plurality of feature sets from Electroencephalographic (EEG) signals of the subject; identification of.
  • EEG Electroencephalographic
  • the feature sets may comprise user specific feature sets associated to the subject.
  • the feature sets may comprise pool data feature sets based on EEG data from a pool of subjects.
  • H(C) is an attention condition variable ⁇
  • ⁇ ) is a conditional entropy of an attention condition if the features are known
  • a is a feature vector, and denotes a probability (or probability density) function.
  • the processing module may combine the classification scores by utilisation of a
  • a computer readable data storage medium having stored thereon computer code means for instructing a computer processor to execute a method of detecting attention of a subject, the method comprising determining a plurality of feature sets from Electroencephaiographic (EEG) signals of the subject; identifying one or more features from each feature set for differentiating attention/non-attention signals; determining respective classification scores for each feature set based on the identified one or more features; combining the classification scores to obtain a combined attention score for said detecting attention; and wherein a first one of the feature sets is based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject and a second one of the feature sets is based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject after normalization to uni-variance.
  • EEG Electroencephaiographic
  • Figure 1 (a) is a schematic diagram illustrating an attention training system in an example embodiment.
  • Figure 1(b) is an enlarged view of a processing module of Figure 1 (a).
  • Figure 2 is a graph illustrating comparative detection accuracy in User Test 1 an example embodiment.
  • Figure 3 is a graph illustrating comparative detection accuracy in User Test 2 an example embodiment.
  • Figure 4 is a schematic flowchart illustrating a method of detecting attention of a subject in an example embodiment.
  • Figure 5 is a schematic diagram of a computer system for implementing a method and system of detecting attention of a subject in an example embodiment.
  • the computer program may be stored on any computer readable medium.
  • the computer readable medium may include storage devices such as magnetic or optical disks, memory chips, or other storage devices suitable for interfacing with a general purpose computer.
  • the computer readable medium may also include a hard-wired medium such as exemplified in the Internet system, or wireless medium such as exemplified in the GSM mobile telephone system.
  • the computer program when loaded and executed on such a general-purpose computer effectively results in an apparatus that implements the steps of the preferred method.
  • the invention may also be implemented as hardware modules. More particular, in the hardware sense, a module is a functional hardware unit designed for use with other components or modules. For example, a module may be implemented using discrete electronic components, or it can form a portion of an entire electronic circuit such as an Application Specific Integrated Circuit (ASIC). Numerous other possibilities exist. Those skilled in the art will appreciate that the system can also be implemented as a combination of hardware and software modules.
  • ASIC Application Specific Integrated Circuit
  • an algorithm comprising computational models of attention detection can address various artefacts, including those from eye-blinking and low quality EEG recordings.
  • continuous EEG signals are decoded into a time sequence of attention scores that represent a user's conditions of attention at each respective time point.
  • FIG. 1(a) is a schematic diagram illustrating an attention training system in an example embodiment.
  • the system 102 can learn parameters and can be applied in a video game.
  • the system 102 comprises a calibration module 104, a processing module 106 and a therapy module 108.
  • a subject/patient 110 provides EEG signals 112 while performing an instructed task 114.
  • the task 114 comprises interleaved incongruent stroop tasks 116 and resting tasks 1 8.
  • the concurrent EEG signals 112 during performance of the task 114 are recorded using, for example, a device from Neuroscan.
  • the device can comprise an EEG amplifier 120 coupled to a computer 122.
  • the computer 122 administers the task 114 and maintains en EEG database 124.
  • the sampling rate of the device which refers to the speed of an analog-digital converter of the device, is preferably set to no less than 100 Hz, more preferably about 250Hz The sampling rate is chosen to contain useful EEG rhythms.
  • Two EEG channels of the device are used to measure electrical potentials at pre-frontal locations of the subject 10. In the example embodiment, the two EEG channels are connected to the left and right sides of the subject's 110 forehead. It has been recognised that the frontal lobe of a brain and probably the parietal part contribute to attention activities. This is discussed in J.V. Pardo et. al., The anterior cingulate cortex mediates processing selection in the stroop attentional conflict paradigm, PNAS, 87:256- 259, 1990, which is incorporated herein by reference.
  • the incongruent Stroop tasks 116 are employed because they preferably correspond to the executive attention network of the brain, which may be related to inattentiveness in ADHD patients. This is discussed in M.M. Lansbergen et. al., Stroop interference and attention-deficit/hyperactivity disorder: a review and meta-analysis, Neuropsychology, 21:251262, 2007, which is incorporated herein by reference.
  • the resting tasks 118 the subject 110 is instructed not to pay attention to the game/task 1 4 or to anything else. Therefore, the resting tasks 118 are expected to generate more likely inattentiveness than in the Stroop tasks 116.
  • the processing module 106 implements an optimisation algorithm 126.
  • the optimisation or attention detection algorithm 126 comprises feature selection 128 and classification 130. It has been recognised that selection of spatial-spectrum features may be a challenge in attention detection.
  • two sets of features are considered. In the first set, set (a), each feature is the average band-power over a time- window of the differential potential between two EEG channels. In the second set, set
  • each feature is the average band-power over a time-window of the differential potential between two EEG channels after normalization to uni-va ance.
  • rhythmic powers are a source of information for determining brain activities from EEG.
  • H(C) is the attention condition variable ⁇
  • H(Cj ⁇ 4) the conditional entropy of the attention condition if the features are known.
  • a is a particular feature vector
  • P (or p) denotes the probability (or probability density) function.
  • Entropy is related to the uncertainty of a random variable.
  • J(A, C) is the reduction of uncertainty about attention conditions by knowing the EEG features. This is discussed in T. M. Cover et. al., Elements of Information Theory, Wiley, New York, 2nd edition, 2006, which is incorporated herein by reference.
  • the mutual information can be estimated using a Monte-Carlo method described in H. Zhang et.
  • optimum spectral filters can be selected from a number of pre-defined band-pass filters such that the mutual information is empirically maximized.
  • the identification of the features is separate in the two feature sets, i.e. sets (a) and (b).
  • a linear classifier- e.g. a Fishier linear discriminant (FLD)
  • FLD Fishier linear discriminant
  • a higher score means a higher level of attention.
  • Figure 1(b) is an enlarged view of the processing module 106 of Figure 1 (a).
  • a subject-dependent feature extraction and selection module (a) 132 and a respective classifier (s:a) 134, as a pair.
  • a subject-dependent feature extraction and selection module (b) 136 and a respective classifier (s.bj 138, as a pair.
  • another two pairs of feature set/module and classifier are also considered.
  • a global band-power feature extraction and selection module (a) 140 and a respective classifier (g.a) 142 and a global band-power feature extraction and selection module (b) 144 and a respective classifier (g.b) 146.
  • the two pairs of feature set/module 140, 144 and classifier 142, 146 are learnt from a pool of users to allow exploration of common features in brain signals across different subjects/users so as to improve the robustness of the system 102.
  • each pair of feature set/module and classifier generates a single score.
  • the four scores 148, 150, 152, 154 are combined into a joint score vector.
  • a Fishier linear discriminant (FLD) 156 is provided to take the joint score vector as input and to provide a final attention score 158 as output.
  • the final attention score 158 may be used for therapy purposes or as a means of game control (see numeral 162) in the therapy module 108 and/or for tuning the optimisation algorithm (see numeral 160).
  • the algorithm can address the two issues of eye blinking artefacts and low classification. It has also been found that the set (b) pairs, i.e. numerals 136-138 pair and numerals 144-146 pair, are generally more robust against blinking artefacts than the other two pairs for set (a).
  • a training/attention detection algorithm is provided.
  • n samples of EEG segments extracted from attention and non- attention conditions are provided.
  • the algorithm provides as output subject-specific feature extraction modules (s.a and s.b) (compare 132, 136 of Figure 1(b)) together with respective classifiers (s.a and s.b) (compare 134, 138 of Figure 1 (b), and a classifier (compare 156 of Figure 1 (b)) that combines the two subject-specific scores (compare 148, 150 of Figure 1 (b)) together with scores generated by global models (compare 152, 154 of Figure 1(b)).
  • the algorithm learns/determines a subject-specific feature extraction module (s.a). This is achieved by computing the average band powers in the differential potential between the two EEG channels over a time-window. In the example embodiment, seven 4Hz-wide frequency bands whose start points are evenly distributed in the range from about 4Hz to about 28Hz are computed. A greedy iterative search procedure is then applied to identify the significant features that together produce the largest mutual information. Next, the algorithm learns a linear classifier that maps the selected/identified features to class labels.
  • a subject-specific feature extraction module s.a
  • the algorithm learns/determines another subject-specific feature extraction module (s.b).
  • the second step is substantially identical to the first step except the algorithm normalizes each EEG channel to uni-variance in the time-window before computing the band power features.
  • the algorithm forms a joint score vector from the two classifier outputs (compare 148, 150 of Figure 1 (b) in addition to two "global models" outputs (compare 152, 154 of Figure 1 (b)).
  • the global models are built in advance with substantially the same techniques in Step 1 and Step 2 but using an aggregated data pool from a plurality of subjects.
  • the algorithm learns the linear classification that maps the joint score vector to the class labels.
  • the continuous output of the classifier (compare 156 of Figure 1 (b)) is taken as the final attention score (compare 158 of Figure 1 (b)).
  • the classifier used in the example embodiment can include any classifier, for example, a FLD.
  • 18 subjects were recruited into a user test study. Each subject performed a Stroop test for collection of concentration/non- concentration EEG signals.
  • the Stroop test comprises 20 pairs of Stroop task blocks and relaxation blocks, in each Stroop task block of about 6 seconds in duration, the subject responded to a question comprising approximately 6 seconds of Stroop test. Each relaxation block matches in duration to the preceding Stroop task block.
  • FIG. 1 is a graph illustrating the comparative detection accuracy in User Test 1.
  • the horizontal axis denotes the human subject number, for example, from 1 to 18 in User Test 1.
  • the "All” item refers to the average result over all the subjects in User Test 1.
  • the vertical axis denotes the detection accuracy rate, i.e. the number of EEG time windows being misclassified versus the number of all the EEG time windows.
  • the Org" bars denote the results generated by a prior-art method published under WO/2009/134205, while the "new” bars show those by the algorithm of the example embodiment.
  • Figure 3 is a graph illustrating the comparative detection accuracy in User Test 2.
  • the statistics show that the subjects achieved a high accuracy of 0.99 ⁇ 0.01 (in mean and standard deviation) in Stroop test responses.
  • the response time was about 2.72 ⁇ 0.10 seconds (not shown).
  • the user performances indicate a satisfactory quality of the data.
  • the proposed algorithm is observed to deliver overall the highest detection accuracy in both user test cases (see numerals 202 and 302). It can significantly improve the accuracy from a level of about 70% to a level of more than about 85% (see numerals 202 and 302).
  • FIG. 4 is a schematic flowchart 400 illustrating a method of detecting attention of a subject in an example embodiment.
  • one or more user specific feature sets are determined from Electroencephalograph ⁇ (EEG) signals of the subject.
  • EEG Electroencephalograph ⁇
  • one or more pool data feature sets are determined from the EEG signals of the subject.
  • one or more features from each feature set are identified for differentiating attention/non-attention signals.
  • respective classification scores for each feature set are determined based on the identified one or more features.
  • the classification scores are combined to obtain a combined attention score for said detecting attention.
  • a new algorithm can be provided that significantly improves attention detection performance. Detection output can be made insensitive to eye blinks and the algorithm can be used for attention training to obtain significantly higher specificity of attention training and higher usability.
  • the method and system of the example embodiments can be implemented on a computer system 500, schematically shown in Figure 5. It may be implemented as software, such as a computer program being executed within the computer system 500, and instructing the computer system 500 to conduct the method of the example embodiment.
  • the computer system 500 comprises a computer module 502, input modules such as a keyboard 504 and mouse 506 and a plurality of output devices such as a display 508, and printer 510.
  • the computer module 502 is connected to a computer network 512 via a suitable transceiver device 514, to enable access to e.g. the Internet or other network systems such as Local Area Network (LAN) or Wide Area Network (WAN).
  • LAN Local Area Network
  • WAN Wide Area Network
  • the computer module 502 in the example includes a processor 518, a Random Access Memory (RAM) 520 and a Read Only Memory (ROM) 522.
  • the computer module 502 also includes a number of Input/Output (I/O) interfaces, for example I/O interface 524 to the display 508, and I/O interface 526 to the keyboard 504.
  • I/O Input/Output
  • the components of the computer module 502 typically communicate via an interconnected bus 528 and in a manner known to the person skilled in the relevant art.
  • the application program is typically supplied to the user of the computer system 500 encoded on a data storage medium such as a CD-ROM or flash memory carrier and read utilising a corresponding data storage medium drive of a data storage device 530.
  • the application program is read and controlled in its execution by the processor 518.
  • Intermediate storage of program data maybe accomplished using RAM 520.

Abstract

A method and system for detecting attention of a subject is provided. The method comprises determining one or more user specific feature sets from Electroencephalographic (EEG) signals of the subject; determining one or more pool data feature sets from the EEG signals of the subject; identifying one or more features from each feature set for differentiating attention/non-attention signals; determining respective classification scores for each feature set based on the identified one or more features; and combining the classification scores to obtain a combined attention score for said detecting attention.

Description

A Method And System For Detecting Attention
FIELD OF INVENTION
The present invention relates broadly to a method and system for detecting
BACKGROUND
Attention-deficit/hyperactivity disorder (ADHD) is a psychatric condition and a neuro-developmental disorder with various hyperactivity, impulsivity and inattention symptoms. Stimulant medication is typically used for treatment but concerns over medication are increasing in terms of, for example, effect size, adverse effects as well as long-term efficacy. Therefore, alternative interventions for ADHD are desired.
An alternative treatment, Electroencephalographic (EEG) biofeedback (also known as neurofeedback), has been researched since the 1970s. Neurofeedback is an operant conditioning procedure in which a patient learns to self-control certain EEG patterns while guided by real-time visual or acoustic representations of the EEG patterns. This is discussed in D.J. Fox et. al., Neurofeedback: An alternative and efficacious treatment for attention deficit hyperactivity disorder, Applied Psychophysiology and Biofeedback, 30:365-373, 2005. Recent reviews can be found in, for example, L. Thompson et. al., QEEG and neurofeedback for assessment and effective intervention with attention deficit hyperactivity disorder, In Introduction to Quantitative EEG and Neurofeedback: Advanced Theory and Applications, pages 337- 364, Elsevier, 2 edition, 2009. There are typically two major neurofeedback approaches, namely, self-regulation of band powers and/or their ratios, and of slow-cortical potentials. However, the neurofeedback techniques above are typically based on extrapolations from research describing abnormal EEG patterns in subjects with" ADHD. Such a generic model approach may not apply well to each and every patient. For example, in M. Thompson et. al., Improving attention in adults and children: Differing electroencephalography profiles and implications for training, Biofeedback, 34:99-105, 2006, it was discussed that regardless of age, each client/patient is unique. Thus, the intervention should be customized.
A treatment method beyond the neurofeedback approach has been proposed. In the treatment, individual subjects' attention conditions, decoded from EEG signals using a subject-specific attention detection model, are associated directly with a control signal in therapeutic video games. In a pilot trial involving 10 intervention subjects versus 10 controls, significant improvement in ADHD rating scores were observed especially in inattentive symptoms.
However, it has been recognised that there are two main problems associated with the above attention detection model/algorithm. Firstly, the attention detection model is sensitive to eye movement artefacts. That is, if a user biinks his/her eyes in a concentration state, the algorithm produces false negatives. Thus, the user must minimize eye blinks during playing of attention-driven video games, which can typically be frustrating, especially during relatively long time sessions. Secondly, it has been found that the classification accuracy of the algorithm is relatively low for some subjects, such that the specificity of attention detection outcomes and the treatment effects may be significantly limited.
Hence, in view of the above, there exists a need for a method and system for detecting attention that seek to address at least one of the above problems.
SUMMARY
In accordance with an aspect of the present invention, there is provided a method of detecting attention of a subject, the method comprising determining one or more user specific feature sets from Electroencephalographic (EEG) signals of the subject; determining one or more pool data feature sets from the EEG signals of the subject; identifying one or more features from each feature set for differentiating attention/non-attention signals; determining respective classification scores for each feature set based on the identified one or more features; and combining the classification scores to obtain a combined attention score for said detecting attention.
A first one of the user specific feature sets may be based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject and a second one of the user specific feature sets may be based on each feature of the feature set being an average band- power over a time-window of a differential potential between two EEG channels coupled to the subject after normalization to uni-variance.
A first one of the pool data feature sets may be based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject as compared to EEG data of a pool of subjects and a second one of the pool data feature sets may be based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject as compared to said EEG data of the pool of subjects after normalization to uni-variance.
The step of identifying one or more features from each feature set may comprise maximising mutual information / between brain conditions C (either attention or in- attentiveness) and EEG features A from the features sets using:
Figure imgf000005_0001
where H(C)is an attention condition variable co , and H(C|^4) is a conditional entropy of an attention condition if the features are known, and a is a feature vector, and P (or p) denotes a probability (or probability density) function.
The step of combining the classification scores may comprise using a Fishier linear discriminant (FLD) to combine the classification scores. In accordance with another aspect of the present invention, there is provided a system for attention detection of a subject, the system comprising a processing module, the processing module capable of determination of one or more user specific feature sets from Electroencephalographic (EEG) signals of the subject; determination of one or more pool data feature sets from the EEG signals of the subject; identification of one or more features from each feature set for differentiating attention/npn-attention signals; determination of respective classification scores for each feature set based on identified one or more features; and combination of the classification scores to obtain a combined attention score for said attention detection.
A first one of the user specific feature sets may be based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject and a second one of the user specific feature sets may be based on each feature of the feature set being an average band- power over a time-window of a differential potential between two EEG channels coupled to the subject after normalization to uni-variance.
A first one of the pool data feature sets may be based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject as compared to EEG data of a pool of subjects and a second one of the pool data feature sets may be based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject as compared to said EEG data of the pool of subjects after normalization to uni-variance.
The processing module may identify one or more features from each feature set by maximisation of mutual information / between brain conditions C (either attention or in-attentiveness) and EEG features A from the features sets by utilisation of: da
Figure imgf000006_0001
where H(C) is an attention condition variable ω , and
Figure imgf000007_0001
a conditional entropy of an attention condition if the features are known, and a represents a feature vector, and P (or p) denotes a probability (or probability density) function.
The processing module may combine the classification scores by utilisation of a Fishier linear discriminant (FLD). in accordance with another aspect of the present invention, there is provided a computer readable data storage medium having stored thereon computer code means for instructing a computer processor to execute a method of detecting attention of a subject, the method comprising determining one or more user specific feature sets from Electroencephalographic (EEG) signals of the subject; determining one or more pool data feature sets from the EEG signals of the subject; identifying one or more features from each feature set for differentiating attention/non-attention signals; determining respective classification scores for each feature set based on the identified one or more features; and combining the classification scores to obtain a combined attention score for said detecting attention.
In accordance with yet another aspect of the present invention, there is provided a method of detecting attention of a subject, the method comprising determining a plurality of feature sets from Electroencephalographic (EEG) signals of the subject; identifying one or more features from each feature set for differentiating attention/non- attention signals; determining respective classification scores for each feature set based on the identified one or more features; combining the classification scores to obtain a combined attention score for said detecting attention; and wherein a first one of the feature sets is based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject and a second one of the feature sets is based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject after normalization to uni-variance. The feature sets may comprise user specific feature sets associated to the subject.
The feature sets may comprise pool data feature sets based on EEG data from a pool of subjects.
The step of identifying one or more features from each feature set may comprise maximising mutual information / between brain conditions C (either attention or in- attentiveness) and EEG features A from the features sets using:
I{A, C) = da
Figure imgf000008_0001
where H(C) is an attention condition variable ω , and H(C|^4) is a conditional entropy of an attention condition if the features are known, and a is a feature vector, and P (or p) denotes a probability (or probability density) function. The step of combining the classification scores may comprise using a Fishier linear discriminant (FLD) to combine the classification scores.
In accordance with another aspect of the present invention, there is provided a system for attention detection of a subject, the system comprising a processing module, the processing module capable of determination of a plurality of feature sets from Electroencephalographic (EEG) signals of the subject; identification of. one or more features from each feature set for differentiating attention/non-attention signals; determination of respective classification scores for each feature set based on identified one or more features; and combination of the classification scores to obtain a combined attention score for said attention detection; and wherein a first one of the feature sets is based on each feature of the feature set being an average band-power over a time- window of a differential potential between two EEG channels coupled to the subject and a second one of the feature sets is based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject after normalization to uni-variance. The feature sets may comprise user specific feature sets associated to the subject.
The feature sets may comprise pool data feature sets based on EEG data from a pool of subjects.
The processing module may identify one or more features from each feature set by maximisation of mutual information / between brain conditions C (either attention or in-attentiveness) and EEG features A from the features sets by utilisation of: I(A, C) = H(C)- da
Figure imgf000009_0001
where H(C) is an attention condition variable ω , and H(C|^) is a conditional entropy of an attention condition if the features are known, and a is a feature vector, and denotes a probability (or probability density) function. The processing module may combine the classification scores by utilisation of a
Fishier linear discriminant (FLD).
In accordance with another aspect of the present invention, there is provided a computer readable data storage medium having stored thereon computer code means for instructing a computer processor to execute a method of detecting attention of a subject, the method comprising determining a plurality of feature sets from Electroencephaiographic (EEG) signals of the subject; identifying one or more features from each feature set for differentiating attention/non-attention signals; determining respective classification scores for each feature set based on the identified one or more features; combining the classification scores to obtain a combined attention score for said detecting attention; and wherein a first one of the feature sets is based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject and a second one of the feature sets is based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject after normalization to uni-variance. BRIEF DESCRIPTION OF THE DRAWINGS
Embodiments of the invention will be better understood and readily apparent to one of ordinary skill in the art from the following written description t by way of example only, and in conjunction with the drawings, in which:
Figure 1 (a) is a schematic diagram illustrating an attention training system in an example embodiment.
Figure 1(b) is an enlarged view of a processing module of Figure 1 (a).
Figure 2 is a graph illustrating comparative detection accuracy in User Test 1 an example embodiment.
Figure 3 is a graph illustrating comparative detection accuracy in User Test 2 an example embodiment. Figure 4 is a schematic flowchart illustrating a method of detecting attention of a subject in an example embodiment.
Figure 5 is a schematic diagram of a computer system for implementing a method and system of detecting attention of a subject in an example embodiment.
DETAILED DESCRIPTION
Some portions of the description which follows are explicitly or implicitly presented in terms of algorithms and functional or symbolic representations of operations on data within a computer memory. These algorithmic descriptions and functional or symbolic representations are the means used by those skilled in the data processing arts to convey most effectively the substance of their work to others skilled in the art. An algorithm is here, and generally, conceived to be a self-consistent sequence of steps leading to a desired result. The steps are those requiring physical manipulations of physical quantities, such as electrical, magnetic or optical signals capable of being stored, transferred, combined, compared, and otherwise manipulated.
Unless specifically stated otherwise, and as apparent from the following, it will be appreciated that throughout the present specification, discussions utilizing terms such as "scanning", "calculating", "determining", "replacing", "generating", "initializing", "outputting", or the like, refer to the action and processes of a computer system, or similar electronic device, that manipulates and transforms data represented as physical quantities within the computer system into other data similarly represented as physical quantities within the computer system or other information storage, transmission or display devices. The present specification also discloses apparatus for performing the operations of the methods. Such apparatus may be specially constructed for the required purposes, or may comprise a general purpose computer or other device selectively activated or reconfigured by a computer program stored in the computer. The algorithms and displays presented herein are not inherently related to any particular computer or other apparatus. Various general purpose machines may be used with programs in accordance with the teachings herein. Alternatively, the construction of more specialized apparatus to perform the required method steps may be appropriate. The structure of a conventional general purpose computer will appear from the description below. In addition, the present specification also implicitly discloses a computer program, in that it would be apparent to the person skilled in the art that the individual steps of the method described herein may be put into effect by computer code. The computer program is not intended to be limited to any particular programming language and implementation thereof. It will be appreciated that a variety of programming languages and coding thereof may be used to implement the teachings of the disclosure contained herein. Moreover, the computer program is not intended to be limited to any particular control flow. There are many other variants of the computer program, which can use different control flows without departing from the spirit or scope of the invention. Furthermore, one or more of the steps of the computer program may be performed in parallel rather than sequentially. Such a computer program may be stored on any computer readable medium. The computer readable medium may include storage devices such as magnetic or optical disks, memory chips, or other storage devices suitable for interfacing with a general purpose computer. The computer readable medium may also include a hard-wired medium such as exemplified in the Internet system, or wireless medium such as exemplified in the GSM mobile telephone system. The computer program when loaded and executed on such a general-purpose computer effectively results in an apparatus that implements the steps of the preferred method.
The invention may also be implemented as hardware modules. More particular, in the hardware sense, a module is a functional hardware unit designed for use with other components or modules. For example, a module may be implemented using discrete electronic components, or it can form a portion of an entire electronic circuit such as an Application Specific Integrated Circuit (ASIC). Numerous other possibilities exist. Those skilled in the art will appreciate that the system can also be implemented as a combination of hardware and software modules.
In an example embodiment, an algorithm comprising computational models of attention detection can address various artefacts, including those from eye-blinking and low quality EEG recordings.
In the example embodiment, continuous EEG signals are decoded into a time sequence of attention scores that represent a user's conditions of attention at each respective time point.
Figure 1(a) is a schematic diagram illustrating an attention training system in an example embodiment. The system 102 can learn parameters and can be applied in a video game. The system 102 comprises a calibration module 104, a processing module 106 and a therapy module 108. In the calibration module 104, a subject/patient 110 provides EEG signals 112 while performing an instructed task 114. The task 114 comprises interleaved incongruent stroop tasks 116 and resting tasks 1 8. The concurrent EEG signals 112 during performance of the task 114 are recorded using, for example, a device from Neuroscan. The device can comprise an EEG amplifier 120 coupled to a computer 122. The computer 122 administers the task 114 and maintains en EEG database 124.
In the example embodiment, the sampling rate of the device, which refers to the speed of an analog-digital converter of the device, is preferably set to no less than 100 Hz, more preferably about 250Hz The sampling rate is chosen to contain useful EEG rhythms. Two EEG channels of the device are used to measure electrical potentials at pre-frontal locations of the subject 10. In the example embodiment, the two EEG channels are connected to the left and right sides of the subject's 110 forehead. It has been recognised that the frontal lobe of a brain and probably the parietal part contribute to attention activities. This is discussed in J.V. Pardo et. al., The anterior cingulate cortex mediates processing selection in the stroop attentional conflict paradigm, PNAS, 87:256- 259, 1990, which is incorporated herein by reference.
In the example embodiment, the incongruent Stroop tasks 116 are employed because they preferably correspond to the executive attention network of the brain, which may be related to inattentiveness in ADHD patients. This is discussed in M.M. Lansbergen et. al., Stroop interference and attention-deficit/hyperactivity disorder: a review and meta-analysis, Neuropsychology, 21:251262, 2007, which is incorporated herein by reference. On the other hand, for the resting tasks 118, the subject 110 is instructed not to pay attention to the game/task 1 4 or to anything else. Therefore, the resting tasks 118 are expected to generate more likely inattentiveness than in the Stroop tasks 116.
In the example embodiment, the processing module 106 implements an optimisation algorithm 126. The optimisation or attention detection algorithm 126 comprises feature selection 128 and classification 130. It has been recognised that selection of spatial-spectrum features may be a challenge in attention detection. In the example embodiment, two sets of features are considered. In the first set, set (a), each feature is the average band-power over a time- window of the differential potential between two EEG channels. In the second set, set
(b), each feature is the average band-power over a time-window of the differential potential between two EEG channels after normalization to uni-va ance. The two sets
(a) and (b) are chosen as such to capture the rhythmic power of each EEG channel, or that of the differential potential between the channels. It has been recognised that rhythmic powers are a source of information for determining brain activities from EEG.
To identify significant features for differentiating the attention/non-attention brain signals, mutual information / between the brain conditions C (either attention or in- attentiveness) and the selected EEG features A (from set (a) or (b)) is maximised as follows: l(A, C) = H(C) - da (1)
Figure imgf000014_0001
where H(C) is the attention condition variable ω , and H(Cj^4)the conditional entropy of the attention condition if the features are known. Here a is a particular feature vector, and P (or p) denotes the probability (or probability density) function. Entropy is related to the uncertainty of a random variable. Hence, the mutual information J(A, C) is the reduction of uncertainty about attention conditions by knowing the EEG features. This is discussed in T. M. Cover et. al., Elements of Information Theory, Wiley, New York, 2nd edition, 2006, which is incorporated herein by reference. The mutual information can be estimated using a Monte-Carlo method described in H. Zhang et. al., Spatio-spectral feature selection based on robust mutual information estimate for brain computer interfaces, In Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pages 2391-2398, 2009, which is incorporated herein by reference. Hence, optimum spectral filters can be selected from a number of pre-defined band-pass filters such that the mutual information is empirically maximized. In the example embodiment, the identification of the features is separate in the two feature sets, i.e. sets (a) and (b). A linear classifier- (e.g. a Fishier linear discriminant (FLD)) (compare 134, 138, 142, 146 of Figure 1 (b)) is used to map each feature set into a score. As attention is considered a positive class and inattention is considered a negative class, a higher score means a higher level of attention.
Figure 1(b) is an enlarged view of the processing module 106 of Figure 1 (a). For set (a), there is provided a subject-dependent feature extraction and selection module (a) 132 and a respective classifier (s:a) 134, as a pair. For set (b), there is provided a subject-dependent feature extraction and selection module (b) 136 and a respective classifier (s.bj 138, as a pair. In addition to the two pairs of feature set/module 132, 136 and respective classifiers 134, 138, another two pairs of feature set/module and classifier are also considered. These are a global band-power feature extraction and selection module (a) 140 and a respective classifier (g.a) 142 and a global band-power feature extraction and selection module (b) 144 and a respective classifier (g.b) 146. The two pairs of feature set/module 140, 144 and classifier 142, 146 are learnt from a pool of users to allow exploration of common features in brain signals across different subjects/users so as to improve the robustness of the system 102.
In the example embodiment, each pair of feature set/module and classifier generates a single score. The four scores 148, 150, 152, 154 are combined into a joint score vector. A Fishier linear discriminant (FLD) 156 is provided to take the joint score vector as input and to provide a final attention score 158 as output. The final attention score 158 may be used for therapy purposes or as a means of game control (see numeral 162) in the therapy module 108 and/or for tuning the optimisation algorithm (see numeral 160).
In the above described example embodiment, the algorithm can address the two issues of eye blinking artefacts and low classification. It has also been found that the set (b) pairs, i.e. numerals 136-138 pair and numerals 144-146 pair, are generally more robust against blinking artefacts than the other two pairs for set (a).
In an example embodiment, a training/attention detection algorithm is provided. As input to the algorithm, n samples of EEG segments extracted from attention and non- attention conditions are provided. The algorithm provides as output subject-specific feature extraction modules (s.a and s.b) (compare 132, 136 of Figure 1(b)) together with respective classifiers (s.a and s.b) (compare 134, 138 of Figure 1 (b), and a classifier (compare 156 of Figure 1 (b)) that combines the two subject-specific scores (compare 148, 150 of Figure 1 (b)) together with scores generated by global models (compare 152, 154 of Figure 1(b)).
In the example embodiment, as a first step, the algorithm learns/determines a subject-specific feature extraction module (s.a). This is achieved by computing the average band powers in the differential potential between the two EEG channels over a time-window. In the example embodiment, seven 4Hz-wide frequency bands whose start points are evenly distributed in the range from about 4Hz to about 28Hz are computed. A greedy iterative search procedure is then applied to identify the significant features that together produce the largest mutual information. Next, the algorithm learns a linear classifier that maps the selected/identified features to class labels.
As a second step, the algorithm learns/determines another subject-specific feature extraction module (s.b). The second step is substantially identical to the first step except the algorithm normalizes each EEG channel to uni-variance in the time-window before computing the band power features.
As a third step, the algorithm forms a joint score vector from the two classifier outputs (compare 148, 150 of Figure 1 (b) in addition to two "global models" outputs (compare 152, 154 of Figure 1 (b)). In the example embodiment, the global models are built in advance with substantially the same techniques in Step 1 and Step 2 but using an aggregated data pool from a plurality of subjects.
As a fourth step, the algorithm learns the linear classification that maps the joint score vector to the class labels. The continuous output of the classifier (compare 156 of Figure 1 (b)) is taken as the final attention score (compare 158 of Figure 1 (b)). The classifier used in the example embodiment can include any classifier, for example, a FLD. In an example implementation of the algorithm, 18 subjects were recruited into a user test study. Each subject performed a Stroop test for collection of concentration/non- concentration EEG signals. In the example, the Stroop test comprises 20 pairs of Stroop task blocks and relaxation blocks, in each Stroop task block of about 6 seconds in duration, the subject responded to a question comprising approximately 6 seconds of Stroop test. Each relaxation block matches in duration to the preceding Stroop task block.
All the 18 subjects participated in one round of user test. This first round of user test is denoted as User Test 1. Figure 2 is a graph illustrating the comparative detection accuracy in User Test 1. The horizontal axis denotes the human subject number, for example, from 1 to 18 in User Test 1. The "All" item refers to the average result over all the subjects in User Test 1. The vertical axis denotes the detection accuracy rate, i.e. the number of EEG time windows being misclassified versus the number of all the EEG time windows. The Org" bars denote the results generated by a prior-art method published under WO/2009/134205, while the "new" bars show those by the algorithm of the example embodiment.
In addition, eight subjects participated in an additional round of user test. This additional round of user test is denoted as User Test 2. Figure 3 is a graph illustrating the comparative detection accuracy in User Test 2.
In the example implementation, overall, the statistics show that the subjects achieved a high accuracy of 0.99 ± 0.01 (in mean and standard deviation) in Stroop test responses. The response time was about 2.72 ± 0.10 seconds (not shown). The user performances indicate a satisfactory quality of the data. The proposed algorithm is observed to deliver overall the highest detection accuracy in both user test cases (see numerals 202 and 302). It can significantly improve the accuracy from a level of about 70% to a level of more than about 85% (see numerals 202 and 302).
Furthermore, the continuous output of the algorithm was examined. It was found that the algorithm is more robust against eye-blinking artefacts as compared to the prior- art method and correctly produced positive scores during the concentration period. Figure 4 is a schematic flowchart 400 illustrating a method of detecting attention of a subject in an example embodiment. At step 402, one or more user specific feature sets are determined from Electroencephalograph^ (EEG) signals of the subject. At step 404, one or more pool data feature sets are determined from the EEG signals of the subject. At step 406, one or more features from each feature set are identified for differentiating attention/non-attention signals. At step 408, respective classification scores for each feature set are determined based on the identified one or more features. At step 410, the classification scores are combined to obtain a combined attention score for said detecting attention.
In the above described example embodiments, a new algorithm can be provided that significantly improves attention detection performance. Detection output can be made insensitive to eye blinks and the algorithm can be used for attention training to obtain significantly higher specificity of attention training and higher usability.
The method and system of the example embodiments can be implemented on a computer system 500, schematically shown in Figure 5. It may be implemented as software, such as a computer program being executed within the computer system 500, and instructing the computer system 500 to conduct the method of the example embodiment.
The computer system 500 comprises a computer module 502, input modules such as a keyboard 504 and mouse 506 and a plurality of output devices such as a display 508, and printer 510.
The computer module 502 is connected to a computer network 512 via a suitable transceiver device 514, to enable access to e.g. the Internet or other network systems such as Local Area Network (LAN) or Wide Area Network (WAN).
The computer module 502 in the example includes a processor 518, a Random Access Memory (RAM) 520 and a Read Only Memory (ROM) 522. The computer module 502 also includes a number of Input/Output (I/O) interfaces, for example I/O interface 524 to the display 508, and I/O interface 526 to the keyboard 504.
The components of the computer module 502 typically communicate via an interconnected bus 528 and in a manner known to the person skilled in the relevant art. The application program is typically supplied to the user of the computer system 500 encoded on a data storage medium such as a CD-ROM or flash memory carrier and read utilising a corresponding data storage medium drive of a data storage device 530. The application program is read and controlled in its execution by the processor 518. Intermediate storage of program data maybe accomplished using RAM 520.
It will be appreciated by a person skilled in the art that numerous variations and/or modifications may be made to the present invention as shown in the specific embodiments without departing from the spirit or scope of the invention as broadly described. The present embodiments are, therefore, to be considered in all respects to be illustrative and not restrictive.

Claims

1. A method of detecting attention of a subject, the method comprising, determining one or more user specific feature sets from Electroencephalographic (EEG) signals of the subject;
determining one or more pool data feature sets from the EEG signals of the subject;
identifying one or more features from each feature set for differentiating attention/non-attention signals;
determining respective classification scores for each feature set based on the identified one or more features; and
combining the classification scores to obtain a combined attention score for said detecting attention.
2. The method as claimed in claim 1 , wherein a first one of the user specific feature sets is based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject and a second one of the user specific feature sets is based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject after normalization to uni- variance.
3. The method as claimed in claims 1 or 2, wherein a first one of the pool data feature sets is based on each feature of the feature set being an average band- power over a time-window of a differential potential between two EEG channels coupled to the subject as compared to EEG data of a pool of subjects and a second one of the pool data feature sets is based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject as compared to said EEG data of the pool of subjects after normalization to uni-variance.
4. The method as claimed in any one of claims 1 to 3, wherein the step of identifying one or more features from each feature, set comprises maximising mutual information / between brain conditions C (either attention or in-attentiveness) and EEG features A from the features sets using:
I{A, C) da
Figure imgf000021_0001
where H(C) is an attention condition variable ω , and H(C|^4) is a conditional entropy of an attention condition if the features are known, and a is a particular feature vector, and P (or p) denotes a probability (or probability density) function.
5. The method as claimed in any one of claims 1 to 4, wherein the step of combining the classification scores comprises using a Fishier linear discriminant (FLD) to combine the classification scores.
6. A system for attention detection of a subject, the system comprising a processing module, the processing module capable of
determination of one or more user specific feature sets from Electroencephalographic (EEG) signals of the subject;
determination of one or more pool data feature sets from the EEG signals of the subject;
identification of one or more features from each feature set for differentiating attention/non-attention signals;
determination of respective classification scores for each feature set based on identified one or more features; and
combination of the classification scores to obtain a combined attention score for said attention detection.
7. The system as claimed in claim 6, wherein a first one of the user specific feature sets is based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject and a second one of the user specific feature sets is based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject after normalization to uni- variance.
8. The system as claimed in claims 6 or 7, wherein a first one of the pool data feature sets is based on each feature of the feature set being an average band- power over a time-window of a differential potential between two EEG channels coupled to the subject as compared to EEG data of a pool of subjects and a second one of the pool data feature sets is based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject as compared to said EEG data of the pool of subjects after normalization to uni-variance.
9. The system as claimed in any one of claims 6 to 8, wherein the processing module identifies one or more features from each feature set by maximisation of mutual information / between brain conditions C (either attention or in- attentiveness) and EEG features A from the features sets by utilisation of: I(A, C) = H(C) - H(C\A) da
Figure imgf000022_0001
where H(C) is an attention condition variable ω , and H(C|^4) is a conditional entropy of an attention condition if the features are known, and a is a particular feature vector, and P (or p) denotes a probability (or probability density) function.
10. The system as claimed in any one of claims 6 to 9, wherein the processing module combines the classification scores by utilisation of a Fishier linear discriminant (FLD).
11. A computer readable data storage medium having stored thereon computer code means for instructing a computer processor to execute a method of detecting attention of a subject, the method comprising,
determining one or more user specific feature sets from Electroencephalographic (EEG) signals of the subject;
determining one or more pool data feature sets from the EEG signals of the subject; identifying one or more features from each feature set for differentiating attention/non-attention signals;
determining respective classification scores for each feature set based on the identified one or more features; and
combining the classification scores to obtain a combined attention score for said detecting attention.
12. A method of detecting attention of a subject, the method comprising, determining a plurality of feature sets from Electroencephalographic (EEG) signals of the subject;
identifying one or more features from each feature set for differentiating attention/non-attention signals;
determining respective classification scores for each feature set based on the identified one or more features;
combining the classification scores to obtain a combined attention score for said detecting attention; and
wherein a first one of the feature sets is based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject and a second one of the feature sets is based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject after normalization to uni-variance.
13. The method as claimed in claim 12, wherein the feature sets comprise user specific feature sets associated to the subject.
14. The method as claimed in claims 12 or 13, wherein the feature sets comprise pool data feature sets based on EEG data from a pool of subjects.
15. The method as claimed in any one of claims 12 to 14, wherein the step of identifying one or more features from each feature set comprises maximising mutual nformation / between brain conditions C (either attention or in-attentiveness) and EEG
Figure imgf000024_0001
onditional entropy of an attention condition if the features are known, and a is a particular feature vector, and P (or p) denotes a probability (or probability density) function.
16. The method as claimed in any one of claims 12 to 15, wherein the step of combining the classification scores comprises using a Fishier linear discriminant (FLD) to combine the classification scores.
17. A system for attention detection of a subject, the system comprising a processing module, the processing module capable of
determination of a plurality of feature sets from Electroencephalograph^ (EEG) signals of the subject;
identification of one or more features from each feature set for differentiating attention/non-attention signals;
determination of respective classification scores for each feature set based on identified one or more features; and
combination of the classification scores to obtain a combined attention score for said attention detection; and
wherein a first one of the feature sets is based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject and a second one of the feature sets is based on each feature of the feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject after normalization to uni-variance.
18. The system as claimed in claim 17, wherein the feature sets comprise user specific feature sets associated to the subject.
19. The system as claimed in claims 17 or 18, wherein the feature sets comprise pool data feature sets based on EEG data from a pool of subjects.
20. The system as claimed in any one of claims 17 to 19, wherein the processing module identifies one or more features from each feature set by maximisation of mutual information / between brain conditions C (either attention or in- attentiveness) and EEG features A from the features sets by utilisation of:
I(A, C) = H(C)- H{C\ where H(C)is H(C|^4) is a conditional
Figure imgf000025_0001
entropy of an attention condition if the features are known, and a is a particular feature vector, and P (or p) denotes a probability (or probability density) function.
21. The system as claimed in any one of claims 17 to 20, wherein the processing module combines the classification scores by utilisation of a Fishier linear discriminant (FLD).
22. A computer readable data storage medium having stored thereon computer code means for instructing a computer processor to execute a method of detecting attention of a subject, the method comprising,
determining a plurality of feature sets from Electroencephalographic (EEG) signals of the subject;
identifying one or more features from each feature set for differentiating attention/non-attention signals;
determining respective classification scores for each feature set based on the identified one or more features;
combining the classification scores to obtain a combined attention score for said detecting attention; and
wherein a first one of the feature sets is based on each feature of the.feature set being an average band-power over a time-window of a differential potential between two EEG channels coupled to the subject and a second one of the feature sets is based on each feature of the feature set being an average band-power over a time-window of a differential potential between EEG channels coupled to the subject after normalization to uni-variance.
PCT/SG2011/000042 2011-01-28 2011-01-28 A method and system for detecting attention WO2012102675A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US13/982,204 US20130331727A1 (en) 2011-01-28 2011-01-28 Method and system for detecting attention
PCT/SG2011/000042 WO2012102675A1 (en) 2011-01-28 2011-01-28 A method and system for detecting attention
SG2013057229A SG192175A1 (en) 2011-01-28 2011-01-28 A method and system for detecting attention

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/SG2011/000042 WO2012102675A1 (en) 2011-01-28 2011-01-28 A method and system for detecting attention

Publications (1)

Publication Number Publication Date
WO2012102675A1 true WO2012102675A1 (en) 2012-08-02

Family

ID=46581053

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SG2011/000042 WO2012102675A1 (en) 2011-01-28 2011-01-28 A method and system for detecting attention

Country Status (3)

Country Link
US (1) US20130331727A1 (en)
SG (1) SG192175A1 (en)
WO (1) WO2012102675A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102824172A (en) * 2012-08-28 2012-12-19 浙江大学 EEG (electroencephalogram) feature extraction method
AT516020B1 (en) * 2014-12-09 2016-02-15 Guger Christoph Dipl Ing Dr Techn Method for quantifying the perceptibility of a person
WO2019025000A1 (en) * 2017-08-03 2019-02-07 Toyota Motor Europe Method and system for determining a driving intention of a user in a vehicle using eeg signals
CN109924975A (en) * 2019-04-04 2019-06-25 燕山大学 Attention level detection method based on complex brain network analysis
CN113157101A (en) * 2021-06-07 2021-07-23 成都华脑科技有限公司 Fragmentation reading habit identification method and device, readable medium and electronic equipment

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6128651B2 (en) * 2012-01-26 2017-05-17 国立研究開発法人国立精神・神経医療研究センター Cognitive function test system, cognitive function estimation system, and cognitive function test method
AU2013308871B2 (en) 2012-08-28 2017-04-13 Delos Living Llc Systems, methods and articles for enhancing wellness associated with habitable environments
WO2015130786A1 (en) 2014-02-28 2015-09-03 Delos Living Llc Systems, methods and articles for enhancing wellness associated with habitable environments
ES2912901T3 (en) 2015-06-08 2022-05-30 Atentiv Llc Functional montage of EEG for the development of cognitive abilities
CN108471991A (en) 2015-08-28 2018-08-31 艾腾媞乌有限责任公司 cognitive skill training system and program
EP3359022A4 (en) * 2015-10-05 2019-03-06 Tata Consultancy Services Limited Method and system for pre-processing of an eeg signal for cognitive load measurement
KR102181680B1 (en) * 2016-11-25 2020-11-24 주식회사 후원 Method screening human prone to addiction by measuring biomedical signals based on behavioral activation and inhibition systems
CN106923825B (en) * 2017-03-27 2020-01-31 广州视源电子科技股份有限公司 Electroencephalogram relaxation degree identification method and device based on frequency domain and phase space
US11668481B2 (en) 2017-08-30 2023-06-06 Delos Living Llc Systems, methods and articles for assessing and/or improving health and well-being
CN108388343B (en) * 2018-02-26 2022-06-24 天津智空科技有限公司 Teaching management system for VR immersion based on concentration degree electroencephalogram feature feedback
US11649977B2 (en) 2018-09-14 2023-05-16 Delos Living Llc Systems and methods for air remediation
US11844163B2 (en) 2019-02-26 2023-12-12 Delos Living Llc Method and apparatus for lighting in an office environment
WO2020198183A1 (en) 2019-03-25 2020-10-01 Delos Living Llc Systems and methods for acoustic monitoring
CN111738355B (en) * 2020-07-22 2020-12-01 中国人民解放军国防科技大学 Image classification method and device with attention fused with mutual information and storage medium
CN113180694A (en) * 2021-04-07 2021-07-30 北京脑陆科技有限公司 Data real-time labeling method and system based on EEG signal
CN113577495A (en) * 2021-07-21 2021-11-02 大连民族大学 Children attention deficit hyperactivity disorder auxiliary treatment system based on BCI-VR

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040152995A1 (en) * 2001-05-04 2004-08-05 Cox Daniel J. Method, apparatus, and computer program product for assessment of attentional impairments
WO2007149553A2 (en) * 2006-06-22 2007-12-27 Us Government As Represented By The Secretary Of The Army Alertness/drowsiness and cognitive capacity index
WO2008051992A2 (en) * 2006-10-23 2008-05-02 Lexicor Medical Technology, Llc Systems and methods for analyzing and assessing attention deficit hyperactivity disorder
US20080220400A1 (en) * 2004-03-18 2008-09-11 Cox Daniel J Method, Apparatus, And Computer Program Product For Stochastic Psycho-Physiological Assessment Of Attentional Impairments
WO2009134205A1 (en) * 2008-04-28 2009-11-05 Agency For Science, Technology And Research A method and system for concentration detection

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4421122A (en) * 1981-05-15 1983-12-20 The Children's Medical Center Corporation Brain electrical activity mapping
CA2418478A1 (en) * 2000-08-15 2002-02-21 The Regents Of The University Of California Method and apparatus for reducing contamination of an electrical signal
US6594524B2 (en) * 2000-12-12 2003-07-15 The Trustees Of The University Of Pennsylvania Adaptive method and apparatus for forecasting and controlling neurological disturbances under a multi-level control
US20050273017A1 (en) * 2004-03-26 2005-12-08 Evian Gordon Collective brain measurement system and method
EP2304627A4 (en) * 2008-05-26 2014-08-13 Agency Science Tech & Res A method and system for classifying brain signals in a bci

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040152995A1 (en) * 2001-05-04 2004-08-05 Cox Daniel J. Method, apparatus, and computer program product for assessment of attentional impairments
US20080220400A1 (en) * 2004-03-18 2008-09-11 Cox Daniel J Method, Apparatus, And Computer Program Product For Stochastic Psycho-Physiological Assessment Of Attentional Impairments
WO2007149553A2 (en) * 2006-06-22 2007-12-27 Us Government As Represented By The Secretary Of The Army Alertness/drowsiness and cognitive capacity index
WO2008051992A2 (en) * 2006-10-23 2008-05-02 Lexicor Medical Technology, Llc Systems and methods for analyzing and assessing attention deficit hyperactivity disorder
WO2009134205A1 (en) * 2008-04-28 2009-11-05 Agency For Science, Technology And Research A method and system for concentration detection

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
CLARKE, A. R. ET AL.: "EEG-defined subtypes of children with attention- deficit/hyperactivity disorder", CLINICAL NEUROPHYSIOLOGY, vol. 112, 2001, pages 2098 - 2105 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102824172A (en) * 2012-08-28 2012-12-19 浙江大学 EEG (electroencephalogram) feature extraction method
AT516020B1 (en) * 2014-12-09 2016-02-15 Guger Christoph Dipl Ing Dr Techn Method for quantifying the perceptibility of a person
AT516020A4 (en) * 2014-12-09 2016-02-15 Guger Christoph Dipl Ing Dr Techn Method for quantifying the perceptibility of a person
WO2019025000A1 (en) * 2017-08-03 2019-02-07 Toyota Motor Europe Method and system for determining a driving intention of a user in a vehicle using eeg signals
CN109924975A (en) * 2019-04-04 2019-06-25 燕山大学 Attention level detection method based on complex brain network analysis
CN113157101A (en) * 2021-06-07 2021-07-23 成都华脑科技有限公司 Fragmentation reading habit identification method and device, readable medium and electronic equipment

Also Published As

Publication number Publication date
SG192175A1 (en) 2013-08-30
US20130331727A1 (en) 2013-12-12

Similar Documents

Publication Publication Date Title
US20130331727A1 (en) Method and system for detecting attention
Alakus et al. Database for an emotion recognition system based on EEG signals and various computer games–GAMEEMO
Li et al. EEG-based mild depressive detection using feature selection methods and classifiers
US9149719B2 (en) Device and method for generating a representation of a subject's attention level
Winkler et al. Robust artifactual independent component classification for BCI practitioners
US8862581B2 (en) Method and system for concentration detection
Liu et al. Real-time subject-dependent EEG-based emotion recognition algorithm
EP2901342B1 (en) System for sensory and cognitive profiling
Chumerin et al. Steady-state visual evoked potential-based computer gaming on a consumer-grade EEG device
Martinez-Leon et al. Are low cost Brain Computer Interface headsets ready for motor imagery applications?
Rahnuma et al. EEG analysis for understanding stress based on affective model basis function
CN110840455A (en) System and method for brain activity resolution
Stangl et al. Mobile cognition: imaging the human brain in the ‘real world’
CN108348181A (en) Method and system for monitoring and improving attention
Delisle-Rodriguez et al. Adaptive spatial filter based on similarity indices to preserve the neural information on eeg signals during on-line processing
Piciucco et al. Biometric recognition using wearable devices in real-life settings
Hosseini et al. Emotional stress recognition using a new fusion link between electroencephalogram and peripheral signals
Chiappa et al. EEG classification using generative independent component analysis
Khan et al. Game induced emotion analysis using electroencephalography
Peng et al. Early screening of children with autism spectrum disorder based on electroencephalogram signal feature selection with L1-norm regularization
Hsu Motor imagery EEG discrimination using the correlation of wavelet features
Khushaba et al. A neuroscientific approach to choice modeling: Electroencephalogram (EEG) and user preferences
Shen et al. Multi-motion robots control based on bioelectric signals from single-channel dry electrode
EP4167858A1 (en) Ventral striatum activity
Oveisi EEG signal classification using nonlinear independent component analysis

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11856803

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 13982204

Country of ref document: US

122 Ep: pct application non-entry in european phase

Ref document number: 11856803

Country of ref document: EP

Kind code of ref document: A1