Name: Mit Hilfe eines EEG-basierten Brain-Computer Interface für Virtual Cursor-Bewegung mit BCI2000 (Video) | JoVE Journal
Uploaded: 2009-07-29T16:58:00.000+00:00
Duration: 12 min 7 s
Description: Lernen Sie die Einrichtung eines EEG-basierten Brain-Computer Interface für die Steuerung eines virtuellen Cursors durch gedachte Bewegungen. Diese Methode ermöglicht die präzise Analyse neuronaler Signale.

ai_agent_IP

ai_agent

maintenance

instantTrialDurationMinutes

isBiopharma

enableNewMyJoveSectionDesign

educationFeatures

seoMetaApi

ai_copilot_institution_blacklist

ai_chat_institution_blacklist

freeAccessWindow

ssoRoleCapture

scheduledMaintenanceBanner

joveLabsFeatures

disable_autoplay_for_bots

extended_trial_duration

5 minutes

playerTrialDesktop

NIH NIBIB RO1: 1R01EB009103-01 Clinical Neuroengineering Training Program (1 T90 DK070079-01) Wallace H Coulter Foundation NIH Institutional Clinical and Translational Science Award NIH/NCRR 1KL2RR025012-01 Wisconsin Alumni Research Foundation

Experimental Procedure
<ol>
<li>Connecting the EEG Electrodes<ol>
<li>Electrodes will be attached to the scalp using an EEG cap; this simplifies the process of ensuring that the electrodes are in the proper location on the scalp, as specified by the 10-20 international system.</li>
<li>To place the cap, mark the vertex on the subject's scalp using a felt-tip pen or some other similar method. To do so, begin by locating the nasion and inion on the subject. Using a tape measure, find the distance between these two locations. The point midway between the two points, or 50% of the distance, is the vertex. Make a mark at that point for later reference. Other 10-20 points can be located in a similar manner.</li>
<li>Find the Cz electrode on the cap, and position it on the vertex. Keeping Cz fixed, slip the cap onto the head. Ensure that the Fz, Cz, and Pz electrodes are on the midline of the scalp, and that the O1-O2 electrodes are horizontal and level with Oz, and that Fp1-Fp2 are level with Fpz.</li>
<li>Now attach the reference electrode, which typically clips onto an earlobe.</li>
<li>Next, the electrodes are filled with a conductive gel so that the electrodes make a low-impedance contact with the scalp. To do so, a small syringe with a blunt-tipped needle is filled with the gel. Also, it may be helpful to see the EEG traces on the computer screen while the gel is being applied to determine if the connection is good.</li>
<li>Insert the needle into an electrode, and gently abrade the scalp with the needle to remove any dead skin. Fill the electrode with a small amount of gel, being careful not to overfill it. Start with the ear reference electrode, and repeat for all of the electrodes, including the ground.</li>
<li>Check the impedances for all channels, which should all be less than 5 kΩ. This method will vary depending on the particular amplifier system being used, but it should be possible to check the impedance either through hardware or through BCI2000.</li>
<li>If an electrode is over 5 kΩ, insert the needle again, and abrade the scalp some more. It should not be necessary to inject more gel, unless there are no decreases in the impedance.</li>
</ol></li>
<li>Obtaining EEG Calibration Features<ol>
<li>At the start of a session, particularly the first time a subject is being tested, it is useful to determine the EEG features that can be used for controlling a BCI. This is because although the basic properties of the Mu and Beta EEG rhythms are the same for all people, these features will vary from person to person, and therefore need to be calibrated prior to any other experiments.</li>
<li>In the calibration session, the subject is instructed to imagine different movements involving their hands or feet in response to visual cues presented on the monitor. To get started, the computer system should be configured for dual-monitor mode, so that the researcher’s display contains the control software, and the second monitor displays the experimental output.</li>
<li>Start BCI2000 from the BCI2000Launcher by selecting your amplifier source module, the ARSignalProcessing module, and StimulusPresentation module. In this example, we are using the gUSBampSource module, which controls the g.USBamp amplifier.</li>
<li>Add the parameter files for your subject, the amplifier, and the motor screening tasks. These should be configured ahead of time, so that they can simply be loaded, and the experiment can start.</li>
<li>Once the parameter files have been added to the file list in BCI2000Launcher, press the Launch button. If everything worked correctly, BCI2000 should start, a trace of the EEG data should appear, and the subject’s monitor should be blank prior to the start of the experiment.</li>
<li>During the session, the screen will either be blank, or display an instruction, such as “Right Hand,” “Left Hand,” “Both Hands,” or “Both Feet.” The instruction will appear on the screen for 3s; during this time, the subject should continuously imagine the movement. The hand movements should be opening and closing the hands (e.g., like squeezing a tennis ball), and the foot movement should be moving the feet back and forth (e.g., like pressing on a gas pedal with both feet). When the screen is blank, the body should be completely relaxed.</li>
<li>During a run, each body part is repeated 20 times. Ideally, there should be 100 data points, meaning that there should be a total of 5 runs. With multiple sessions, fewer runs are necessary, since the subject is able to perform the imagined task better.</li>
</ol></li>
<li>Analyzing the EEG Features<ol>
<li>In order to determine which EEG features the subject is able to voluntarily modulate in order to control the BCI, the calibration data is analyzed offline using the BCI2000 Offline Analysis tool, included with BCI2000. This tool converts the collected data into frequency domain features, which shows the frequencies and locations that changed during the different movements, and are maximally correlated with the tasks. These features can then be used in a BCI experiment.</li>
<li>To determine which features should be used, start the BCI2000 Offline Analysis tool. BCI2000 includes an extensive tutorial for using the analysis tool, which should be consulted for more information.</li>
<li>Determine which EEG features are strongly correlated with each movement by finding the large r-squared values in the plots produced from the analysis tool. The channels and frequency bins with the largest r-squared values (e.g., greater than 0.2) can then be selected as a control signal component for a particular direction. For example, features that change for the Right Hand condition should be set up to move the cursor to the right side of the screen.</li>
<li>It is also important to remember that the Mu/Beta rhythms decrease in amplitude with an associated movement. So, in order to move the cursor to the right, the positive x-direction, this feature should have a negative weight associated with it.</li>
<li>The channels and frequencies chosen should be consistent with known properties of cortical sensorimotor rhythms. That is, significant changes corresponding with imagined right hand movement should be seen over the contralateral (left) motor cortex, near C3 and CP3 and centered near 8-12 Hz and/or 18-28 Hz. Similarly, left hand movements should result in changes over right motor cortex on the C4 and CP4 electrodes, and foot movements should appear over Cz and CPz. If these locations and values are different, then it is likely that some other noise or random effect was measured, and should not be configured as a control feature.</li>
<li>For each condition, the four largest r-squared values should be chosen in terms of the channel number and bin number. The frequencies are arranged in 2 Hz bins, so a feature with a high r-squared from 10-12 Hz would appear in bin 6. With these values in hand, the system can be configured for the cursor control task.</li>
</ol></li>
<li>Online Feedback Session Configuration<ol>
<li>Configure the cursor movement session in the BCI2000 Launcher.</li>
<li>Before starting the experiment, several parameters need to be configured. First, the spatial filter should be configured with a common-average reference. To do so, press Config in the BCI2000 operator to bring up the settings list, and press the Filtering tab.</li>
<li>Go to SpatialFiltering, and change the SpatialFilterType drop-down box so that it says “Common-Average Reference (CAR).”</li>
<li>Under SpatialFilter CAR Output, list the channel names or numbers selected in the calibration session. For example, you can type “C3 CP3 C4 CP4 Cz CPz” (without the quotes), and BCI2000 will know which channels to use (provided that the channel labels are listed under the “Channel Names” field in the Source tab).</li>
<li>Next, the classification matrix must be configured to use the features selected. Under the Filtering tab, go to the Classifier parameter and press Edit Matrix.</li>
<li>The number of columns should be set to 4, and the number of rows should be equal to the total number of features selected. Each matrix row corresponds to an individual feature.</li>
<li>The first column should contain all of the channel names being used, e.g., C3, C4, etc. The second column contains the bins selected for control. It is possible enter either a bin number or specific frequency; entering “6” or “11Hz” will select the same bin, provided that the BinWidth parameter is “2 Hz” under the Source tab. The third column is the output channel; a value of “1” corresponds to horizontal movement, and “2” corresponds to vertical movement. The channels C3, CP3, C4, and CP4 should be set to 1 for a horizontal cursor control task; C3, CP3, C4, CP4, Cz and CPz should be set to 2 for a vertical cursor control task. Finally, the fourth column holds the feature weight, and should correspond to the opposite intended direction, e.g., C3 and CP3 should be weighted -1 to move the cursor right, and C4 and CP4 should be weighted 1 to move it left. To move the cursor down, Cz and CPz should be weighted 1, and to move the cursor up, C3 and C4 should be weighted -1.</li>
</ol></li>
<li>Cursor Movement Task<ol>
<li>Now that the system is configured with the correct settings, it is time to start the experimental task.</li>
<li>The system is configured so that one of four targets will appear during a trial. The subject’s goal is to move the cursor to the correct target using imagined movements corresponding to the desired direction of movement (e.g., right-hand to move right, feet to move down, etc).</li>
<li>For the first trials, the cursor is constrained to the axis of the target. That is, if the target is at the top or bottom, it is only possible to move the cursor up or down, and if it is at the left or right of the screen, the cursor can only be moved left or right.</li>
<li>When the run starts, the letter “T” appears on the screen for 2 seconds. Next, one of the targets appears for 1 second.</li>
<li>After this 1-second period, the cursor appears in the middle of the screen. The subject uses the appropriate imagined movements to direct the cursor to the target. If the subject hits the target, it changes color. Otherwise, the subject has 5 seconds to hit the target before the session times-out and is counted as a miss.</li>
<li>After the trial, there is a 2 second inter-trial interval during which the subject can relax, blink, swallow, or otherwise re-adjust positions. During the trials, movement should be kept to an absolute minimum to reduce movement artifacts or muscle artifacts. It is also beneficial to sit in a dimly lit room in a comfortable chair.</li>
<li>After 20 trials, BCI2000 enters a suspended state. During this time, it may be necessary to re-adjust some of the settings if the subject is unable to move the cursor.</li>
<li>If after 4 runs the subject is still unable to volitionally move the cursor, it may be necessary to re-analyze the collected data in the BCI2000 Offline Analysis tool. Select the new channels and frequencies based on the new feature plots. It may take several runs or possibly several sessions before a subject can become proficient at the task.</li>
</ol></li>
</ol>
Part 6: Representative Results:
<ol>
<li>Figures 1 and 2 show the r-squared values and scalp topography for the calibration procedure, indicating which channels and frequency bins should be selected for cursor control.</li>
<li>A trained subject should be able to quickly move the cursor to the shown target within 1 or 2 seconds.</li>
</ol>
<img src="/files/ftp_upload/1319/1319fig1.jpg" alt="Brain activity map, EEG spectral analysis, frequency-amplitude graphs, neural signal processing." data-altupdatedat="1787630408000" data-alt="Fig 1">
Figure 1 A) and B) Topography of spectral changes in the 10-12 Hz band during real and imagined movements with the right hand. C) The power spectrum on C3 during rest (dashed) and movement (solid). D) The r-squared of the power during movement compared to rest.
<img src="/files/ftp_upload/1319/1319fig2.jpg" alt="Spectral analysis heatmap, frequency vs. channel, showing color-coded signal strength, graph." data-altupdatedat="1787630408000" data-alt="Fig 2">
Figure 2 The r-squared across all channels for imagined right-hand movement. The x-axis is the frequency in 2 Hz bins from 0 to 70 Hz. The y-axis is the channel number. The highest r-squared values are found on channels 9, 10, 17, 18, and 19, which cover the contralateral hand area of motor cortex.

<ol><li>Fabiani, G. E., McFarland, D. J., Wolpaw, J. R., Pfurtscheller, G. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Conversion+of+eeg+activity+into+cursor+movement+by+a+brain-computer+interface+%28bci%29%5BTitle%5D)+AND+%22IEEE+transactions+on+neural+systems+and+rehabilitation+engineering%22%5BJournal%5D)">Conversion of eeg activity into cursor movement by a brain-computer interface (bci).</a> IEEE transactions on neural systems and rehabilitation engineering. 12 (3), 331-338 (2004).</li>
<li>Wolpaw, J. R., McFarland, D. J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Control+of+a+two-dimensional+movement+signal+by+a+noninvasive+brain-computer+interface+in+humans%5BTitle%5D)+AND+%22Proc+Natl+Acad+Sci+USA%22%5BJournal%5D)">Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans.</a> Proc Natl Acad Sci USA. 101 (51), 17849-17854 (2004).</li>
<li>Schalk, G., McFarland, D. J., Hinterberger, T., Birbaumer, N., Wolpaw, J. R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Bci2000%3A+a+general-purpose+brain-computer+interface+%28BCI%29+system%5BTitle%5D)+AND+%22IEEE+transactions+on+bio-medical+engineering%22%5BJournal%5D)">Bci2000: a general-purpose brain-computer interface (BCI) system.</a> IEEE transactions on bio-medical engineering. 51 (6), 1034-1043 (2004).</li>
</ol>

<ol>
<li>It is vital that the electrode impedances are low, but that too much gel was not used to lower the impedance. A single bad channel can affect all the others through the common-average reference. If the impedance cannot be reduced after several tries, it is recommended that a quick-insert electrode be used, which can simply be inserted into the bad electrode through the hole that the needle is placed through for injecting the gel, and taped in place.</li>
<li>During the first session, the subject may have difficulty imagining the requ...

<table><tbody><tr><td>BCI2000- Compatible Amplifer System</td><td>g.USBamp</td><td></td><td>&lt;a href=&quot;http://www.gtect.at&quot;&gt;http://www.gtect.at&lt;/a&gt;</td></tr><tr><td>BCI2000- Compatible Amplifer System</td><td>Tucker-Davis Technologies</td><td>Rx5 or Rx 7</td><td>&lt;a href=&quot;http://www.tdt.com&quot;&gt;http://www.tdt.com&lt;/a&gt;</td></tr><tr><td>EEG cap</td><td>Electro-cap International</td><td></td><td>&lt;a href=&quot;http://www.electro-cap.com&quot;&gt;http://www.electro-cap.com&lt;/a&gt;&lt;br/&gt;At a minimum, the cap should have electrodes over hand and feet areas (C3, C4, and Cz). Additional channels can be used for control (CP3, CP4, CPz) and for spatial filtering as well, which will improve the signal quality.</td></tr><tr><td>Conductive gel</td><td>Electro-cap International</td><td></td><td>&lt;a href=&quot;http://www.electro-cap.com&quot;&gt;http://www.electro-cap.com&lt;/a&gt;</td></tr><tr><td>PC</td><td></td><td></td><td>Running Windows XP or Vista (at least Pentium 4, 2 GHz, 1 GB RAM)</td></tr><tr><td>Two monitors</td><td></td><td></td><td>Each at least 19in (one for the subject and one for the researcher)</td></tr></tbody></table>

using an eeg-based brain-computer interface for virtual cursor movement with bci2000

Using an EEG-Based Brain-Computer Interface for Virtual Cursor Movement with BCI2000

A brain-computer interface (BCI) functions by translating a neural signal, such as the electroencephalogram (EEG), into a signal that can be used to control a computer or other device. The amplitude of the EEG signals in selected frequency bins are measured and translated into a device command, in this case the horizontal and vertical velocity of a computer cursor. First, the EEG electrodes are applied to the user s scalp using a cap to record brain activity. Next, a calibration procedure is used to find the EEG electrodes and features that the user will learn to voluntarily modulate to use the BCI. In humans, the power in the mu (8-12 Hz) and beta (18-28 Hz) frequency bands decrease in amplitude during a real or imagined movement. These changes can be detected in the EEG in real-time, and used to control a BCI ([1],[2]). Therefore, during a screening test, the user is asked to make several different imagined movements with their hands and feet to determine the unique EEG features that change with the imagined movements. The results from this calibration will show the best channels to use, which are configured so that amplitude changes in the mu and beta frequency bands move the cursor either horizontally or vertically. In this experiment, the general purpose BCI system BCI2000 is used to control signal acquisition, signal processing, and feedback to the user [3].

In this video, we demonstrate the steps required to run a brain-computer interface experiment, including setting up the EEG cap, calibrating the system, and training the user to move a cursor in two dimensions using imagined movements.

A brain-computer interface (BCI) functions by translating a neural signal, such as the electroencephalogram (EEG), into a signal that can be used to ...

A brain computer interface or BCI functions by translating a neural signal such as the electroencephalogram or EEG, into a signal that can be used to control a computer or other device. The procedure begins by attaching the EEG electrode cap to the subject's scalp to record brain activity. The subject is then asked to imagine several voluntary movements with their hands and feet, at which time a calibration procedure is performed, which analyzes the characteristics of the EEG as a result of the calibration procedure.The R-squared values and scalp tomography can be used to determine which electrodes and frequency bins will be used to guide a cursor on the computer screen. Subjects will then be able to move a cursor quickly to target areas just by thinking about it. Hi, I'm Adam Wilson, and I work in Justin Williams lab in the Department of Biomedical Engineering at the University of Wisconsin-Madison.Today I'll be sharing the procedure for recording brain activity called the electroencephalogram or EEG for controlling a brain computer interface application. So let's get started. You begin this protocol by connecting EEG electrodes to the subject's scalp through an EEG cap, which pos

using-an-eeg-based-brain-computer-interface-for-virtual-cursor

Research

JoVE Journal

Biology

We present a method for collecting electrocorticographic signals for research purposes from humans who are undergoing invasive epilepsy monitoring.  We show how to use the BCI2000 software platform for data collection, signal processing and stimulus presentation.  Specifically, we demonstrate SIGFRIED, a BCI2000-based tool for real-time functional brain mapping.

Recording Human Electrocorticographic (ECoG) Signals for Neuroscientific Research and Real-time Functional Cortical Mapping

Development of an effective brain-machine-interface (BMI) system for restoration and rehabilitation of bipedal locomotion requires accurate decoding of user's intent.  Here we present a novel experimental protocol and data collection technique for simultaneous non-invasive acquisition of neural activity, muscle activity, and whole-body kinematics during various locomotion tasks and conditions.

Simultaneous Scalp Electroencephalography (EEG), Electromyography (EMG), and Whole-body Segmental Inertial Recording for Multi-modal Neural Decoding

A novel low-cost human-machine interface for interactive post-stroke balance rehabilitation system is presented in this article. The system integrates off-the-shelf low-cost sensors towards volitionally driven electrotherapy paradigm. The proof-of-concept software interface is demonstrated on healthy volunteers.

A Human-machine-interface Integrating Low-cost Sensors with a Neuromuscular Electrical Stimulation System for Post-stroke Balance Rehabilitation

The overall goal of this method is to establish an SSVEP-based experimental procedure by integrating multiple software programs to enable the study of brain-robot interaction with humanoid robots, which is prospective in assisting the sick and elderly as well as performing unsanitary or dangerous jobs.

SSVEP-based Experimental Procedure for Brain-Robot Interaction with Humanoid Robots

With this experiment, one might be able to detect consciousness in people with disorders of consciousness. Furthermore, the approach can create a simple communication channel that enables people to give simple YES/NO answers to questions.

Assessment and Communication for People with Disorders of Consciousness

This article presents a method for estimating same-day P300 speller Brain-Computer Interface (BCI) accuracy using a small testing dataset.

P300-Based Brain-Computer Interface Speller Performance Estimation with Classifier-Based Latency Estimation

This paper discusses how to build a brain-computer interface by relying on consumer-grade equipment and steady-state visually evoked potentials. For this, a single-channel electroencephalograph exploiting dry electrodes was integrated with augmented reality glasses for stimuli presentation and output data visualization. The final system was non-invasive, wearable, and portable.

A Single-Channel and Non-Invasive Wearable Brain-Computer Interface for Industry and Healthcare

The purpose of this study is to provide an important reference for the standard clinical operation of motor imagery brain-computer interface (MI-BCI) for upper limb motor dysfunction after stroke.

Motor Imagery Brain-Computer Interface in Rehabilitation of Upper Limb Motor Dysfunction After Stroke

Motor imagery in a virtual reality environment has wide applications in brain-computer interface systems. This manuscript outlines the use of personalized digital avatars that resemble the participants performing movements imagined by the participant in a virtual reality environment to enhance immersion and a sense of body ownership.

Motor Imagery Performance Through Embodied Digital Twins in a Virtual Reality-Enabled Brain-Computer Interface Environment

This study introduces a brain-computer interface (BCI) system for stroke patients, which combines electroencephalography and electrooculography signals to control an upper limb robotic hand, enhancing daily activities. The evaluation used the Berlin Bimanual Test for Stroke (BeBiTS).

Brain-Computer Interface-controlled Upper Limb Robotic System for Enhancing Daily Activities in Stroke Patients

This study presents a standardized and reproducible protocol for implementing the Spatial-Temporal-Frequency EEG analysis tool (STFEEG) for motor imagery EEG decoding, incorporating configurable spatial-temporal-frequency segmentation, Common Spatial Patterns (CSP)-based feature extraction, multiple classification algorithms, and visualization capabilities.

STFEEG-Tool: A Spatial-Temporal-Frequency EEG Analysis Tool for Motor Imagery Brain-Computer Interfaces

Lernen Sie die Einrichtung eines EEG-basierten Brain-Computer Interface für die Steuerung eines virtuellen Cursors durch gedachte Bewegungen. Diese Methode ermöglicht die präzise Analyse neuronaler Signale.

Using an EEG-Based Brain-Computer Interface for Virtual Cursor Movement with BCI2000

Weitere Videos entdecken