Real Time EEG Based Measurements of Cognitive Load Indicates Mental States During Learning

##plugins.themes.bootstrap3.article.main##

##plugins.themes.bootstrap3.article.sidebar##

Published Dec 23, 2017
Alex Dan Miriam Reiner

Abstract

One of the recommended approaches in instructional design methods is to optimize the value of working memory capacity and avoid cognitive overload. Educational neuroscience offers innovative processes and methodologies to analyze cognitive load based on physiological measures. Observing psychophysiological changes when they occur in response to the course of a learning session allows adjustments in the learning session based on the individual learner's capabilities. The availability of non-invasive electroencephalogram (EEG)-based devices and advanced near-real-time analysis techniques have improved our understanding of the underlying mechanisms and have impacted the way we design instructional methods and adapt them to the current learner's cognitive load and valence states. We review Cognitive Load Theory, how cognitive load may be measured, and how analysis of EEG data can be applied to enhance learning through real-time measurements of the learner's cognitive load. We show an experiment that provides a proof of concept of real-time measures based on EEG indicators and of mental states during learning.

How to Cite

Dan, A., & Reiner, M. (2017). Real Time EEG Based Measurements of Cognitive Load Indicates Mental States During Learning. Journal of Educational Data Mining, 9(2), 31–44. https://doi.org/10.5281/zenodo.3554719
Abstract 3820 | PDF Downloads 2710

##plugins.themes.bootstrap3.article.details##

Keywords

cognitive load, EEG, adaptive learning

References
ANSARI, D., AND COCH, D. 2006. Bridges over troubled waters: education and cognitive neuroscience. Trends in Cognitive Sciences, 10(4), 146–51. http://doi.org/10.1016/j.tics.2006.02.007

ANSARI, D., DE SMEDT, B., AND GRABNER, R. H. 2012. Neuroeducation – a critical overview of an emerging field. Neuroethics, 5(2), 105–117. http://doi.org/10.1007/s12152- 011-9119-3

ANTONENKO, P., PAAS, F., GRABNER, R., AND VAN GOG, T. 2010. Using electroencephalography to measure cognitive load. Educational Psychology Review, 22(4), 425–438. http://doi.org/10.1007/s10648-010-9130-y

BANNERT, M. 2002. Managing cognitive load — recent trends in cognitive load theory. Learning and Instruction, 12, 139–146.

BASAR, E., BASAR-EROGLU, C., KARAKAS, S., AND SCHÜRMANN, M. 1999. Oscillatory brain theory: a new trend in neuroscience. IEEE Engineering in Medicine and Biology Magazine: The Quarterly Magazine of the Engineering in Medicine and Biology Society, 18(3), 56–66. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/10337564

BAŞAR, E., BAŞAR-EROGLU, C., KARAKAŞ, S., AND SCHÜRMANN, M. 2001. Gamma, Alpha, delta, and Theta oscillations govern cognitive processes. International Journal of Psychophysiology, 39(2-3), 241–248. http://doi.org/10.1016/S01678760(00)00145-8

BORGHINI, G., ASTOLFI, L., VECCHIATO, G., MATTIA, D., AND BABILONI, F. 2012. Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness. Neuroscience and Biobehavioral Reviews, 44, 58–75. http://doi.org/10.1016/j.neubiorev.2012.10.003

BROUWER, A.-M., HOGERVORST, M. A, VAN ERP, J. B. F., HEFFELAAR, T., ZIMMERMAN, P. H., AND OOSTENVELD, R. 2012. Estimating workload using EEG spectral power and ERPs in the n-back task. Journal of Neural Engineering, 9(4), 045008. http://doi.org/10.1088/1741-2560/9/4/045008

BUCCINO, G., VOGT, S., RITZL, A., FINK, G. R., ZILLES, K., FREUND, H., AND RIZZOLATTI, G. 2004. Of hand actions: an event-related FMRI study. Neuron,42, 323– 334.

CAIN, B. 2004. A Review of the mental workload literature. In NATO RTO-TR-HFM- 121- Part-II (pp. 4–1 – 4–34). Retrieved from http://www.dtic.mil/cgibin/GetTRDoc?Location=U2&doc=GetTRDoc.pdf&AD=ADA474193

CAREW, T. J., AND MAGSAMEN, S. H. 2010. Neuroscience and education: an ideal partnership for producing evidence-based solutions to Guide 21(st) Century Learning. Neuron, 67(5), 685–8. http://doi.org/10.1016/j.neuron.2010.08.028

CHANDLER, P., AND SWELLER, J. 1991. Cognitive load theory and the format of Instruction. Cognition and Instruction, 8(4), 293–332.

CHIK, D. 2013. Theta-Alpha cross-frequency synchronization facilitates working memory control – a modeling study. SpringerPlus, 2(1), p.14. http://doi.org/10.1186/2193-1801-2- 14

COOPER, G. 2008. Research into cognitive load theory and instructional design at UNSW. Retrieved from http://dwb4.unl.edu/QQQ/SW/UNSW.htm 2/27/2008

DAS, R., CHATTERJEE, D., DAS, D., SINHARAY, A., & SINHA, A. 2014. Cognitive load measurement - A methodology to compare low cost commercial EEG devices. In 2014 International Conference on Advances in Computing, Communications and Informatics (ICACCI) (pp. 1188–1194). IEEE. http://doi.org/10.1109/ICACCI.2014.6968528

DELEEUW, K. E., AND MAYER, R. E. 2008. A comparison of three measures of cognitive load: Evidence for separable measures of intrinsic, extraneous, and germane load. Journal of Educational Psychology, 100(1), 223–234. http://doi.org/10.1037/0022-0663.100.1.223

DEVONSHIRE, I. M., AND DOMMETT, E. J. 2010. Neuroscience: viable applications in education? The Neuroscientist: A Review Journal Bringing Neurobiology, Neurology and Psychiatry, 16(4), 349–56. http://doi.org/10.1177/1073858410370900

DIRICAN, A. C., AND GÖKTÜRK, M. 2011. Psychophysiological measures of human cognitive states applied in human computer interaction. Procedia Computer Science, 3, 1361–1367. http://doi.org/10.1016/j.procs.2011.01.016

EVERHART, D. E., AND DEMAREE, H. A. 2003. Low Alpha power (7.5-9.5 Hz) changes during positive and negative affective learning. Cognitive, Affective and Behavioral Neuroscience, 3(1), 39–45. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/12822597

EWING, K. C., AND FAIRCLOUGH, S. H. 2010. The effect of an extrinsic incentive on psychophysiological measures of mental effort and motivational disposition when task demand is varied. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 54(3), 259–263. http://doi.org/10.1177/154193121005400316

EYSINK, T. H. S., AND DE JONG, T. 2012. Does instructional approach matter? How elaboration plays a crucial role in multimedia learning. Journal of the Learning Sciences, 21(4), 583–625. http://doi.org/10.1080/10508406.2011.611776

FINK, A, GRABNER, R. H., NEUPER, C., AND NEUBAUER, A. C. 2005. EEG Alpha band dissociation with increasing task demands. Cognitive Brain Research, 24(2), 252–259. http://doi.org/10.1016/j.cogbrainres.2005.02.002

GEVINS, A., SMITH, M. E., LEONG, H., MCEVOY, L., WHITFIELD, S., DU, R., and RUSH, G. 1998. Monitoring working memory load during computer-based tasks with EEG pattern recognition methods. Human Factors, 40(1), 79–91. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/9579105

GEORGEON, O. L., AND RITTER, F. E. 2012. An intrinsically-motivated schema mechanism to model and simulate emergent cognition. Cognitive Systems Research, 15- 16, 73–92. http://doi.org/10.1016/j.cogsys.2011.07.003

GERJETS, P., SCHEITER, K., AND CATRAMBONE, R. 2004. Designing instructional examples to reduce intrinsic cognitive load: molar versus modular presentation of solution procedures. Instructional Science, 32(1/2), 33–58. http://doi.org/10.1023/B:TRUC.0000021809.10236.71

GEVINS, A., SMITH, M. E., LEONG, H., MCEVOY, L., WHITFIELD, S., DU, R., and RUSH, G. 1998. Monitoring working memory load during computer-based tasks with EEG pattern recognition methods. Human Factors, 40(1), 79–91. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/9579105

GOLDMAN, S. R. 2009. Explorations of relationships among learners, tasks, and learning. Learning and Instruction, 19(5), 451–454. http://doi.org/10.1016/j.learninstruc.2009.02.006

GOSWAMI, U., AND SZŰCS, D. 2011. Educational neuroscience: developmental mechanisms: Towards a conceptual framework. NeuroImage, 57(3), 651–658. http://doi.org/10.1016/j.neuroimage.2010.08.072

GRIMES, D., TAN, D. S., HUDSON, S. E., SHENOY, P., AND RAO, R. P. N. 2008. Feasibility and pragmatics of classifying working memory load with an electroencephalograph. In Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems - CHI ’08 (p. 835). New York, New York, USA: ACM Press. http://doi.org/10.1145/1357054.1357187

HANCOCK, P. A., AND MESHKATI, N. 1988. Human mental workload. Amsterdam: North-Holland.

HÖFFLER, T. N., AND LEUTNER, D. 2007. Instructional animation versus static pictures: a meta-analysis. Learning and Instruction, 17(6), 722–738. http://doi.org/10.1016/j.learninstruc.2007.09.013

HOLM, A., LUKANDER, K., KORPELA, J., SALLINEN, M., AND MÜLLER, K. M. I. 2009. Estimating brain load from the EEG. The Scientific World Journal, 9, 639–51. http://doi.org/10.1100/tsw.2009.83

IMMORDINO-YANG, M. H., AND FISCHER, K. W. 2010. Neuroscience bases of learning. International encyclopedia of education, 3, 310-16.

KLIMESCH, W. 1999. EEG Alpha and Theta oscillations reflect cognitive and memory performance: a review and analysis. Brain Research Reviews, 29(2-3), 169–195. http://doi.org/10.1016/S0165-0173(98)00056-3

KOHLMORGEN, J., DORNHEGE, G., BRAUN, M., BLANKERTZ, B., MÜLLER, K. R., CURIO, G., ... AND KINCSES, W. 2007. Improving human performance in a real operating environment through real-time mental workload detection. Toward BrainComputer Interfacing, 409-422.

LEI, S., AND ROETTING, M. 2011. Influence of task combination on EEG spectrum modulation for driver workload estimation. Human Factors: The Journal of the Human Factors and Ergonomics Society, 53(2), 168–179. http://doi.org/10.1177/0018720811400601

LEPPINK, J., PAAS, F., VAN DER VLEUTEN, C. P. M., VAN GOG, T., AND VAN MERRIËNBOER, J. J. G. 2013. Development of an instrument for measuring different types of cognitive load. Behavior Research Methods, 45(4), 1058–1072. http://doi.org/10.3758/s13428-013-0334-1

LYSAGHT, R. J., HILL, S. G., DICK, A. O., PLAMONDON, B. D., LINTON, P. M., WIERWILLE, W. W., ... WHERRY, R. J. 1989. Operator workload: comprehensive review and evaluation of operator workload methodologies. United States Army Research Institute for the Behavioral Sciences, Technical Report. Alexandria, Virginia.

MAYER, R. E., AND MORENO, R. 2003. Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38(1), 43–52. http://doi.org/10.1207/S15326985EP3801_6

MCEVOY, L. K., SMITH, M. E., AND GEVINS, A. 1998 Dynamic cortical networks of verbal and spatial working memory: effects of memory load and task practice. Cerebral Cortex, 8(7), 563–74. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/9823478

MICHELS, L., MOAZAMI-GOUDARZI, M., JEANMONOD, D., and SARNTHEIN, J. 2008. EEG Alpha distinguishes between cuneal and precuneal activation in working memory. NeuroImage, 40(3), 1296–310. http://doi.org/10.1016/j.neuroimage.2007.12.048

MORRISON, G. R., AND ANGLIN, G. J. 2005. Research on cognitive load theory: Application to e-learning. Educational Technology Research and Development, 53(3), 94– 104. http://doi.org/10.1007/BF02504801

PAAS, F., RENKL, A., AND SWELLER, J. 2004. Cognitive load theory: instructional implications of the interaction between information structures and cognitive architecture. Instructional Science, 32(1/2), 1–8. http://doi.org/10.1023/B:TRUC.0000021806.17516.d0

PAAS, F., TUOVINEN, J. E., TABBERS, H., AND VAN GERVEN, P. W. M. 2003. Cognitive load measurement as a means to advance cognitive load theory. Educational Psychologist, 38(1), 63–71. http://doi.org/10.1207/S15326985EP3801_8

PLASS, J. L., HEIDIG, S., HAYWARD, E. O., HOMER, B. D., AND UM, E. 2013. Emotional design in multimedia learning: Effects of shape and color on affect and learning. Learning and Instruction. http://doi.org/10.1016/j.learninstruc.2013.02.006

PARASURAMAN, R. 2003. Neuroergonomics: Research and practice. Theoretical Issues in Ergonomics Science, 4(1-2), 5–20. http://doi.org/10.1080/14639220210199753

PARASURAMAN, R., SHERIDAN, T. B., AND WICKENS, C. D. 2008. Situation awareness, mental workload, and trust in automation: Viable, empirically supported cognitive engineering constructs. Journal of Cognitive Engineering and Decision Making, 2(2), 140–160. http://doi.org/10.1518/155534308X284417.

PENARANDA, B. N., AND BALDWIN, C. L. 2012. Temporal factors of EEG and artificial neural network classifiers of mental workload. Proceedings of the Human Factors and Ergonomics Society Annual Meeting. http://doi.org/10.1177/1071181312561016

PICKUP, L., WILSON, J. R., SHARPIES, S., NORRIS, B., CLARKE, T., AND YOUNG, M. S. 2005. Fundamental examination of mental workload in the rail industry. Theoretical Issues in Ergonomics Science, 6(6), 463–482. http://doi.org/10.1080/14639220500078021

REBSAMEN, B., KWOK, K., AND PENNEY, T. B. 2011. Evaluation of cognitive workload from eeg during a mental arithmetic task. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 55(1), 1342–1345. http://doi.org/10.1177/1071181311551279

REINER, M., AND GELFELD, T. M. 2014. Estimating mental workload through eventrelated fluctuations of pupil area during a task in a virtual world. International Journal of Psychophysiology: Official Journal of the International Organization of Psychophysiology, 93(1), 38–44. http://doi.org/10.1016/j.ijpsycho.2013.11.002

ROBERTS, D. M., TAYLOR, B. A., BARROW, J. H., ROBERTSON, G., BUZZELL, G., SIBLEY, C., ... BALDWIN, C. L. 2010. EEG spectral analysis of workload for a part-task UAV simulation. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 54(3), 200–204. http://doi.org/10.1177/154193121005400303

RUBIO, S., DÍAZ, E., MARTÍN, J., AND PUENTE, J. M. 2004. Evaluation of subjective mental workload: A Comparison of SWAT, NASA-TLX, and workload profile methods. Applied Psychology: An International Review, 53(1), 61–86.

RYU, K., AND MYUNG, R. 2005. Evaluation of mental workload with a combined measure based on physiological indices during a dual task of tracking and mental arithmetic. International Journal of Industrial Ergonomics, 35(11), 991–1009. http://doi.org/10.1016/j.ergon.2005.04.005

SAMMER, G. 1996. Working-memory load and dimensional complexity of the EEG. International Journal of Psychophysiology, 24(1-2), 173–182. http://doi.org/10.1016/S0167-8760(96)00070-0

SMITH, M. E., GEVINS, A., BROWN, H., KARNIK, A., AND DU, R. 2001. Monitoring task loading with multivariate EEG measures during complex forms of human-computer interaction. Human Factors: The Journal of the Human Factors and Ergonomics Society, 43(3), 366–380. http://doi.org/10.1518/001872001775898287

SWELLER, J. 1988. Cognitive load during problem solving: Effects on learning. Cognitive Science, 12(2), 257–285. http://doi.org/10.1016/0364-0213(88)90023-7

SWELLER, J. 2010. Element interactivity and intrinsic, extraneous, and germane cognitive load. Educational Psychology Review, 22(2), 123–138. http://doi.org/10.1007/s10648-010- 9128-5

TABBERS, H. K., MARTENS, R. L., AND MERRIËNBOER, J. J. G. 2004. Multimedia instructions and cognitive load theory: Effects of modality and cueing. British Journal of Educational Psychology, 74(1), 71–81. http://doi.org/10.1348/000709904322848824

TEPLAN, M. 2002. Fundamentals of EEG Measurement. Measurement Science Review,2(2), 1–11.

VAN MERRIËNBOER, J. J. G., and SWELLER, J. 2005. Cognitive load theory and complex learning: Recent developments and future directions. Educational Psychology Review, 17(2), 147–177. http://doi.org/10.1007/s10648-005-3951-0

WARD, L. M. 2003. Synchronous neural oscillations and cognitive processes. Trends in Cognitive Sciences, 7(12), 553–559. http://doi.org/10.1016/j.tics.2003.10.012

WHELAN, R. R. 2007. Neuroimaging of cognitive load in instructional multimedia. Educational Research Review, 2(1), 1–12. http://doi.org/10.1016/j.edurev.2006.11.001

WICKENS, C. D. 2008. Multiple resources and mental workload. Human Factors: The Journal of the Human Factors and Ergonomics Society, 50(3), 449–455. http://doi.org/10.1518/001872008X288394

XIE, B., AND SALVENDY, G. 2000. Prediction of mental workload in single and multiple tasks environments. International Journal of Cognitive Ergonomics, 4(3), 213–242.

YUAN, Y., CHANG, K. M., XU, Y., & MOSTOW, J. 2014. A public toolkit and its dataset for EEG. In Proceedings of the ITS2014 Workshop on Utilizing EEG Input in Intelligent Tutoring Systems, 49.

ZARJAM, P., EPPS, J., AND CHEN, F. 2011. Characterizing working memory load using EEG delta activity. 19th European Signal Processing Conference (EUSIPCO 2011), 1554–1558.
Section
Articles