Real Time EEG Based Measurements of Cognitive Load Indicates Mental States During Learning
##plugins.themes.bootstrap3.article.main##
##plugins.themes.bootstrap3.article.sidebar##
Abstract
One of the recommended approaches in instructional design methods is to optimize the value of working memory capacity and avoid cognitive overload. Educational neuroscience offers innovative processes and methodologies to analyze cognitive load based on physiological measures. Observing psychophysiological changes when they occur in response to the course of a learning session allows adjustments in the learning session based on the individual learner's capabilities. The availability of non-invasive electroencephalogram (EEG)-based devices and advanced near-real-time analysis techniques have improved our understanding of the underlying mechanisms and have impacted the way we design instructional methods and adapt them to the current learner's cognitive load and valence states. We review Cognitive Load Theory, how cognitive load may be measured, and how analysis of EEG data can be applied to enhance learning through real-time measurements of the learner's cognitive load. We show an experiment that provides a proof of concept of real-time measures based on EEG indicators and of mental states during learning.
How to Cite
##plugins.themes.bootstrap3.article.details##
cognitive load, EEG, adaptive learning
ANSARI, D., DE SMEDT, B., AND GRABNER, R. H. 2012. Neuroeducation – a critical overview of an emerging field. Neuroethics, 5(2), 105–117. http://doi.org/10.1007/s12152- 011-9119-3
ANTONENKO, P., PAAS, F., GRABNER, R., AND VAN GOG, T. 2010. Using electroencephalography to measure cognitive load. Educational Psychology Review, 22(4), 425–438. http://doi.org/10.1007/s10648-010-9130-y
BANNERT, M. 2002. Managing cognitive load — recent trends in cognitive load theory. Learning and Instruction, 12, 139–146.
BASAR, E., BASAR-EROGLU, C., KARAKAS, S., AND SCHÜRMANN, M. 1999. Oscillatory brain theory: a new trend in neuroscience. IEEE Engineering in Medicine and Biology Magazine: The Quarterly Magazine of the Engineering in Medicine and Biology Society, 18(3), 56–66. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/10337564
BAŞAR, E., BAŞAR-EROGLU, C., KARAKAŞ, S., AND SCHÜRMANN, M. 2001. Gamma, Alpha, delta, and Theta oscillations govern cognitive processes. International Journal of Psychophysiology, 39(2-3), 241–248. http://doi.org/10.1016/S01678760(00)00145-8
BORGHINI, G., ASTOLFI, L., VECCHIATO, G., MATTIA, D., AND BABILONI, F. 2012. Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness. Neuroscience and Biobehavioral Reviews, 44, 58–75. http://doi.org/10.1016/j.neubiorev.2012.10.003
BROUWER, A.-M., HOGERVORST, M. A, VAN ERP, J. B. F., HEFFELAAR, T., ZIMMERMAN, P. H., AND OOSTENVELD, R. 2012. Estimating workload using EEG spectral power and ERPs in the n-back task. Journal of Neural Engineering, 9(4), 045008. http://doi.org/10.1088/1741-2560/9/4/045008
BUCCINO, G., VOGT, S., RITZL, A., FINK, G. R., ZILLES, K., FREUND, H., AND RIZZOLATTI, G. 2004. Of hand actions: an event-related FMRI study. Neuron,42, 323– 334.
CAIN, B. 2004. A Review of the mental workload literature. In NATO RTO-TR-HFM- 121- Part-II (pp. 4–1 – 4–34). Retrieved from http://www.dtic.mil/cgibin/GetTRDoc?Location=U2&doc=GetTRDoc.pdf&AD=ADA474193
CAREW, T. J., AND MAGSAMEN, S. H. 2010. Neuroscience and education: an ideal partnership for producing evidence-based solutions to Guide 21(st) Century Learning. Neuron, 67(5), 685–8. http://doi.org/10.1016/j.neuron.2010.08.028
CHANDLER, P., AND SWELLER, J. 1991. Cognitive load theory and the format of Instruction. Cognition and Instruction, 8(4), 293–332.
CHIK, D. 2013. Theta-Alpha cross-frequency synchronization facilitates working memory control – a modeling study. SpringerPlus, 2(1), p.14. http://doi.org/10.1186/2193-1801-2- 14
COOPER, G. 2008. Research into cognitive load theory and instructional design at UNSW. Retrieved from http://dwb4.unl.edu/QQQ/SW/UNSW.htm 2/27/2008
DAS, R., CHATTERJEE, D., DAS, D., SINHARAY, A., & SINHA, A. 2014. Cognitive load measurement - A methodology to compare low cost commercial EEG devices. In 2014 International Conference on Advances in Computing, Communications and Informatics (ICACCI) (pp. 1188–1194). IEEE. http://doi.org/10.1109/ICACCI.2014.6968528
DELEEUW, K. E., AND MAYER, R. E. 2008. A comparison of three measures of cognitive load: Evidence for separable measures of intrinsic, extraneous, and germane load. Journal of Educational Psychology, 100(1), 223–234. http://doi.org/10.1037/0022-0663.100.1.223
DEVONSHIRE, I. M., AND DOMMETT, E. J. 2010. Neuroscience: viable applications in education? The Neuroscientist: A Review Journal Bringing Neurobiology, Neurology and Psychiatry, 16(4), 349–56. http://doi.org/10.1177/1073858410370900
DIRICAN, A. C., AND GÖKTÜRK, M. 2011. Psychophysiological measures of human cognitive states applied in human computer interaction. Procedia Computer Science, 3, 1361–1367. http://doi.org/10.1016/j.procs.2011.01.016
EVERHART, D. E., AND DEMAREE, H. A. 2003. Low Alpha power (7.5-9.5 Hz) changes during positive and negative affective learning. Cognitive, Affective and Behavioral Neuroscience, 3(1), 39–45. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/12822597
EWING, K. C., AND FAIRCLOUGH, S. H. 2010. The effect of an extrinsic incentive on psychophysiological measures of mental effort and motivational disposition when task demand is varied. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 54(3), 259–263. http://doi.org/10.1177/154193121005400316
EYSINK, T. H. S., AND DE JONG, T. 2012. Does instructional approach matter? How elaboration plays a crucial role in multimedia learning. Journal of the Learning Sciences, 21(4), 583–625. http://doi.org/10.1080/10508406.2011.611776
FINK, A, GRABNER, R. H., NEUPER, C., AND NEUBAUER, A. C. 2005. EEG Alpha band dissociation with increasing task demands. Cognitive Brain Research, 24(2), 252–259. http://doi.org/10.1016/j.cogbrainres.2005.02.002
GEVINS, A., SMITH, M. E., LEONG, H., MCEVOY, L., WHITFIELD, S., DU, R., and RUSH, G. 1998. Monitoring working memory load during computer-based tasks with EEG pattern recognition methods. Human Factors, 40(1), 79–91. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/9579105
GEORGEON, O. L., AND RITTER, F. E. 2012. An intrinsically-motivated schema mechanism to model and simulate emergent cognition. Cognitive Systems Research, 15- 16, 73–92. http://doi.org/10.1016/j.cogsys.2011.07.003
GERJETS, P., SCHEITER, K., AND CATRAMBONE, R. 2004. Designing instructional examples to reduce intrinsic cognitive load: molar versus modular presentation of solution procedures. Instructional Science, 32(1/2), 33–58. http://doi.org/10.1023/B:TRUC.0000021809.10236.71
GEVINS, A., SMITH, M. E., LEONG, H., MCEVOY, L., WHITFIELD, S., DU, R., and RUSH, G. 1998. Monitoring working memory load during computer-based tasks with EEG pattern recognition methods. Human Factors, 40(1), 79–91. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/9579105
GOLDMAN, S. R. 2009. Explorations of relationships among learners, tasks, and learning. Learning and Instruction, 19(5), 451–454. http://doi.org/10.1016/j.learninstruc.2009.02.006
GOSWAMI, U., AND SZŰCS, D. 2011. Educational neuroscience: developmental mechanisms: Towards a conceptual framework. NeuroImage, 57(3), 651–658. http://doi.org/10.1016/j.neuroimage.2010.08.072
GRIMES, D., TAN, D. S., HUDSON, S. E., SHENOY, P., AND RAO, R. P. N. 2008. Feasibility and pragmatics of classifying working memory load with an electroencephalograph. In Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems - CHI ’08 (p. 835). New York, New York, USA: ACM Press. http://doi.org/10.1145/1357054.1357187
HANCOCK, P. A., AND MESHKATI, N. 1988. Human mental workload. Amsterdam: North-Holland.
HÖFFLER, T. N., AND LEUTNER, D. 2007. Instructional animation versus static pictures: a meta-analysis. Learning and Instruction, 17(6), 722–738. http://doi.org/10.1016/j.learninstruc.2007.09.013
HOLM, A., LUKANDER, K., KORPELA, J., SALLINEN, M., AND MÜLLER, K. M. I. 2009. Estimating brain load from the EEG. The Scientific World Journal, 9, 639–51. http://doi.org/10.1100/tsw.2009.83
IMMORDINO-YANG, M. H., AND FISCHER, K. W. 2010. Neuroscience bases of learning. International encyclopedia of education, 3, 310-16.
KLIMESCH, W. 1999. EEG Alpha and Theta oscillations reflect cognitive and memory performance: a review and analysis. Brain Research Reviews, 29(2-3), 169–195. http://doi.org/10.1016/S0165-0173(98)00056-3
KOHLMORGEN, J., DORNHEGE, G., BRAUN, M., BLANKERTZ, B., MÜLLER, K. R., CURIO, G., ... AND KINCSES, W. 2007. Improving human performance in a real operating environment through real-time mental workload detection. Toward BrainComputer Interfacing, 409-422.
LEI, S., AND ROETTING, M. 2011. Influence of task combination on EEG spectrum modulation for driver workload estimation. Human Factors: The Journal of the Human Factors and Ergonomics Society, 53(2), 168–179. http://doi.org/10.1177/0018720811400601
LEPPINK, J., PAAS, F., VAN DER VLEUTEN, C. P. M., VAN GOG, T., AND VAN MERRIËNBOER, J. J. G. 2013. Development of an instrument for measuring different types of cognitive load. Behavior Research Methods, 45(4), 1058–1072. http://doi.org/10.3758/s13428-013-0334-1
LYSAGHT, R. J., HILL, S. G., DICK, A. O., PLAMONDON, B. D., LINTON, P. M., WIERWILLE, W. W., ... WHERRY, R. J. 1989. Operator workload: comprehensive review and evaluation of operator workload methodologies. United States Army Research Institute for the Behavioral Sciences, Technical Report. Alexandria, Virginia.
MAYER, R. E., AND MORENO, R. 2003. Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38(1), 43–52. http://doi.org/10.1207/S15326985EP3801_6
MCEVOY, L. K., SMITH, M. E., AND GEVINS, A. 1998 Dynamic cortical networks of verbal and spatial working memory: effects of memory load and task practice. Cerebral Cortex, 8(7), 563–74. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/9823478
MICHELS, L., MOAZAMI-GOUDARZI, M., JEANMONOD, D., and SARNTHEIN, J. 2008. EEG Alpha distinguishes between cuneal and precuneal activation in working memory. NeuroImage, 40(3), 1296–310. http://doi.org/10.1016/j.neuroimage.2007.12.048
MORRISON, G. R., AND ANGLIN, G. J. 2005. Research on cognitive load theory: Application to e-learning. Educational Technology Research and Development, 53(3), 94– 104. http://doi.org/10.1007/BF02504801
PAAS, F., RENKL, A., AND SWELLER, J. 2004. Cognitive load theory: instructional implications of the interaction between information structures and cognitive architecture. Instructional Science, 32(1/2), 1–8. http://doi.org/10.1023/B:TRUC.0000021806.17516.d0
PAAS, F., TUOVINEN, J. E., TABBERS, H., AND VAN GERVEN, P. W. M. 2003. Cognitive load measurement as a means to advance cognitive load theory. Educational Psychologist, 38(1), 63–71. http://doi.org/10.1207/S15326985EP3801_8
PLASS, J. L., HEIDIG, S., HAYWARD, E. O., HOMER, B. D., AND UM, E. 2013. Emotional design in multimedia learning: Effects of shape and color on affect and learning. Learning and Instruction. http://doi.org/10.1016/j.learninstruc.2013.02.006
PARASURAMAN, R. 2003. Neuroergonomics: Research and practice. Theoretical Issues in Ergonomics Science, 4(1-2), 5–20. http://doi.org/10.1080/14639220210199753
PARASURAMAN, R., SHERIDAN, T. B., AND WICKENS, C. D. 2008. Situation awareness, mental workload, and trust in automation: Viable, empirically supported cognitive engineering constructs. Journal of Cognitive Engineering and Decision Making, 2(2), 140–160. http://doi.org/10.1518/155534308X284417.
PENARANDA, B. N., AND BALDWIN, C. L. 2012. Temporal factors of EEG and artificial neural network classifiers of mental workload. Proceedings of the Human Factors and Ergonomics Society Annual Meeting. http://doi.org/10.1177/1071181312561016
PICKUP, L., WILSON, J. R., SHARPIES, S., NORRIS, B., CLARKE, T., AND YOUNG, M. S. 2005. Fundamental examination of mental workload in the rail industry. Theoretical Issues in Ergonomics Science, 6(6), 463–482. http://doi.org/10.1080/14639220500078021
REBSAMEN, B., KWOK, K., AND PENNEY, T. B. 2011. Evaluation of cognitive workload from eeg during a mental arithmetic task. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 55(1), 1342–1345. http://doi.org/10.1177/1071181311551279
REINER, M., AND GELFELD, T. M. 2014. Estimating mental workload through eventrelated fluctuations of pupil area during a task in a virtual world. International Journal of Psychophysiology: Official Journal of the International Organization of Psychophysiology, 93(1), 38–44. http://doi.org/10.1016/j.ijpsycho.2013.11.002
ROBERTS, D. M., TAYLOR, B. A., BARROW, J. H., ROBERTSON, G., BUZZELL, G., SIBLEY, C., ... BALDWIN, C. L. 2010. EEG spectral analysis of workload for a part-task UAV simulation. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 54(3), 200–204. http://doi.org/10.1177/154193121005400303
RUBIO, S., DÍAZ, E., MARTÍN, J., AND PUENTE, J. M. 2004. Evaluation of subjective mental workload: A Comparison of SWAT, NASA-TLX, and workload profile methods. Applied Psychology: An International Review, 53(1), 61–86.
RYU, K., AND MYUNG, R. 2005. Evaluation of mental workload with a combined measure based on physiological indices during a dual task of tracking and mental arithmetic. International Journal of Industrial Ergonomics, 35(11), 991–1009. http://doi.org/10.1016/j.ergon.2005.04.005
SAMMER, G. 1996. Working-memory load and dimensional complexity of the EEG. International Journal of Psychophysiology, 24(1-2), 173–182. http://doi.org/10.1016/S0167-8760(96)00070-0
SMITH, M. E., GEVINS, A., BROWN, H., KARNIK, A., AND DU, R. 2001. Monitoring task loading with multivariate EEG measures during complex forms of human-computer interaction. Human Factors: The Journal of the Human Factors and Ergonomics Society, 43(3), 366–380. http://doi.org/10.1518/001872001775898287
SWELLER, J. 1988. Cognitive load during problem solving: Effects on learning. Cognitive Science, 12(2), 257–285. http://doi.org/10.1016/0364-0213(88)90023-7
SWELLER, J. 2010. Element interactivity and intrinsic, extraneous, and germane cognitive load. Educational Psychology Review, 22(2), 123–138. http://doi.org/10.1007/s10648-010- 9128-5
TABBERS, H. K., MARTENS, R. L., AND MERRIËNBOER, J. J. G. 2004. Multimedia instructions and cognitive load theory: Effects of modality and cueing. British Journal of Educational Psychology, 74(1), 71–81. http://doi.org/10.1348/000709904322848824
TEPLAN, M. 2002. Fundamentals of EEG Measurement. Measurement Science Review,2(2), 1–11.
VAN MERRIËNBOER, J. J. G., and SWELLER, J. 2005. Cognitive load theory and complex learning: Recent developments and future directions. Educational Psychology Review, 17(2), 147–177. http://doi.org/10.1007/s10648-005-3951-0
WARD, L. M. 2003. Synchronous neural oscillations and cognitive processes. Trends in Cognitive Sciences, 7(12), 553–559. http://doi.org/10.1016/j.tics.2003.10.012
WHELAN, R. R. 2007. Neuroimaging of cognitive load in instructional multimedia. Educational Research Review, 2(1), 1–12. http://doi.org/10.1016/j.edurev.2006.11.001
WICKENS, C. D. 2008. Multiple resources and mental workload. Human Factors: The Journal of the Human Factors and Ergonomics Society, 50(3), 449–455. http://doi.org/10.1518/001872008X288394
XIE, B., AND SALVENDY, G. 2000. Prediction of mental workload in single and multiple tasks environments. International Journal of Cognitive Ergonomics, 4(3), 213–242.
YUAN, Y., CHANG, K. M., XU, Y., & MOSTOW, J. 2014. A public toolkit and its dataset for EEG. In Proceedings of the ITS2014 Workshop on Utilizing EEG Input in Intelligent Tutoring Systems, 49.
ZARJAM, P., EPPS, J., AND CHEN, F. 2011. Characterizing working memory load using EEG delta activity. 19th European Signal Processing Conference (EUSIPCO 2011), 1554–1558.
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Authors who publish with this journal agree to the following terms:
- The Author retains copyright in the Work, where the term “Work” shall include all digital objects that may result in subsequent electronic publication or distribution.
- Upon acceptance of the Work, the author shall grant to the Publisher the right of first publication of the Work.
- The Author shall grant to the Publisher and its agents the nonexclusive perpetual right and license to publish, archive, and make accessible the Work in whole or in part in all forms of media now or hereafter known under a Creative Commons 4.0 License (Attribution-Noncommercial-No Derivatives 4.0 International), or its equivalent, which, for the avoidance of doubt, allows others to copy, distribute, and transmit the Work under the following conditions:
- Attribution—other users must attribute the Work in the manner specified by the author as indicated on the journal Web site;
- Noncommercial—other users (including Publisher) may not use this Work for commercial purposes;
- No Derivative Works—other users (including Publisher) may not alter, transform, or build upon this Work,with the understanding that any of the above conditions can be waived with permission from the Author and that where the Work or any of its elements is in the public domain under applicable law, that status is in no way affected by the license.
- The Author is able to enter into separate, additional contractual arrangements for the nonexclusive distribution of the journal's published version of the Work (e.g., post it to an institutional repository or publish it in a book), as long as there is provided in the document an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post online a pre-publication manuscript (but not the Publisher’s final formatted PDF version of the Work) in institutional repositories or on their Websites prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (see The Effect of Open Access). Any such posting made before acceptance and publication of the Work shall be updated upon publication to include a reference to the Publisher-assigned DOI (Digital Object Identifier) and a link to the online abstract for the final published Work in the Journal.
- Upon Publisher’s request, the Author agrees to furnish promptly to Publisher, at the Author’s own expense, written evidence of the permissions, licenses, and consents for use of third-party material included within the Work, except as determined by Publisher to be covered by the principles of Fair Use.
- The Author represents and warrants that:
- the Work is the Author’s original work;
- the Author has not transferred, and will not transfer, exclusive rights in the Work to any third party;
- the Work is not pending review or under consideration by another publisher;
- the Work has not previously been published;
- the Work contains no misrepresentation or infringement of the Work or property of other authors or third parties; and
- the Work contains no libel, invasion of privacy, or other unlawful matter.
- The Author agrees to indemnify and hold Publisher harmless from Author’s breach of the representations and warranties contained in Paragraph 6 above, as well as any claim or proceeding relating to Publisher’s use and publication of any content contained in the Work, including third-party content.