涓€绋€氶亷scout ESI鍜孋NN瑙g⒓EEG閬嬪嫊鎯宠薄鍥�鍒�椤炰换鍕欑殑鏂版柟娉�
灏庤畝鏉卞寳闆诲姏澶у鍜岄暦鏄ョ悊宸ュぇ瀛哥爺绌跺湗闅婇枊鐧煎苟瀵︾従涓€绋祼鍚堣叇闆诲湒婧愭垚鍍�(ESI)鎶€琛撳拰鍗风⿳绁炵稉缍茬怠(CNN)鐨勬柊鏂规硶锛屼互灏嶉亱鍕曟兂璞�(MI)浠诲嫏閫茶鍒嗛銆侲SI鎶€琛撻噰鐢ㄩ倞鐣屽厓娉�(BEM)鍜屽姞娆婃渶灏忚寖鏁镐及瑷�(WMNE)鍒嗗垾瑙f焙EEG鐨勬鍚戝拰閫嗗悜鍟忛銆傜劧鍚庡湪閬嬪嫊鐨堡涓壍寤哄崄鍊媠cout渚嗛伕鎿囨劅鑸堣叮鐨勫崁鍩�(ROI)銆傜爺绌惰€呬娇鐢∕orlet灏忔尝鏂规硶寰瀞cout鐨勬檪闁撳簭鍒椾腑鎻愬彇鐗瑰緛銆傛渶鍚�锛屼娇鐢–NN灏峂I浠诲嫏閫茶鍒嗛銆傚椹楃祼鏋�:鍦≒hysionet鏁告摎搴笂鐨勬暣楂斿钩鍧囨簴纰虹巼閬斿埌94.5%锛屽垎鍒ュ皪宸︽嫵闋�銆佸彸鎷抽牠銆侀洐鎷冲拰闆欒叧鐨勫柈鍊嬫簴纰虹巼閬斿埌95.3%銆�93.3%銆�93.6%銆�96%锛岄噰鐢ㄥ崄鍊嶄氦鍙夐璀夐€茶椹楄瓑銆傜爺绌朵汉鍝¤〃绀�锛屼粬鍊戠殑鐮旂┒鎴愭灉鑸囨渶鍏堥€茬殑MI鍒嗛鏂规硶鐨勭祼鏋滅浉姣�锛岀附楂斿垎椤炲鍔犱簡14.4%銆傜爺绌惰€呯偤椹楄瓑鏂规硶鐨勬湁鏁堟€�锛屽姞鍏ヤ簡4鍊嬫柊鐨勫彈瑭﹁€呴€茶椹楄瓑锛岀櫦鐝剧附楂斿钩鍧囨簴纰虹巼鐐�92.5%銆傛澶�锛屽叏灞€鍒嗛鍣ㄩ仼鎳夊柈涓€灏嶈薄锛屾暣楂斿钩鍧囨簴纰虹巼鎻愰珮鍒�94.54%銆傜爺绌惰€呰〃绀�锛屼粬鍊戞彁鍑虹殑绲愬悎scout ESI鍜孋NN鐨勬柟娉�锛屾彁楂樹簡鑵﹂浕瑙g⒓鍥涢MI浠诲嫏鐨凚CI鎬ц兘銆傜郴绲辨鏋跺湒1 绯荤当妗嗘灦鍦栫郴绲辨鏋跺鍦�1鎵€绀�銆傚師濮嬫暩鎿氫締鑷湅闅�10-10绯荤当鐨�64鍊嬮浕妤�(涓嶅寘鎷琋z銆丗9銆丗10銆丗T9銆丗T10銆丄1銆丄2銆乀P9銆乀P10銆丳9鍜孭10闆绘サ)锛屽苟浠ユ瘡绉�160鍊嬫ǎ鏈殑閫熷害閲囬泦銆傛牴鎿氬湅闅�10-10绯荤当寰�64鍊嬮€氶亾閲囬泦鍘熷鑵﹂浕鍦�锛屽苟浣跨敤BCI2000绯荤当閫茶瑷橀寗銆傝閷勭殑鏁告摎琚垎鐐哄洓鍊嬬崹绔婱I浠诲嫏鍖呮嫭宸︽嫵MI,鍙虫嫵MI,闆欐嫵MI鍜岄洐鑵矼I銆傞鍏堬紝鐢变簬ERD鍦ㄥ煼琛岄亱鍕曟兂璞℃檪鍦╝lpha鍜宐eta涓笉鍚�锛屽洜姝や娇鐢‵IR婵炬尝鍣ㄥ皪EEG閫茶浜�8 Hz鑷�30 Hz鐨勫付閫氭烤娉€€傜劧鍚庯紝閫氶亷瑷堢畻鍖呭惈姝e晱椤屽拰閫嗗晱椤岀殑婧�锛屽皣鍌虫劅鍣ㄧ┖闁撶殑娲诲嫊杞夊寲鐐烘簮绌洪枔鐨勬椿鍕�銆傛帴涓嬩締锛屽壍寤簊cout骞舵彁鍙栫壒寰併€傜爺绌惰€呭湪閬嬪嫊鐨堡涓壍寤轰簡10鍊媠cout锛屽洜鐐烘垜鍊戝彧闂滃績鑸囬亱鍕曠浉闂滅殑娲诲嫊銆傚崄鍊媠cout涓殑姣忎竴鍊嬮兘浠h〃浜嗗彲鐢ㄦ簮绌洪枔涓殑涓€鍊嬫劅鑸堣叮鐨勫崁鍩�(ROI)锛屽苟涓旀槸瀹氱京鍦ㄧ毊灞よ〃闈㈡垨闋儴楂旂⿳涓婄殑鍋舵サ瀛愮殑瀛愰泦銆傚乏鑵︾殑scout绋辩偤L1銆丩2銆丩3銆丩4銆丩5锛屽彸鑵︾殑scout绋辩偤R1銆丷2銆丷3銆丷4銆丷5銆傚埄鐢↗TFA寰�10鍊媠cout鐨勬簮鏅傞枔搴忓垪涓彁鍙栫壒寰�銆傛渶鍚�锛屽埄鐢–NN灏嶆檪闋诲湒閫茶鍒嗛洟骞堕€茶鍒嗛銆傚椹楀湪瀵﹂涓�锛岀爺绌朵汉鍝″儏浣跨敤浜嗛毃姗熼伕鎿囩殑鍗佸€嬪彈瑭﹁€呯殑MI trail (S5锛孲6锛孲7锛孲8锛孲9锛孲10锛孲11锛孲12锛孲13锛孲14)銆傞€欓噷鐢ㄤ簬鍒嗘瀽鐨勬暩鎿氶泦鍖呭惈姣忓€嬪彈瑭﹁€�84娆¤│椹�锛屾瘡涓€椤炲寘鍚�21娆¤│椹椼€傚湪瑷橀寗64閫氶亾鑵﹂浕鍦栨檪锛屽彈瑭﹁€呭煼琛屼簡涓嶅悓鐨勯亱鍕曟兂璞′换鍕�銆傛瘡鍊嬪彈瑭﹁€呴嚌灏嶄互涓嬪洓鍊嬩换鍕欎腑鐨勬瘡涓€鍊嬪煼琛屼簡3杓�21瑭﹂锛氱暥鐩鍑虹従鍦ㄥ睆骞曞乏鍋存檪锛屽彈瑭﹁€呮兂璞℃墦闁嬪拰鍚堜笂鐩告噳鐨勬嫵闋�锛岀洿鍒扮洰妯欐秷澶�銆傜劧鍚庡彈瑭﹁€呮斁鏉俱€傜暥鐩鍑虹従鍦ㄥ睆骞曠殑鍙冲伌鏅�锛屽彈瑭﹁€呮兂璞℃墦闁嬪拰鍚堜笂鐩告噳鐨勬嫵闋�锛岀洿鍒扮洰妯欐秷澶�銆傜劧鍚庡彈瑭﹁€呮斁鏉俱€傜暥鐩鍑虹従鍦ㄥ睆骞曢爞閮ㄦ檪锛屽彈瑭﹁€呮兂璞℃墦闁嬪拰鍚堜笂闆欐墜鐨勬嫵闋�锛岀洿鍒扮洰妯欐秷澶便€傜劧鍚庡彈瑭﹁€呮斁鏉俱€傜暥鐩鍑虹従鍦ㄥ睆骞曞簳閮ㄦ檪锛岀洰妯欐渻鎯宠薄闆欒叧寮甸枊鍜屽悎鏀忥紝鐩村埌鐩娑堝け銆傜劧鍚庡彈瑭﹁€呮斁鏉俱€傜偤浜嗙当涓€鏁告摎缍暩锛岀爺绌惰€呴伕鎿囦簡4s鐨勬暩鎿�锛屽洜鐐烘瘡娆℃兂璞′换鍕欑殑鍩疯鏅傞枔閮藉湪4s宸﹀彸銆傛澶�锛岃叇闆诲湒浠诲嫏鏄垎闁嬬殑锛岀爺绌朵汉鍝″湪瀵﹂涓皣宸︽嫵锛屽彸鎷�锛岄洐鎷冲拰闆欒叧MI浠诲嫏鍒嗗垾绋辩偤T1锛孴2锛孴3鍜孴4銆傚湒2 scout鍛藉悕宸﹀彸閬嬪嫊鎯宠薄鐨剆cout鍒嗗垾鍛藉悕鐐篖1銆丩2銆丩3銆丩4銆丩5銆丷1銆丷2銆丷3銆丷4銆丷5锛屽鍦�2鎵€绀�銆�10鍊媠cout姣忎竴鍊嬮兘琚摯灞曞埌40鍊嬮爞榛烇紝姣忓€嬮爞榛炲彧鏈変竴鍊嬫簮銆侺1鍗€鍩熷皪鎳�40鍊嬩俊铏�锛屽叾浠杝cout涔熶竴妯c€傚湪瑷堢畻浜嗕締婧愬悗锛岀爺绌惰€呭湪閬嬪嫊鐨堡涓壍寤轰簡鍗佸€媠cout锛屽鍦�3鎵€绀�銆傚湒3 鍓靛缓10鍊媠cout浣跨敤ESI瑷堢畻鍗佸€嬪彈瑭﹁€�(S5銆丼6銆丼7銆丼8銆丼9銆丼10銆丼11銆丼12銆丼13銆丼14)姣忔瑭﹂鐨勫洓鍊嬩换鍕�(T1銆乀2銆乀3銆乀4)鐨勬簮銆傚皪浜庨€欏洓闋呬换鍕欎腑鐨勬瘡涓€闋咃紝姣忓€嬪彈瑭﹁€呮瘡娆¢兘瑕侀€茶7娆℃脯瑭�(#1锛�#2锛�#3锛�#4锛�#5锛�#6锛�#7)銆傚睍绀轰簡绗竴鍊嬫鐨�10鍊嬭瑭︾殑10鍊媠cout鐨�4闋呬换鍕欑殑渚嗘簮銆傜劧鍚庢彁鍙�10鍊媠cout鐨勬檪闁撳簭鍒楅€茶閫蹭竴姝ュ垎鏋�銆傜壒寰佹彁鍙栧湪瑷堢畻婧愪箣鍚�锛岀爺绌朵汉鍝″湪閬嬪嫊鐨堡涓壍寤轰簡鍖呭惈40鍊嬫簮鐨�10鍊媠cout锛屽苟鎻愬彇浜唖cout鐨勬檪闁撳簭鍒�銆傚鍦�4鎵€绀虹偤鎻愬彇R5 scout鏅傞枔搴忓垪浣滅偤绀轰緥銆傚湒鐨勫彸閭婇’绀轰簡R5 scout鐨勬檪闁撳簭鍒椼€傛湰鏂囧埄鐢ㄥ皬娉㈣畩鎻涘緸scout鏅傞枔搴忓垪涓彁鍙栫壒寰�銆傚湒4 鎻愬彇R5 scout鏅傞枔搴忓垪浣滅偤绀轰緥鍦ㄩ€欓爡鐮旂┒涓�锛岀爺绌惰€呮彁鍑哄埄鐢–NN渚嗚В姹洪亱鍕曟兂璞′换鍕欏垎椤炵殑鍟忛銆傝┎妯″瀷鍩轰簬Schirrmeister绛夋彁鍑虹殑Deep ConvNet鏋舵锛岃┎缍茬怠妯″瀷鐢变竴鍊嬪叚灞ゅ嵎绌嶇恫绲$祫鎴�锛屽叾涓叐鍊嬫渶澶ф睜灞ゅ拰涓夊€嬪叏閫f帴灞�锛屽鍦�5鎵€绀恒€傚湒5灏嶄簬Physionet鏁告摎搴�锛岀爺绌惰€呴鍏堥噰鐢―eep ConvNet鏋舵锛屽寘鎷洓鍊嬪嵎绌嶅堡銆佸洓鍊嬫渶澶ф睜灞ゅ拰涓€鍊嬪叏閫f帴灞�銆傚湪瀵﹂涓紝鐮旂┒鑰呬緷鎿氱稉椹椾娇鐢ㄥ叐鍊嬫渶澶ф睜鍖栧堡銆傚苟鍢楄│浜嗕笉鍚屾暩閲忕殑鍗风⿳灞ゅ拰瀹屽叏閫f帴灞�銆傛檪闋诲湒鍒╃敤Morlet灏忔尝鏂规硶寰楀埌浜唖cout鐨勭壒寰�銆傚皪浜庢瘡鍊嬩换鍕�锛孯5 scout鐨勬檪闋诲湒濡傚湒6鎵€绀�銆傚寘鍚檪闁撳拰闋荤巼浜掕鐨勬檪闋诲垎鏋愭柟娉曟彁渚涗簡鏅傚煙鍜岄牷鍩熺殑鑱悎鍒嗗竷淇℃伅锛屾竻鏅板湴鎻忚堪浜嗕俊铏熼牷鐜囪垏鏅傞枔鐨勯棞绯汇€傚湒6 R5 scout鐨勬檪闋诲湒椤劧锛屽彧鏈夐儴鍒嗘檪闋绘槧灏勬槸绱呰壊鐨勶紝琛ㄦ槑姣忓€嬩换鍕欏彧灏嶇壒瀹氱殑闋荤巼鍜屾檪闁撴晱鎰�銆傜敱浜庡湒鐨勬暩閲忔瘮杓冨ぇ锛岀爺绌惰€呬娇鐢–NN渚嗛伕鎿囧拰瀛哥繏閫欎簺鍦栦腑鏈€鍩烘湰鐨勭壒寰�銆傜爺绌朵汉鍝¢毃姗熼伕鎿囦簡骞惧€嬫ǎ鏈�锛屽苟灏囦竴浜涚壒寰佸湒鍙鍖栵紝浣滅偤MI浠诲嫏鐨勫缈掕〃绀�锛屽鍦�7鎵€绀恒€傚湒7鐐轰簡鐛插緱鏈夋晥鐨勭祼鏋�锛屽皣鏁告摎闆嗗垎鐐�90锛呬綔鐐鸿〒绶撮泦锛屽叾浣�10锛呬綔鐐烘脯瑭﹂泦銆傞鍏堬紝灏囧崄鍊嬪彈瑭﹁€呯殑鏁告摎闆嗭紙绺藉叡19320鍊嬫ǎ鏈級鍒嗙偤17388鍊嬫ǎ鏈互瑷撶反鎵€鎻愬嚭鐨凜NN妯″瀷锛屼互鍙�1932鍊嬫ǎ鏈互椹楄瓑妯″瀷鐨勬湁鏁堟€с€傚湪瀵﹂涓紝鐮旂┒鑰呴倓閬告搰浜嗗彟澶栧洓鍊嬪彈瑭﹁€呯殑鏁告摎闆嗕互澧炲姞鏁告摎闆嗙殑瑕忔ā(27048鍊嬫ǎ鏈�)锛屽叾涓�24343鍊嬫ǎ鏈槸瑷撶反闆�锛屽叾浠栨ǎ鏈槸娓│闆嗐€傚湪閬稿畾鐨剆cout涓婂皪鎵€鎻愬嚭鐨凜NN鏋舵閫茶浜嗗崄娆¤〒绶村拰娓│锛屼互椹楄瓑鎵€鎻愬嚭妯″瀷鐨勯妫掓€�銆傚湒8(a)椤ず浜�10鍊媠cout涓瘡鍊嬬殑鍏ㄥ眬骞冲潎绮惧害銆傚湒8 绲辫▓绲愭灉R5鐨勫叏灞€骞冲潎绮惧害鏈€楂�锛岄仈鍒�94.5%锛岃€孡2鐨勫叏灞€骞冲潎绮惧害鏈€浣�锛岀偤91.3%銆傚皪鎳塋1銆丩3銆丩4銆丩5銆丷1銆丷2銆丷3銆丷4鐨勬暣楂旀簴纰虹巼鍒嗗垾鐐�92.4%銆�92.5%銆�93.6%銆�91.9%銆�93.0%銆�91.8%銆�92.1%銆�92.6%銆傛墍鏈塻cout鐨勭附楂旂簿搴﹀潎鍦�91%浠ヤ笂锛屾婧栧樊鍧囧湪0.20%浠ヤ笅銆傚湒8(b)椤ず浜嗗崄鍊媠cout涓瘡鍊媠cout鍥涘€婱I浠诲嫏鐨勭祫绱氱当瑷堢祼鏋滃強鍏舵婧栧樊銆備竴鑸締瑾�锛孯5琛ㄧ従鐨勮姣斿叾浠栫殑濂�锛岃€孡2鍦ㄨ凯浠�2000涓〃鐝炬渶宸�銆傛婧栧樊杓冨皬锛岃鏄庨€欎簺绮惧害鏇存帴杩戝钩鍧囧€间笖绌╁畾銆傚湒9 绲辫▓绲愭灉鍦�9(a)椤ず浜嗗付鏈夋婧栧樊鐨勬贩娣嗙煩闄o紝瑾槑浜唃roup level鍒嗛绲愭灉銆俆1銆乀2銆乀3鍜孴4鐨勫叏灞€骞冲潎绮惧害宄板€煎垎鍒ョ偤95.3%銆�93.3%銆�93.6%鍜�96.0%銆俁5 scout鐨勫洓鍊婱I浠诲嫏涓殑姣忎竴鍊嬮兘濡傚湒9(b)鎵€绀�銆傞€氶亷鏀硅畩瑷撶反闆嗗拰娓│闆嗛爢搴忕殑10娆¤│椹�锛岀⒑瀹氫簡scoutR5鐨勬€ц兘锛岀祼鏋滃鍦�10(a)鍜�(b)鎵€绀�銆傚湪10娆¤│椹椾腑锛宻cout R5鐨凾1銆乀2銆乀3銆乀4鐨勫钩鍧囨簴纰虹巼鍒嗗垾鐐�93.3%銆�93.8%銆�94.2%銆�94.1%銆傛彌鍙ヨ┍瑾紝鍥涘€嬩换鍕欎腑姣忎竴鍊嬬殑骞冲潎婧栫⒑鐜囬兘瓒呴亷浜�93%銆傚叏灞€骞冲潎婧栫⒑鐜囩偤93.7%銆�10娆¤│椹楃祼鏋滆〃鏄�锛岃┎鏂规硶灏峴cout R5鐨勫垎椤炴晥鏋滆純濂姐€傚緸浠ヤ笂绲愭灉鍙互娓呮鍦扮湅鍑�锛孯5 scout鍦ㄥ洓绋甅I浠诲嫏鐨勫垎椤炰腑鎵紨钁楁渶閲嶈鐨勮鑹�銆傚洜姝�锛岄伕鎿嘡5灏嶅洓鍊婱I浠诲嫏閫茶鍒嗛銆傚湒 10鍦�11. (a)鏄笉鍚屾ā鍨嬬殑鍏ㄥ眬骞冲潎婧栫⒑鎬х殑姣旇純銆傚彲浠ョ櫦鐝�锛岃┎鐮旂┒鎻愬嚭鐨勬ā鍨嬪彲浠ラ仈鍒版渶澶х殑绮惧害銆傚緸鍦�11. (b)涓嶅悓妯″瀷鐨凴OC鏇茬窔鍙互鐪嬪嚭鎻愬嚭鐨勬ā鍨嬫瘮鍏朵粬妯″瀷琛ㄧ従鏇村ソ銆�?涓嶅悓妯″瀷T1涓婄殑绮惧害姣旇純銆�(d)涓嶅悓妯″瀷T2鐨勭簿搴︽瘮杓�銆�(e)涓嶅悓妯″瀷T3鐨勭簿搴︽瘮杓�銆�(f)涓嶅悓鍨嬭櫉T4鐨勭簿搴︽瘮杓�銆傚湒11 涓嶅悓妯″瀷鐨勭簿搴︽瘮杓冪祼璜栨澅鍖楅浕鍔涘ぇ瀛稿拰闀锋槬鐞嗗伐澶у鐮旂┒鍦橀殜闁嬬櫦骞跺鐝句竴绋祼鍚堣叇闆诲湒婧愭垚鍍�(ESI)鎶€琛撳拰鍗风⿳绁炵稉缍茬怠(CNN)鐨勬柊鏂规硶銆傝┎鏂规硶鍙互灏嶉亱鍕曟兂璞�(MI)浠诲嫏閫茶鍒嗛銆傚椹楃祼鏋滆〃鏄�锛屼粬鍊戠殑鐮旂┒鎴愭灉鑸囨渶鍏堥€茬殑MI鍒嗛鏂规硶鐨勭祼鏋滅浉姣�锛岀附楂斿垎椤炲鍔犱簡14.4%銆傜爺绌惰€呭姞鍏ヤ簡4鍊嬫柊鐨勫彈瑭﹁€呴€茶椹楄瓑渚嗛璀夋柟娉曠殑鏈夋晥鎬с€傜爺绌惰€呰〃绀�锛屼粬鍊戞彁鍑虹殑绲愬悎scout ESI鍜孋NN鐨勬柟娉�锛屾彁楂樹簡鑵﹂浕瑙g⒓鍥涢MI浠诲嫏鐨凚CI鎬ц兘銆傝珫鏂囦俊鎭細A novel approach of decoding EEG four-class motor imagery tasks via scout ESI and CNN
鏉卞寳闆诲姏澶у
2021-04-10