涓€绋€氶亷scout ESI鍜孋NN瑙g⒓EEG閬嬪嫊鎯宠薄鍥涘垎椤炰换鍕欑殑鏂�鏂规硶
灏庤畝鏉卞寳闆诲姏澶у鍜岄暦鏄ョ悊宸ュぇ瀛哥爺绌跺湗闅婇枊鐧煎苟瀵︾従涓€绋祼鍚堣叇闆诲湒婧愭垚鍍�(ESI)鎶€琛撳拰鍗风⿳绁炵稉缍茬怠(CNN)鐨勬柊鏂规硶锛屼互灏嶉亱鍕曟兂璞�(MI)浠诲嫏閫茶鍒嗛銆侲SI鎶€琛撻噰鐢ㄩ倞鐣屽厓娉�(BEM)鍜屽姞娆婃渶灏忚寖鏁镐及瑷�(WMNE)鍒嗗垾瑙f焙EEG鐨勬鍚戝拰閫嗗悜鍟忛銆傜劧鍚庡湪閬嬪嫊鐨堡涓壍寤哄崄鍊媠cout渚嗛伕鎿囨劅鑸堣叮鐨勫崁鍩�(ROI)銆傜爺绌惰€呬娇鐢∕orlet灏忔尝鏂规硶寰瀞cout鐨勬檪闁撳簭鍒椾腑鎻愬彇鐗瑰緛銆傛渶鍚庯紝浣跨敤CNN灏峂I浠诲嫏閫茶鍒嗛銆傚椹楃祼鏋�:鍦≒hysionet鏁告摎搴笂鐨勬暣楂斿钩鍧囨簴纰虹巼閬斿埌94.5%锛屽垎鍒ュ皪宸︽嫵闋€佸彸鎷抽牠銆侀洐鎷冲拰闆欒叧鐨勫柈鍊嬫簴纰虹巼閬斿埌95.3%銆�93.3%銆�93.6%銆�96%锛岄噰鐢ㄥ崄鍊嶄氦鍙夐璀夐€茶椹楄瓑銆傜爺绌朵汉鍝¤〃绀猴紝浠栧€戠殑鐮旂┒鎴愭灉鑸囨渶鍏堥€茬殑MI鍒嗛鏂规硶鐨勭祼鏋滅浉姣旓紝绺介珨鍒嗛澧炲姞浜�14.4%銆傜爺绌惰€呯偤椹楄瓑鏂规硶鐨勬湁鏁堟€э紝鍔犲叆浜�4鍊嬫柊鐨勫彈瑭﹁€呴€茶椹楄瓑锛岀櫦鐝剧附楂斿钩鍧囨簴纰虹巼鐐�92.5%銆傛澶栵紝鍏ㄥ眬鍒嗛鍣ㄩ仼鎳夊柈涓€灏嶈薄锛屾暣楂斿钩鍧囨簴纰虹巼鎻愰珮鍒�94.54%銆傜爺绌惰€呰〃绀猴紝浠栧€戞彁鍑虹殑绲愬悎scout ESI鍜孋NN鐨勬柟娉曪紝鎻愰珮浜嗚叇闆昏В纰煎洓椤濵I浠诲嫏鐨凚CI鎬ц兘銆傜郴绲辨鏋跺湒1 绯荤当妗嗘灦鍦栫郴绲辨鏋跺鍦�1鎵€绀恒€傚師濮嬫暩鎿氫締鑷湅闅�10-10绯荤当鐨�64鍊嬮浕妤�(涓嶅寘鎷琋z銆丗9銆丗10銆丗T9銆丗T10銆丄1銆丄2銆乀P9銆乀P10銆丳9鍜孭10闆绘サ)锛屽苟浠ユ瘡绉�160鍊嬫ǎ鏈殑閫熷害閲囬泦銆傛牴鎿氬湅闅�10-10绯荤当寰�64鍊嬮€氶亾閲囬泦鍘熷鑵﹂浕鍦栵紝骞朵娇鐢˙CI2000绯荤当閫茶瑷橀寗銆傝閷勭殑鏁告摎琚垎鐐哄洓鍊嬬崹绔婱I浠诲嫏鍖呮嫭宸︽嫵MI,鍙虫嫵MI,闆欐嫵MI鍜岄洐鑵矼I銆傞鍏堬紝鐢变簬ERD鍦ㄥ煼琛岄亱鍕曟兂璞℃檪鍦╝lpha鍜宐eta涓笉鍚岋紝鍥犳浣跨敤FIR婵炬尝鍣ㄥ皪EEG閫茶浜�8 Hz鑷�30 Hz鐨勫付閫氭烤娉€€傜劧鍚庯紝閫氶亷瑷堢畻鍖呭惈姝e晱椤屽拰閫嗗晱椤岀殑婧愶紝灏囧偝鎰熷櫒绌洪枔鐨勬椿鍕曡綁鍖栫偤婧愮┖闁撶殑娲诲嫊銆傛帴涓嬩締锛屽壍寤簊cout骞舵彁鍙栫壒寰併€傜爺绌惰€呭湪閬嬪嫊鐨堡涓壍寤轰簡10鍊媠cout锛屽洜鐐烘垜鍊戝彧闂滃績鑸囬亱鍕曠浉闂滅殑娲诲嫊銆傚崄鍊媠cout涓殑姣忎竴鍊嬮兘浠h〃浜嗗彲鐢ㄦ簮绌洪枔涓殑涓€鍊嬫劅鑸堣叮鐨勫崁鍩�(ROI)锛屽苟涓旀槸瀹氱京鍦ㄧ毊灞よ〃闈㈡垨闋儴楂旂⿳涓婄殑鍋舵サ瀛愮殑瀛愰泦銆傚乏鑵︾殑scout绋辩偤L1銆丩2銆丩3銆丩4銆丩5锛屽彸鑵︾殑scout绋辩偤R1銆丷2銆丷3銆丷4銆丷5銆傚埄鐢↗TFA寰�10鍊媠cout鐨勬簮鏅傞枔搴忓垪涓彁鍙栫壒寰併€傛渶鍚庯紝鍒╃敤CNN灏嶆檪闋诲湒閫茶鍒嗛洟骞堕€茶鍒嗛銆傚椹楀湪瀵﹂涓紝鐮旂┒浜哄摗鍍呬娇鐢ㄤ簡闅ㄦ閬告搰鐨勫崄鍊嬪彈瑭﹁€呯殑MI trail (S5锛孲6锛孲7锛孲8锛孲9锛孲10锛孲11锛孲12锛孲13锛孲14)銆傞€欓噷鐢ㄤ簬鍒嗘瀽鐨勬暩鎿氶泦鍖呭惈姣忓€嬪彈瑭﹁€�84娆¤│椹楋紝姣忎竴椤炲寘鍚�21娆¤│椹椼€傚湪瑷橀寗64閫氶亾鑵﹂浕鍦栨檪锛屽彈瑭﹁€呭煼琛屼簡涓嶅悓鐨勯亱鍕曟兂璞′换鍕欍€傛瘡鍊嬪彈瑭﹁€呴嚌灏嶄互涓嬪洓鍊嬩换鍕欎腑鐨勬瘡涓€鍊嬪煼琛屼簡3杓�21瑭﹂锛氱暥鐩鍑虹従鍦ㄥ睆骞曞乏鍋存檪锛屽彈瑭﹁€呮兂璞℃墦闁嬪拰鍚堜笂鐩告噳鐨勬嫵闋紝鐩村埌鐩娑堝け銆傜劧鍚庡彈瑭﹁€呮斁鏉俱€傜暥鐩鍑虹従鍦ㄥ睆骞曠殑鍙冲伌鏅傦紝鍙楄│鑰呮兂璞℃墦闁嬪拰鍚堜笂鐩告噳鐨勬嫵闋紝鐩村埌鐩娑堝け銆傜劧鍚庡彈瑭﹁€呮斁鏉俱€傜暥鐩鍑虹従鍦ㄥ睆骞曢爞閮ㄦ檪锛屽彈瑭﹁€呮兂璞℃墦闁嬪拰鍚堜笂闆欐墜鐨勬嫵闋紝鐩村埌鐩娑堝け銆傜劧鍚庡彈瑭﹁€呮斁鏉俱€傜暥鐩鍑虹従鍦ㄥ睆骞曞簳閮ㄦ檪锛岀洰妯欐渻鎯宠薄闆欒叧寮甸枊鍜屽悎鏀忥紝鐩村埌鐩娑堝け銆傜劧鍚庡彈瑭﹁€呮斁鏉俱€傜偤浜嗙当涓€鏁告摎缍暩锛岀爺绌惰€呴伕鎿囦簡4s鐨勬暩鎿氾紝鍥犵偤姣忔鎯宠薄浠诲嫏鐨勫煼琛屾檪闁撻兘鍦�4s宸﹀彸銆傛澶栵紝鑵﹂浕鍦栦换鍕欐槸鍒嗛枊鐨勶紝鐮旂┒浜哄摗鍦ㄥ椹椾腑灏囧乏鎷筹紝鍙虫嫵锛岄洐鎷冲拰闆欒叧MI浠诲嫏鍒嗗垾绋辩偤T1锛孴2锛孴3鍜孴4銆傚湒2 scout鍛藉悕宸﹀彸閬嬪嫊鎯宠薄鐨剆cout鍒嗗垾鍛藉悕鐐篖1銆丩2銆丩3銆丩4銆丩5銆丷1銆丷2銆丷3銆丷4銆丷5锛屽鍦�2鎵€绀恒€�10鍊媠cout姣忎竴鍊嬮兘琚摯灞曞埌40鍊嬮爞榛烇紝姣忓€嬮爞榛炲彧鏈変竴鍊嬫簮銆侺1鍗€鍩熷皪鎳�40鍊嬩俊铏燂紝鍏朵粬scout涔熶竴妯c€傚湪瑷堢畻浜嗕締婧愬悗锛岀爺绌惰€呭湪閬嬪嫊鐨堡涓壍寤轰簡鍗佸€媠cout锛屽鍦�3鎵€绀恒€傚湒3 鍓靛缓10鍊媠cout浣跨敤ESI瑷堢畻鍗佸€嬪彈瑭﹁€�(S5銆丼6銆丼7銆丼8銆丼9銆丼10銆丼11銆丼12銆丼13銆丼14)姣忔瑭﹂鐨勫洓鍊嬩换鍕�(T1銆乀2銆乀3銆乀4)鐨勬簮銆傚皪浜庨€欏洓闋呬换鍕欎腑鐨勬瘡涓€闋咃紝姣忓€嬪彈瑭﹁€呮瘡娆¢兘瑕侀€茶7娆℃脯瑭�(#1锛�#2锛�#3锛�#4锛�#5锛�#6锛�#7)銆傚睍绀轰簡绗竴鍊嬫鐨�10鍊嬭瑭︾殑10鍊媠cout鐨�4闋呬换鍕欑殑渚嗘簮銆傜劧鍚庢彁鍙�10鍊媠cout鐨勬檪闁撳簭鍒楅€茶閫蹭竴姝ュ垎鏋愩€傜壒寰佹彁鍙栧湪瑷堢畻婧愪箣鍚庯紝鐮旂┒浜哄摗鍦ㄩ亱鍕曠毊灞や腑鍓靛缓浜嗗寘鍚�40鍊嬫簮鐨�10鍊媠cout锛屽苟鎻愬彇浜唖cout鐨勬檪闁撳簭鍒椼€傚鍦�4鎵€绀虹偤鎻愬彇R5 scout鏅傞枔搴忓垪浣滅偤绀轰緥銆傚湒鐨勫彸閭婇’绀轰簡R5 scout鐨勬檪闁撳簭鍒椼€傛湰鏂囧埄鐢ㄥ皬娉㈣畩鎻涘緸scout鏅傞枔搴忓垪涓彁鍙栫壒寰併€傚湒4 鎻愬彇R5 scout鏅傞枔搴忓垪浣滅偤绀轰緥鍦ㄩ€欓爡鐮旂┒涓紝鐮旂┒鑰呮彁鍑哄埄鐢–NN渚嗚В姹洪亱鍕曟兂璞′换鍕欏垎椤炵殑鍟忛銆傝┎妯″瀷鍩轰簬Schirrmeister绛夋彁鍑虹殑Deep ConvNet鏋舵锛岃┎缍茬怠妯″瀷鐢变竴鍊嬪叚灞ゅ嵎绌嶇恫绲$祫鎴愶紝鍏朵腑鍏╁€嬫渶澶ф睜灞ゅ拰涓夊€嬪叏閫f帴灞わ紝濡傚湒5鎵€绀恒€傚湒5灏嶄簬Physionet鏁告摎搴紝鐮旂┒鑰呴鍏堥噰鐢―eep ConvNet鏋舵锛屽寘鎷洓鍊嬪嵎绌嶅堡銆佸洓鍊嬫渶澶ф睜灞ゅ拰涓€鍊嬪叏閫f帴灞ゃ€傚湪瀵﹂涓紝鐮旂┒鑰呬緷鎿氱稉椹椾娇鐢ㄥ叐鍊嬫渶澶ф睜鍖栧堡銆傚苟鍢楄│浜嗕笉鍚屾暩閲忕殑鍗风⿳灞ゅ拰瀹屽叏閫f帴灞ゃ€傛檪闋诲湒鍒╃敤Morlet灏忔尝鏂规硶寰楀埌浜唖cout鐨勭壒寰併€傚皪浜庢瘡鍊嬩换鍕欙紝R5 scout鐨勬檪闋诲湒濡傚湒6鎵€绀恒€傚寘鍚檪闁撳拰闋荤巼浜掕鐨勬檪闋诲垎鏋愭柟娉曟彁渚涗簡鏅傚煙鍜岄牷鍩熺殑鑱悎鍒嗗竷淇℃伅锛屾竻鏅板湴鎻忚堪浜嗕俊铏熼牷鐜囪垏鏅傞枔鐨勯棞绯汇€傚湒6 R5 scout鐨勬檪闋诲湒椤劧锛屽彧鏈夐儴鍒嗘檪闋绘槧灏勬槸绱呰壊鐨勶紝琛ㄦ槑姣忓€嬩换鍕欏彧灏嶇壒瀹氱殑闋荤巼鍜屾檪闁撴晱鎰熴€傜敱浜庡湒鐨勬暩閲忔瘮杓冨ぇ锛岀爺绌惰€呬娇鐢–NN渚嗛伕鎿囧拰瀛哥繏閫欎簺鍦栦腑鏈€鍩烘湰鐨勭壒寰併€傜爺绌朵汉鍝¢毃姗熼伕鎿囦簡骞惧€嬫ǎ鏈紝骞跺皣涓€浜涚壒寰佸湒鍙鍖栵紝浣滅偤MI浠诲嫏鐨勫缈掕〃绀猴紝濡傚湒7鎵€绀恒€傚湒7鐐轰簡鐛插緱鏈夋晥鐨勭祼鏋滐紝灏囨暩鎿氶泦鍒嗙偤90锛呬綔鐐鸿〒绶撮泦锛屽叾浣�10锛呬綔鐐烘脯瑭﹂泦銆傞鍏堬紝灏囧崄鍊嬪彈瑭﹁€呯殑鏁告摎闆嗭紙绺藉叡19320鍊嬫ǎ鏈級鍒嗙偤17388鍊嬫ǎ鏈互瑷撶反鎵€鎻愬嚭鐨凜NN妯″瀷锛屼互鍙�1932鍊嬫ǎ鏈互椹楄瓑妯″瀷鐨勬湁鏁堟€с€傚湪瀵﹂涓紝鐮旂┒鑰呴倓閬告搰浜嗗彟澶栧洓鍊嬪彈瑭﹁€呯殑鏁告摎闆嗕互澧炲姞鏁告摎闆嗙殑瑕忔ā(27048鍊嬫ǎ鏈�)锛屽叾涓�24343鍊嬫ǎ鏈槸瑷撶反闆嗭紝鍏朵粬妯f湰鏄脯瑭﹂泦銆傚湪閬稿畾鐨剆cout涓婂皪鎵€鎻愬嚭鐨凜NN鏋舵閫茶浜嗗崄娆¤〒绶村拰娓│锛屼互椹楄瓑鎵€鎻愬嚭妯″瀷鐨勯妫掓€с€傚湒8(a)椤ず浜�10鍊媠cout涓瘡鍊嬬殑鍏ㄥ眬骞冲潎绮惧害銆傚湒8 绲辫▓绲愭灉R5鐨勫叏灞€骞冲潎绮惧害鏈€楂橈紝閬斿埌94.5%锛岃€孡2鐨勫叏灞€骞冲潎绮惧害鏈€浣庯紝鐐�91.3%銆傚皪鎳塋1銆丩3銆丩4銆丩5銆丷1銆丷2銆丷3銆丷4鐨勬暣楂旀簴纰虹巼鍒嗗垾鐐�92.4%銆�92.5%銆�93.6%銆�91.9%銆�93.0%銆�91.8%銆�92.1%銆�92.6%銆傛墍鏈塻cout鐨勭附楂旂簿搴﹀潎鍦�91%浠ヤ笂锛屾婧栧樊鍧囧湪0.20%浠ヤ笅銆傚湒8(b)椤ず浜嗗崄鍊媠cout涓瘡鍊媠cout鍥涘€婱I浠诲嫏鐨勭祫绱氱当瑷堢祼鏋滃強鍏舵婧栧樊銆備竴鑸締瑾紝R5琛ㄧ従鐨勮姣斿叾浠栫殑濂斤紝鑰孡2鍦ㄨ凯浠�2000涓〃鐝炬渶宸€傛婧栧樊杓冨皬锛岃鏄庨€欎簺绮惧害鏇存帴杩戝钩鍧囧€间笖绌╁畾銆傚湒9 绲辫▓绲愭灉鍦�9(a)椤ず浜嗗付鏈夋婧栧樊鐨勬贩娣嗙煩闄o紝瑾槑浜唃roup level鍒嗛绲愭灉銆俆1銆乀2銆乀3鍜孴4鐨勫叏灞€骞冲潎绮惧害宄板€煎垎鍒ョ偤95.3%銆�93.3%銆�93.6%鍜�96.0%銆俁5 scout鐨勫洓鍊婱I浠诲嫏涓殑姣忎竴鍊嬮兘濡傚湒9(b)鎵€绀恒€傞€氶亷鏀硅畩瑷撶反闆嗗拰娓│闆嗛爢搴忕殑10娆¤│椹楋紝纰哄畾浜唖coutR5鐨勬€ц兘锛岀祼鏋滃鍦�10(a)鍜�(b)鎵€绀恒€傚湪10娆¤│椹椾腑锛宻cout R5鐨凾1銆乀2銆乀3銆乀4鐨勫钩鍧囨簴纰虹巼鍒嗗垾鐐�93.3%銆�93.8%銆�94.2%銆�94.1%銆傛彌鍙ヨ┍瑾紝鍥涘€嬩换鍕欎腑姣忎竴鍊嬬殑骞冲潎婧栫⒑鐜囬兘瓒呴亷浜�93%銆傚叏灞€骞冲潎婧栫⒑鐜囩偤93.7%銆�10娆¤│椹楃祼鏋滆〃鏄庯紝瑭叉柟娉曞皪scout R5鐨勫垎椤炴晥鏋滆純濂姐€傚緸浠ヤ笂绲愭灉鍙互娓呮鍦扮湅鍑猴紝R5 scout鍦ㄥ洓绋甅I浠诲嫏鐨勫垎椤炰腑鎵紨钁楁渶閲嶈鐨勮鑹层€傚洜姝わ紝閬告搰R5灏嶅洓鍊婱I浠诲嫏閫茶鍒嗛銆傚湒 10鍦�11. (a)鏄笉鍚屾ā鍨嬬殑鍏ㄥ眬骞冲潎婧栫⒑鎬х殑姣旇純銆傚彲浠ョ櫦鐝撅紝瑭茬爺绌舵彁鍑虹殑妯″瀷鍙互閬斿埌鏈€澶х殑绮惧害銆傚緸鍦�11. (b)涓嶅悓妯″瀷鐨凴OC鏇茬窔鍙互鐪嬪嚭鎻愬嚭鐨勬ā鍨嬫瘮鍏朵粬妯″瀷琛ㄧ従鏇村ソ銆�?涓嶅悓妯″瀷T1涓婄殑绮惧害姣旇純銆�(d)涓嶅悓妯″瀷T2鐨勭簿搴︽瘮杓冦€�(e)涓嶅悓妯″瀷T3鐨勭簿搴︽瘮杓冦€�(f)涓嶅悓鍨嬭櫉T4鐨勭簿搴︽瘮杓冦€傚湒11 涓嶅悓妯″瀷鐨勭簿搴︽瘮杓冪祼璜栨澅鍖楅浕鍔涘ぇ瀛稿拰闀锋槬鐞嗗伐澶у鐮旂┒鍦橀殜闁嬬櫦骞跺鐝句竴绋祼鍚堣叇闆诲湒婧愭垚鍍�(ESI)鎶€琛撳拰鍗风⿳绁炵稉缍茬怠(CNN)鐨勬柊鏂规硶銆傝┎鏂规硶鍙互灏嶉亱鍕曟兂璞�(MI)浠诲嫏閫茶鍒嗛銆傚椹楃祼鏋滆〃鏄庯紝浠栧€戠殑鐮旂┒鎴愭灉鑸囨渶鍏堥€茬殑MI鍒嗛鏂规硶鐨勭祼鏋滅浉姣旓紝绺介珨鍒嗛澧炲姞浜�14.4%銆傜爺绌惰€呭姞鍏ヤ簡4鍊嬫柊鐨勫彈瑭﹁€呴€茶椹楄瓑渚嗛璀夋柟娉曠殑鏈夋晥鎬с€傜爺绌惰€呰〃绀猴紝浠栧€戞彁鍑虹殑绲愬悎scout ESI鍜孋NN鐨勬柟娉曪紝鎻愰珮浜嗚叇闆昏В纰煎洓椤濵I浠诲嫏鐨凚CI鎬ц兘銆傝珫鏂囦俊鎭細A novel approach of decoding EEG four-class motor imagery tasks via scout ESI and CNN
鏉卞寳闆诲姏澶у
2021-04-10