排列5走势图

避免神经网络过度拟合的五种方式!

发布时间:2019-12-21 11:00:00
阅读量:176
作者:猎维人工智能培训
[导读]:
本文介绍了5种在训练神经网络中避免过拟合的技术。

排列5走势图SHENDUXUEXILINGYUZHONGYOUHENDUOSHENJINGWANGLUO,BIRUJUANJISHENJINGWANGLUO、XUNHUANSHENJINGWANGLUO、ZIBIANMAQIDENGDENG。ZUICHANGJIANDEYIGEWENTIJIUSHIZAIXUNLIANSHI,SHENDUSHENJINGWANGLUOHUIGUONIHE。

DANGMOXINGSHIZHEYUCEZAOSHENGJIAODUODESHUJUDEQUSHISHI,YOUYUMOXINGCANSHUGUODUO、GUOYUFUZA,JIUHUIDAOZHIGUONIHE。GUONIHEDEMOXINGTONGCHANGSHIBUJINGQUEDE,YINWEIZHEIYANGDEYUCEQUSHIBINGBUHUIFANYINGSHUJUDEZHENSHIQINGKUANG。WOMENKEYITONGGUOMOXINGZAIYIZHIDESHUJU(XUNLIANJI)ZHONGYOUHAODEYUCEJIEGUO,DANZAIWEIZHIDESHUJU(CESHIJI)ZHONGJIAOCHADEBIAOXIANLAIPANDUANSHIFOUCUNZAIGUONIHE。JIQIXUEXIMOXINGDEMUDESHICONGXUNLIANJIDAOGAIWENTILINGYUDERENHESHUJUJISHANGJUNYOUFANHUADEJIAOHAOBIAOXIAN,YINWEIWOMENXIWANGMOXINGNENGGOUYUCEWEIZHIDESHUJU。ZAIBENWENZHONG,JIANGZHANSHI5ZHONGZAIXUNLIANSHENJINGWANGLUOSHIBIMIANGUONIHEDEJISHU。

一、简化模型

排列5走势图CHULIGUONIHEDEDIYIBUJIUSHIJIANGDIMOXINGFUZADU。WEILEJIANGDIFUZADU,WOMENKEYIJIANDANDIYICHUCENGHUOZHEJIANSHAOSHENJINGYUANDESHULIANGSHIDEWANGLUOGUIMOBIANXIAO。YUCITONGSHI,JISUANSHENJINGWANGLUOZHONGBUTONGCENGDESHURUHESHUCHUWEIDUYESHIFENZHONGYAO。SUIRANYICHUCENGDESHULIANGHUOSHENJINGWANGLUODEGUIMOBINGWUTONGYONGDEGUIDING,DANRUGUONIDESHENJINGWANGLUOFASHENGLEGUONIHE,JIUCHANGSHISUOXIAOTADEGUIMO。

二、早停

ZAISHIYONGDIEDAIDEFANGFA(LIRUTIDUXIAJIANG)LAIXUNLIANMOXINGSHI,ZAOTINGSHIYIZHONGZHENGZEHUADEXINGSHI。YINWEISUOYOUDESHENJINGWANGLUODOUSHITONGGUOTIDUXIAJIANGDEFANGFALAIXUEXIDE,SUOYIZAOTINGSHIYIZHONGSHIYONGYUSUOYOUWENTIDETONGYONGJISHU。SHIYONGZHEIZHONGFANGFALAIGENGXINMOXINGYIBIANQIZAIMEICIDIEDAISHINENGGENGHAODISHIYINGXUNLIANJI。ZAIYIDINGCHENGDUSHANG,ZHEIZHONGFANGFAKEYIGAISHANMOXINGZAICESHIJISHANGDEBIAOXIAN。DANSHICHUCIZHIWAI,GAISHANMOXINGDUIXUNLIANJIDENIHEHUIZENGJIAFANHUAWUCHA。ZAOTINGGUIZEZHIDINGLEMOXINGZAIGUONIHEZHIQIANKEYIDIEDAIDECISHU。

SHANGTUZHANSHILEZHEIZHONGJISHU。ZHENGRUWOMENKANDAODE,ZAIJICIDIEDAIHOU,JISHIXUNLIANWUCHARENGRANZAIJIANSHAO,DANCEYANWUCHAYIJINGKAISHIZENGJIALE。

三、使用数据增强

ZAISHENJINGWANGLUOZHONG,SHUJUZENGQIANGZHIYIWEIZHEZENGJIASHUJUGUIMO,YEJIUSHIZENGJIASHUJUJILIZHONGTUXIANGDESHULIANG。YIXIEREMENDETUXIANGZENGQIANGJISHUYOUFANZHUAN、PINGYI、XUANZHUAN、SUOFANG、GAIBIANLIANGDU、TIANJIAZAOSHENGDENGDENG。

RUSHANGTUSUOSHI,SHIYONGSHUJUZENGQIANGKEYISHENGCHENGDUOFUXIANGSITUXIANG。ZHEIKEYIBANGZHUWOMENZENGJIASHUJUJIGUIMOCONGERJIANSHAOGUONIHE。YINWEISUIZHESHUJULIANGDEZENGJIA,MOXINGWUFAGUONIHESUOYOUYANGBEN,YINCIBUDEBUJINXINGFANHUA。

四、使用正则化

ZHENGZEHUASHIYIZHONGJIANGDIMOXINGFUZADUDEFANGSHI。TASHITONGGUOZAISUNSHIHANSHUZHONGTIANJIAYIGECHENGFAXIANGLAISHIXIANZHENGZEHUA。ZUICHANGJIANDEJISHUSHIL1HEL2ZHENGZEHUA:

L1CHENGFAXIANGDEMUDESHISHIQUANZHONGJUEDUIZHIZUIXIAOHUA。GONGSHIRUXIA:

L2CHENGFAXIANGDEMUDESHISHIQUANZHONGDEPINGFANGZUIXIAOHUA。GONGSHIRUXIA:

排列5走势图YIXIABIAOGEDUILIANGZHONGZHENGZEHUAFANGFAJINXINGLEDUIBI。

排列5走势图NEIMENAYIZHONGFANGSHIGENGYOULIYUBIMIANGUONIHENI?DAANSHI——KANQINGKUANG。RUGUOSHUJUGUOYUFUZAYIZHIYUWUFAZHUNQUEDIJIANMO,NEIMEL2SHIGENGHAODEXUANZE,YINWEITANENGGOUXUEXISHUJUZHONGCHENGXIANDENEIZAIMOSHI。ERDANGSHUJUZUGOUJIANDAN,KEYIJINGQUEJIANMODEHUA,L1GENGHESHI。DUIYUWOYUDAODEDADUOSHUJISUANJISHIJUEWENTI,L2ZHENGZEHUAJIHUZONGSHIKEYIJICHUGENGHAODEJIEGUO。RANERL1BURONGYISHOUDAOLIQUNZHIDEYINGXIANG。SUOYIZHENGQUEDEZHENGZEHUAXUANXIANGQUJUEYUWOMENXIANGYAOJIEJUEDEWENTI。

五、使用丢弃法(Dropouts)

排列5走势图DIUQIFASHIYIZHONGBIMIANSHENJINGWANGLUOGUONIHEDEZHENGZEHUAJISHU。XIANGL1HEL2ZHEIYANGDEZHENGZEHUAJISHUTONGGUOXIUGAIDAIJIAHANSHULAIJIANSHAOGUONIHE。ERDIUQIFAXIUGAISHENJINGWANGLUOBENSHEN。TAZAIXUNLIANDEMEIYICIDIEDAIGUOCHENGZHONGSUIJIDIDIUQISHENJINGWANGLUOZHONGDESHENJINGYUAN。DANGWOMENDIUQIBUTONGSHENJINGYUANJIHEDESHIHOU,JIUDENGTONGYUXUNLIANBUTONGDESHENJINGWANGLUO。BUTONGDESHENJINGWANGLUOHUIYIBUTONGDEFANGSHIFASHENGGUONIHE,SUOYIDIUQIDEJINGXIAOYINGJIANGHUIJIANSHAOGUONIHEDEFASHENG。

RUSHANGTUSUOSHI,DIUQIFABEIYONGYUZAIXUNLIANSHENJINGWANGLUODEGUOCHENGZHONGSUIJIDIUQISHENJINGWANGLUOZHONGDESHENJINGYUAN。ZHEIZHONGJISHUBEIZHENGMINGKEYIJIANSHAOHENDUOWENTIDEGUONIHE,ZHEIXIEWENTIBAOKUOTUXIANGFENLEI、TUXIANGQIEGE、CIQIANRU、YUYIPIPEIDENGWENTI。

结论

排列5走势图JIANDANHUIGUXIASHANGSHUNEIRONG,WOJIESHILESHENMESHIGUONIHEYIJIWEISHENMETASHISHENJINGWANGLUODANGZHONGCHANGJIANDEWENTI。JIEXIALAIWOYOUJICHULEWUZHONGZUICHANGJIANDEZAIXUNLIANSHENJINGWANGLUOGUOCHENGZHONGBIMIANGUONIHEDEFANGFA——JIANHUAMOXING、ZAOTING、SHUJUZENGQIANG、ZHENGZEHUAYIJIDIUQIFA。

更多资讯