• Matlab中常见的神经网络训练函数和学习函数


    一、训练函数

    1、traingd

    Name:Gradient descent backpropagation (梯度下降反向传播算法 )  

    Description:triangd is a network training function that updates weight and bias values  according to gradient descent.              

    2、traingda

    Name:Gradient descent  with adaptive learning rate backpropagation(自适应学习率的t梯度下降反向传播算法)   

    Description:triangd is a network training function that updates weight and bias values  according to gradient descent with adaptive learning rate. it will return a trained net (net) and  the trianing record (tr).

    3、traingdx (newelm函数默认的训练函数)

    name:Gradient descent with momentum and adaptive learning rate backpropagation(带动量的梯度下降的自适应学习率的反向传播算法)  

    Description:triangdx is a network training function that updates weight and bias values  according to gradient descent momentum and an adaptive learning rate.it will return a trained net (net) and  the trianing record (tr).   

    4、trainlm

    Name:Levenberg-Marquardt backpropagation (L-M反向传播算法)

    Description:triangd is a network training function that updates weight and bias values  according toLevenberg-Marquardt optimization. it will return a trained  net (net) and  the trianing record (tr). 

    注:更多的训练算法请用matlab的help命令查看。

    二、学习函数

    1、learngd

    Name:Gradient descent weight and bias learning function (梯度下降的权值和阈值学习函数)  

    Description:learngd is the gradient descent weight and bias learning function, it will return the weight change dW and a new learning state.

    2、learngdm 

    Name:Gradient descent with momentum weight and bias learning function (带动量的梯度下降的权值和阈值学习函数)  

    Description:learngd is the gradient descent  with momentum weight and bias learning function, it will return the weight change dW and a new learning state.

    注:更多的学习函数用matlab的help命令查看。

    三、训练函数与学习函数的区别

      学习函数的输出是权值和阈值的增量,训练函数的输出是训练好的网络和训练记录,在训练过程中训练函数不断调用学习函数修正权值和阈值,通过检测设定的训练步数或性能函数计算出的误差小于设定误差,来结束训练。    
    或者这么说:训练函数是全局调整权值和阈值,考虑的是整体误差的最小。学习函数是局部调整权值和阈值,考虑的是单个神经元误差的最小[1]。


    参考链接:【1】 https://zhidao.baidu.com/question/1883990061249711708.html?fr=iks&word=matlab%D6%D0traingdx%BA%CDlearngdm%B5%C4%C7%F8%B1%F0&ie=gbk
  • 相关阅读:
    ORA-04098 trigger 'DBBJ.DB_EV_ALTER_ST_METADATA' is invalid and failed re-validation
    ORA -04098 触发器无效且未通过重新验证
    Oracle 设置主键自增长__Oracle
    重启Oracle服务
    手动启动 oracle 服务
    oracle错误-ORA-12519, TNS:no appropriate service handler found
    ORA-00904: 标识符无效——解决方案
    [原创] 新人分享--ORA-01012:not logged on的解决办法 [复制链接]
    java验证,”支持6-20个字母、数字、下划线或减号,以字母开头“这个的正则表达式怎么写?
    全面解析JS字符串和正则表达式中的match、replace、exec等函数
  • 原文地址:https://www.cnblogs.com/hezhiyao/p/7197141.html
Copyright © 2020-2023  润新知