class Chainer::WeightDecay
Optimizer/UpdateRule hook function for weight decay regularization
This hook function adds a scaled parameter to the correspondeing gradient It can be used as a regularization
@param [Float] rate Coefficient for the weight decay
Public Class Methods
new(rate)
click to toggle source
# File lib/chainer/optimizer.rb, line 168 def initialize(rate) @rate = rate end
Public Instance Methods
call(rule, param)
click to toggle source
# File lib/chainer/optimizer.rb, line 172 def call(rule, param) return if param.data.nil? || param.grad.nil? param.grad += (@rate * param.data) end
call_for_each_param()
click to toggle source
# File lib/chainer/optimizer.rb, line 164 def call_for_each_param true end
name()
click to toggle source
# File lib/chainer/optimizer.rb, line 160 def name "WeightDecay" end