class Chainer::WeightDecay

Optimizer/UpdateRule hook function for weight decay regularization

This hook function adds a scaled parameter to the correspondeing gradient It can be used as a regularization

@param [Float] rate Coefficient for the weight decay

Public Class Methods

new(rate) click to toggle source
# File lib/chainer/optimizer.rb, line 168
def initialize(rate)
  @rate = rate
end

Public Instance Methods

call(rule, param) click to toggle source
# File lib/chainer/optimizer.rb, line 172
def call(rule, param)
  return if param.data.nil? || param.grad.nil?
  param.grad += (@rate * param.data)
end
call_for_each_param() click to toggle source
# File lib/chainer/optimizer.rb, line 164
def call_for_each_param
  true
end
name() click to toggle source
# File lib/chainer/optimizer.rb, line 160
def name
  "WeightDecay"
end