class IncludedInMemcached

A specialized class using memcached to track items stored. It supports three operations: new, <<, and include? . Together these can be used to add items to the memcache, then determine whether the item has been added.

To use it with Spider use the check_already_seen_with method:

Spider.start_at('http://example.com/') do |s|
  s.check_already_seen_with IncludedInMemcached.new('localhost:11211')
end

Public Class Methods

new(*a) click to toggle source

Construct a new IncludedInMemcached instance. All arguments here are passed to MemCache (part of the memcache-client gem).

# File lib/spider/included_in_memcached.rb, line 17
def initialize(*a)
  @c = MemCache.new(*a)
end

Public Instance Methods

<<(v) click to toggle source

Add an item to the memcache.

# File lib/spider/included_in_memcached.rb, line 22
def <<(v)
  @c.add(v.to_s, v)
end
include?(v) click to toggle source

True if the item is in the memcache.

# File lib/spider/included_in_memcached.rb, line 27
def include?(v)
  @c.get(v.to_s) == v
end