class DaimonSkycrawlers::Crawler::Default

The default crawler

This crawler can GET/POST given URL and store response to storage

Public Instance Methods

fetch(url, message) click to toggle source

GET/POST given url

@param url [String] URI or path @param message [Hash] message can include anything

@return [Faraday::Response] HTTP response

# File lib/daimon_skycrawlers/crawler/default.rb, line 19
def fetch(url, message)
  params = message[:params] || {}
  method = message[:method] || "GET"
  if method == "POST"
    post(url, params)
  else
    get(url, params)
  end
end