class DaimonSkycrawlers::Crawler::Default
The default crawler
This crawler can GET/POST given URL and store response to storage
Public Instance Methods
fetch(url, message)
click to toggle source
GET/POST given url
@param url [String] URI or path @param message [Hash] message can include anything
@return [Faraday::Response] HTTP response
# File lib/daimon_skycrawlers/crawler/default.rb, line 19 def fetch(url, message) params = message[:params] || {} method = message[:method] || "GET" if method == "POST" post(url, params) else get(url, params) end end