module Greeb::Core
Greeb::Core
is a simple tool that allows to invoke Greeb::Tokenizer
and Greeb::Parser
facilities together in a convinient and coherent way.
Constants
- HELPERS
Greeb::Core
uses several helpers fromGreeb::Parser
to perform additional analysis using there heuristic methods.
Public Instance Methods
analyze(text, helpers = HELPERS)
click to toggle source
Recognize e-mail addresses in the input text.
@param text [String] an input text. @param helpers [Array<Symbol>] a set of helper identifiers.
@return [Array<Greeb::Span>] a set of tokens.
# File lib/greeb/core.rb, line 19 def analyze(text, helpers = HELPERS) Greeb::Tokenizer.tokenize(text).tap do |tokens| helpers.each do |helper| Greeb::Parser.public_send(helper, text).each do |parsed| extract_spans(tokens, parsed) end end end end
Also aliased as: '[]'
extract_spans(spans, span)
click to toggle source
Extact spans of the specified type from the input spans set.
@param spans [Array<Greeb::Span>] input spans set. @param span [Greeb::Span] span to be extracted.
@return [Greeb::Span] span to be extracted.
# File lib/greeb/core.rb, line 38 def extract_spans(spans, span) from = spans.index { |e| e.from == span.from } to = spans.index { |e| e.to == span.to } return unless from && to spans[from..to] = span end