module Pipeline

Pipeline is a library that provides a common interface for implementing pipeline (ETL) behaviour. You can register extractors that may use transformations before pushing into specified loaders.

Semantic Versioning (semver.org/)

Constants

VERSION

Public Instance Methods

extractors() click to toggle source

# File lib/pipeline.rb, line 17
def extractors
  @extractors ||= []
end

loaders() click to toggle source

# File lib/pipeline.rb, line 33
def loaders
  @loaders ||= []
end

logger() click to toggle source

# File lib/pipeline.rb, line 37
def logger
  Pipeline::Logging.logger
end

register_extractor(extractor) click to toggle source

# File lib/pipeline.rb, line 13
def register_extractor(extractor)
  extractors << extractor
end

register_loader(loader) click to toggle source

# File lib/pipeline.rb, line 29
def register_loader(loader)
  loaders << loader
end

register_transformer(transformer) click to toggle source

# File lib/pipeline.rb, line 21
def register_transformer(transformer)
  transformers << transformer
end

transformers() click to toggle source

# File lib/pipeline.rb, line 25
def transformers
  @transformers ||= []
end