module Pipeline
Pipeline
is a library that provides a common interface for implementing pipeline (ETL) behaviour. You can register extractors that may use transformations before pushing into specified loaders.
Semantic Versioning (semver.org/)
Constants
- VERSION
Public Instance Methods
extractors()
click to toggle source
# File lib/pipeline.rb, line 17 def extractors @extractors ||= [] end
loaders()
click to toggle source
# File lib/pipeline.rb, line 33 def loaders @loaders ||= [] end
logger()
click to toggle source
# File lib/pipeline.rb, line 37 def logger Pipeline::Logging.logger end
register_extractor(extractor)
click to toggle source
# File lib/pipeline.rb, line 13 def register_extractor(extractor) extractors << extractor end
register_loader(loader)
click to toggle source
# File lib/pipeline.rb, line 29 def register_loader(loader) loaders << loader end
register_transformer(transformer)
click to toggle source
# File lib/pipeline.rb, line 21 def register_transformer(transformer) transformers << transformer end
transformers()
click to toggle source
# File lib/pipeline.rb, line 25 def transformers @transformers ||= [] end