class Google::Apis::DataflowV1b3::SourceSplitRequest

Represents the operation to split a high-level Source specification into bundles (parts for parallel processing). At a high level, splitting of a source into bundles happens as follows: SourceSplitRequest is applied to the source. If it returns SOURCE_SPLIT_OUTCOME_USE_CURRENT, no further splitting happens and the source is used “as is”. Otherwise, splitting is applied recursively to each produced DerivedSource. As an optimization, for any Source, if its does_not_need_splitting is true, the framework assumes that splitting this source would return SOURCE_SPLIT_OUTCOME_USE_CURRENT, and doesn't initiate a SourceSplitRequest. This applies both to the initial source being split and to bundles produced from it.

Attributes

options[RW]

Hints for splitting a Source into bundles (parts for parallel processing) using SourceSplitRequest. Corresponds to the JSON property `options` @return [Google::Apis::DataflowV1b3::SourceSplitOptions]

source[RW]

A source that records can be read and decoded from. Corresponds to the JSON property `source` @return [Google::Apis::DataflowV1b3::Source]

Public Class Methods

new(**args) click to toggle source
# File lib/google/apis/dataflow_v1b3/classes.rb, line 4782
def initialize(**args)
   update!(**args)
end

Public Instance Methods

update!(**args) click to toggle source

Update properties of this object

# File lib/google/apis/dataflow_v1b3/classes.rb, line 4787
def update!(**args)
  @options = args[:options] if args.key?(:options)
  @source = args[:source] if args.key?(:source)
end