class Google::Apis::DataflowV1b3::SourceSplitRequest
Represents the operation to split a high-level Source
specification into bundles (parts for parallel processing). At a high level, splitting of a source into bundles happens as follows: SourceSplitRequest
is applied to the source. If it returns SOURCE_SPLIT_OUTCOME_USE_CURRENT, no further splitting happens and the source is used “as is”. Otherwise, splitting is applied recursively to each produced DerivedSource
. As an optimization, for any Source
, if its does_not_need_splitting is true, the framework assumes that splitting this source would return SOURCE_SPLIT_OUTCOME_USE_CURRENT, and doesn't initiate a SourceSplitRequest
. This applies both to the initial source being split and to bundles produced from it.
Attributes
Hints for splitting a Source
into bundles (parts for parallel processing) using SourceSplitRequest
. Corresponds to the JSON property `options` @return [Google::Apis::DataflowV1b3::SourceSplitOptions]
A source that records can be read and decoded from. Corresponds to the JSON property `source` @return [Google::Apis::DataflowV1b3::Source]
Public Class Methods
# File lib/google/apis/dataflow_v1b3/classes.rb, line 4782 def initialize(**args) update!(**args) end
Public Instance Methods
Update properties of this object
# File lib/google/apis/dataflow_v1b3/classes.rb, line 4787 def update!(**args) @options = args[:options] if args.key?(:options) @source = args[:source] if args.key?(:source) end