class Google::Apis::DataflowV1b3::SourceOperationRequest

A work item that represents the different operations that can be performed on a user-defined Source specification.

Attributes

get_metadata[RW]

A request to compute the SourceMetadata of a Source. Corresponds to the JSON property `getMetadata` @return [Google::Apis::DataflowV1b3::SourceGetMetadataRequest]

name[RW]

User-provided name of the Read instruction for this source. Corresponds to the JSON property `name` @return [String]

original_name[RW]

System-defined name for the Read instruction for this source in the original workflow graph. Corresponds to the JSON property `originalName` @return [String]

split[RW]

Represents the operation to split a high-level Source specification into bundles (parts for parallel processing). At a high level, splitting of a source into bundles happens as follows: SourceSplitRequest is applied to the source. If it returns SOURCE_SPLIT_OUTCOME_USE_CURRENT, no further splitting happens and the source is used “as is”. Otherwise, splitting is applied recursively to each produced DerivedSource. As an optimization, for any Source, if its does_not_need_splitting is true, the framework assumes that splitting this source would return SOURCE_SPLIT_OUTCOME_USE_CURRENT, and doesn't initiate a SourceSplitRequest. This applies both to the initial source being split and to bundles produced from it. Corresponds to the JSON property `split` @return [Google::Apis::DataflowV1b3::SourceSplitRequest]

stage_name[RW]

System-defined name of the stage containing the source operation. Unique across the workflow. Corresponds to the JSON property `stageName` @return [String]

system_name[RW]

System-defined name of the Read instruction for this source. Unique across the workflow. Corresponds to the JSON property `systemName` @return [String]

Public Class Methods

new(**args) click to toggle source
# File lib/google/apis/dataflow_v1b3/classes.rb, line 4690
def initialize(**args)
   update!(**args)
end

Public Instance Methods

update!(**args) click to toggle source

Update properties of this object

# File lib/google/apis/dataflow_v1b3/classes.rb, line 4695
def update!(**args)
  @get_metadata = args[:get_metadata] if args.key?(:get_metadata)
  @name = args[:name] if args.key?(:name)
  @original_name = args[:original_name] if args.key?(:original_name)
  @split = args[:split] if args.key?(:split)
  @stage_name = args[:stage_name] if args.key?(:stage_name)
  @system_name = args[:system_name] if args.key?(:system_name)
end