class Google::Apis::DataflowV1b3::FlexTemplateRuntimeEnvironment

The environment values to be set at runtime for flex template.

Attributes

additional_experiments[RW]

Additional experiment flags for the job. Corresponds to the JSON property `additionalExperiments` @return [Array<String>]

additional_user_labels[RW]

Additional user labels to be specified for the job. Keys and values must follow the restrictions specified in the [labeling restrictions](cloud. google.com/compute/docs/labeling-resources#restrictions) page. An object containing a list of “key”: value pairs. Example: ` “name”: “wrench”, “mass”: “ 1kg”, “count”: “3” `. Corresponds to the JSON property `additionalUserLabels` @return [Hash<String,String>]

autoscaling_algorithm[RW]

The algorithm to use for autoscaling Corresponds to the JSON property `autoscalingAlgorithm` @return [String]

disk_size_gb[RW]

Worker disk size, in gigabytes. Corresponds to the JSON property `diskSizeGb` @return [Fixnum]

dump_heap_on_oom[RW]

If true, save a heap dump before killing a thread or process which is GC thrashing or out of memory. The location of the heap file will either be echoed back to the user, or the user will be given the opportunity to download the heap file. Corresponds to the JSON property `dumpHeapOnOom` @return [Boolean]

dump_heap_on_oom?[RW]

If true, save a heap dump before killing a thread or process which is GC thrashing or out of memory. The location of the heap file will either be echoed back to the user, or the user will be given the opportunity to download the heap file. Corresponds to the JSON property `dumpHeapOnOom` @return [Boolean]

enable_streaming_engine[RW]

Whether to enable Streaming Engine for the job. Corresponds to the JSON property `enableStreamingEngine` @return [Boolean]

enable_streaming_engine?[RW]

Whether to enable Streaming Engine for the job. Corresponds to the JSON property `enableStreamingEngine` @return [Boolean]

flexrs_goal[RW]

Set FlexRS goal for the job. cloud.google.com/dataflow/docs/guides/ flexrs Corresponds to the JSON property `flexrsGoal` @return [String]

ip_configuration[RW]

Configuration for VM IPs. Corresponds to the JSON property `ipConfiguration` @return [String]

kms_key_name[RW]

Name for the Cloud KMS key for the job. Key format is: projects//locations// keyRings//cryptoKeys/ Corresponds to the JSON property `kmsKeyName` @return [String]

launcher_machine_type[RW]

The machine type to use for launching the job. The default is n1-standard-1. Corresponds to the JSON property `launcherMachineType` @return [String]

machine_type[RW]

The machine type to use for the job. Defaults to the value from the template if not specified. Corresponds to the JSON property `machineType` @return [String]

max_workers[RW]

The maximum number of Google Compute Engine instances to be made available to your pipeline during execution, from 1 to 1000. Corresponds to the JSON property `maxWorkers` @return [Fixnum]

network[RW]

Network to which VMs will be assigned. If empty or unspecified, the service will use the network “default”. Corresponds to the JSON property `network` @return [String]

num_workers[RW]

The initial number of Google Compute Engine instances for the job. Corresponds to the JSON property `numWorkers` @return [Fixnum]

save_heap_dumps_to_gcs_path[RW]

Cloud Storage bucket (directory) to upload heap dumps to the given location. Enabling this implies that heap dumps should be generated on OOM ( dump_heap_on_oom is set to true). Corresponds to the JSON property `saveHeapDumpsToGcsPath` @return [String]

sdk_container_image[RW]

Docker registry location of container image to use for the 'worker harness. Default is the container for the version of the SDK. Note this field is only valid for portable pipelines. Corresponds to the JSON property `sdkContainerImage` @return [String]

service_account_email[RW]

The email address of the service account to run the job as. Corresponds to the JSON property `serviceAccountEmail` @return [String]

staging_location[RW]

The Cloud Storage path for staging local files. Must be a valid Cloud Storage URL, beginning with `gs://`. Corresponds to the JSON property `stagingLocation` @return [String]

subnetwork[RW]

Subnetwork to which VMs will be assigned, if desired. You can specify a subnetwork using either a complete URL or an abbreviated path. Expected to be of the form “www.googleapis.com/compute/v1/projects/HOST_PROJECT_ID/ regions/REGION/subnetworks/SUBNETWORK” or “regions/REGION/subnetworks/ SUBNETWORK”. If the subnetwork is located in a Shared VPC network, you must use the complete URL. Corresponds to the JSON property `subnetwork` @return [String]

temp_location[RW]

The Cloud Storage path to use for temporary files. Must be a valid Cloud Storage URL, beginning with `gs://`. Corresponds to the JSON property `tempLocation` @return [String]

worker_region[RW]

The Compute Engine region (cloud.google.com/compute/docs/regions-zones/ regions-zones) in which worker processing should occur, e.g. “us-west1”. Mutually exclusive with worker_zone. If neither worker_region nor worker_zone is specified, default to the control plane's region. Corresponds to the JSON property `workerRegion` @return [String]

worker_zone[RW]

The Compute Engine zone (cloud.google.com/compute/docs/regions-zones/ regions-zones) in which worker processing should occur, e.g. “us-west1-a”. Mutually exclusive with worker_region. If neither worker_region nor worker_zone is specified, a zone in the control plane's region is chosen based on available capacity. If both `worker_zone` and `zone` are set, `worker_zone` takes precedence. Corresponds to the JSON property `workerZone` @return [String]

zone[RW]

The Compute Engine [availability zone](cloud.google.com/compute/docs/ regions-zones/regions-zones) for launching worker instances to run your pipeline. In the future, worker_zone will take precedence. Corresponds to the JSON property `zone` @return [String]

Public Class Methods

new(**args) click to toggle source
# File lib/google/apis/dataflow_v1b3/classes.rb, line 1601
def initialize(**args)
   update!(**args)
end

Public Instance Methods

update!(**args) click to toggle source

Update properties of this object

# File lib/google/apis/dataflow_v1b3/classes.rb, line 1606
def update!(**args)
  @additional_experiments = args[:additional_experiments] if args.key?(:additional_experiments)
  @additional_user_labels = args[:additional_user_labels] if args.key?(:additional_user_labels)
  @autoscaling_algorithm = args[:autoscaling_algorithm] if args.key?(:autoscaling_algorithm)
  @disk_size_gb = args[:disk_size_gb] if args.key?(:disk_size_gb)
  @dump_heap_on_oom = args[:dump_heap_on_oom] if args.key?(:dump_heap_on_oom)
  @enable_streaming_engine = args[:enable_streaming_engine] if args.key?(:enable_streaming_engine)
  @flexrs_goal = args[:flexrs_goal] if args.key?(:flexrs_goal)
  @ip_configuration = args[:ip_configuration] if args.key?(:ip_configuration)
  @kms_key_name = args[:kms_key_name] if args.key?(:kms_key_name)
  @launcher_machine_type = args[:launcher_machine_type] if args.key?(:launcher_machine_type)
  @machine_type = args[:machine_type] if args.key?(:machine_type)
  @max_workers = args[:max_workers] if args.key?(:max_workers)
  @network = args[:network] if args.key?(:network)
  @num_workers = args[:num_workers] if args.key?(:num_workers)
  @save_heap_dumps_to_gcs_path = args[:save_heap_dumps_to_gcs_path] if args.key?(:save_heap_dumps_to_gcs_path)
  @sdk_container_image = args[:sdk_container_image] if args.key?(:sdk_container_image)
  @service_account_email = args[:service_account_email] if args.key?(:service_account_email)
  @staging_location = args[:staging_location] if args.key?(:staging_location)
  @subnetwork = args[:subnetwork] if args.key?(:subnetwork)
  @temp_location = args[:temp_location] if args.key?(:temp_location)
  @worker_region = args[:worker_region] if args.key?(:worker_region)
  @worker_zone = args[:worker_zone] if args.key?(:worker_zone)
  @zone = args[:zone] if args.key?(:zone)
end