class Google::Apis::DatalabelingV1beta1::GoogleCloudDatalabelingV1beta1EvaluationJobConfig

Configures specific details of how a continuous evaluation job works. Provide this configuration when you create an EvaluationJob.

Attributes

bigquery_import_keys[RW]

Required. Prediction keys that tell Data Labeling Service where to find the data for evaluation in your BigQuery table. When the service samples prediction input and output from your model version and saves it to BigQuery, the data gets stored as JSON strings in the BigQuery table. These keys tell Data Labeling Service how to parse the JSON. You can provide the following entries in this field: * `data_json_key`: the data key for prediction input. You must provide either this key or `reference_json_key`. * ` reference_json_key`: the data reference key for prediction input. You must provide either this key or `data_json_key`. * `label_json_key`: the label key for prediction output. Required. * `label_score_json_key`: the score key for prediction output. Required. * `bounding_box_json_key`: the bounding box key for prediction output. Required if your model version perform image object detection. Learn [how to configure prediction keys](/ml-engine/docs/continuous- evaluation/create-job#prediction-keys). Corresponds to the JSON property `bigqueryImportKeys` @return [Hash<String,String>]

bounding_poly_config[RW]

Config for image bounding poly (and bounding box) human labeling task. Corresponds to the JSON property `boundingPolyConfig` @return [Google::Apis::DatalabelingV1beta1::GoogleCloudDatalabelingV1beta1BoundingPolyConfig]

evaluation_config[RW]

Configuration details used for calculating evaluation metrics and creating an Evaluation. Corresponds to the JSON property `evaluationConfig` @return [Google::Apis::DatalabelingV1beta1::GoogleCloudDatalabelingV1beta1EvaluationConfig]

evaluation_job_alert_config[RW]

Provides details for how an evaluation job sends email alerts based on the results of a run. Corresponds to the JSON property `evaluationJobAlertConfig` @return [Google::Apis::DatalabelingV1beta1::GoogleCloudDatalabelingV1beta1EvaluationJobAlertConfig]

example_count[RW]

Required. The maximum number of predictions to sample and save to BigQuery during each evaluation interval. This limit overrides ` example_sample_percentage`: even if the service has not sampled enough predictions to fulfill `example_sample_perecentage` during an interval, it stops sampling predictions when it meets this limit. Corresponds to the JSON property `exampleCount` @return [Fixnum]

example_sample_percentage[RW]

Required. Fraction of predictions to sample and save to BigQuery during each evaluation interval. For example, 0.1 means 10% of predictions served by your model version get saved to BigQuery. Corresponds to the JSON property `exampleSamplePercentage` @return [Float]

human_annotation_config[RW]

Configuration for how human labeling task should be done. Corresponds to the JSON property `humanAnnotationConfig` @return [Google::Apis::DatalabelingV1beta1::GoogleCloudDatalabelingV1beta1HumanAnnotationConfig]

image_classification_config[RW]

Config for image classification human labeling task. Corresponds to the JSON property `imageClassificationConfig` @return [Google::Apis::DatalabelingV1beta1::GoogleCloudDatalabelingV1beta1ImageClassificationConfig]

input_config[RW]

The configuration of input data, including data type, location, etc. Corresponds to the JSON property `inputConfig` @return [Google::Apis::DatalabelingV1beta1::GoogleCloudDatalabelingV1beta1InputConfig]

text_classification_config[RW]

Config for text classification human labeling task. Corresponds to the JSON property `textClassificationConfig` @return [Google::Apis::DatalabelingV1beta1::GoogleCloudDatalabelingV1beta1TextClassificationConfig]

Public Class Methods

new(**args) click to toggle source
# File lib/google/apis/datalabeling_v1beta1/classes.rb, line 1976
def initialize(**args)
   update!(**args)
end

Public Instance Methods

update!(**args) click to toggle source

Update properties of this object

# File lib/google/apis/datalabeling_v1beta1/classes.rb, line 1981
def update!(**args)
  @bigquery_import_keys = args[:bigquery_import_keys] if args.key?(:bigquery_import_keys)
  @bounding_poly_config = args[:bounding_poly_config] if args.key?(:bounding_poly_config)
  @evaluation_config = args[:evaluation_config] if args.key?(:evaluation_config)
  @evaluation_job_alert_config = args[:evaluation_job_alert_config] if args.key?(:evaluation_job_alert_config)
  @example_count = args[:example_count] if args.key?(:example_count)
  @example_sample_percentage = args[:example_sample_percentage] if args.key?(:example_sample_percentage)
  @human_annotation_config = args[:human_annotation_config] if args.key?(:human_annotation_config)
  @image_classification_config = args[:image_classification_config] if args.key?(:image_classification_config)
  @input_config = args[:input_config] if args.key?(:input_config)
  @text_classification_config = args[:text_classification_config] if args.key?(:text_classification_config)
end