class Google::Apis::DatalabelingV1beta1::GoogleCloudDatalabelingV1beta1EvaluationJob

Defines an evaluation job that runs periodically to generate Evaluations. [ Creating an evaluation job](/ml-engine/docs/continuous-evaluation/create-job) is the starting point for using continuous evaluation.

Attributes

annotation_spec_set[RW]

Required. Name of the AnnotationSpecSet describing all the labels that your machine learning model outputs. You must create this resource before you create an evaluation job and provide its name in the following format: “ projects/`project_id`/annotationSpecSets/`annotation_spec_set_id`” Corresponds to the JSON property `annotationSpecSet` @return [String]

attempts[RW]

Output only. Every time the evaluation job runs and an error occurs, the failed attempt is appended to this array. Corresponds to the JSON property `attempts` @return [Array<Google::Apis::DatalabelingV1beta1::GoogleCloudDatalabelingV1beta1Attempt>]

create_time[RW]

Output only. Timestamp of when this evaluation job was created. Corresponds to the JSON property `createTime` @return [String]

description[RW]

Required. Description of the job. The description can be up to 25,000 characters long. Corresponds to the JSON property `description` @return [String]

evaluation_job_config[RW]

Configures specific details of how a continuous evaluation job works. Provide this configuration when you create an EvaluationJob. Corresponds to the JSON property `evaluationJobConfig` @return [Google::Apis::DatalabelingV1beta1::GoogleCloudDatalabelingV1beta1EvaluationJobConfig]

label_missing_ground_truth[RW]

Required. Whether you want Data Labeling Service to provide ground truth labels for prediction input. If you want the service to assign human labelers to annotate your data, set this to `true`. If you want to provide your own ground truth labels in the evaluation job's BigQuery table, set this to `false` . Corresponds to the JSON property `labelMissingGroundTruth` @return [Boolean]

label_missing_ground_truth?[RW]

Required. Whether you want Data Labeling Service to provide ground truth labels for prediction input. If you want the service to assign human labelers to annotate your data, set this to `true`. If you want to provide your own ground truth labels in the evaluation job's BigQuery table, set this to `false` . Corresponds to the JSON property `labelMissingGroundTruth` @return [Boolean]

model_version[RW]

Required. The [AI Platform Prediction model version](/ml-engine/docs/ prediction-overview) to be evaluated. Prediction input and output is sampled from this model version. When creating an evaluation job, specify the model version in the following format: “projects/`project_id`/models/`model_name`/ versions/`version_name`” There can only be one evaluation job per model version. Corresponds to the JSON property `modelVersion` @return [String]

name[RW]

Output only. After you create a job, Data Labeling Service assigns a name to the job with the following format: “projects/`project_id`/evaluationJobs/ ` evaluation_job_id`” Corresponds to the JSON property `name` @return [String]

schedule[RW]

Required. Describes the interval at which the job runs. This interval must be at least 1 day, and it is rounded to the nearest day. For example, if you specify a 50-hour interval, the job runs every 2 days. You can provide the schedule in [crontab format](/scheduler/docs/configuring/cron-job-schedules) or in an [English-like format](/appengine/docs/standard/python/config/cronref# schedule_format). Regardless of what you specify, the job will run at 10:00 AM UTC. Only the interval from this schedule is used, not the specific time of day. Corresponds to the JSON property `schedule` @return [String]

state[RW]

Output only. Describes the current state of the job. Corresponds to the JSON property `state` @return [String]

Public Class Methods

new(**args) click to toggle source
# File lib/google/apis/datalabeling_v1beta1/classes.rb, line 1852
def initialize(**args)
   update!(**args)
end

Public Instance Methods

update!(**args) click to toggle source

Update properties of this object

# File lib/google/apis/datalabeling_v1beta1/classes.rb, line 1857
def update!(**args)
  @annotation_spec_set = args[:annotation_spec_set] if args.key?(:annotation_spec_set)
  @attempts = args[:attempts] if args.key?(:attempts)
  @create_time = args[:create_time] if args.key?(:create_time)
  @description = args[:description] if args.key?(:description)
  @evaluation_job_config = args[:evaluation_job_config] if args.key?(:evaluation_job_config)
  @label_missing_ground_truth = args[:label_missing_ground_truth] if args.key?(:label_missing_ground_truth)
  @model_version = args[:model_version] if args.key?(:model_version)
  @name = args[:name] if args.key?(:name)
  @schedule = args[:schedule] if args.key?(:schedule)
  @state = args[:state] if args.key?(:state)
end