Add google_vertex_ai_evaluation_metric resource

[gregbreard]

Summary

Adds a new resource google_vertex_ai_evaluation_metric for managing
Vertex AI EvaluationMetric resources, which represent reusable metric
configurations for model evaluation (LLM-based metrics and custom code
execution metrics).

Resource details

• CRUD: Create, Get, List, Delete (LRO). No Update — resource is immutable.
• Client-specified ID: Optional (evaluation_metric_id parameter)
• Async: Delete only (LRO)
• Fields: display_name, description, metric (JSON), labels, gcs_uri, encryption_spec

`google_vertex_ai_evaluation_metric`

[github-actions]

Googlers: For automatic test runs see go/terraform-auto-test-runs.

@melinath, a repository maintainer, has been assigned to review your changes. If you have not received review feedback within 2 business days, please leave a comment on this PR asking them to take a look.

You can help make sure that review is quick by doing a self-review and by running impacted tests locally.

[gregbreard]

@navekshasood could you review this as the service team reviewer?

[modular-magician]

Hi there, I'm the Modular magician. I've detected the following information about your changes for commit dfa14d9:

Diff report

Your PR generated the following diffs in downstream repositories:

Repository	Diff Link	Changes
google provider	View Diff	5 files changed, 1353 insertions(+)
google-beta provider	View Diff	5 files changed, 1353 insertions(+)
terraform-google-conversion	View Diff	1 file changed, 212 insertions(+)

Missing test report

Your PR includes resource fields which are not covered by any test.

Resource: google_vertex_ai_evaluation_metric (1 total tests)
Please add an acceptance test which includes these fields. The test should include the following:

resource "google_vertex_ai_evaluation_metric" "primary" {
  encryption_spec {
    kms_key_name = # value needed
  }
  gcs_uri = # value needed
  labels  = # value needed
}

Missing service labels

The following new resources do not have corresponding service labels:

• google_vertex_ai_evaluation_metric

If you believe this detection to be incorrect please raise the concern with your reviewer. Googlers: This error is safe to ignore once you've completed go/fix-missing-service-labels.
An override-missing-service-label label can be added to allow merging.

Test report

Analytics

Total Tests	Passed	Skipped	Affected
111	87	7	17

Affected Service Packages

• vertexai

Learn how VCR tests work

---

Step 1: Replaying Mode

Action taken

Found 17 affected test(s) by replaying old test recordings. Starting RECORDING based on the most recent commit.

Click here to see the affected tests

• TestAccVertexAIEvaluationMetric_vertexAiEvaluationMetricExample
• TestAccVertexAIFeatureGroupFeature_updated
• TestAccVertexAIFeatureGroupFeature_vertexAiFeatureGroupFeatureExample
• TestAccVertexAIFeatureGroupFeature_vertexAiFeatureGroupFeatureWithVersionColumnNameExample
• TestAccVertexAIFeatureGroupIamBindingGenerated
• TestAccVertexAIFeatureGroupIamMemberGenerated
• TestAccVertexAIFeatureGroupIamPolicyGenerated
• TestAccVertexAIFeatureGroup_updated
• TestAccVertexAIFeatureGroup_vertexAiFeatureGroupExample
• TestAccVertexAIFeatureOnlineStoreFeatureviewIamBindingGenerated
• TestAccVertexAIFeatureOnlineStoreFeatureviewIamMemberGenerated
• TestAccVertexAIFeatureOnlineStoreFeatureviewIamPolicyGenerated
• TestAccVertexAIFeatureOnlineStoreFeatureview_vertexAiFeatureonlinestoreFeatureviewCrossProjectExample
• TestAccVertexAIFeatureOnlineStoreFeatureview_vertexAiFeatureonlinestoreFeatureviewExample
• TestAccVertexAIFeatureOnlineStoreFeatureview_vertexAiFeatureonlinestoreFeatureviewFeatureRegistryExample
• TestAccVertexAIFeatureOnlineStoreFeatureview_vertexAiFeatureonlinestoreFeatureview_featureRegistry_updated
• TestAccVertexAIFeatureOnlineStoreFeatureview_vertexAiFeatureonlinestoreFeatureview_updated

View the replaying VCR build log

---

Step 2: Recording Mode

Recording Mode	Replaying Rerun	Test Name
✅ Log	✅	TestAccVertexAIEvaluationMetric_vertexAiEvaluationMetricExample
✅ Log	✅	TestAccVertexAIFeatureGroupFeature_updated
✅ Log	✅	TestAccVertexAIFeatureGroupFeature_vertexAiFeatureGroupFeatureExample
✅ Log	✅	TestAccVertexAIFeatureGroupFeature_vertexAiFeatureGroupFeatureWithVersionColumnNameExample
✅ Log	✅	TestAccVertexAIFeatureGroupIamBindingGenerated
✅ Log	✅	TestAccVertexAIFeatureGroupIamMemberGenerated
✅ Log	✅	TestAccVertexAIFeatureGroupIamPolicyGenerated
✅ Log	✅	TestAccVertexAIFeatureGroup_updated
✅ Log	✅	TestAccVertexAIFeatureGroup_vertexAiFeatureGroupExample
✅ Log	✅	TestAccVertexAIFeatureOnlineStoreFeatureviewIamBindingGenerated
✅ Log	✅	TestAccVertexAIFeatureOnlineStoreFeatureviewIamPolicyGenerated
✅ Log	✅	TestAccVertexAIFeatureOnlineStoreFeatureview_vertexAiFeatureonlinestoreFeatureviewCrossProjectExample
✅ Log	✅	TestAccVertexAIFeatureOnlineStoreFeatureview_vertexAiFeatureonlinestoreFeatureviewFeatureRegistryExample
✅ Log	✅	TestAccVertexAIFeatureOnlineStoreFeatureview_vertexAiFeatureonlinestoreFeatureview_updated
❌ Error · Log	-	TestAccVertexAIFeatureOnlineStoreFeatureviewIamMemberGenerated
❌ Error · Log	-	TestAccVertexAIFeatureOnlineStoreFeatureview_vertexAiFeatureonlinestoreFeatureviewExample
❌ Error · Log	-	TestAccVertexAIFeatureOnlineStoreFeatureview_vertexAiFeatureonlinestoreFeatureview_featureRegistry_updated

Caution

Issues requiring attention before PR completion

🔴 Initial Recording Failed: Some tests failed during the recording step. See the table above for details.

Please address these issues to complete your PR. If you believe these detections are incorrect or unrelated to your change, please raise the concern with your reviewer.

View the recording VCR build log or the debug logs folder for detailed results.

@gregbreard, @melinath VCR tests complete for dfa14d9!

[modular-magician]

Hi there, I'm the Modular magician. I've detected the following information about your changes for commit c134d96:

Diff report

Your PR generated the following diffs in downstream repositories:

Repository	Diff Link	Changes
google provider	View Diff	5 files changed, 1445 insertions(+)
google-beta provider	View Diff	5 files changed, 1445 insertions(+)
terraform-google-conversion	View Diff	1 file changed, 212 insertions(+)

Missing test report

Your PR includes resource fields which are not covered by any test.

Resource: google_vertex_ai_evaluation_metric (2 total tests)
Please add an acceptance test which includes these fields. The test should include the following:

resource "google_vertex_ai_evaluation_metric" "primary" {
  encryption_spec {
    kms_key_name = # value needed
  }
}

Test report

Analytics

Total Tests	Passed	Skipped	Affected
112	103	7	2

Affected Service Packages

• vertexai

Learn how VCR tests work

---

Step 1: Replaying Mode

Action taken

Found 2 affected test(s) by replaying old test recordings. Starting RECORDING based on the most recent commit.

Click here to see the affected tests

• TestAccVertexAIEvaluationMetric_vertexAiEvaluationMetricFullExample
• TestAccVertexAIFeatureOnlineStoreFeatureview_vertexAiFeatureonlinestoreFeatureview_featureRegistry_updated

View the replaying VCR build log

---

Step 2: Recording Mode

Recording Mode	Replaying Rerun	Test Name
✅ Log	✅	TestAccVertexAIEvaluationMetric_vertexAiEvaluationMetricFullExample
❌ Error · Log	-	TestAccVertexAIFeatureOnlineStoreFeatureview_vertexAiFeatureonlinestoreFeatureview_featureRegistry_updated

Caution

Issues requiring attention before PR completion

🔴 Initial Recording Failed: Some tests failed during the recording step. See the table above for details.

Please address these issues to complete your PR. If you believe these detections are incorrect or unrelated to your change, please raise the concern with your reviewer.

View the recording VCR build log or the debug logs folder for detailed results.

@gregbreard, @melinath VCR tests complete for c134d96!