Commit d2c8c6f
committed
feat: add evaluation metrics and autorater configuration to the AI Platform v1 API
feat: add evaluation configuration and dataset runs to TuningJob
feat: add multimodal input support and custom output formats to evaluation metrics
PiperOrigin-RevId: 893059415
Source-Link: googleapis/googleapis@582172d
Source-Link: googleapis/googleapis-gen@b8fd776
Copy-Tag: eyJwIjoiQWlQbGF0Zm9ybS8uT3dsQm90LnlhbWwiLCJoIjoiYjhmZDc3Njc2ZGUwMDYzZTQ2MjY1NGE5NGYzOGM5YjE3YzQwNDJmNyJ91 parent aafc718 commit d2c8c6f
2,133 files changed
Lines changed: 437540 additions & 0 deletions
File tree
- owl-bot-staging/AiPlatform/v1
- proto/src
- GPBMetadata/Google/Cloud/Aiplatform/V1
- Google/Cloud/AIPlatform/V1
- ApiAuth
- Artifact
- AugmentPromptRequest
- BatchMigrateResourcesOperationMetadata
- BatchPredictionJob
- BatchReadFeatureValuesRequest
- CachedContent
- Candidate
- CodeExecutionResult
- CometSpec
- ComputationBasedMetricSpec
- ContentMap
- CorpusStatus
- CorroborateContentRequest
- DeleteFeatureValuesRequest
- DeleteFeatureValuesResponse
- DeployRequest
- DeployedIndexAuthConfig
- DeployedIndex
- DeployedModel
- DynamicRetrievalConfig
- EmbedContentRequest
- EmbedContentResponse
- ErrorAnalysisAnnotation
- EvaluatedAnnotation
- Event
- ExamplesOverride
- Examples
- ExampleGcsSource
- ExecutableCode
- Execution
- ExplanationMetadataOverride
- ExplanationMetadata
- InputMetadata
- Visualization
- ExportDataConfig
- ExportFeatureValuesRequest
- ExportModelOperationMetadata
- ExportModelRequest
- FeatureGroup
- BigQuery
- FeatureNoiseSigma
- FeatureOnlineStore
- Bigtable
- FeatureValue
- FeatureViewDataKey
- FeatureViewDirectWriteRequest
- DataKeyAndFeatureValues
- FeatureViewDirectWriteResponse
- FeatureViewSync
- FeatureView
- FeatureRegistrySource
- IndexConfig
- FeaturestoreMonitoringConfig
- ImportFeaturesAnalysis
- Featurestore
- OnlineServingConfig
- Feature
- MonitoringStatsAnomaly
- FetchFeatureValuesResponse
- FeatureNameValuePairList
- FileStatus
- FindNeighborsRequest
- Query
- FindNeighborsResponse
- FunctionCallingConfig
- GenAiAdvancedFeaturesConfig
- GenerateContentResponse
- PromptFeedback
- UsageMetadata
- GenerationConfig
- RoutingConfig
- AutoRoutingMode
- ThinkingConfig
- GoogleDriveSource
- ResourceId
- GroundingChunk
- Maps
- PlaceAnswerSources
- GroundingMetadata
- ImageConfig
- ImportFeatureValuesRequest
- IndexDatapoint
- NumericRestriction
- Index
- JiraSource
- LogprobsResult
- Measurement
- MetadataSchema
- MetadataStore
- MetricxSpec
- Metric
- MigratableResource
- DataLabelingDataset
- MigrateResourceRequest
- MigrateDataLabelingDatasetConfig
- ModelDeploymentMonitoringBigQueryTable
- ModelDeploymentMonitoringJob
- ModelEvaluationSlice
- Slice
- SliceSpec
- ModelEvaluation
- ModelMonitoringAlertConfig
- ModelMonitoringObjectiveConfig
- ExplanationConfig
- ExplanationBaseline
- ModelMonitoringStatsAnomalies
- ModelSourceInfo
- Model
- ExportFormat
- NasJobOutput
- NasJobSpec
- MultiTrialAlgorithmSpec
- MetricSpec
- NasTrial
- NearestNeighborQuery
- NumericFilter
- NearestNeighborSearchOperationMetadata
- RecordError
- NearestNeighbors
- NotebookExecutionJob
- NotebookRuntime
- OutputFieldSpec
- Part
- MediaResolution
- PersistentResource
- PipelineJob
- RuntimeConfig
- PipelineTaskDetail
- PipelineTaskExecutorDetail
- PostStartupScriptConfig
- Presets
- Probe
- PublisherModel
- CallToAction
- Deploy
- RagChunk
- RagContexts
- RagEmbeddingModelConfig
- RagFileChunkingConfig
- RagFileParsingConfig
- RagManagedDbConfig
- RagRetrievalConfig
- Ranking
- RagVectorDbConfig
- RagManagedDb
- ReadFeatureValuesResponse
- EntityView
- ReadTensorboardUsageResponse
- ReasoningEngineSpec
- SourceCodeSpec
- ReservationAffinity
- ResourcePool
- RetrieveContextsRequest
- VertexRagStore
- SafetyRating
- SafetySetting
- SampleConfig
- SamplingStrategy
- Schedule
- Scheduling
- SearchDataItemsRequest
- SearchModelDeploymentMonitoringStatsAnomaliesRequest
- SlackSource
- SlackChannels
- SpeculativeDecodingSpec
- StudySpec
- MetricSpec
- ParameterSpec
- ConditionalParameterSpec
- Study
- SupervisedHyperParameters
- SupervisedTuningDatasetDistribution
- TensorboardTimeSeries
- Tensor
- Tool
- ComputerUse
- Trial
- UrlMetadata
- UsageMetadata
- VertexAISearch
- VertexRagStore
- samples/V1
- DataFoundryServiceClient
- DatasetServiceClient
- DeploymentResourcePoolServiceClient
- EndpointServiceClient
- EvaluationServiceClient
- FeatureOnlineStoreAdminServiceClient
- FeatureOnlineStoreServiceClient
- FeatureRegistryServiceClient
- FeaturestoreOnlineServingServiceClient
- FeaturestoreServiceClient
- GenAiCacheServiceClient
- GenAiTuningServiceClient
- IndexEndpointServiceClient
- IndexServiceClient
- JobServiceClient
- LlmUtilityServiceClient
- MatchServiceClient
- MetadataServiceClient
- MigrationServiceClient
- ModelGardenServiceClient
- ModelServiceClient
- NotebookServiceClient
- PersistentResourceServiceClient
- PipelineServiceClient
- PredictionServiceClient
- ReasoningEngineExecutionServiceClient
- ReasoningEngineServiceClient
- ScheduleServiceClient
- SessionServiceClient
- SpecialistPoolServiceClient
- TensorboardServiceClient
- VertexRagDataServiceClient
- VertexRagServiceClient
- VizierServiceClient
- src/V1
- Client
- resources
- tests/Unit/V1/Client
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
owl-bot-staging/AiPlatform/v1/proto/src/GPBMetadata/Google/Cloud/Aiplatform/V1/AcceleratorType.php
Lines changed: 24 additions & 0 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
Lines changed: 29 additions & 0 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
Lines changed: 27 additions & 0 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
Lines changed: 26 additions & 0 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
Lines changed: 28 additions & 0 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
Lines changed: 37 additions & 0 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
Lines changed: 31 additions & 0 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
0 commit comments