Skip to content

Protocol Documentation

Table of Contents

Top

app.proto

ApiKey

Field Type Label Description
name string
key string

App

Field Type Label Description
id string App's id
name string Name of the application
description string Description of the application
problem_type string App's Problem Type (could be 'classification', 'regression', or 'forecasting')
target_columns string repeated List of target columns in the dataset
extra_columns App.ExtraColumnsEntry repeated Map of extra columns
training_data_proportion double Proportion of train/test split
status string Status of the application
metadata string Deprecated: not available anymore

Application metadata in JSON format | | org | RefEntity | | The organisation to that this application belongs | | project | RefEntity | | The project to that this application belongs | | dataset | RefEntity | | The dataset that this application uses | | stats | App.StatsEntry | repeated | Application's statistics | | audit | Audit | | Audit information |

App.ExtraColumnsEntry

Field Type Label Description
key string
value string

App.StatsEntry

Field Type Label Description
key string
value string

AppData

Field Type Label Description
id string
version int32
train_data_urls string repeated
test_data_urls string repeated
sample_train_data_url string
sample_test_data_url string
sample_data_url string
app_id string

CreateAppDataRequest

Field Type Label Description
app_id string
append bool
train_data_urls string repeated
test_data_urls string repeated
sample_train_data_url string
sample_test_data_url string
sample_data_url string

CreateAppRequest

Create new application request

Field Type Label Description
name string Name of the application
description string Description of the application
dataset_id string ID of the dataset used to create the application
problem_type string Type of the problem that this application solves (the value must be one of 'classification', 'regression', or 'forecasting')
target_columns string repeated
extra_columns CreateAppRequest.ExtraColumnsEntry repeated
training_data_proportion double
pipeline_configuration_id string Pipeline configuration id

CreateAppRequest.ExtraColumnsEntry

Field Type Label Description
key string
value string

DeleteAppRequest

Field Type Label Description
id string

DeleteDeploymentRequest

Field Type Label Description
id string
deployment_id string

Deployment

Field Type Label Description
id string
app RefEntity
model RefEntity
training RefTraining
status string
endpoint RefEntity
name string
type string
target string
auto_deploy bool
description string
audit Audit

DeploymentHistory

Field Type Label Description
id string
action string
deployment Deployment

Endpoint

Field Type Label Description
id string
name string
url string
api_keys ApiKey repeated
app RefEntity
description string
status string
audit Audit

EndpointHistory

Field Type Label Description
id string
endpoint_id string
endpoint Endpoint
action string
timestamp int64
data EndpointHistory.DataEntry repeated

EndpointHistory.DataEntry

Field Type Label Description
key string
value string

GenerateApiKeyRequest

Field Type Label Description
id string deployment's id
endpoint_id string endpoint's id
name string name of the API Key

GetAppDataRequest

Field Type Label Description
id string
version int32

GetAppRequest

Field Type Label Description
id string

GetDeploymentRequest

Field Type Label Description
id string
deployment_id string

GetEndpointRequest

Field Type Label Description
id string
endpoint_id string

ListAppsRequest

Field Type Label Description
project_id string

ListAppsResponse

Field Type Label Description
apps App repeated

ListDeploymentHistoriesRequest

Field Type Label Description
id string
deployment_id string
created_from int64
created_to int64

ListDeploymentHistoriesResponse

Field Type Label Description
deployment_histories DeploymentHistory repeated

ListDeploymentsRequest

Field Type Label Description
id string

ListDeploymentsResponse

Field Type Label Description
deployments Deployment repeated

ListEndpointHistoriesRequest

Field Type Label Description
id string
endpoint_id string
created_from int64
created_to int64

ListEndpointHistoriesResponse

Field Type Label Description
endpoint_histories EndpointHistory repeated

ListEndpointsRequest

Field Type Label Description
id string

ListEndpointsResponse

Field Type Label Description
endpoints Endpoint repeated

RevokeApiKeyRequest

Field Type Label Description
id string
endpoint_id string
name string

UpdateAppMetadataRequest

Field Type Label Description
id string
metadata string

UpdateAppRequest

Field Type Label Description
id string
name string
description string

UpdateDeploymentRequest

Field Type Label Description
id string App id
deployment_id string Deployment id
name string Deployment name
description string Deployment description
status string Deployment Status Active/Deactive
auto_deploy bool Deployment auto deploy on/off
training_id string New training id, when auto-deploy settings deploy newer model ‘version’ to replace the existing

UpdateEndpointRequest

Field Type Label Description
id string App id
endpoint_id string Endpoint id
name string Endpoint name
description string Endpoint description

AppService

Provides APIs to manage applications in a project

Method Name Request Type Response Type Description
CreateApp CreateAppRequest App Create a new application
ListApps ListAppsRequest ListAppsResponse Get the list of current applications in the project
GetApp GetAppRequest App Get application details
UpdateApp UpdateAppRequest App Update application details
DeleteApp DeleteAppRequest .google.protobuf.Empty Update application details
GetAppData GetAppDataRequest AppData Get application's data URLs
CreateAppData CreateAppDataRequest AppData Create application's data URLs of specific version
ListEndpoints ListEndpointsRequest ListEndpointsResponse Get list of deployment endpoints of the application
GetEndpoint GetEndpointRequest Endpoint Get endpoint details
UpdateEndpoint UpdateEndpointRequest Endpoint Update endpoint details
GenerateApiKey GenerateApiKeyRequest Endpoint Generate new API Key for an endpoint
RevokeApiKey RevokeApiKeyRequest Endpoint Revoke the API Key
ListDeployments ListDeploymentsRequest ListDeploymentsResponse Get list of deployments of an application
GetDeployment GetDeploymentRequest Deployment Get deployment details
UpdateDeployment UpdateDeploymentRequest Deployment Update deployment details
ListDeploymentHistories ListDeploymentHistoriesRequest ListDeploymentHistoriesResponse Get deployment histories
DeleteDeployment DeleteDeploymentRequest .google.protobuf.Empty Delete the deploymennt
ListEndpointHistories ListEndpointHistoriesRequest ListEndpointHistoriesResponse Get endpoint histories

Top

audit.proto

AuditRecord

Field Type Label Description
id string
project RefEntity
by RefEntity
action string
object_type string
object RefEntity
timestamp double

ListAuditRecordsRequest

Field Type Label Description
project_id string

ListAuditRecordsResponse

Field Type Label Description
auditRecords AuditRecord repeated

AuditService

Method Name Request Type Response Type Description
ListAuditRecords ListAuditRecordsRequest ListAuditRecordsResponse Get list of audit records

Top

billing.proto

GetInvoiceRequest

Field Type Label Description
id string

Invoice

Field Type Label Description
id string
period_start int64
period_end int64
amount double
status string
pdf string
currency string
plan_name string
items InvoiceItem repeated
receipt_url string
is_prorated bool

InvoiceItem

Field Type Label Description
description string
quantity int32
price double
total double
period_start int64
period_end int64

ListInvoicesRequest

Field Type Label Description
id string

ListInvoicesResponse

Field Type Label Description
invoices Invoice repeated

ListPaymentMethodsRequest

Field Type Label Description
id string

ListPaymentMethodsResponse

Field Type Label Description
payment_methods PaymentMethod repeated

PayInvoiceRequest

Field Type Label Description
id string Invoice id

PaymentMethod

Field Type Label Description
id string
type string
billing_details PaymentMethod.BillingDetails
card PaymentMethod.Card
is_default bool

PaymentMethod.Address

Field Type Label Description
line1 string
line2 string
city string
state string
postal_code string
country string

PaymentMethod.BillingDetails

Field Type Label Description
address PaymentMethod.Address
email string
name string
phone string

PaymentMethod.Card

Field Type Label Description
brand string
expire_month int64
expire_year int64
last4 string

BillingService

Method Name Request Type Response Type Description
ListPaymentMethods ListPaymentMethodsRequest ListPaymentMethodsResponse List payment methods by billing id
ListInvoices ListInvoicesRequest ListInvoicesResponse List invoices
GetInvoice GetInvoiceRequest Invoice Get Get invoice detail
PayInvoice PayInvoiceRequest Invoice Pay invoice

Top

common.proto

Audit

Field Type Label Description
created AuditLog
updated AuditLog

AuditLog

Field Type Label Description
timestamp uint64
by RefEntity

Progress

Field Type Label Description
progress double
tasks Task repeated

RefEntity

Field Type Label Description
id string
name string

Task

Field Type Label Description
name string
progress double

User

Field Type Label Description
id string
display_name string
email string
photo_url string
phone string
status string

Top

config.proto

GetConfigRequest

Field Type Label Description
id string

GetConfigResponse

Field Type Label Description
fields GetConfigResponse.FieldsEntry repeated

GetConfigResponse.FieldsEntry

Field Type Label Description
key string
value string

GetConfigsRequest

GetConfigsResponse

Field Type Label Description
roles Role repeated
permissions Permission repeated

Permission

Field Type Label Description
id string
name string
action string
resource string

Role

Field Type Label Description
id string
name string
permissions string repeated

UpdateConfigRequest

Field Type Label Description
id string
fields UpdateConfigRequest.FieldsEntry repeated

UpdateConfigRequest.FieldsEntry

Field Type Label Description
key string
value string

ConfigService

Method Name Request Type Response Type Description
GetConfigs GetConfigsRequest GetConfigsResponse Get system configurations
GetConfig GetConfigRequest GetConfigResponse Get system configuration of key
UpdateConfig UpdateConfigRequest GetConfigResponse Update configuration

Top

data_source.proto

ConfirmedSchema

Field Type Label Description
columns Column repeated user's confirmed schema
renamed_columns ConfirmedSchema.RenamedColumnsEntry repeated key is original column name, value is renamed column name

ConfirmedSchema.RenamedColumnsEntry

Field Type Label Description
key string
value string

CreateDataSourceRequest

Field Type Label Description
name string
project_id string
source_type string http, database, s3, ftp
connection_info CreateDataSourceRequest.ConnectionInfoEntry repeated
skip_preview bool true will skip pre-process for preview data
pipeline_configuration_id string Job configuration id

CreateDataSourceRequest.ConnectionInfoEntry

Field Type Label Description
key string
value google.protobuf.Value

CreateDataSourceResponse

Field Type Label Description
data_source DataSource
job_id string job ID for data import, UI must wait result

CreateDatasetVersionRequest

Field Type Label Description
id string
dataset_id string
data_item_ids string repeated use list of data items to update dataset
pipeline_configuration_id string Job configuration id

CreateDatasetVersionResponse

Field Type Label Description
job_id string job ID for updating dataset, UI must wait result

CreateDatasetsRequest

Field Type Label Description
id string
datasets DatasetRequest repeated create datasets
pipeline_configuration_id string Job configuration id

CreateDatasetsResponse

Field Type Label Description
job_ids string repeated each job ID for each dataset

DataItem

A data item maybe a sheet of excel file, or a table in database, or each file of uploading

Field Type Label Description
id string
name string
type string item type: excel_sheet, single_file, database_table
file_type string csv, json, parquet, excel
file_size uint64
urls string repeated Urls of data items which are used when create datasets
file_settings FileSettings settings to read file (csv/excel/parquet/excel)
schema ConfirmedSchema each data item has different schema. Otherwise all data items use same shared schema on datasource

DataItemFileSettings

settings to read file

Field Type Label Description
data_item_id string each data item maybe has different settings
file_type string csv/json/parquet/excel
settings DataItemFileSettings.SettingsEntry repeated csv: delimiter, encoding, quote, escape, comment, dateFormat, header, ignoreLeadingWhiteSpace, ignoreTrailingWhiteSpace, multiLine

DataItemFileSettings.SettingsEntry

Field Type Label Description
key string
value google.protobuf.Value

DataItemRequest

Field Type Label Description
id string
name string
type string item type: excel_sheet, single_file, database_table
file_type string csv, json, parquet, excel
urls string repeated Urls of data items which are used when create datasets
file_size uint64

DataItemSchema

Field Type Label Description
data_item_id string each data item maybe has different schema. If all data items has same schema, this field is empty.
confirmed_schema ConfirmedSchema

DataSource

Field Type Label Description
id string
name string
org RefEntity
project RefEntity
source_type string http, database, s3, ftp
connection_info DataSource.ConnectionInfoEntry repeated
status string new, data_ready, success, failed
data_items DataItem repeated data items after data source was imported to platform
shared_file_settings FileSettings if all data items has same settings to read file (csv/excel/parquet/excel)
shared_schema ConfirmedSchema if all data items has same schema, they use shared schema. Otherwise each data item maybe has its own schema

DataSource.ConnectionInfoEntry

Field Type Label Description
key string
value google.protobuf.Value

DatasetRequest

Field Type Label Description
dataset_name string
data_item_ids string repeated use list of data items to create a dataset

DeleteDataItemRequest

Field Type Label Description
id string Data source id
data_item_id string Data item id

FileSettings

settings to read file

Field Type Label Description
file_type string csv/json/parquet/excel
settings FileSettings.SettingsEntry repeated csv: delimiter, encoding, quote, escape, comment, dateFormat, header, ignoreLeadingWhiteSpace, ignoreTrailingWhiteSpace, multiLine

FileSettings.SettingsEntry

Field Type Label Description
key string
value google.protobuf.Value

GetDataSourceRequest

Field Type Label Description
id string

UpdateDataItemSchemaRequest

Field Type Label Description
id string
shared_schema ConfirmedSchema if all data items have same schema
data_item_schemas DataItemSchema repeated if each data items has different schema

UpdateDataItemsRequest

Field Type Label Description
id string
data_items DataItemRequest repeated data items after data source was imported to platform

UpdateDataSourceRequest

Field Type Label Description
id string
name string
connection_info UpdateDataSourceRequest.ConnectionInfoEntry repeated
pipeline_configuration_id string Job configuration id

UpdateDataSourceRequest.ConnectionInfoEntry

Field Type Label Description
key string
value google.protobuf.Value

UpdateDataSourceResponse

Field Type Label Description
data_source DataSource
job_id string job ID for data import, UI must wait result

UpdateFileSettingsRequest

Field Type Label Description
id string
shared_file_settings FileSettings if all data items have same settings
data_item_file_settings DataItemFileSettings repeated if each data item has different settings

DataSourceService

Method Name Request Type Response Type Description
CreateDataSource CreateDataSourceRequest CreateDataSourceResponse Create a data source
UpdateDataSource UpdateDataSourceRequest UpdateDataSourceResponse Update a data source
UpdateDataItems UpdateDataItemsRequest DataSource Update data items after DataSource was imported to platform
UpdateFileSettings UpdateFileSettingsRequest DataSource Update file settings
UpdateDataItemSchema UpdateDataItemSchemaRequest DataSource Update schema for data items
GetDataSource GetDataSourceRequest DataSource Get DataSource
CreateDatasets CreateDatasetsRequest CreateDatasetsResponse Create single dataset or multiple datasets
CreateDatasetVersion CreateDatasetVersionRequest CreateDatasetVersionResponse Create Dataset Version for a dataset

Top

dataset.proto

AnalysisResult

Field Type Label Description
row_count float
column_count float
analysis_time float
file_size float
is_time_series bool

AnalysisStats

Field Type Label Description
analysis_time float
file_size float

CancelDatasetVersionExportRequest

Field Type Label Description
job_id string Job id

Column

Field Type Label Description
name string
semantic_type string

CreateDatasetRequest

Field Type Label Description
name string
description string
project_id string
schema_url string
file_format string
type string
urls string repeated

Dataset

Field Type Label Description
id string
name string
description string
step string
status string
org RefEntity
project RefEntity
latest_version int32
data_source RefEntity
stats Dataset.StatsEntry repeated statistics
audit Audit audit field

Dataset.StatsEntry

Field Type Label Description
key string
value string

DatasetSchema

Field Type Label Description
columns Column repeated
version string
dimension_names DatasetSchema.DimensionNamesEntry repeated

DatasetSchema.DimensionNamesEntry

Field Type Label Description
key string
value google.protobuf.Value

DatasetVersion

Field Type Label Description
id string
version int32 Dataset version
size int64 Total dataset version size
rows int32 Number of rows of all files in dataset version
columns int32 Number of schema columns
dataset_id string
audit Audit

DatasetVersionExport

Field Type Label Description
id string
version int32
format string
job_id string
created_time int64
status string

DeleteDatasetRequest

Field Type Label Description
id string

DeleteDatasetVersionRequest

Field Type Label Description
id string
version int32

ExportDatasetVersionRequest

Field Type Label Description
id string
version int32
format string Format allows: csv, json, parquet
pipeline_configuration_id string Pipeline configuration id

ExportDatasetVersionResponse

Field Type Label Description
job_id string Job Id for waiting result if the exported file has not existed yet
download_url string Download URL if the exported file has already existed

GetDatasetRequest

Field Type Label Description
id string

GetFileFormatRequest

Field Type Label Description
id string

GetFileFormatResponse

Field Type Label Description
file_format string

GetMetadataUploadUrlRequest

Field Type Label Description
id string
version int32 Dataset version

GetMetadataUploadUrlResponse

Field Type Label Description
url string

GetMetadataUrlRequest

Field Type Label Description
id string
version int32 Dataset version

GetMetadataUrlResponse

Field Type Label Description
url string

GetSampleDataUrlRequest

Field Type Label Description
id string
strategy string first5K, first1KJson, random

GetSampleDataUrlResponse

Field Type Label Description
url string

GetSchemaUrlRequest

Field Type Label Description
id string

GetSchemaUrlResponse

Field Type Label Description
url string

InferSchemaRequest

Field Type Label Description
id string

ListDatasetVersionExportsRequest

Field Type Label Description
id string

ListDatasetVersionExportsResponse

Field Type Label Description
dataset_version_exports DatasetVersionExport repeated

ListDatasetVersionsRequest

Field Type Label Description
dataset_id string
created_from int64
created_to int64

ListDatasetVersionsResponse

Field Type Label Description
dataset_versions DatasetVersion repeated

ListDatasetsRequest

Field Type Label Description
project_id string

ListDatasetsResponse

Field Type Label Description
datasets Dataset repeated

UpdateAnalysisResultRequest

Field Type Label Description
id string
result AnalysisResult
version int32

UpdateDatasetRequest

Field Type Label Description
id string
name string
description string

UpdateFileFormatRequest

Field Type Label Description
id string
file_format string
error string
schema DatasetSchema

UpdateSampleDataUrlRequest

Field Type Label Description
id string
url string
strategy string first5K, first1KJson, random

UpdateSchemaRequest

Field Type Label Description
id string
schema DatasetSchema

DatasetService

Method Name Request Type Response Type Description
CreateDataset CreateDatasetRequest Dataset Create a new, empty dataset. To upload data files to this dataset, please use the File API.
UpdateDataset UpdateDatasetRequest Dataset Update name or description of the dataset
UpdateAnalysisResult UpdateAnalysisResultRequest .google.protobuf.Empty
UpdateSchema UpdateSchemaRequest Dataset Update dataset schema. This will start running the dataset analysis pipeline
UpdateFileFormat UpdateFileFormatRequest Dataset Create dataset's file format. Used by dataset file format inference pipeline to update dataset's file format.
GetFileFormat GetFileFormatRequest GetFileFormatResponse Get dataset's file format
ListDatasets ListDatasetsRequest ListDatasetsResponse Return the list of datasets available in a project
GetDataset GetDatasetRequest Dataset Return detail information of a dataset
DeleteDataset DeleteDatasetRequest .google.protobuf.Empty Delete a dataset. All related information such as data files are also deleted.
GetMetadataUploadUrl GetMetadataUploadUrlRequest GetMetadataUploadUrlResponse Get dataset metadata upload URL
GetMetadataUrl GetMetadataUrlRequest GetMetadataUrlResponse Get dataset metadata download URL
UpdateSampleDataUrl UpdateSampleDataUrlRequest .google.protobuf.Empty Update url of sample data by strategy: first5K, random
GetSampleDataUrl GetSampleDataUrlRequest GetSampleDataUrlResponse Get dataset's sample data download URL by strategy: first5K, first1KJson, random
GetSchemaUrl GetSchemaUrlRequest GetSchemaUrlResponse Get dataset's schema download URL
ListDatasetVersions ListDatasetVersionsRequest ListDatasetVersionsResponse List dataset versions
DeleteDatasetVersion DeleteDatasetVersionRequest .google.protobuf.Empty List dataset version
ExportDatasetVersion ExportDatasetVersionRequest ExportDatasetVersionResponse Export dataset's files to a single file with format: csv, json, parquet
ListDatasetVersionExports ListDatasetVersionExportsRequest ListDatasetVersionExportsResponse List dataset version exports
CancelDatasetVersionExport CancelDatasetVersionExportRequest .google.protobuf.Empty Cancel export dataset version

Top

feature_set.proto

CreateFeatureSetRequest

Field Type Label Description
app_id string Id of the app from which the feature set is created
name string Name of the feature set
description string
selected_features string repeated
pipeline_configuration_id string Pipeline configuration id

DeleteFeatureSetRequest

Field Type Label Description
id string

FeatureSet

Field Type Label Description
id string
name string Name of feature set
description string
feature_names string repeated List of feature names
recommendations string Recommendations in JSON format
status string
org RefEntity
project RefEntity
app RefEntity
dataset RefEntity
stats FeatureSet.StatsEntry repeated
audit Audit

FeatureSet.StatsEntry

Field Type Label Description
key string
value string

GetFeatureSetRequest

Field Type Label Description
id string

ListFeatureSetsRequest

Field Type Label Description
app_id string

ListFeatureSetsResponse

Field Type Label Description
feature_sets FeatureSet repeated

UpdateFeatureSetRequest

Field Type Label Description
id string
name string
description string
selected_features string repeated
pipeline_configuration_id string Pipeline configuration id

UpdateRecommendationsRequest

Field Type Label Description
id string
recommendations string

FeatureSetService

Method Name Request Type Response Type Description
CreateFeatureSet CreateFeatureSetRequest FeatureSet Create a new feature set.
UpdateFeatureSet UpdateFeatureSetRequest FeatureSet add or remove features, rename feature set name
UpdateRecommendations UpdateRecommendationsRequest .google.protobuf.Empty update model recommendation when feature set changes
GetFeatureSet GetFeatureSetRequest FeatureSet
DeleteFeatureSet DeleteFeatureSetRequest .google.protobuf.Empty
ListFeatureSets ListFeatureSetsRequest ListFeatureSetsResponse list all feature sets for a specific app

Top

file.proto

CompletePartsRequest

Field Type Label Description
upload_id string
parts CompletePartsRequest.PartsEntry repeated Key is part number, value is ETag value S3 returned when finished upload a part

CompletePartsRequest.PartsEntry

Field Type Label Description
key int32
value string

CompletePartsResponse

Field Type Label Description
url string If all parts are completed, return raw final url. User use this url to create Datasource

CreateFilesRequest

Field Type Label Description
dataset_id string
files FileInfo repeated
metadata CreateFilesRequest.MetadataEntry repeated
append bool Allow to append new files to latest version
pipeline_configuration_id string Pipeline configuration id

CreateFilesRequest.MetadataEntry

Field Type Label Description
key string
value string

CreateFilesResponse

Field Type Label Description
files File repeated
job_id string Return pipeline id to catch up schema validation result

DeleteFileRequest

Field Type Label Description
url string

DeleteMultipartUploadRequest

Field Type Label Description
upload_id string

File

Field Type Label Description
id string
name string
url string
status string
content_type string
size uint64
dataset RefEntity
audit Audit audit field

FileInfo

Field Type Label Description
name string
url string
content_type string
size uint64

GenerateDownloadUrlRequest

Field Type Label Description
project_id string
url string
expired_time_in_minutes int32 Expired time in minutes
download_file_name string

GenerateDownloadUrlResponse

Field Type Label Description
url string

GetFileDownloadUrlRequest

Field Type Label Description
id string

GetFileDownloadUrlResponse

Field Type Label Description
url string

ImportFilesRequest

Field Type Label Description
dataset_id string
source string
data ImportFilesRequest.DataEntry repeated
pipeline_configuration_id string Pipeline configuration id

ImportFilesRequest.DataEntry

Field Type Label Description
key string
value string

ListFilesRequest

Field Type Label Description
dataset_id string
version int32

ListFilesResponse

Field Type Label Description
files File repeated

ListUncompletedPartsRequest

Field Type Label Description
upload_id string

ListUncompletedPartsResponse

Field Type Label Description
upload_id string
uncompleted_parts ListUncompletedPartsResponse.UncompletedPartsEntry repeated Multipart upload: key is part number, value is signed url to upload

ListUncompletedPartsResponse.UncompletedPartsEntry

Field Type Label Description
key int32
value string

UploadFileRequest

Field Type Label Description
name string
content_type string
project_id string
number_of_parts int32

UploadFileResponse

Field Type Label Description
url string Raw S3 url
upload_url string Signed url used to upload single file
upload_id string The upload ID of multipart upload session
multipart_urls UploadFileResponse.MultipartUrlsEntry repeated Multipart upload: key is part number, value is signed url to upload

UploadFileResponse.MultipartUrlsEntry

Field Type Label Description
key int32
value string

FileService

Method Name Request Type Response Type Description
UploadFile UploadFileRequest UploadFileResponse Request the pre-signed URL used for uploading data file.
ListUncompletedParts ListUncompletedPartsRequest ListUncompletedPartsResponse List uncompleted parts
CompleteParts CompletePartsRequest CompletePartsResponse Complete parts upload.
DeleteMultipartUpload DeleteMultipartUploadRequest .google.protobuf.Empty Delete multipart upload.
DeleteFile DeleteFileRequest .google.protobuf.Empty Delete file by url
ImportFiles ImportFilesRequest .google.protobuf.Empty Import files from data sources such as Databases, S3, GCS...
CreateFiles CreateFilesRequest CreateFilesResponse Save multiple files into the dataset
ListFiles ListFilesRequest ListFilesResponse Return a list of data files belongs to the dataset
GetFileDownloadUrl GetFileDownloadUrlRequest GetFileDownloadUrlResponse Return a pre-signed URL which can be used to download the dataset's file.
GenerateDownloadUrl GenerateDownloadUrlRequest GenerateDownloadUrlResponse Return a pre-signed URL which can be used to download file.

Top

model.proto

AssignTargetRequest

Field Type Label Description
id string Model id
deployment_id string Deployment id
target_info TargetInfo
auto_activate bool Auto Activate deployment
deployment_configuration_id string

AssignTargetResponse

Field Type Label Description
id string Deployment Id
model RefEntity
status string
target RefEntity

CreateContinuousLearningPipelineRequest

Field Type Label Description
dataset_id string
version int32

CreateEvaluationResultRequest

Field Type Label Description
id string Model's Id
training_id string Training Id
test_dataset_version int32 Test dataset version
result string Result of the model's evaluation

CreateEvaluationResultResponse

Field Type Label Description
model RefEntity Model's info
dataset RefEntity Dataset info
evaluation_result EvaluationResult evaluation result of the model on a different version of the dataset

CreateModelRequest

Field Type Label Description
app_id string
feature_set_id string
name string
template_id string
hyperparameters string
evaluation ModelEvaluation
dataset_version int32 Dataset version
continuous_learning bool Continuous learning
pipeline_configuration_id string Pipeline configuration id

CreateTrainingEntityRequest

Field Type Label Description
model_id string
dataset_version int32 Dataset version is used to train model
new_training_id string New training ID will insert to DB, it's already used in pipeline

DeleteModelRequest

Field Type Label Description
id string

DeleteTrainingRequest

Field Type Label Description
id string
training_id string

DeployModelRequest

Field Type Label Description
id string
training_id string
target_info TargetInfo
auto_activate bool Deployment activation automatically
type string Deployment type like: cloud or local
auto_deploy bool Auto deploy
name string Deployment name
description string Deployment description
deployment_configuration_id string deployment configartion id

DeployModelResponse

Field Type Label Description
id string
app RefEntity
model RefEntity
training RefTraining
status string
endpoint RefEntity
name string
description string
audit Audit

EvaluateModelRequest

Field Type Label Description
id string Model's Id
training_id string Train dataset version
test_dataset_version int32 Test dataset version
pipeline_configuration_id string Pipeline configuration id

EvaluateModelResponse

Field Type Label Description
job_id string Job id of the evaluation

EvaluationResult

Field Type Label Description
id string Evaluation's Id
train_dataset_version int32 The number of the trained dataset version
test_dataset_version int32 The number of the test dataset version
result string The result of the model on the test dataset version
audit Audit audit fields

GetModelRequest

Field Type Label Description
id string

GetModelStatsRequest

Field Type Label Description
id string model's id
stats_name string 'traffic', 'model_health' or 'prediction'
stats_type string 'CUMULATIVE', 'WEEKLY', 'QUATERLY', 'MONTHLY', 'YEARLY'
from_date string ISO Date string 'YYYY-MM-DD', for example '2000-01-01'
to_date string ISO Date string 'YYYY-MM-DD'

GetModelStatsResponse

Field Type Label Description
stats string a JSON string

GetPredictResultRequest

Field Type Label Description
job_id string

GetPredictResultResponse

Field Type Label Description
status string
result_url string

GetTrainingRequest

Field Type Label Description
id string
training_id string

GetTrainingResultRequest

Field Type Label Description
id string
training_id string

GetTrainingResultResponse

Field Type Label Description
url string

ListEvaluationResultsRequest

Field Type Label Description
id string model's id

ListEvaluationResultsResponse

Field Type Label Description
model RefEntity Model's info
dataset RefEntity Dataset info
evaluation_results EvaluationResult repeated All evaluation results of the model on the different versions of the dataset

ListModelsRequest

Field Type Label Description
app_id string

ListModelsResponse

Field Type Label Description
models Model repeated

ListTrainingsRequest

Field Type Label Description
id string
created_from int64 From created time
created_to int64 To created time
status string Training status

ListTrainingsResponse

Field Type Label Description
trainings Training repeated

Model

Field Type Label Description
id string
name string
evaluation ModelEvaluation
org RefEntity
project RefEntity
app RefEntity
dataset RefEntity
feature_set RefEntity
template RefEntity
hyperparameters string
status string
last_training uint64
last_deployed uint64
last_training_id string
last_success_training Training
continuous_learning bool Continuous learning
stats Model.StatsEntry repeated Model stats
audit Audit audit field

Model.StatsEntry

Field Type Label Description
key string
value string

ModelEvaluation

Field Type Label Description
metric string
threshold double
min_feedback_count double

PredictRequest

Field Type Label Description
id string
dataset_id string
data string
content_type string csv,parquet,json
pipeline_configuration_id string Pipeline configuration id

PredictResponse

Field Type Label Description
job_id string

RefTraining

Field Type Label Description
id string
dataset_version int32

TargetInfo

Field Type Label Description
id string
name string
description string
type string
settings TargetInfo.SettingsEntry repeated

TargetInfo.SettingsEntry

Field Type Label Description
key string
value string

TrainModelRequest

Field Type Label Description
id string
dataset_version int32 Dataset version
pipeline_configuration_id string Pipeline configuration id

Training

Field Type Label Description
id string
status string
result string
model RefEntity
dataset_version int32 Dataset version
audit Audit audit fields

UpdateModelRequest

Field Type Label Description
id string
name string
evaluation ModelEvaluation
continuous_learning bool Continuous learning

UpdatePredictionResultRequest

Field Type Label Description
job_id string
result_url string

UpdateTrainingResultRequest

Field Type Label Description
id string
training_id string
result string

ModelService

Method Name Request Type Response Type Description
CreateModel CreateModelRequest Model Create a new model. The model will be trained automatically on created.
UpdateModel UpdateModelRequest Model Update model information Only model's name are allowed to update
TrainModel TrainModelRequest Training Retrain the model Re-run the training pipeline in case of any infrastructure failure
UpdateTrainingResult UpdateTrainingResultRequest .google.protobuf.Empty
GetTrainingResult GetTrainingResultRequest GetTrainingResultResponse Get the training result Return the URL which can be used to download the detail training report.
CreateEvaluationResult CreateEvaluationResultRequest CreateEvaluationResultResponse Insert the result of the model evaluation on a test dataset
EvaluateModel EvaluateModelRequest EvaluateModelResponse EvaluateModel
ListEvaluationResults ListEvaluationResultsRequest ListEvaluationResultsResponse Get the list of evaluation results of a model
DeployModel DeployModelRequest DeployModelResponse Deploy a model to an endpoint
AssignTarget AssignTargetRequest AssignTargetResponse Assign target to deployment
Predict PredictRequest PredictResponse Predict data with a trained model
UpdatePredictionResult UpdatePredictionResultRequest .google.protobuf.Empty
GetPredictResult GetPredictResultRequest GetPredictResultResponse Get model details
ListModels ListModelsRequest ListModelsResponse Get the list of models of an app
GetModel GetModelRequest Model Get model details
DeleteModel DeleteModelRequest .google.protobuf.Empty Delete the model
ListTrainings ListTrainingsRequest ListTrainingsResponse Get all available model trainings
GetTraining GetTrainingRequest Training Get model training details
DeleteTraining DeleteTrainingRequest .google.protobuf.Empty Delete model training
GetModelStats GetModelStatsRequest GetModelStatsResponse Get model statistics
CreateContinuousLearningPipeline CreateContinuousLearningPipelineRequest PipelineRun Create pipeline to re-train model from new dataset version
CreateTrainingEntity CreateTrainingEntityRequest Training Internal API is used by pipeline job. This create training entity before training pipeline run

Top

notification.proto

CreateNotificationRequest

Field Type Label Description
project RefEntity
org RefEntity
type string
data CreateNotificationRequest.DataEntry repeated

CreateNotificationRequest.DataEntry

Field Type Label Description
key string
value string

GetNotificationsResponse

Field Type Label Description
notifications Notification repeated

MarkNotificationAsReadRequest

Field Type Label Description
id string

Notification

Field Type Label Description
id string
project RefEntity
type string
data Notification.DataEntry repeated
status string
org RefEntity
audit Audit

Notification.DataEntry

Field Type Label Description
key string
value string

NotificationService

Method Name Request Type Response Type Description
GetNotifications .google.protobuf.Empty GetNotificationsResponse Get user's notifications
CreateNotification CreateNotificationRequest Notification Create notification
MarkNotificationAsRead MarkNotificationAsReadRequest .google.protobuf.Empty Mark a notification as read

Top

org.proto

CreateOrgRequest

Field Type Label Description
name string
description string
logo_url string

CreateOrgUserRequest

Field Type Label Description
id string
user_id string
role_id string

DeleteOrgRequest

Field Type Label Description
id string

DeleteOrgUserRequest

Field Type Label Description
id string
user_id string

GetOrgRequest

Field Type Label Description
id string

GetOrgUserRequest

Field Type Label Description
id string
user_id string

ListOrgUsersRequest

Field Type Label Description
id string

ListOrgUsersResponse

Field Type Label Description
orgUsers OrgUser repeated
externalUsers OrgUser repeated List all external users for an Organisation

ListOrgsRequest

ListOrgsResponse

Field Type Label Description
orgs Org repeated

ListUsageSummariesRequest

Field Type Label Description
id string

ListUsageSummariesResponse

Field Type Label Description
usage_summaries UsageSummary repeated

ListUserOrgsRequest

Field Type Label Description
user_id string

ListUserOrgsResponse

Field Type Label Description
orgs Org repeated

Org

Field Type Label Description
id string
name string
description string
logo_url string
subscription_id string Current Active Subscription
stats Org.StatsEntry repeated statistics
audit Audit audit field

Org.StatsEntry

Field Type Label Description
key string
value string

OrgUser

Field Type Label Description
user User
role string

UpdateOrgRequest

Field Type Label Description
id string
name string
description string
logo_url string

UsageSummary

Field Type Label Description
metric string
usage int64
quota int64

OrgService

Method Name Request Type Response Type Description
ListOrgs ListOrgsRequest ListOrgsResponse List all organizations to which the user belongs
GetOrg GetOrgRequest Org Get details of an organization
CreateOrg CreateOrgRequest Org Create a new organization.
UpdateOrg UpdateOrgRequest Org Update organization details
DeleteOrg DeleteOrgRequest .google.protobuf.Empty Delete an organization
ListOrgUsers ListOrgUsersRequest ListOrgUsersResponse List all org's users. This API requires organisation Owner role.
GetOrgUser GetOrgUserRequest OrgUser Get organization user details
CreateOrgUser CreateOrgUserRequest OrgUser Add a user to the organization
DeleteOrgUser DeleteOrgUserRequest .google.protobuf.Empty Remove a user from the organization
ListUsageSummaries ListUsageSummariesRequest ListUsageSummariesResponse

Top

pipeline.proto

Backoff

Field Type Label Description
duration string Duration is the amount to back off. Default unit is seconds, but could also be a duration (e.g. "2m", "1h")
factor int32 A factor to multiply the base duration after each failed retry
max_duration string The maximum amount of time allowed for the backoff strategy

ContainerResource

Field Type Label Description
requests ContainerResource.RequestsEntry repeated
limits ContainerResource.LimitsEntry repeated

ContainerResource.LimitsEntry

Field Type Label Description
key string
value string

ContainerResource.RequestsEntry

Field Type Label Description
key string
value string

CreatePipelineRunRequest

Field Type Label Description
pipeline_id string
owner_type string
owner_id string
owner_metadata CreatePipelineRunRequest.OwnerMetadataEntry repeated
step_parameters StepParameter repeated
global_parameters CreatePipelineRunRequest.GlobalParametersEntry repeated
pipeline_configuration_id string

CreatePipelineRunRequest.GlobalParametersEntry

Field Type Label Description
key string
value string

CreatePipelineRunRequest.OwnerMetadataEntry

Field Type Label Description
key string
value string

DeletePipelineRequest

Field Type Label Description
id string

EnvFrom

Field Type Label Description
type string
name string

EnvVarFromSource

Field Type Label Description
name string
value_from string
conf EnvVarFromSource.ConfEntry repeated

EnvVarFromSource.ConfEntry

Field Type Label Description
key string
value string

GetPipelineRequest

Field Type Label Description
id string

GetPipelineRunRequest

Field Type Label Description
id string

GetProgressRequest

Field Type Label Description
owner_id string
owner_type string
metadata GetProgressRequest.MetadataEntry repeated

GetProgressRequest.MetadataEntry

Field Type Label Description
key string
value string

GetResultRequest

Field Type Label Description
job_id string

GetResultResponse

Field Type Label Description
status string
results StepResult repeated
error_message string pipeline failed with error message
error_code string pipeline failed with error code

Graph

Field Type Label Description
container_templates Step repeated
steps_templates StepsTemplate repeated
tasks GraphTask repeated

GraphTask

Field Type Label Description
name string
template string
template_arguments GraphTask.TemplateArgumentsEntry repeated
dependencies string repeated

GraphTask.TemplateArgumentsEntry

Field Type Label Description
key string
value string

Input

Field Type Label Description
parameters Input.ParametersEntry repeated key is parameter name, value is value of parameter
artifacts Input.ArtifactsEntry repeated key is artifact name, value is artifact of previous step

Input.ArtifactsEntry

Field Type Label Description
key string
value string

Input.ParametersEntry

Field Type Label Description
key string
value string

ListSupportedConfigurationsRequest

Field Type Label Description
name string

ListSupportedConfigurationsResponse

Field Type Label Description
supported_configurations PipelineRunConfiguration repeated

Output

Field Type Label Description
parameters string repeated platform will write output to local file: /tmp/
artifacts string repeated platform will write output to local file: /tmp/

Pipeline

Field Type Label Description
id string
name string
sequence_steps SequenceStep repeated
global_inputs Input
labels Pipeline.LabelsEntry repeated
volumes Volume repeated
volume_claim_templates VolumeClaimTemplates repeated
node_selector Pipeline.NodeSelectorEntry repeated
graph Graph
supported_configurations PipelineRunConfiguration repeated

Pipeline.LabelsEntry

Field Type Label Description
key string
value string

Pipeline.NodeSelectorEntry

Field Type Label Description
key string
value string

PipelineRun

Field Type Label Description
id string
pipeline_id string
owner_type string
owner_id string
owner_metadata PipelineRun.OwnerMetadataEntry repeated
status int32
progress Progress
pipeline_configuration_id string

PipelineRun.OwnerMetadataEntry

Field Type Label Description
key string
value string

PipelineRunConfiguration

Field Type Label Description
id string
name string
default bool
spec PipelineRunConfiguration.SpecEntry repeated

PipelineRunConfiguration.SpecEntry

Field Type Label Description
key string
value PipelineRunConfigurationSpec

PipelineRunConfigurationSpec

Field Type Label Description
scope string
configuration string
extraSettings PipelineRunConfigurationSpec.ExtraSettingsEntry repeated

PipelineRunConfigurationSpec.ExtraSettingsEntry

Field Type Label Description
key string
value string

RefItem

Field Type Label Description
key string
path string

RetryStrategy

Field Type Label Description
limit int32 Limit is the maximum number of attempts when retrying a container
backoff Backoff A backoff strategy
retry_policy string "Always": retry on errors AND failures. Also available: "OnFailure" (default), "OnError"

SequenceStep

Field Type Label Description
parallel_steps Step repeated

Step

Field Type Label Description
name string
image string
command string repeated
inputs Input
outputs Output
condition string
env Step.EnvEntry repeated
env_var_from_sources EnvVarFromSource repeated
env_froms EnvFrom repeated
volume_mounts VolumeMount repeated
labels Step.LabelsEntry repeated
resources ContainerResource
node_selector Step.NodeSelectorEntry repeated
retry_strategy RetryStrategy
tolerations Toleration repeated

Step.EnvEntry

Field Type Label Description
key string
value string

Step.LabelsEntry

Field Type Label Description
key string
value string

Step.NodeSelectorEntry

Field Type Label Description
key string
value string

StepParameter

Field Type Label Description
step_name string
parameters StepParameter.ParametersEntry repeated
condition string

StepParameter.ParametersEntry

Field Type Label Description
key string
value string

StepResult

Field Type Label Description
name string
result StepResult.ResultEntry repeated

StepResult.ResultEntry

Field Type Label Description
key string
value string

StepsTemplate

Field Type Label Description
name string
sequence_steps SequenceStep repeated
inputs Input
outputs Output

Toleration

Field Type Label Description
effect string
key string
operator string
toleration_seconds int32
value string

UpdateProgressRequest

Field Type Label Description
id string
status int32
tasks Task repeated

UpdateResultRequest

Field Type Label Description
job_id string
step_name string Name of step which report result, this is optional, provide it if pipeline has many step's result
result UpdateResultRequest.ResultEntry repeated Result of a step in pipeline
status int32 Status of pipeline
error_message string pipeline failed with error message
error_code string pipeline failed with error code

UpdateResultRequest.ResultEntry

Field Type Label Description
key string
value string

Volume

Field Type Label Description
name string
type string
conf Volume.ConfEntry repeated
ref_items RefItem repeated

Volume.ConfEntry

Field Type Label Description
key string
value string

VolumeClaimTemplates

Field Type Label Description
name string
access_modes string repeated
storage_size string
storage_class_name string

VolumeMount

Field Type Label Description
name string
path string
read_only bool

PipelineService

Method Name Request Type Response Type Description
CreatePipeline Pipeline Pipeline Create a new pipeline which has one or multiple steps
UpdatePipeline Pipeline Pipeline Update pipeline information
GetPipeline GetPipelineRequest Pipeline Get pipeline definition
ListSupportedConfigurations ListSupportedConfigurationsRequest ListSupportedConfigurationsResponse List supported configuration of pipeline: system.recipe-interpreter, system.dataset-analysis, system.app-processing
DeletePipeline DeletePipelineRequest .google.protobuf.Empty Delete pipeline
CreatePipelineRun CreatePipelineRunRequest PipelineRun Run pipeline with a special input
GetPipelineRun GetPipelineRunRequest PipelineRun Get pipeline run by id
UpdateProgress UpdateProgressRequest .google.protobuf.Empty Update progress, status(failed/successed) a PipelineRun
GetProgress GetProgressRequest Progress Get progress of owner of pipelinerun
UpdateResult UpdateResultRequest .google.protobuf.Empty Update pipeline result
GetResult GetResultRequest GetResultResponse Get pipeline result

Top

project.proto

ClusterConfig

Field Type Label Description
scheduler_endpoint string

CreateProjectRequest

Field Type Label Description
name string
description string
org_id string

CreateProjectUserRequest

Field Type Label Description
id string
user_id string
role_id string

DeleteProjectRequest

Field Type Label Description
id string

DeleteProjectUserRequest

Field Type Label Description
id string
user_id string

GetProjectRequest

Field Type Label Description
id string

GetProjectUserRequest

Field Type Label Description
id string
user_id string

GsInfo

Field Type Label Description
bucket string
credentials string

HdfsInfo

Field Type Label Description
name_nodes string
rpc_port float
http_port float
root_folder string

ListOrgProjectsRequest

Field Type Label Description
org_id string

ListOrgProjectsResponse

Field Type Label Description
projects Project repeated

ListProjectUsersRequest

Field Type Label Description
id string

ListProjectUsersResponse

Field Type Label Description
projectUsers ProjectUser repeated

ListUserProjectsRequest

ListUserProjectsResponse

Field Type Label Description
projects Project repeated

Project

Field Type Label Description
id string
name string
description string
org RefEntity
config ProjectConfig
stats Project.StatsEntry repeated statistics
audit Audit audit field

Project.StatsEntry

Field Type Label Description
key string
value string

ProjectConfig

Field Type Label Description
cluster ClusterConfig
storage StorageConfig

ProjectUser

Field Type Label Description
user User
role string

S3Info

Field Type Label Description
bucket string
aws_key string
aws_secret string
aws_region string
endpoint string

StorageConfig

Field Type Label Description
protocol string
protocol_info StorageConfig.ProtocolInfoEntry repeated

StorageConfig.ProtocolInfoEntry

Field Type Label Description
key string
value string

UpdateProjectRequest

Field Type Label Description
id string
name string
description string

ProjectService

Method Name Request Type Response Type Description
ListOrgProjects ListOrgProjectsRequest ListOrgProjectsResponse List all organization's projects
GetProject GetProjectRequest Project Get detail information of the project
ListUserProjects ListUserProjectsRequest ListUserProjectsResponse List all user's projects
CreateProject CreateProjectRequest Project Create a new project
UpdateProject UpdateProjectRequest Project Update project details
DeleteProject DeleteProjectRequest .google.protobuf.Empty Delete a project
ListProjectUsers ListProjectUsersRequest ListProjectUsersResponse List all project's users
GetProjectUser GetProjectUserRequest ProjectUser Get project user details
CreateProjectUser CreateProjectUserRequest ProjectUser Add a user to a project
DeleteProjectUser DeleteProjectUserRequest .google.protobuf.Empty Remove a user from a project

Top

quota_manager.proto

CheckUsageRequest

Field Type Label Description
org_id string
usage_inputs UsageInput repeated list of usages need check quota

UsageInput

Field Type Label Description
usage_id string constant for each type of quota: users, projects, concurrent_recipes, concurrent_training_models, concurrent_deployment, total_dataset_storage, size_of_processed_data_per_month, predictive_api_call, dataset_size_import
new_usage_size int64 size of new usage, such as: bytes of dataset, number of predict records
tracking_labels UsageInput.TrackingLabelsEntry repeated if new usage size is not out of quota, system will track usage with these labels

UsageInput.TrackingLabelsEntry

Field Type Label Description
key string
value string

QuotaManagerService

Internal APIs is used by pipeline jobs to manage quota system

Method Name Request Type Response Type Description
CheckUsage CheckUsageRequest .google.protobuf.Empty Check if usage out of quota and track entity with new size

Top

recipe.proto

AddActionsRequest

Field Type Label Description
id string
iteration int32
actions string JSON string represents the list of actions

AddActionsResponse

Field Type Label Description
invalid_index int32
error string

CommitActionsRequest

Field Type Label Description
id string
iteration int32
target_columns string repeated
pipeline_configuration_id string Interpreter pipeline configuration ID

CompleteRecipeRequest

Field Type Label Description
id string
dataset_name string

CompleteRecipeResponse

Field Type Label Description
dataset_id string

CreateRecipeRequest

Field Type Label Description
name string
description string
datasets InputDataset repeated

CreateRecommendedActionsRequest

Field Type Label Description
id string
iteration int32
actions string

DeleteRecipeRequest

Field Type Label Description
id string

GetCommittedActionsUrlRequest

Field Type Label Description
id string
iteration int32

GetCommittedActionsUrlResponse

Field Type Label Description
url string

GetRecipeIterationRequest

Field Type Label Description
id string
iteration int32

GetRecipeRequest

Field Type Label Description
id string

GetRecipeRunningResultRequest

Field Type Label Description
job_id string

GetRecommendedActionsUrlRequest

Field Type Label Description
id string
iteration int32

GetRecommendedActionsUrlResponse

Field Type Label Description
url string

GetRunActionsResultUrlByJobIdRequest

Field Type Label Description
job_id string

GetRunActionsResultUrlByJobIdResponse

Field Type Label Description
status string
url string

GetRunActionsResultUrlRequest

Field Type Label Description
id string
iteration int32

GetRunActionsResultUrlResponse

Field Type Label Description
url string
status string

GetUpdatedSchemaUrlRequest

Field Type Label Description
id string
iteration int32

GetUpdatedSchemaUrlResponse

Field Type Label Description
url string

InputDataset

Field Type Label Description
id string
target_columns string repeated
alias string Alias for this dataset
version int32 Dataset version

ListAppliedRecipesRequest

Field Type Label Description
dataset_id string dataset id

ListAppliedRecipesResponse

Field Type Label Description
recipes Recipe repeated

ListRecipesRequest

Field Type Label Description
project_id string

ListRecipesResponse

Field Type Label Description
recipes Recipe repeated

PingRequest

Field Type Label Description
id string

PredictionInfo

Field Type Label Description
data string
content_type string csv,parquet,json

Recipe

Field Type Label Description
id string
name string
description string
datasets InputDataset repeated
iterations RecipeIteration repeated
status string
project RefEntity
org RefEntity
pipeline_configuration_id string Interpreter pipeline configuration ID
audit Audit

RecipeIteration

Field Type Label Description
iteration int32
dataset_id string
recommended_actions_url string
committed_actions_url string
action_state_url string
target_columns string repeated
status string
step string
recommendation_status string

RecipeRunningResult

Field Type Label Description
status string
new_dataset_id string
result_url string

RunActionsRequest

Field Type Label Description
id string
iteration int32
to_index int32

RunActionsResponse

Field Type Label Description
job_id string

RunRecipeRequest

Field Type Label Description
id string
dataset_id string
new_dataset_name string
prediction PredictionInfo
pipeline_configuration_id string Interpreter pipeline configuration ID

RunRecipeResponse

Field Type Label Description
job_id string

UpdateActionsRequest

Field Type Label Description
id string
iteration int32
actions string JSON string represents the array of updating actions
from_index int32 index of the action in the queue, from which will be replaced by the provided actions

UpdateActionsResponse

Field Type Label Description
invalid_index int32
error string

UpdateInputDatasetsRequest

Field Type Label Description
id string
datasets InputDataset repeated
override bool if true, override all input datasets, otherwise add new input datasets

UpdateRecipeIterationRequest

Field Type Label Description
id string
iteration int32
dataset_id string

UpdateRecipeRequest

Field Type Label Description
id string
name string
pipeline_configuration_id string Interpreter pipeline configuration ID

UpdateRecipeRunningResultRequest

Field Type Label Description
job_id string
new_dataset_id string
result_url string

RecipeService

Method Name Request Type Response Type Description
CreateRecipe CreateRecipeRequest Recipe Create new recipe
GetRecipe GetRecipeRequest Recipe Get recipe details
UpdateRecipe UpdateRecipeRequest Recipe Update recipe details
UpdateInputDatasets UpdateInputDatasetsRequest Recipe Update input datasets, override or add new input datasets
DeleteRecipe DeleteRecipeRequest .google.protobuf.Empty Delete Recipe
Ping PingRequest .google.protobuf.Empty Ping service
ListAppliedRecipes ListAppliedRecipesRequest ListAppliedRecipesResponse Get list of applied recipes from dataset id
ListRecipes ListRecipesRequest ListRecipesResponse Get list of available recipes in the projects
GetRecipeIteration GetRecipeIterationRequest RecipeIteration Get recipe iteration details
UpdateRecipeIteration UpdateRecipeIterationRequest RecipeIteration Update recipe iteration details
CreateRecommendedActions CreateRecommendedActionsRequest .google.protobuf.Empty Create recommendations for the iteration
AddActions AddActionsRequest AddActionsResponse Add actions
UpdateActions UpdateActionsRequest UpdateActionsResponse Update action
CommitActions CommitActionsRequest .google.protobuf.Empty Commit actions
RunActions RunActionsRequest RunActionsResponse Run actions
CompleteRecipe CompleteRecipeRequest CompleteRecipeResponse Complete the recipe
GetRecommendedActionsUrl GetRecommendedActionsUrlRequest GetRecommendedActionsUrlResponse Get recipe iteration's recommendedActions download URL
GetCommittedActionsUrl GetCommittedActionsUrlRequest GetCommittedActionsUrlResponse Get recipe iteration's recommendedActions download URL
GetUpdatedSchemaUrl GetUpdatedSchemaUrlRequest GetUpdatedSchemaUrlResponse Get recipe iteration's updated schema URL after add/update actions
GetRunActionsResultUrl GetRunActionsResultUrlRequest GetRunActionsResultUrlResponse Get recipe iteration's run action result download URL
GetRunActionsResultUrlByJobId GetRunActionsResultUrlByJobIdRequest GetRunActionsResultUrlByJobIdResponse Get running action result by jobId
RunRecipe RunRecipeRequest RunRecipeResponse Run recipe with provided dataset
GetRecipeRunningResult GetRecipeRunningResultRequest RecipeRunningResult Get running result when running Recipe
UpdateRecipeRunningResult UpdateRecipeRunningResultRequest RecipeRunningResult

Top

subscription.proto

CancelSubscriptionRequest

Field Type Label Description
id string

ChangePlanRequest

Field Type Label Description
org_id string
plan_id string
payment_method_id string

CreateSubscriptionRequest

Field Type Label Description
org_id string
plan_id string
payment_method_id string

GetResourcesQuotaRequest

Field Type Label Description
id string
resources string repeated resource is one or more of the list ConcurrentModelsTrainingQuota, ConcurrentModelsDeployedQuota, ConcurrentOpenDataPreparationRecipesQuota, DatasetSizeQuota, UsersQuota, ProjectsQuota, CallForPredictiveAPIsQuota, TotalDatasetStorageQuota, SizeOfProcessedDataPerMonthQuota

GetResourcesQuotaResponse

Field Type Label Description
quotas Quota repeated

GetSubscriptionRequest

Field Type Label Description
id string

ListPlansResponse

Field Type Label Description
plans Plan repeated

Plan

Field Type Label Description
id string
name string
price int64
currency string
quotas Quota repeated
is_self_upgraded bool
enabled bool

Quota

Field Type Label Description
resource string
description string
quota int64
unit string

Subscription

Field Type Label Description
id string Subscription's id
next_billing_date int64
start_billing_date int64
plan RefEntity
org RefEntity The organisation to that this Subscription belongs
status string Subscription status
trial_end int64 Trial end time
audit Audit Audit information

UpdatePaymentMethodRequest

Field Type Label Description
org_id string
payment_method_id string

SubscriptionService

Provides APIs to manage subscription in a organisation

Method Name Request Type Response Type Description
CreateSubscription CreateSubscriptionRequest Subscription Create subscription
UpdatePaymentMethod UpdatePaymentMethodRequest PaymentMethod
CancelSubscription CancelSubscriptionRequest Subscription Cancel subscription
ListPlans .google.protobuf.Empty ListPlansResponse List all subscription plans
GetSubscription GetSubscriptionRequest Subscription Get subscription details
ChangePlan ChangePlanRequest Subscription Change to new plan
GetResourcesQuota GetResourcesQuotaRequest GetResourcesQuotaResponse

Top

template.proto

CreateTemplateRequest

Field Type Label Description
id string
name string
summary string
description string
category string
metadata string
version string
training_image_name string
tags string repeated
serving_image_name string

ListTemplatesResponse

Field Type Label Description
templates Template repeated

Template

Field Type Label Description
id string
name string
summary string
description string
category string
metadata string
version string
training_image_name string
supported_configurations RefEntity repeated
tags string repeated example: ["gpu", "scikit-learn", "experimental"]
serving_image_name string
supported_deployment_configurations RefEntity repeated
audit Audit

UpdateTemplateRequest

Field Type Label Description
id string
name string
summary string
description string
category string
metadata string
version string
training_image_name string
tags string repeated
serving_image_name string

TemplateService

Method Name Request Type Response Type Description
CreateTemplate CreateTemplateRequest Template Create a new model template
UpdateTemplate UpdateTemplateRequest Template Update model template details
ListTemplates .google.protobuf.Empty ListTemplatesResponse Get all available model templates

Top

user.proto

ChangePasswordRequest

Field Type Label Description
password string
email string
current_password string

CreateCustomTokenRequest

CreateUserRequest

Field Type Label Description
email string
password string
name string
phone string
organization string

CustomToken

Field Type Label Description
token string

DeleteCustomTokenRequest

Field Type Label Description
token string

DeleteUserRequest

Field Type Label Description
id string

GetUserByEmailRequest

Field Type Label Description
email string

GetUserRequest

Field Type Label Description
id string

ListCustomTokensRequest

ListCustomTokensResponse

Field Type Label Description
custom_tokens CustomToken repeated

RefreshTokenRequest

Field Type Label Description
refresh_token string

ResetPasswordRequest

Field Type Label Description
code string
password string

SendCodeRequest

Field Type Label Description
email string
codeType string Can be 'PASSWORD_RESET' or 'VERIFY_EMAIL'

SignInWithCustomTokenRequest

Field Type Label Description
token string

SignInWithEmailRequest

Field Type Label Description
email string
password string

TokenResponse

Field Type Label Description
token string
refresh_token string
expires_in string

UpdateUserRequest

Field Type Label Description
id string
name string
phone string

UserService

Method Name Request Type Response Type Description
CreateUser CreateUserRequest User Register new user
UpdateUser UpdateUserRequest User Update user detail
GetUser GetUserRequest User
DeleteUser DeleteUserRequest .google.protobuf.Empty
GetUserByEmail GetUserByEmailRequest User Get user's detail by email
SignInWithEmail SignInWithEmailRequest TokenResponse Sign in with email and password
SignInWithCustomToken SignInWithCustomTokenRequest TokenResponse Sign in with custom token
RefreshToken RefreshTokenRequest TokenResponse Refresh the authorization token using the refresh token
SendCode SendCodeRequest .google.protobuf.Empty
ResetPassword ResetPasswordRequest .google.protobuf.Empty
ChangePassword ChangePasswordRequest .google.protobuf.Empty
CreateCustomToken CreateCustomTokenRequest CustomToken Generate new custom token, which can be used for Client SDKs
ListCustomTokens ListCustomTokensRequest ListCustomTokensResponse List existing custom tokens
DeleteCustomToken DeleteCustomTokenRequest .google.protobuf.Empty Delete a custom token

Scalar Value Types

.proto Type Notes C++ Java Python Go C# PHP Ruby
double double double float float64 double float Float
float float float float float32 float float Float
int32 Uses variable-length encoding. Inefficient for encoding negative numbers – if your field is likely to have negative values, use sint32 instead. int32 int int int32 int integer Bignum or Fixnum (as required)
int64 Uses variable-length encoding. Inefficient for encoding negative numbers – if your field is likely to have negative values, use sint64 instead. int64 long int/long int64 long integer/string Bignum
uint32 Uses variable-length encoding. uint32 int int/long uint32 uint integer Bignum or Fixnum (as required)
uint64 Uses variable-length encoding. uint64 long int/long uint64 ulong integer/string Bignum or Fixnum (as required)
sint32 Uses variable-length encoding. Signed int value. These more efficiently encode negative numbers than regular int32s. int32 int int int32 int integer Bignum or Fixnum (as required)
sint64 Uses variable-length encoding. Signed int value. These more efficiently encode negative numbers than regular int64s. int64 long int/long int64 long integer/string Bignum
fixed32 Always four bytes. More efficient than uint32 if values are often greater than 2^28. uint32 int int uint32 uint integer Bignum or Fixnum (as required)
fixed64 Always eight bytes. More efficient than uint64 if values are often greater than 2^56. uint64 long int/long uint64 ulong integer/string Bignum
sfixed32 Always four bytes. int32 int int int32 int integer Bignum or Fixnum (as required)
sfixed64 Always eight bytes. int64 long int/long int64 long integer/string Bignum
bool bool boolean boolean bool bool boolean TrueClass/FalseClass
string A string must always contain UTF-8 encoded or 7-bit ASCII text. string String str/unicode string string string String (UTF-8)
bytes May contain any arbitrary sequence of bytes. string ByteString str []byte ByteString string String (ASCII-8BIT)