Skip to content

feat: Add MLflow integration support to Feast operator #6611

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
Vperiodt wants to merge 1 commit into
base: master
Choose a base branch
from
+2,030 −101
Draft

feat: Add MLflow integration support to Feast operator #6611

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
46 changes: 46 additions & 0 deletions infra/feast-operator/api/v1/featurestore_types.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -142,6 +142,46 @@ type OpenLineageConsumerConfig struct {
NamespaceMapping map[string]string `json:"namespaceMapping,omitempty"`
}

// MlflowConfig enables MLflow experiment tracking integration for Feast.
// When enabled, feature retrieval metadata is automatically logged to MLflow runs
// and the Feast UI displays lineage from feature views to registered models.
type MlflowConfig struct {
// Enable MLflow integration.
Enabled bool `json:"enabled"`
// MLflow tracking server URI. When omitted, the operator auto-discovers
// from the cluster MLflow CR (status.address.url). Falls back to
// MLFLOW_TRACKING_URI env var on pods.
// +optional
TrackingUri *string `json:"trackingUri,omitempty"`
// Automatically log feature metadata on every retrieval inside an active MLflow run.
// Defaults to true when enabled.
// +optional
AutoLog *bool `json:"autoLog,omitempty"`
// Save entity DataFrame as MLflow artifact on historical retrieval.
// Defaults to false.
// +optional
AutoLogEntityDf *bool `json:"autoLogEntityDf,omitempty"`
// Maximum number of entity DataFrame rows to save as an MLflow artifact.
// DataFrames exceeding this limit are skipped. Defaults to 100000.
// +kubebuilder:validation:Minimum=1
// +optional
EntityDfMaxRows *int32 `json:"entityDfMaxRows,omitempty"`
// Log feast apply and materialize operations to a separate MLflow experiment.
// Defaults to false.
// +optional
LogOperations *bool `json:"logOperations,omitempty"`
// Suffix appended to the project name for the operations experiment.
// Defaults to "-feast-ops".
// +optional
OpsExperimentSuffix *string `json:"opsExperimentSuffix,omitempty"`
// ExtraConfig holds additional MLflow key-value settings written inline into
// the mlflow block of feature_store.yaml. Boolean and integer string values
// are coerced to native YAML types. Keys must be valid Feast MlflowConfig
// YAML field names.
// +optional
ExtraConfig map[string]string `json:"extraConfig,omitempty"`
}

// FeatureStoreSpec defines the desired state of FeatureStore
// +kubebuilder:validation:XValidation:rule="self.replicas <= 1 || !has(self.services) || !has(self.services.scaling) || !has(self.services.scaling.autoscaling)",message="replicas > 1 and services.scaling.autoscaling are mutually exclusive."
// +kubebuilder:validation:XValidation:rule="self.replicas <= 1 && (!has(self.services) || !has(self.services.scaling) || !has(self.services.scaling.autoscaling)) || (has(self.services) && has(self.services.onlineStore) && has(self.services.onlineStore.persistence) && has(self.services.onlineStore.persistence.store))",message="Scaling requires DB-backed persistence for the online store. Configure services.onlineStore.persistence.store when using replicas > 1 or autoscaling."
Expand Down Expand Up @@ -172,6 +212,12 @@ type FeatureStoreSpec struct {
// Written into feature_store.yaml for all service pods.
// +optional
OpenLineage *OpenLineageConfig `json:"openlineage,omitempty"`
// Mlflow enables MLflow experiment tracking integration for Feast.
// Written into feature_store.yaml for all service pods and the client ConfigMap.
// When omitted and a cluster MLflow instance is detected, defaults to enabled
// with the discovered tracking URI.
// +optional
Mlflow *MlflowConfig `json:"mlflow,omitempty"`
}

// FeastProjectDir defines how to create the feast project directory.
Expand Down
57 changes: 57 additions & 0 deletions infra/feast-operator/api/v1/zz_generated.deepcopy.go
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

18 changes: 17 additions & 1 deletion infra/feast-operator/bundle/manifests/feast-operator.clusterserviceversion.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -147,7 +147,7 @@ metadata:
}
]
capabilities: Basic Install
createdAt: "2026-06-13T11:22:06Z"
createdAt: "2026-07-16T11:41:33Z"
operators.operatorframework.io/builder: operator-sdk-v1.41.0
operators.operatorframework.io/project_layout: go.kubebuilder.io/v4
name: feast-operator.v0.64.0
Expand Down Expand Up @@ -246,6 +246,14 @@ spec:
- patch
- update
- watch
- apiGroups:
- config.openshift.io
resources:
- apiservers
verbs:
- get
- list
- watch
- apiGroups:
- feast.dev
resources:
Expand All @@ -272,6 +280,14 @@ spec:
- get
- patch
- update
- apiGroups:
- mlflow.opendatahub.io
resources:
- mlflows
verbs:
- get
- list
- watch
- apiGroups:
- monitoring.coreos.com
resources:
Expand Down
Loading
Loading