Hopsworks AI Lakehouse with

Great Expectations

Hopsworks integrates Great Expectations with feature pipelines that write to the Hopsworks Feature Store. The results of Great Expectation validation runs and the expectation suite itself are stored in Hopsworks, and Hopsworks can be configured to alert users (email, slack) on expectation failures.

Hopsworks Integrations

You can define your Expectation Suites and declaratively associate them with a Feature Group in Hopsworks, so that every time features are written to a Feature Group, the attached expectations are validated before the features are written. You can turn on and off validation of expectations for Feature Groups, making it easy to switch from development to production pipelines.

Other integrations

Cloudera
Kubeflow
Airflow