Hopsworks AI Lakehouse with

Dagster

Dagster can be used to orchestrate feature, training, and batch inference pipelines as Python programs that write/read to/from the Hopsworks Feature Store.

Hopsworks Integrations

Dagster can be used as the orchestration engine for all your machine learning pipelines (feature pipelines, training pipelines, and batch inference pipelines).

Github: Hopsworks & Dagster

Other integrations

Synapse Azure
Notebooks
AWS Lambda/Chalice