app.hopsworks.ai is experiencing some issues - we are investigating
2

Codes and examples to get you started

All the things you need to start with Hopsworks

Basic Tutorial
Batch

Churn

Predict customers that are at risk of churning.

Additional ressources:
Advanced Tutorial
Batch

Credit Default Risk

Predict clients' repayment abilities.

Additional ressources:
Basic Tutorial
Real-Time
On-demand Features

Fraud - Online

Detect Fraud Transactions.

Additional ressources:
Basic Tutorial
Batch

Fraud - Batch

Detect Fraud Transactions using batch data.

Additional ressources:
Basic Tutorial
Real-Time
On-demand Features

Quick Start

An introductory tutorial including all the main concepts to get started easily.

Additional ressources:
Basic Tutorial
Real-Time

Iris

Classify iris flower species.

Additional ressources:
Basic Tutorial
Batch
On-demand Features

Loan Approval

Predict loan approvals.

Additional ressources:
Feature engineering

Kafka PySpark Example

In this example, you write a PySpark program that produces and consumes messages to/from a Kafka cluster. This program can only be run from inside Hopsworks.

Additional ressources:
Hopsworks Integration

Weights and Biases with Hopsworks

Build a machine learning model with Weights & Biases.

Additional ressources:
Hopsworks Integration

Great Expectations with Hopsworks

Introduction to Great Expectations concepts and classes which are relevant for integration with the Hopsworks MLOps platform.

Additional ressources:
On-demand Features
Hopsworks Integration

BigQuery Storage Connector

Create an External Feature Group using BigQuery Storage Connector.

Additional ressources:
On-demand Features
Hopsworks Integration

Google Cloud Storage

Create an External Feature Group using GCS Storage Connector.

Additional ressources:
On-demand Features
Hopsworks Integration

Redshift

Create an External Feature Group using Redshift Storage Connector.

Additional ressources:
On-demand Features
Hopsworks Integration

Snowflake

Create an External Feature Group using Snowflake Storage Connector.

Additional ressources:
On-demand Features
Hopsworks Integration

DBT Tutorial with BigQuery

Perform feature engineering in DBT on BigQuery.

Additional ressources:
Hopsworks Integration

Feature Monitoring

How to implement feature monitoring in your production pipeline.

Additional ressources:
Hopsworks Integration

Bytewax

Real-time feature computation using Bytewax.

Additional ressources:
Hopsworks Integration

Apache Beam

Real time feature computation using Apache Beam, Google Cloud Dataflow and Hopsworks Feature Store.

Additional ressources:
Hopsworks Integration

Apache Flink

Real time feature computation using Apache Flink and Hopsworks Feature Store.

Additional ressources:
Hopsworks Integration

Federated Offline Query

Create Snowflake, BigQuery and Hopsworks feature groups and then combine them in a unified view exposing all features together regardless of their source.

Additional ressources:
Hopsworks API

Hopsworks Project API

This example of Hopsworks Python API program shows how to create new projects or access existing ones in Hopsworks.

Additional ressources:
Hopsworks API

Hopsworks OpenSearch API

How to run a Python program (from inside Hopsworks) that acts as an opensearch-py client for the OpenSearch cluster in Hopsworks.

Additional ressources:
Hopsworks API

Hopsworks Kafka API

This example shows the Hopsworks Python API for Kafka - manage schemas, topics and set up the connection to the kafka brokers.

Additional ressources:
Hopsworks API

Hopsworks Jobs API

This example of Python Hopsworks API program, shows how to create a job for an existing python or spark program, execute it and access application logs.

Additional ressources:
Hopsworks API

Hopsworks Dataset API

How to upload data to your cluster and download data from the cluster to your local environment.

Additional ressources:
Hopsworks API

Hopsworks Git API

This Python Hopsworks API example shows how to clone a git repository, checkout new branches to develop a feature, and push it to a remote.

Additional ressources:
Hopsworks API

Hopsworks Secrets API

This example Hopsworks program shows the Python API for managing secrets in Hopsworks.

Additional ressources:
Machine Learning

Hopsworks File System Example

This Python Hopsworks example shows how to interact with HopsFS from python, using the hdfs module.

Additional ressources:
Orchestration

Launch a Job on Airflow

How to run an example Airflow DAG that launches jobs on Hopsworks.

Additional ressources:
Advanced Tutorial
Batch

Citibike Usage Prediction

Predict the number of citibike users on each citibike station in New York City.

Advanced Tutorial
Batch

Air Quality Prediction

Predict the Air Quality value (PM2.5) in Europe and USA using weather features and air quality features of the previous days.

Additional ressources:
Advanced Tutorial
Batch

NYC Taxi Fares

Predict the fare amount for a taxi ride in New York City given the pickup and drop off locations.

Additional ressources:
Advanced Tutorial
Batch
On-demand Features

Electricity Price Estimation in Sweden

Predict the electricity prices in several Swedish cities based on weather conditions, previous prices, and Swedish holidays.

Additional ressources:
Advanced Tutorial
On-demand Features
Batch
Real-Time

Bitcoin Price Prediction

Predict Bitcoin price using time series features and tweets sentiment analysis.

Additional ressources:
On-demand Features
Real-Time
Batch
Advanced Tutorial

Keras model and Sklearn Transformation Functions with Hopsworks Model Registry

How to register Sklearn Transformation Functions and Keras model in the Hopsworks Model Registry, how to retrieve them and then use in training and inference pipelines.

Additional ressources:
On-demand Features
Real-Time
Batch
Advanced Tutorial

PyTorch model and Sklearn Transformation Functions with Hopsworks Model Registry

How to register Sklearn Transformation Functions and PyTorch model in the Hopsworks Model Registry, how to retrieve them and then use in training and inference pipelines.

Additional ressources:
On-demand Features
Real-Time
Batch
Advanced Tutorial

Sklearn Transformation Functions with Hopsworks Model Registy

How to register sklearn.pipeline with transformation functions and classifier in Hopsworks Model Registry and use it in training and inference pipelines.

Additional ressources:
Advanced Tutorial
On-demand Features
Batch
Real-Time

Recommender System

Build a recommender system for fashion items based on data from previous transactions, as well as from customer and product meta data.

Additional ressources:
Batch
On-demand Features
Advanced Tutorial
Real-Time

TimeSeries

Timeseries price prediction based on previous prices and engineered features such as RSI, EMA, etc.

Additional ressources:
Real-Time
On-demand Features
Batch
Advanced Tutorial

Custom Transformation Functions

How to register custom transformation functions in hopsworks feature store use then in training and inference pipelines.

Additional ressources:
No Item Found.