back chevron
Back to Events
back chevron
Back to Events

MLOps on the fly: Optimizing a feature store with DuckDB and ArrowFlight

MLOps on the fly: Optimizing a feature store with DuckDB and ArrowFlight
No items found.

MLOps on the fly: Optimizing a feature store with DuckDB and ArrowFlight

calendar icon
December 14, 2023
calendar icon
clock icon
6:10 pm
CEST
clock icon
CEST
clock icon
Stockholm, Sweden

Feature Stores are a vital part of the MLOps stack for managing machine learning features and ensuring data consistency. This talk introduces Feature Stores and the underlying data management architecture.

In this talk, we will cover the following topics:

• Introduction to Machine Learning Feature Stores (5 min): Understanding the role of feature stores in the MLOps stack and their significance in managing machine learning features within organizations.
• Data management architecture behind Feature Stores (2-3 min): Exploring the underlying mechanisms and data management components employed in feature stores.
• Introduction to DuckDB and Arrow Flight (5 min): Highlighting the integration of DuckDB and Arrow Flight into the PyData ecosystem, leveraging the capabilities of Arrow.
• The journey of integrating DuckDB and Arrow Flight into our Feature Store platform (12 min): Sharing our experiences and insights on integrating DuckDB and Arrow Flight into the Hudi-based Lakehouse platform that powers our (offline) feature store, discussing challenges and successes encountered along the way.
• Benchmarks (5 min): Presenting a benchmark comparing the performance of DuckDB/Arrow Flight vs Spark/HiveServer2, in particular for small to medium sized data.

RSVP here

Register now!

Thank you for registering!
Oops! Something went wrong while submitting the form, please check your details again.

Tags

You might also be interested in: