Skip to content

Data engineering + ML systems: lakehouse/ETL, streaming, feature store, MLOps, and model serving. Synthetic data → train → ONNX → FastAPI service + CI.

Notifications You must be signed in to change notification settings

drsunday-ade/ai-systems-data-engineering

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 

Repository files navigation

ai-systems-data-engineering

Data engineering + ML systems: lakehouse/ETL, streaming, feature store, MLOps, and model serving. Synthetic data → train → ONNX → FastAPI service + CI.

AI Systems & Data Engineering

Goal: end-to-end, reproducible ML systems: ingest → validate → transform → feature store → train → export (ONNX) → serve (FastAPI) → CI.

Quickstart

python -m venv .venv && source .venv/bin/activate
pip install -r requirements.txt
python etl/synth_data.py
python etl/transform.py
python etl/validate.py
python training/train.py
python training/export_onnx.py
uvicorn serving.app:app --reload

About

Data engineering + ML systems: lakehouse/ETL, streaming, feature store, MLOps, and model serving. Synthetic data → train → ONNX → FastAPI service + CI.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published