Online Course · Udemy

Designing Production-Grade Deep Learning Pipelines

Take a deep learning model from a notebook to an automated, monitored production system on Google Cloud.

8 hrs

on-demand video

14

resources

2

articles

Designing Production-Grade Deep Learning Pipelines course thumbnail

What You'll Build

One pipeline, from raw data to a live endpoint

A complete, production-grade system that runs on your laptop and on Google Cloud — and retrains itself when new data arrives.

GitHub Actions CI/CD · keyless Workload Identity Docker image pushed to Artifact Registry Orchestration Apache Beam on your laptop → Vertex AI Pipelines on Google Cloud runs TFX PIPELINE Features Modeling Gate & deploy Data validation ExampleGen ingest StatisticsGen profile SchemaGen infer schema ExampleValidator catch anomalies Transform features Tuner tune Trainer train Keras DNN Evaluator gate Pusher deploy ships only if it beats the current model New data lands in Cloud Storage Cloud Run function triggers a new pipeline run Model Registry versioned models Vertex AI Endpoint serves predictions automatic retraining registered & deployed

Evaluation-gated deployment

A new model ships only if it clears accuracy thresholds and beats the model already in production.

Event-driven retraining

New data in Cloud Storage triggers a fresh pipeline run automatically, with no manual retraining.

Same pipeline, laptop to cloud

Build and debug locally with Apache Beam, then run the identical pipeline on Vertex AI.

What You'll Learn

Four stages, from notebook to continuous delivery

Every skill is applied to the same real system, so each stage builds directly on the last.

01

Build

Build an end-to-end TFX pipeline: ExampleGen, StatisticsGen, SchemaGen, ExampleValidator, Transform, Tuner, Trainer, Evaluator and Pusher

Track experiments with MLflow and turn a Keras DNN from notebook code into a reproducible, versioned pipeline

TFX Keras MLflow
02

Orchestrate

Run pipelines locally with Apache Beam, then run the same pipeline on Google Cloud Vertex AI Pipelines

Containerize pipeline code with Docker and manage cloud access securely with IAM service accounts and Cloud Storage

Apache Beam Vertex AI Pipelines Docker IAM
03

Deploy

Register, version and serve models with the Vertex AI Model Registry and Vertex AI Endpoints

Gate deployments with evaluation thresholds, so a new model ships only if it beats the current one

Model Registry Endpoints Evaluation gates
04

Automate

Trigger retraining automatically on new data with Cloud Run functions, and understand drift and training–serving skew

Set up CI/CD for ML pipelines with GitHub Actions and keyless Workload Identity Federation

Cloud Run GitHub Actions Workload Identity Federation

The Course Journey

One real problem, carried all the way to production

You predict the compressive strength of concrete from eight mix-design features, using the public UCI dataset — and take that model through four stages, each with its own folder in the companion code.

01

Experiment

Explore the data, engineer features and design the Keras model in notebooks, tracking every run with MLflow.

01_experimentation/
02

Run it locally

Turn the notebooks into a TFX pipeline and run it end to end on your own machine with Apache Beam.

02_local_pipeline/
03

Move to the cloud

Containerize the pipeline, run it on Vertex AI Pipelines and serve the approved model from an endpoint.

03_cloud_pipeline/
04

Automate it

Retrain automatically when new data arrives, and ship every change through CI/CD with GitHub Actions.

04_cloud_run_functions/
The course pipeline running on Vertex AI Pipelines, shown as a graph of TFX components
Stage 03 · The pipeline running on Vertex AI Pipelines, with each TFX component as a step in the graph.

Who It's For

For people who can train a model — and want to ship one

This course is for you if…

You can train a Keras or TensorFlow model, but haven’t taken one to production yet

You’re an ML engineer or data scientist who wants reproducible, automated pipelines instead of one-off notebooks

You want hands-on experience with TFX and Vertex AI on Google Cloud

What you’ll need

Comfortable writing Python

Basic Keras or TensorFlow

A Google Cloud account — cloud resources are billed while in use, and the course shows you how to clean up

No prior MLOps or Google Cloud experience required. Every service is introduced as you need it.

Companion Code

Every line of the course, open source

The full pipeline lives in a public GitHub repository, organized stage by stage so you can follow along — or jump straight to the part you need.

Open source under the MIT license — reuse it in your own projects

A pinned environment and data-prep script, so it runs the same on every machine

Setup guides and lab notes for every stage

The deployment gate

A new model deploys only if its error stays under 10 MPa (MAE) and 15 MPa (RMSE), and it beats the model already serving.

View on GitHub
github.com/real-ahmed-moussa/pdlp
pdlp/
├── 01_experimentation/# notebooks + module.py
├── 02_local_pipeline/# local TFX run · SQLite metadata
├── 03_cloud_pipeline/# Vertex AI · Docker · CI/CD
├── 04_cloud_run_functions/# retraining & deployment triggers
├── docs/# setup guides & lab notes
├── prepare_data.py# builds the data folders
└── requirements.txt# pinned environment

Start Building

Take your next model all the way to production

Eight hours, one real problem, and a pipeline that validates, trains, evaluates, deploys, and retrains itself on Google Cloud.