Hands-On MLOps on Azure: Automate, secure, and scale ML workflows with the Azure ML CLI, GitHub, and LLMOps

A practical guide to building, deploying, automating, monitoring, and scaling ML and LLM solutions in production

Key Features

• Build reproducible ML pipelines with Azure ML CLI and GitHub Actions
• Automate ML workflows end to end, including deployment and monitoring
• Apply LLMOps principles to deploy and manage generative AI responsibly across clouds
• Purchase of the print or Kindle book includes a free PDF eBook

Book Description

Effective machine learning (ML) now demands not just building models but deploying and managing them at scale. Written by a seasoned senior software engineer with high-level expertise in both MLOps and LLMOps, Hands-On MLOps on Azure equips ML practitioners, DevOps engineers, and cloud professionals with the skills to automate, monitor, and scale ML systems across environments.

The book begins with MLOps fundamentals and their roots in DevOps, exploring training workflows, model versioning, and reproducibility using pipelines. You'll implement CI/CD with GitHub Actions and the Azure ML CLI, automate deployments, and manage governance and alerting for enterprise use. The author draws on their production ML experience to provide you with actionable guidance and real-world examples. A dedicated section on LLMOps covers operationalizing large language models (LLMs) such as GPT-4 using RAG patterns, evaluation techniques, and responsible AI practices. You'll also work with case studies across Azure, AWS, and GCP that offer practical context for multi-cloud operations.

Whether you're building pipelines, packaging models, or deploying LLMs, this guide delivers end-to-end strategy to build robust, scalable systems. By the end of this book, you'll be ready to design, deploy, and maintain enterprise-grade ML solutions with confidence.

What you will learn

• Understand the DevOps to MLOps transition
• Build reproducible, reusable pipelines using the Azure ML CLI
• Set up CI/CD for training and deployment workflows
• Monitor ML applications and detect model/data drift
• Capture and secure governance and lineage data
• Operationalize LLMs using RAG and prompt flows
• Apply MLOps across Azure, AWS, and GCP use cases

Who this book is for

This book is for DevOps and Cloud engineers and SREs interested in or responsible for managing the lifecycle of machine learning models. Professionals who are already familiar with their ML workloads and want to improve their practices, or those who are new to MLOps and want to learn how to effectively manage machine learning models in this environment, will find this book beneficial. The book is also useful for technical decision-makers and project managers looking to understand the process and benefits of MLOps.

Table of Contents

1. Understanding DevOps to MLOps
2. Training and Experimentation
3. Reproducible and Reusable ML
4. Model Management (Registration and Packaging)
5. Model Deployment: Batch Scoring and Real-Time Web Services
6. Capturing and Securing Governance Data for MLOps
7. Monitoring the ML Model
8. Notification and Alerting in MLOps
9. Automating the ML Lifecycle with ML Pipelines and GitHub Workflows
10. Using Models in Real-world Applications
11. Exploring Next-Gen MLOps

Banibrata De is a seasoned Senior Software Engineer at Microsoft's Core AI group in Redmond. With deep expertise in both MLOps and LLMOps, Banibrata has contributed to a wide range of AI-driven products. Prior to this, he played a key role in enhancing security for Microsoft customers as part of the Windows Defender team and optimized performance across critical Microsoft services to elevate user experience. He holds a degree in Computer Science from Jadavpur University, Kolkata, India.