Microsoft AI

Clone this repo:
  1. babd0c0 Update listing_config_schema.json by Daniel Ciborowski · 1 year, 1 month ago master
  2. bcdc533 Update listing_config_schema.json by Daniel Ciborowski · 1 year, 1 month ago
  3. f73c62c Create listing_config_schema.json by Daniel Ciborowski · 1 year, 1 month ago
  4. 533b7bd Create azuredeploy.json (#18) by Daniel Ciborowski · 1 year, 9 months ago
  5. 2b27be3 Update README file (#16) by Albert Davletov · 2 years ago

Samples, Reference Architectures & Best Practices

This repository is meant to organize Microsoft's Open Source AI based repositories.


batch scoring, realtime scoring, model training, MLOps, Azure Machine Learning, computer vision, natural language processing, recommenders

Table of contents

  1. Getting Started
  2. AI100 - Samples
  3. AI200 - Reference Architectures
  4. AI300 - Best Practices
  5. Contributing

Getting Started

This repository is arranged as submodules so you can either pull all the tutorials or simply the ones you want. To pull all the tutorials run:

git clone --recurse-submodules

if you have git older than 2.13 run:

git clone --recursive

To pull a single submodule (e.g. DeployDeepModelKubernetes) run:

git clone
cd ai
git submodule init submodules/DeployDeepModelKubernetes
git submodule update

AI100 - Samples

Samples are a collection of open source Python repositories created by the Microsoft product teams, which focus on AI services.

Azure ML Python SDKPython notebooks with ML and deep learning examples with Azure Machine Learning
Azure Cognitive Services Python SDKLearn how to use the Cognitive Services Python SDK with these samples
Azure Intelligent KioskHere you will find several demos showcasing workflows and experiences built on top of the Microsoft Cognitive Services.
MML Spark SamplesMMLSpark is an ecosystem of tools aimed towards expanding the distributed computing framework Apache Spark in several new directions.
Seismic Deep Learning SamplesDeep Learning for Seismic Imaging and Interpretation.

AI200 - Reference Architectures

Our reference architectures are arranged by scenario. Each architecture includes open source practices, along with considerations for scalability, availability, manageability, and security.

Deploy Classic ML Model on KubernetesPythonCPUReal-Time ScoringTrain LightGBM model locally using Azure ML, deploy on Kubernetes or IoT Edge for real-time scoringBuild Status
Deploy Deep Learning Model on KubernetesPythonKerasReal-Time ScoringDeploy image classification model on Kubernetes or IoT Edge for real-time scoring using Azure MLBuild Status
Hyperparameter Tuning of Classical ML ModelsPythonCPUTrainingTrain LightGBM model locally and run Hyperparameter tuning using Hyperdrive in Azure ML
Deploy Deep Learning Model on PipelinesPythonGPUBatch ScoringDeploy PyTorch style transfer model for batch scoring using Azure ML PipelinesBuild Status
Deploy Classic ML Model on PipelinesPythonCPUBatch ScoringDeploy one-class SVM for batch scoring anomaly detection using Azure ML Pipelines
Deploy R ML Model on KubernetesRCPUReal-Time ScoringDeploy ML model for real-time scoring on Kubernetes
Deploy R ML Model on BatchRCPUScoringDeploy forecasting model for batch scoring using Azure Batch and doAzureParallel
Deploy Spark ML Model on DatabricksPythonSparkBatch ScoringDeploy a classification model for batch scoring using Databricks
Train Distributed Deep Leaning ModelPythonGPUTrainingDistributed training of ResNet50 model using Batch AI

AI300 - Best Practices

Our best practices are arranged by topic. Each best pratice repository includes open source methods, along with considerations for scalability, availability, manageability, and security.

Computer VisionAccelerate the development of computer vision applications with examples and best practice guidelines for building computer vision systems
Natural Language ProcessingState-of-the-art methods and common scenarios that are popular among researchers and practitioners working on problems involving text and language.
RecommendersExamples and best practices for building recommendation systems, provided as Jupyter notebooks.
MLOpsMLOps empowers data scientists and app developers to help bring ML models to production.

Recommend a Scenario

If there is a particular scenario you are interested in seeing a tutorial for please fill in a scenario suggestion

Ongoing Work

We are constantly developing interesting AI reference architectures using Microsoft AI Platform. Some of the ongoing projects include IoT Edge scenarios, model scoring on mobile devices, add more... To follow the progress and any new reference architectures, please go to the AI section of this link.


This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit

When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., label, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact with any additional questions or comments.