Machine Learning Platform

Designed to support the end-to-end ML workflow: manage data, train,
evaluate, and deploy models, make predictions, and monitor predictions.

What is a Machine Learning Platform?

The AI Singapore technology stack includes the components described below as well as others into an integrated platform to support our data scientists and AI engineers and is continuously evolving to incorporate new technologies and address new challenges in machine learning.

The technology stack is comprised of tooling and pipelines for data scientists to develop, deploy, measure, improve and iterate to enable better models not only for one particular problem but wider range of datasets and algorithms. It also includes all the requirements of more traditional applications such as API development and versioning, package management, containerization, reproducibility, scale, monitoring, logging and more.

Common Tools and Libraries

Polyaxon

Polyaxon is an open source platform for building, training, and monitoring large scale deep learning applications.

Developer’s Resource: https://github.com/polyaxon/polyaxon

Apache Spark is an open-source distributed general-purpose cluster computing framework with (mostly) in-memory data processing engine

Developer’s Resource: https://spark.apache.org/

Seldon

Seldon Core is an open source platform for deploying machine learning models on a Kubernetes cluster.

Developer’s Resource: https://www.seldon.io/

100E Use Cases

Model management tools and frameworks support all current 100E projects (see diagram below), enabling both data scientists and AI Engineers to create data pipelines, engineer features, train models and monitor and manage the lifecycle of those models.

Related Articles

  1. Distributed Deep Learning with Polyaxon
    1. Link to article: https://medium.com/polyaxon/distributed-deep-learning-with-polyaxon-6d9f1288e4b8
  2. Spark Tutorial
    1. Link to article: https://www.edureka.co/blog/spark-tutorial/
  3. Manage ML Deployments Like A Boss: Deploy Your First AB Test With Sklearn, Kubernetes and Seldon-core using Only Your Web Browser & Google Cloud
    1. Link to article: https://medium.com/analytics-vidhya/manage-ml-deployments-like-a-boss-deploy-your-first-ab-test-with-sklearn-kubernetes-and-b10ae0819dfe