Scalable End-to-End ML Platforms: from AutoML to Self-serve
Authors:
Igor L. Markov,
Pavlos A. Apostolopoulos,
Mia R. Garrard,
Tanya Qie,
Yin Huang,
Tanvi Gupta,
Anika Li,
Cesar Cardoso,
George Han,
Ryan Maghsoudian,
Norm Zhou
Abstract:
ML platforms help enable intelligent data-driven applications and maintain them with limited engineering effort. Upon sufficiently broad adoption, such platforms reach economies of scale that bring greater component reuse while improving efficiency of system development and maintenance. For an end-to-end ML platform with broad adoption, scaling relies on pervasive ML automation and system integrat…
▽ More
ML platforms help enable intelligent data-driven applications and maintain them with limited engineering effort. Upon sufficiently broad adoption, such platforms reach economies of scale that bring greater component reuse while improving efficiency of system development and maintenance. For an end-to-end ML platform with broad adoption, scaling relies on pervasive ML automation and system integration to reach the quality we term self-serve that we define with ten requirements and six optional capabilities. With this in mind, we identify long-term goals for platform development, discuss related tradeoffs and future work. Our reasoning is illustrated on two commercially-deployed end-to-end ML platforms that host hundreds of real-time use cases -- one general-purpose and one specialized.
△ Less
Submitted 3 March, 2023; v1 submitted 27 February, 2023;
originally announced February 2023.
Personalization for Web-based Services using Offline Reinforcement Learning
Authors:
Pavlos Athanasios Apostolopoulos,
Zehui Wang,
Hanson Wang,
Chad Zhou,
Kittipat Virochsiri,
Norm Zhou,
Igor L. Markov
Abstract:
Large-scale Web-based services present opportunities for improving UI policies based on observed user interactions. We address challenges of learning such policies through model-free offline Reinforcement Learning (RL) with off-policy training. Deployed in a production system for user authentication in a major social network, it significantly improves long-term objectives. We articulate practical…
▽ More
Large-scale Web-based services present opportunities for improving UI policies based on observed user interactions. We address challenges of learning such policies through model-free offline Reinforcement Learning (RL) with off-policy training. Deployed in a production system for user authentication in a major social network, it significantly improves long-term objectives. We articulate practical challenges, compare several ML techniques, provide insights on training and evaluation of RL models, and discuss generalizations.
△ Less
Submitted 10 February, 2021;
originally announced February 2021.
