-
Learned Indexes for a Google-scale Disk-based Database
Authors:
Hussam Abu-Libdeh,
Deniz Altınbüken,
Alex Beutel,
Ed H. Chi,
Lyric Doshi,
Tim Kraska,
Xiaozhou,
Li,
Andy Ly,
Christopher Olston
Abstract:
There is great excitement about learned index structures, but understandable skepticism about the practicality of a new method uprooting decades of research on B-Trees. In this paper, we work to remove some of that uncertainty by demonstrating how a learned index can be integrated in a distributed, disk-based database system: Google's Bigtable. We detail several design decisions we made to integra…
▽ More
There is great excitement about learned index structures, but understandable skepticism about the practicality of a new method uprooting decades of research on B-Trees. In this paper, we work to remove some of that uncertainty by demonstrating how a learned index can be integrated in a distributed, disk-based database system: Google's Bigtable. We detail several design decisions we made to integrate learned indexes in Bigtable. Our results show that integrating learned index significantly improves the end-to-end read latency and throughput for Bigtable.
△ Less
Submitted 23 December, 2020;
originally announced December 2020.
-
TensorFlow-Serving: Flexible, High-Performance ML Serving
Authors:
Christopher Olston,
Noah Fiedel,
Kiril Gorovoy,
Jeremiah Harmsen,
Li Lao,
Fangwei Li,
Vinu Rajashekhar,
Sukriti Ramesh,
Jordan Soyke
Abstract:
We describe TensorFlow-Serving, a system to serve machine learning models inside Google which is also available in the cloud and via open-source. It is extremely flexible in terms of the types of ML platforms it supports, and ways to integrate with systems that convey new models and updated versions from training to serving. At the same time, the core code paths around model lookup and inference h…
▽ More
We describe TensorFlow-Serving, a system to serve machine learning models inside Google which is also available in the cloud and via open-source. It is extremely flexible in terms of the types of ML platforms it supports, and ways to integrate with systems that convey new models and updated versions from training to serving. At the same time, the core code paths around model lookup and inference have been carefully optimized to avoid performance pitfalls observed in naive implementations. Google uses it in many production deployments, including a multi-tenant model hosting service called TFS^2.
△ Less
Submitted 27 December, 2017; v1 submitted 17 December, 2017;
originally announced December 2017.
-
Shuffling a Stacked Deck: The Case for Partially Randomized Ranking of Search Engine Results
Authors:
Sandeep Pandey,
Sourashis Roy,
Christopher Olston,
Junghoo Cho,
Soumen Chakrabarti
Abstract:
In-degree, PageRank, number of visits and other measures of Web page popularity significantly influence the ranking of search results by modern search engines. The assumption is that popularity is closely correlated with quality, a more elusive concept that is difficult to measure directly. Unfortunately, the correlation between popularity and quality is very weak for newly-created pages that ha…
▽ More
In-degree, PageRank, number of visits and other measures of Web page popularity significantly influence the ranking of search results by modern search engines. The assumption is that popularity is closely correlated with quality, a more elusive concept that is difficult to measure directly. Unfortunately, the correlation between popularity and quality is very weak for newly-created pages that have yet to receive many visits and/or in-links. Worse, since discovery of new content is largely done by querying search engines, and because users usually focus their attention on the top few results, newly-created but high-quality pages are effectively ``shut out,'' and it can take a very long time before they become popular.
We propose a simple and elegant solution to this problem: the introduction of a controlled amount of randomness into search result ranking methods. Doing so offers new pages a chance to prove their worth, although clearly using too much randomness will degrade result quality and annul any benefits achieved. Hence there is a tradeoff between exploration to estimate the quality of new pages and exploitation of pages already known to be of high quality. We study this tradeoff both analytically and via simulation, in the context of an economic objective function based on aggregate result quality amortized over time. We show that a modest amount of randomness leads to improved search results.
△ Less
Submitted 4 March, 2005;
originally announced March 2005.
