Scalability! but at what cost? | RDL Research Database

Abstract

We offer a new metric for big data platforms, COST, or the Configuration that Outperforms a Single Thread. The COST of a given platform for a given problem is the hardware configuration required before the platform out-performs a competent single-threaded implementation. COST weighs a system’s scalability against the over-heads introduced by the system, and indicates the actual performance gains of the system, without rewarding sys-tems that bring substantial but parallelizable overheads. We survey measurements of data-parallel systems re-cently reported in SOSP and OSDI, and find that many systems have either a surprisingly large COST, often hundreds of cores, or simply underperform one thread for all of their reported configurations. 1

Keywords

ScalabilityParallelizable manifoldComputer scienceThread (computing)Distributed computingBig dataEmbedded systemParallel computingOperating system

Affiliated Institutions

Related Publications

TSAaaS: Time Series Analytics as a Service on IoT

Xiaomin Xu , Sheng Huang , Yaoliang Chen +3 more

In recent years, the evolving of IoT (Internet of Things) has resulted in the deployment of massive numbers of sensors in various fields, such as the Energy and Utility (E&U) in...

2014 40 citations

Efficient Architecture-Aware Acceleration of BWA-MEM for Multicore Systems

Md. Vasimuddin , Sanchit Misra , Heng Li +1 more

Innovations in Next-Generation Sequencing are enabling generation of DNA sequence data at ever faster rates and at very low cost. For example, the Illumina NovaSeq 6000 sequence...

2019 2019 IEEE International Parallel and ... 2300 citations

PETSc Users Manual

Satish Balay , Shrirang Abhyankar , Mark F. Adams +19 more

The Portable, Extensible Toolkit for Scientific Computation (PETSc), is a suite of data structures and routines for the scalable (parallel) solution of scientific applications m...

2019 1947 citations

An integrated semiconductor device enabling non-optical genome sequencing

Jonathan M. Rothberg , Wolfgang Hinz , Todd M. Rearick +41 more

The seminal importance of DNA sequencing to the life sciences, biotechnology and medicine has driven the search for more scalable and lower-cost solutions. Here we describe a DN...

2011 Nature 2132 citations

GeePS

Henggang Cui , Hao Zhang , Gregory R. Ganger +2 more

Large-scale deep learning requires huge computational resources to train a multi-layer neural network. Recent systems propose using 100s to 1000s of machines to train networks w...

2016 296 citations

Publication Info

Year: 2015
Type: article
Pages: 14-14
Citations: 218
Access: Closed

External Links

Citation Metrics

218

OpenAlex

Cite This

APA Style

                            
                                    Frank McSherry, 
                                
                                    Michael Isard, 
                                
                                    Derek G. Murray
                                
                            (2015). 
                            Scalability! but at what cost?. 
                            
                            , 14-14.