AutoPath: Harnessing parallel execution paths for efficient resource allocation in multi-stage big data frameworks

Han Gao; Zhengyu Yang; Janki Bhimani; Teng Wang; Jiayin Wang; Bo Sheng; Ningfang Mi

doi:10.1109/ICCCN.2017.8038381

AutoPath: Harnessing parallel execution paths for efficient resource allocation in multi-stage big data frameworks

Han Gao
, Zhengyu Yang
, Janki Bhimani
, Teng Wang
, Jiayin Wang
, Bo Sheng
, Ningfang Mi

Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Original language	English
Title of host publication	2017 26th International Conference on Computer Communications and Networks, ICCCN 2017
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781509029914
DOIs	https://doi.org/10.1109/ICCCN.2017.8038381
State	Published - Sep 14 2017
Event	26th International Conference on Computer Communications and Networks, ICCCN 2017 - Vancouver, Canada Duration: Jul 31 2017 → Aug 3 2017

Publication series

Name	2017 26th International Conference on Computer Communications and Networks, ICCCN 2017

Conference

Conference	26th International Conference on Computer Communications and Networks, ICCCN 2017
Country/Territory	Canada
City	Vancouver
Period	7/31/17 → 8/3/17

ASJC Scopus Subject Areas

Artificial Intelligence
Computer Networks and Communications
Software
Management of Technology and Innovation
Information Systems and Management
Safety, Risk, Reliability and Quality
Media Technology
Control and Optimization

Keywords

Resource management
Scheduling
Spark
Task assignment
Workload evaluation & estimation

Access to Document

10.1109/ICCCN.2017.8038381

Cite this

Gao, H., Yang, Z., Bhimani, J., Wang, T., Wang, J., Sheng, B., & Mi, N. (2017). AutoPath: Harnessing parallel execution paths for efficient resource allocation in multi-stage big data frameworks. In 2017 26th International Conference on Computer Communications and Networks, ICCCN 2017 Article 8038381 (2017 26th International Conference on Computer Communications and Networks, ICCCN 2017). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICCCN.2017.8038381

AutoPath: Harnessing parallel execution paths for efficient resource allocation in multi-stage big data frameworks. / Gao, Han; Yang, Zhengyu; Bhimani, Janki et al.
2017 26th International Conference on Computer Communications and Networks, ICCCN 2017. Institute of Electrical and Electronics Engineers Inc., 2017. 8038381 (2017 26th International Conference on Computer Communications and Networks, ICCCN 2017).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Gao, H, Yang, Z, Bhimani, J, Wang, T, Wang, J, Sheng, B & Mi, N 2017, AutoPath: Harnessing parallel execution paths for efficient resource allocation in multi-stage big data frameworks. in 2017 26th International Conference on Computer Communications and Networks, ICCCN 2017., 8038381, 2017 26th International Conference on Computer Communications and Networks, ICCCN 2017, Institute of Electrical and Electronics Engineers Inc., 26th International Conference on Computer Communications and Networks, ICCCN 2017, Vancouver, Canada, 7/31/17. https://doi.org/10.1109/ICCCN.2017.8038381

Gao H, Yang Z, Bhimani J, Wang T, Wang J, Sheng B et al. AutoPath: Harnessing parallel execution paths for efficient resource allocation in multi-stage big data frameworks. In 2017 26th International Conference on Computer Communications and Networks, ICCCN 2017. Institute of Electrical and Electronics Engineers Inc. 2017. 8038381. (2017 26th International Conference on Computer Communications and Networks, ICCCN 2017). doi: 10.1109/ICCCN.2017.8038381

Gao, Han ; Yang, Zhengyu ; Bhimani, Janki et al. / AutoPath : Harnessing parallel execution paths for efficient resource allocation in multi-stage big data frameworks. 2017 26th International Conference on Computer Communications and Networks, ICCCN 2017. Institute of Electrical and Electronics Engineers Inc., 2017. (2017 26th International Conference on Computer Communications and Networks, ICCCN 2017).

@inproceedings{3f56a97c05a14085a60d398ab18327be,

title = "AutoPath: Harnessing parallel execution paths for efficient resource allocation in multi-stage big data frameworks",

keywords = "Resource management, Scheduling, Spark, Task assignment, Workload evaluation \& estimation",

author = "Han Gao and Zhengyu Yang and Janki Bhimani and Teng Wang and Jiayin Wang and Bo Sheng and Ningfang Mi",

note = "Publisher Copyright: {\textcopyright} 2017 IEEE.; 26th International Conference on Computer Communications and Networks, ICCCN 2017 ; Conference date: 31-07-2017 Through 03-08-2017",

year = "2017",

month = sep,

day = "14",

doi = "10.1109/ICCCN.2017.8038381",

language = "English",

series = "2017 26th International Conference on Computer Communications and Networks, ICCCN 2017",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "2017 26th International Conference on Computer Communications and Networks, ICCCN 2017",

}

TY - GEN

T1 - AutoPath

T2 - 26th International Conference on Computer Communications and Networks, ICCCN 2017

AU - Gao, Han

AU - Yang, Zhengyu

AU - Bhimani, Janki

AU - Wang, Teng

AU - Wang, Jiayin

AU - Sheng, Bo

AU - Mi, Ningfang

PY - 2017/9/14

Y1 - 2017/9/14

KW - Resource management

KW - Scheduling

KW - Spark

KW - Task assignment

KW - Workload evaluation & estimation

UR - https://www.scopus.com/pages/publications/85024839187

UR - https://www.scopus.com/pages/publications/85024839187#tab=citedBy

U2 - 10.1109/ICCCN.2017.8038381

DO - 10.1109/ICCCN.2017.8038381

M3 - Conference contribution

AN - SCOPUS:85024839187

T3 - 2017 26th International Conference on Computer Communications and Networks, ICCCN 2017

BT - 2017 26th International Conference on Computer Communications and Networks, ICCCN 2017

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 31 July 2017 through 3 August 2017

ER -

AutoPath: Harnessing parallel execution paths for efficient resource allocation in multi-stage big data frameworks

Publication series

Conference

ASJC Scopus Subject Areas

Keywords

Access to Document

Other files and links

Fingerprint

Cite this