Learning-Based Dynamic Memory Allocation Schemes for Apache Spark Data Processing

Danlin Jia; Li Wang; Natalia Valencia; Janki Bhimani; Bo Sheng; Ningfang Mi

doi:10.1109/TCC.2023.3329129

Learning-Based Dynamic Memory Allocation Schemes for Apache Spark Data Processing

Danlin Jia
, Li Wang
, Natalia Valencia
, Janki Bhimani
, Bo Sheng
, Ningfang Mi

Computer Science

Research output: Contribution to journal › Article › peer-review

Original language	English
Pages (from-to)	13-25
Number of pages	13
Journal	IEEE Transactions on Cloud Computing
Volume	12
Issue number	1
DOIs	https://doi.org/10.1109/TCC.2023.3329129
State	Published - Jan 1 2024

ASJC Scopus Subject Areas

Software
Information Systems
Hardware and Architecture
Computer Science Applications
Computer Networks and Communications

Keywords

Apache Spark
distributed data processing
JVM memory management
machine learning
Q-learning

Access to Document

10.1109/TCC.2023.3329129

Cite this

@article{924b8800400543a193eee5752e65c222,

title = "Learning-Based Dynamic Memory Allocation Schemes for Apache Spark Data Processing",

keywords = "Apache Spark, distributed data processing, JVM memory management, machine learning, Q-learning",

author = "Danlin Jia and Li Wang and Natalia Valencia and Janki Bhimani and Bo Sheng and Ningfang Mi",

note = "Publisher Copyright: {\textcopyright} 2013 IEEE.",

year = "2024",

month = jan,

day = "1",

doi = "10.1109/TCC.2023.3329129",

language = "English",

volume = "12",

pages = "13--25",

journal = "IEEE Transactions on Cloud Computing",

issn = "2168-7161",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

number = "1",

}

TY - JOUR

T1 - Learning-Based Dynamic Memory Allocation Schemes for Apache Spark Data Processing

AU - Jia, Danlin

AU - Wang, Li

AU - Valencia, Natalia

AU - Bhimani, Janki

AU - Sheng, Bo

AU - Mi, Ningfang

PY - 2024/1/1

Y1 - 2024/1/1

KW - Apache Spark

KW - distributed data processing

KW - JVM memory management

KW - machine learning

KW - Q-learning

UR - https://www.scopus.com/pages/publications/85177054553

UR - https://www.scopus.com/pages/publications/85177054553#tab=citedBy

U2 - 10.1109/TCC.2023.3329129

DO - 10.1109/TCC.2023.3329129

M3 - Article

AN - SCOPUS:85177054553

SN - 2168-7161

VL - 12

SP - 13

EP - 25

JO - IEEE Transactions on Cloud Computing

JF - IEEE Transactions on Cloud Computing

IS - 1

ER -

Learning-Based Dynamic Memory Allocation Schemes for Apache Spark Data Processing

ASJC Scopus Subject Areas

Keywords

Access to Document

Other files and links

Fingerprint

Cite this