Lineage stash Article Swipe
Related Concepts
Overhead (engineering)
Computer science
Lineage (genetic)
Fault tolerance
SPARK (programming language)
Distributed computing
Cluster (spacecraft)
High availability
Operating system
Biology
Programming language
Biochemistry
Gene
Stephanie Wang
,
John Liagouris
,
Robert Nishihara
,
Philipp Moritz
,
Ujval Misra
,
Alexey Tumanov
,
Ion Stoica
·
YOU?
·
· 2019
· Open Access
·
· DOI: https://doi.org/10.1145/3341301.3359653
· OA: W2981937105
YOU?
·
· 2019
· Open Access
·
· DOI: https://doi.org/10.1145/3341301.3359653
· OA: W2981937105
As cluster computing frameworks such as Spark, Dryad, Flink, and Ray are being deployed in mission critical applications and on larger and larger clusters, their ability to tolerate failures is growing in importance. These frameworks employ two broad approaches for fault tolerance: checkpointing and lineage. Checkpointing exhibits low overhead during normal operation but high overhead during recovery, while lineage-based solutions make the opposite tradeoff.
Related Topics
Finding more related topics…