Accelerating Data Access for Single Node in Distributed Storage Systems via MDS Codes Article Swipe

PDF

Hao Shi , Zhengyi Jiang , Zhongyi Huang , Linqi Song , Hanxu Hou ·

YOU? · · 2025 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2501.11353

Maximum distance separable (MDS) array codes are widely employed in modern distributed storage systems to provide high data reliability with small storage overhead. Compared with the data access latency of the entire file, the data access latency of a single node in a distributed storage system is equally important. In this paper, we propose two algorithms to effectively reduce the data access latency on a single node in different scenarios for MDS codes. We show theoretically that our algorithms have an expected reduction ratio of $\frac{(n-k)(n-k+1)}{n(n+1)}$ and $\frac{n-k}{n}$ for the data access latency of a single node when it obeys uniform distribution and shifted-exponential distribution, respectively, where $n$ and $k$ are the numbers of all nodes and the number of data nodes respectively. In the worst-case analysis, we show that our algorithms have a reduction ratio of more than $60\%$ when $(n,k)=(3,2)$. Furthermore, in simulation experiments, we use the Monte Carlo simulation algorithm to demonstrate less data access latency compared with the baseline algorithm.

Related Topics

Computer Science

Computer Data Storage

Database

Engineering

Structural Engineering

Concepts

Distributed data store Computer science Node (physics) Data access Computer data storage Computer network Distributed computing Database Operating system Engineering Structural engineering

Metadata

Type: preprint
Language: en
Landing Page: http://arxiv.org/abs/2501.11353
PDF: https://arxiv.org/pdf/2501.11353
OA Status: green
Related Works: 10
OpenAlex ID: https://openalex.org/W4406735468

All OpenAlex metadata

Raw OpenAlex JSON

OpenAlex ID: https://openalex.org/W4406735468

Canonical identifier for this work in OpenAlex
DOI: https://doi.org/10.48550/arxiv.2501.11353

Digital Object Identifier
Title: Accelerating Data Access for Single Node in Distributed Storage Systems via MDS Codes

Work title
Type: preprint

OpenAlex work type
Language: en

Primary language
Publication year: 2025

Year of publication
Publication date: 2025-01-20

Full publication date if available
Authors: Hao Shi, Zhengyi Jiang, Zhongyi Huang, Linqi Song, Hanxu Hou

List of authors in order
Landing page: https://arxiv.org/abs/2501.11353

Publisher landing page
PDF URL: https://arxiv.org/pdf/2501.11353

Direct link to full text PDF
Open access: Yes

Whether a free full text is available
OA status: green

Open access status per OpenAlex
OA URL: https://arxiv.org/pdf/2501.11353

Direct OA link when available
Concepts: Distributed data store, Computer science, Node (physics), Data access, Computer data storage, Computer network, Distributed computing, Database, Operating system, Engineering, Structural engineering

Top concepts (fields/topics) attached by OpenAlex
Cited by: 0

Total citation count in OpenAlex
Related works (count): 10

Other works algorithmically related by OpenAlex

Full payload

id	https://openalex.org/W4406735468
doi	https://doi.org/10.48550/arxiv.2501.11353
ids.doi	https://doi.org/10.48550/arxiv.2501.11353
ids.openalex	https://openalex.org/W4406735468
fwci
type	preprint
title	Accelerating Data Access for Single Node in Distributed Storage Systems via MDS Codes
biblio.issue
biblio.volume
biblio.last_page
biblio.first_page
topics[0].id	https://openalex.org/T11181
topics[0].field.id	https://openalex.org/fields/17
topics[0].field.display_name	Computer Science
topics[0].score	0.9970999956130981
topics[0].domain.id	https://openalex.org/domains/3
topics[0].domain.display_name	Physical Sciences
topics[0].subfield.id	https://openalex.org/subfields/1705
topics[0].subfield.display_name	Computer Networks and Communications
topics[0].display_name	Advanced Data Storage Technologies
topics[1].id	https://openalex.org/T11478
topics[1].field.id	https://openalex.org/fields/17
topics[1].field.display_name	Computer Science
topics[1].score	0.9962000250816345
topics[1].domain.id	https://openalex.org/domains/3
topics[1].domain.display_name	Physical Sciences
topics[1].subfield.id	https://openalex.org/subfields/1705
topics[1].subfield.display_name	Computer Networks and Communications
topics[1].display_name	Caching and Content Delivery
topics[2].id	https://openalex.org/T10715
topics[2].field.id	https://openalex.org/fields/17
topics[2].field.display_name	Computer Science
topics[2].score	0.9890999794006348
topics[2].domain.id	https://openalex.org/domains/3
topics[2].domain.display_name	Physical Sciences
topics[2].subfield.id	https://openalex.org/subfields/1705
topics[2].subfield.display_name	Computer Networks and Communications
topics[2].display_name	Distributed and Parallel Computing Systems
is_xpac	False
apc_list
apc_paid
concepts[0].id	https://openalex.org/C24885549
concepts[0].level	2
concepts[0].score	0.661095142364502
concepts[0].wikidata	https://www.wikidata.org/wiki/Q339678
concepts[0].display_name	Distributed data store
concepts[1].id	https://openalex.org/C41008148
concepts[1].level	0
concepts[1].score	0.6552504897117615
concepts[1].wikidata	https://www.wikidata.org/wiki/Q21198
concepts[1].display_name	Computer science
concepts[2].id	https://openalex.org/C62611344
concepts[2].level	2
concepts[2].score	0.5898704528808594
concepts[2].wikidata	https://www.wikidata.org/wiki/Q1062658
concepts[2].display_name	Node (physics)
concepts[3].id	https://openalex.org/C47487241
concepts[3].level	2
concepts[3].score	0.5199926495552063
concepts[3].wikidata	https://www.wikidata.org/wiki/Q5227230
concepts[3].display_name	Data access
concepts[4].id	https://openalex.org/C194739806
concepts[4].level	2
concepts[4].score	0.463432639837265
concepts[4].wikidata	https://www.wikidata.org/wiki/Q66221
concepts[4].display_name	Computer data storage
concepts[5].id	https://openalex.org/C31258907
concepts[5].level	1
concepts[5].score	0.3836413025856018
concepts[5].wikidata	https://www.wikidata.org/wiki/Q1301371
concepts[5].display_name	Computer network
concepts[6].id	https://openalex.org/C120314980
concepts[6].level	1
concepts[6].score	0.3715941309928894
concepts[6].wikidata	https://www.wikidata.org/wiki/Q180634
concepts[6].display_name	Distributed computing
concepts[7].id	https://openalex.org/C77088390
concepts[7].level	1
concepts[7].score	0.28242361545562744
concepts[7].wikidata	https://www.wikidata.org/wiki/Q8513
concepts[7].display_name	Database
concepts[8].id	https://openalex.org/C111919701
concepts[8].level	1
concepts[8].score	0.24717074632644653
concepts[8].wikidata	https://www.wikidata.org/wiki/Q9135
concepts[8].display_name	Operating system
concepts[9].id	https://openalex.org/C127413603
concepts[9].level	0
concepts[9].score	0.09632930159568787
concepts[9].wikidata	https://www.wikidata.org/wiki/Q11023
concepts[9].display_name	Engineering
concepts[10].id	https://openalex.org/C66938386
concepts[10].level	1
concepts[10].score	0.0
concepts[10].wikidata	https://www.wikidata.org/wiki/Q633538
concepts[10].display_name	Structural engineering
keywords[0].id	https://openalex.org/keywords/distributed-data-store
keywords[0].score	0.661095142364502
keywords[0].display_name	Distributed data store
keywords[1].id	https://openalex.org/keywords/computer-science
keywords[1].score	0.6552504897117615
keywords[1].display_name	Computer science
keywords[2].id	https://openalex.org/keywords/node
keywords[2].score	0.5898704528808594
keywords[2].display_name	Node (physics)
keywords[3].id	https://openalex.org/keywords/data-access
keywords[3].score	0.5199926495552063
keywords[3].display_name	Data access
keywords[4].id	https://openalex.org/keywords/computer-data-storage
keywords[4].score	0.463432639837265
keywords[4].display_name	Computer data storage
keywords[5].id	https://openalex.org/keywords/computer-network
keywords[5].score	0.3836413025856018
keywords[5].display_name	Computer network
keywords[6].id	https://openalex.org/keywords/distributed-computing
keywords[6].score	0.3715941309928894
keywords[6].display_name	Distributed computing
keywords[7].id	https://openalex.org/keywords/database
keywords[7].score	0.28242361545562744
keywords[7].display_name	Database
keywords[8].id	https://openalex.org/keywords/operating-system
keywords[8].score	0.24717074632644653
keywords[8].display_name	Operating system
keywords[9].id	https://openalex.org/keywords/engineering
keywords[9].score	0.09632930159568787
keywords[9].display_name	Engineering
language	en
locations[0].id	pmh:oai:arXiv.org:2501.11353
locations[0].is_oa	True
locations[0].source.id	https://openalex.org/S4306400194
locations[0].source.issn
locations[0].source.type	repository
locations[0].source.is_oa	True
locations[0].source.issn_l
locations[0].source.is_core	False
locations[0].source.is_in_doaj	False
locations[0].source.display_name	arXiv (Cornell University)
locations[0].source.host_organization	https://openalex.org/I205783295
locations[0].source.host_organization_name	Cornell University
locations[0].source.host_organization_lineage	https://openalex.org/I205783295
locations[0].license
locations[0].pdf_url	https://arxiv.org/pdf/2501.11353
locations[0].version	submittedVersion
locations[0].raw_type	text
locations[0].license_id
locations[0].is_accepted	False
locations[0].is_published	False
locations[0].raw_source_name
locations[0].landing_page_url	http://arxiv.org/abs/2501.11353
locations[1].id	doi:10.48550/arxiv.2501.11353
locations[1].is_oa	True
locations[1].source.id	https://openalex.org/S4306400194
locations[1].source.issn
locations[1].source.type	repository
locations[1].source.is_oa	True
locations[1].source.issn_l
locations[1].source.is_core	False
locations[1].source.is_in_doaj	False
locations[1].source.display_name	arXiv (Cornell University)
locations[1].source.host_organization	https://openalex.org/I205783295
locations[1].source.host_organization_name	Cornell University
locations[1].source.host_organization_lineage	https://openalex.org/I205783295
locations[1].license
locations[1].pdf_url
locations[1].version
locations[1].raw_type	article
locations[1].license_id
locations[1].is_accepted	False
locations[1].is_published
locations[1].raw_source_name
locations[1].landing_page_url	https://doi.org/10.48550/arxiv.2501.11353
indexed_in	arxiv, datacite
authorships[0].author.id	https://openalex.org/A5100627106
authorships[0].author.orcid	https://orcid.org/0000-0003-0184-2245
authorships[0].author.display_name	Hao Shi
authorships[0].author_position	first
authorships[0].raw_author_name	Shi, Hao
authorships[0].is_corresponding	False
authorships[1].author.id	https://openalex.org/A5006147935
authorships[1].author.orcid	https://orcid.org/0000-0001-8676-7461
authorships[1].author.display_name	Zhengyi Jiang
authorships[1].author_position	middle
authorships[1].raw_author_name	Jiang, Zhengyi
authorships[1].is_corresponding	False
authorships[2].author.id	https://openalex.org/A5101599983
authorships[2].author.orcid	https://orcid.org/0009-0000-2512-6054
authorships[2].author.display_name	Zhongyi Huang
authorships[2].author_position	middle
authorships[2].raw_author_name	Huang, Zhongyi
authorships[2].is_corresponding	False
authorships[3].author.id	https://openalex.org/A5035185924
authorships[3].author.orcid	https://orcid.org/0000-0003-2756-4984
authorships[3].author.display_name	Linqi Song
authorships[3].author_position	middle
authorships[3].raw_author_name	Song, Linqi
authorships[3].is_corresponding	False
authorships[4].author.id	https://openalex.org/A5039863234
authorships[4].author.orcid	https://orcid.org/0000-0001-7328-9341
authorships[4].author.display_name	Hanxu Hou
authorships[4].author_position	last
authorships[4].raw_author_name	Hou, Hanxu
authorships[4].is_corresponding	False
has_content.pdf	False
has_content.grobid_xml	False
is_paratext	False
open_access.is_oa	True
open_access.oa_url	https://arxiv.org/pdf/2501.11353
open_access.oa_status	green
open_access.any_repository_has_fulltext	False
created_date	2025-10-10T00:00:00
display_name	Accelerating Data Access for Single Node in Distributed Storage Systems via MDS Codes
has_fulltext	False
is_retracted	False
updated_date	2025-11-06T06:51:31.235846
primary_topic.id	https://openalex.org/T11181
primary_topic.field.id	https://openalex.org/fields/17
primary_topic.field.display_name	Computer Science
primary_topic.score	0.9970999956130981
primary_topic.domain.id	https://openalex.org/domains/3
primary_topic.domain.display_name	Physical Sciences
primary_topic.subfield.id	https://openalex.org/subfields/1705
primary_topic.subfield.display_name	Computer Networks and Communications
primary_topic.display_name	Advanced Data Storage Technologies
related_works	https://openalex.org/W2890987641, https://openalex.org/W2374861481, https://openalex.org/W2205290344, https://openalex.org/W2785349009, https://openalex.org/W2994768483, https://openalex.org/W2025557598, https://openalex.org/W3137135443, https://openalex.org/W2769329074, https://openalex.org/W1844167575, https://openalex.org/W2057452656
cited_by_count	0
locations_count	2
best_oa_location.id	pmh:oai:arXiv.org:2501.11353
best_oa_location.is_oa	True
best_oa_location.source.id	https://openalex.org/S4306400194
best_oa_location.source.issn
best_oa_location.source.type	repository
best_oa_location.source.is_oa	True
best_oa_location.source.issn_l
best_oa_location.source.is_core	False
best_oa_location.source.is_in_doaj	False
best_oa_location.source.display_name	arXiv (Cornell University)
best_oa_location.source.host_organization	https://openalex.org/I205783295
best_oa_location.source.host_organization_name	Cornell University
best_oa_location.source.host_organization_lineage	https://openalex.org/I205783295
best_oa_location.license
best_oa_location.pdf_url	https://arxiv.org/pdf/2501.11353
best_oa_location.version	submittedVersion
best_oa_location.raw_type	text
best_oa_location.license_id
best_oa_location.is_accepted	False
best_oa_location.is_published	False
best_oa_location.raw_source_name
best_oa_location.landing_page_url	http://arxiv.org/abs/2501.11353
primary_location.id	pmh:oai:arXiv.org:2501.11353
primary_location.is_oa	True
primary_location.source.id	https://openalex.org/S4306400194
primary_location.source.issn
primary_location.source.type	repository
primary_location.source.is_oa	True
primary_location.source.issn_l
primary_location.source.is_core	False
primary_location.source.is_in_doaj	False
primary_location.source.display_name	arXiv (Cornell University)
primary_location.source.host_organization	https://openalex.org/I205783295
primary_location.source.host_organization_name	Cornell University
primary_location.source.host_organization_lineage	https://openalex.org/I205783295
primary_location.license
primary_location.pdf_url	https://arxiv.org/pdf/2501.11353
primary_location.version	submittedVersion
primary_location.raw_type	text
primary_location.license_id
primary_location.is_accepted	False
primary_location.is_published	False
primary_location.raw_source_name
primary_location.landing_page_url	http://arxiv.org/abs/2501.11353
publication_date	2025-01-20
publication_year	2025
referenced_works_count	0
abstract_inverted_index.a	38, 42, 64, 94, 133
abstract_inverted_index.In	49, 123
abstract_inverted_index.We	73
abstract_inverted_index.an	80
abstract_inverted_index.in	9, 41, 67, 143
abstract_inverted_index.is	46
abstract_inverted_index.it	98
abstract_inverted_index.of	29, 37, 84, 93, 113, 119, 136
abstract_inverted_index.on	63
abstract_inverted_index.to	14, 56, 153
abstract_inverted_index.we	52, 127, 146
abstract_inverted_index.$k$	109
abstract_inverted_index.$n$	107
abstract_inverted_index.MDS	71
abstract_inverted_index.all	114
abstract_inverted_index.and	86, 102, 108, 116
abstract_inverted_index.are	6, 110
abstract_inverted_index.for	70, 88
abstract_inverted_index.our	77, 130
abstract_inverted_index.the	25, 30, 33, 59, 89, 111, 117, 124, 148, 161
abstract_inverted_index.two	54
abstract_inverted_index.use	147
abstract_inverted_index.data	17, 26, 34, 60, 90, 120, 156
abstract_inverted_index.have	79, 132
abstract_inverted_index.high	16
abstract_inverted_index.less	155
abstract_inverted_index.more	137
abstract_inverted_index.node	40, 66, 96
abstract_inverted_index.show	74, 128
abstract_inverted_index.than	138
abstract_inverted_index.that	76, 129
abstract_inverted_index.this	50
abstract_inverted_index.when	97, 140
abstract_inverted_index.with	19, 24, 160
abstract_inverted_index.(MDS)	3
abstract_inverted_index.Carlo	150
abstract_inverted_index.Monte	149
abstract_inverted_index.array	4
abstract_inverted_index.codes	5
abstract_inverted_index.file,	32
abstract_inverted_index.nodes	115, 121
abstract_inverted_index.obeys	99
abstract_inverted_index.ratio	83, 135
abstract_inverted_index.small	20
abstract_inverted_index.where	106
abstract_inverted_index.$60\%$	139
abstract_inverted_index.access	27, 35, 61, 91, 157
abstract_inverted_index.codes.	72
abstract_inverted_index.entire	31
abstract_inverted_index.modern	10
abstract_inverted_index.number	118
abstract_inverted_index.paper,	51
abstract_inverted_index.reduce	58
abstract_inverted_index.single	39, 65, 95
abstract_inverted_index.system	45
abstract_inverted_index.widely	7
abstract_inverted_index.Maximum	0
abstract_inverted_index.equally	47
abstract_inverted_index.latency	28, 36, 62, 92, 158
abstract_inverted_index.numbers	112
abstract_inverted_index.propose	53
abstract_inverted_index.provide	15
abstract_inverted_index.storage	12, 21, 44
abstract_inverted_index.systems	13
abstract_inverted_index.uniform	100
abstract_inverted_index.Compared	23
abstract_inverted_index.baseline	162
abstract_inverted_index.compared	159
abstract_inverted_index.distance	1
abstract_inverted_index.employed	8
abstract_inverted_index.expected	81
abstract_inverted_index.algorithm	152
abstract_inverted_index.analysis,	126
abstract_inverted_index.different	68
abstract_inverted_index.overhead.	22
abstract_inverted_index.reduction	82, 134
abstract_inverted_index.scenarios	69
abstract_inverted_index.separable	2
abstract_inverted_index.algorithm.	163
abstract_inverted_index.algorithms	55, 78, 131
abstract_inverted_index.important.	48
abstract_inverted_index.simulation	144, 151
abstract_inverted_index.worst-case	125
abstract_inverted_index.demonstrate	154
abstract_inverted_index.distributed	11, 43
abstract_inverted_index.effectively	57
abstract_inverted_index.reliability	18
abstract_inverted_index.Furthermore,	142
abstract_inverted_index.distribution	101
abstract_inverted_index.experiments,	145
abstract_inverted_index.distribution,	104
abstract_inverted_index.respectively,	105
abstract_inverted_index.respectively.	122
abstract_inverted_index.theoretically	75
abstract_inverted_index.$(n,k)=(3,2)$.	141
abstract_inverted_index.$\frac{n-k}{n}$	87
abstract_inverted_index.shifted-exponential	103
abstract_inverted_index.$\frac{(n-k)(n-k+1)}{n(n+1)}$	85
cited_by_percentile_year
countries_distinct_count	0
institutions_distinct_count	5
citation_normalized_percentile