Performance and Communication Cost of Deep Neural Networks in Federated Learning Environments: An Empirical Study. Article Swipe

MAKE IMPACT

Bader Alhafi Alotaibi , Fakhri Alam Khan , Yousef Qawqzeh , Gwanggil Jeon , David Camacho · YOU? · · 2024 · Open Access · · DOI: https://doi.org/10.9781/ijimai.2024.12.001

Federated learning, a distributive cooperative learning approach, allows clients to train the model locally using their data and share the trained model with a central server. When developing a federated learning environment, a deep/machine learning model needs to be chosen. The choice of the learning model can impact the model performance and the communication cost since federated learning requires the model exchange between clients and a central server in several rounds. In this work, we provide an empirical study to investigate the impact of using three different neural networks (CNN, VGG, and ResNet) models in image classification tasks using two different datasets (Cifar-10 and Cifar-100) in a federated learning environment. We investigate the impact of using these models on the global model performance and communication cost under different data distribution that are IID data and non-IID data distribution. The obtained results indicate that using CNN and ResNet models provide a faster convergence than VGG model. Additionally, these models require less communication costs. In contrast, the VGG model necessitates the sharing of numerous bits over several rounds to achieve higher accuracy under the IID data settings. However, its accuracy level is lower under non-IID data distributions than the other models. Furthermore, using a light model like CNN provides comparable results to the deeper neural network models with less communication cost, even though it may require more communication rounds to achieve the target accuracy in both datasets. CNN model requires fewer bits to be shared during communication than other models.

Type

article

Language

en

Landing Page

https://doi.org/10.9781/ijimai.2024.12.001

OA Status

diamond

Cited By

1

Related Works

10

OpenAlex ID

https://openalex.org/W4405584652

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W4405584652

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.9781/ijimai.2024.12.001

Digital Object Identifier

Title

Performance and Communication Cost of Deep Neural Networks in Federated Learning Environments: An Empirical Study.

Work title

Type

article

OpenAlex work type

Language

en

Primary language

Publication year

2024

Year of publication

Publication date

2024-12-19

Full publication date if available

Authors

Bader Alhafi Alotaibi, Fakhri Alam Khan, Yousef Qawqzeh, Gwanggil Jeon, David Camacho

List of authors in order

Landing page

https://doi.org/10.9781/ijimai.2024.12.001

Publisher landing page

Open access

Yes

Whether a free full text is available

OA status

diamond

Open access status per OpenAlex

OA URL

https://doi.org/10.9781/ijimai.2024.12.001

Direct OA link when available

Concepts

Computer science, Artificial neural network, Empirical research, Artificial intelligence, Deep learning, Deep neural networks, Data science, Federated learning, Machine learning, Philosophy, Epistemology

Top concepts (fields/topics) attached by OpenAlex

Cited by

1

Total citation count in OpenAlex

Citations by year (recent)

2025: 1

Per-year citation counts (last 5 years)

Related works (count)

10

Other works algorithmically related by OpenAlex

Full payload