Explanipedia

CHARPEVAL: Benchmarking Large Language Models’ Contextual Reasoning in Knowledge-Grounded Dialogue Open

Abbas Ghaddar, David Alfonso-Hermelo, Philippe Langlais, Boxing Chen, Prasanna Parthasarathi · 2025

On the importance of Data Scale in Pretraining Arabic Language Models Open

Abbas Ghaddar, Philippe Langlais, Mehdi Rezagholizadeh, Boxing Chen · 2024

Pretraining monolingual language models have been proven to be vital for performance in Arabic Natural Language Processing (NLP) tasks. In this paper, we conduct a comprehensive study on the role of data in Arabic Pretrained Language Model…

AraMUS: Pushing the Limits of Data and Model Scale for Arabic Natural Language Processing Open

Asaad Alghamdi, Xinyu Duan, Wei Jiang, Zhenhai Wang, Yimeng Wu , et al. · 2023

Developing monolingual large Pre-trained Language Models (PLMs) is shown to be very successful in handling different tasks in Natural Language Processing (NLP). In this work, we present AraMUS, the largest Arabic PLM with 11B parameters tr…

Whole-body gene expression atlas of an adult metazoan Open

Abbas Ghaddar, Erick Armingol, Chau Huynh, Louis Gevirtzman, Nathan E. Lewis , et al. · 2023

Animals are integrated organ systems composed of interacting cells whose structure and function are in turn defined by their active genes. Understanding what distinguishes physiological and disease states therefore requires systemic knowle…

AraMUS: Pushing the Limits of Data and Model Scale for Arabic Natural Language Processing Open

Asaad Alghamdi, Xinyu Duan, Wei Jiang, Zhenhai Wang, Yimeng Wu , et al. · 2023

Asaad Alghamdi, Xinyu Duan, Wei Jiang, Zhenhai Wang, Yimeng Wu, Qingrong Xia, Zhefeng Wang, Yi Zheng, Mehdi Rezagholizadeh, Baoxing Huai, Peilun Cheng, Abbas Ghaddar. Findings of the Association for Computational Linguistics: ACL 2023. 202…

Whole-body gene expression atlas of an adult metazoan Open

Abbas Ghaddar, Erick Armingol, Chau Huynh, Louis Gevirtzman, Nathan E. Lewis , et al. · 2022

<p>Animals are integrated organ systems composed of interacting cells whose structure and function are in turn defined by their active genes. Understanding what distinguishes physiological and disease states therefore requires system…

Whole-body gene expression atlas of an adult metazoan Open

Abbas Ghaddar, Erick Armingol, Chau Huynh, Louis Gevirtzman, Nathan E. Lewis , et al. · 2022

<p>Animals are integrated organ systems composed of interacting cells whose structure and function are in turn defined by their active genes. Understanding what distinguishes physiological and disease states therefore requires system…

Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language Understanding Open

Abbas Ghaddar, Yimeng Wu, Sunyam Bagga, Ahmad Rashid, Khalil Bibi , et al. · 2022

There is a growing body of work in recent years to develop pre-trained language models (PLMs) for the Arabic language. This work concerns addressing two major problems in existing Arabic PLMs which constraint progress of the Arabic NLU and…

CILDA: Contrastive Data Augmentation using Intermediate Layer Knowledge Distillation Open

Md Akmal Haidar, Mehdi Rezagholizadeh, Abbas Ghaddar, Khalil Bibi, Philippe Langlais , et al. · 2022

Knowledge distillation (KD) is an efficient framework for compressing large-scale pre-trained language models. Recent years have seen a surge of research aiming to improve KD by leveraging Contrastive Learning, Intermediate Layer Distillat…

Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language Processing Open

Abbas Ghaddar, Yimeng Wu, Sunyam Bagga, Ahmad Rashid, Khalil Bibi , et al. · 2022

Abbas Ghaddar, Yimeng Wu, Sunyam Bagga, Ahmad Rashid, Khalil Bibi, Mehdi Rezagholizadeh, Chao Xing, Yasheng Wang, Xinyu Duan, Zhefeng Wang, Baoxing Huai, Xin Jiang, Qun Liu, Phillippe Langlais. Proceedings of the 2022 Conference on Empiric…

JABER and SABER: Junior and Senior Arabic BERt Open

Abbas Ghaddar, Yimeng Wu, Ahmad Rashid, Khalil Bibi, Mehdi Rezagholizadeh , et al. · 2021

Language-specific pre-trained models have proven to be more accurate than multilingual ones in a monolingual evaluation setting, Arabic is no exception. However, we found that previously released Arabic BERT models were significantly under…

NATURE: Natural Auxiliary Text Utterances for Realistic Spoken Language\n Evaluation Open

David Alfonso-Hermelo, Ahmad Rashid, Abbas Ghaddar, Philippe Langlais, Mehdi Rezagholizadeh · 2021

Slot-filling and intent detection are the backbone of conversational agents\nsuch as voice assistants, and are active areas of research. Even though\nstate-of-the-art techniques on publicly available benchmarks show impressive\nperformance…

RAIL-KD: RAndom Intermediate Layer Mapping for Knowledge Distillation Open

Md Akmal Haidar, Nithin Anchuri, Mehdi Rezagholizadeh, Abbas Ghaddar, Philippe Langlais , et al. · 2021

Intermediate layer knowledge distillation (KD) can improve the standard KD technique (which only targets the output of teacher and student models) especially over large pre-trained language models. However, intermediate layer distillation …

Knowledge Distillation with Noisy Labels for Natural Language\n Understanding Open

Shivendra Bhardwaj, Abbas Ghaddar, Ahmad Rashid, Khalil Bibi, Chengyang Li , et al. · 2021

Knowledge Distillation (KD) is extensively used to compress and deploy large\npre-trained language models on edge devices for real-world applications.\nHowever, one neglected area of research is the impact of noisy (corrupted)\nlabels on K…

Characterization of Organic Inverter Open

Ahmad Skaiky, Ahmad El Hajj, Mahmoud Koabaz, Abbas Ghaddar · 2020

Tunable Terahertz Response of Split Ring Resonator Loaded Along Planar Goubau Line Open

Abdallah Chhahadih, Mohamad Faran, Abbas Ghaddar, Gabriel Moreno, Youssef Haidar , et al. · 2019

In this communication, a computational and experimental investigation at terahertz frequencies of Planar Gaubau Line combined with Split Ring Resonator is reported. Different parameters such as gap width, position and gap orientation that …

Solving Diffusion Time in Heterogeneous Microscale Rock Matrix by 3D Computations: Non-Fickian Dispersion Observed in Porous Media Open

Khalil Abou-Saleh, Jalal Dweik, Youssef Haidar, Abbas Ghaddar · 2019

Understanding and simulating the underlying microscopic physics of the rock matrix is very useful for determining macroscopic physical properties such as permeability. Matrix diffusion is an important transport parameter controlling the la…

Robust Lexical Features for Improved Neural Network Named-Entity\n Recognition Open

Abbas Ghaddar, Philippe Langlais · 2018

Neural network approaches to Named-Entity Recognition reduce the need for\ncarefully hand-crafted features. While some features do remain in\nstate-of-the-art systems, lexical features have been mostly discarded, with the\nexception of gaz…

Abbas Ghaddar YOU? Author Swipe