Yaozong Wu
YOU?
Author Swipe
View article: A Survey of Backpropagation-free Training For LLMS
A Survey of Backpropagation-free Training For LLMS Open
Large language models (LLMs) have achieved remarkable performance in various downstream tasks.However, training LLMs is computationally expensive and requires a large amount of memory.To address this issue, backpropagation-free (BP-free) t…
View article: Federated Few-Shot Learning for Mobile NLP
Federated Few-Shot Learning for Mobile NLP Open
Natural language processing (NLP) sees rich mobile applications. To support\nvarious language understanding tasks, a foundation NLP model is often\nfine-tuned in a federated, privacy-preserving setting (FL). This process\ncurrently relies …
View article: FwdLLM: Efficient FedLLM using Forward Gradient
FwdLLM: Efficient FedLLM using Forward Gradient Open
Large Language Models (LLMs) are transforming the landscape of mobile intelligence. Federated Learning (FL), a method to preserve user data privacy, is often employed in fine-tuning LLMs to downstream mobile tasks, an approach known as Fed…
View article: Towards Practical Few-shot Federated NLP
Towards Practical Few-shot Federated NLP Open
Transformer-based pre-trained models have emerged as the predominant solution for natural language processing (NLP). Fine-tuning such pre-trained models for downstream tasks often requires a considerable amount of labeled private data. In …
View article: FedAdapter: Efficient Federated Learning for Modern NLP
FedAdapter: Efficient Federated Learning for Modern NLP Open
Transformer-based pre-trained models have revolutionized NLP for superior performance and generality. Fine-tuning pre-trained models for downstream tasks often requires private data, for which federated learning is the de-facto approach (i…
View article: A Novel Chloroplast Protein RNA Processing 8 Is Required for the Expression of Chloroplast Genes and Chloroplast Development in Arabidopsis thaliana
A Novel Chloroplast Protein RNA Processing 8 Is Required for the Expression of Chloroplast Genes and Chloroplast Development in Arabidopsis thaliana Open
Chloroplast development involves the coordinated expression of both plastids- and nuclear-encoded genes in higher plants. However, the underlying mechanism still remains largely unknown. In this study, we isolated and characterized an Arab…