Tianda Li
YOU?
Author Swipe
View article: Metabolic reprogramming in bone metastasis of human cancers
Metabolic reprogramming in bone metastasis of human cancers Open
Bone metastasis represents a complex complication of advanced human malignancies. Metabolic reprogramming plays a critical role in bone metastasis. Tumor cells hijack and alter local metabolic pathways to fuel their energetic and biosynthe…
View article: SPDF: Sparse Pre-training and Dense Fine-tuning for Large Language Models
SPDF: Sparse Pre-training and Dense Fine-tuning for Large Language Models Open
The pre-training and fine-tuning paradigm has contributed to a number of breakthroughs in Natural Language Processing (NLP). Instead of directly training on a downstream task, language models are first pre-trained on large datasets with cr…
View article: Do we need Label Regularization to Fine-tune Pre-trained Language Models?
Do we need Label Regularization to Fine-tune Pre-trained Language Models? Open
Ivan Kobyzev, Aref Jafari, Mehdi Rezagholizadeh, Tianda Li, Alan Do-Omri, Peng Lu, Pascal Poupart, Ali Ghodsi. Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics. 2023.
View article: Do we need Label Regularization to Fine-tune Pre-trained Language Models?
Do we need Label Regularization to Fine-tune Pre-trained Language Models? Open
Knowledge Distillation (KD) is a prominent neural model compression technique that heavily relies on teacher network predictions to guide the training of a student model. Considering the ever-growing size of pre-trained language models (PL…
View article: Conversation- and Tree-Structure Losses for Dialogue Disentanglement
Conversation- and Tree-Structure Losses for Dialogue Disentanglement Open
When multiple conversations occur simultaneously, a listener must decide which conversation each utterance is part of in order to interpret and respond to it appropriately. This task is referred as dialogue disentanglement. A significant d…
View article: A Short Study on Compressing Decoder-Based Language Models
A Short Study on Compressing Decoder-Based Language Models Open
Pre-trained Language Models (PLMs) have been successful for a wide range of natural language processing (NLP) tasks. The state-of-the-art of PLMs, however, are extremely large to be used on edge devices. As a result, the topic of model com…
View article: How to Select One Among All? An Extensive Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding
How to Select One Among All? An Extensive Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding Open
Knowledge Distillation (KD) is a model compression algorithm that helps transfer the knowledge of a large neural network into a smaller one. Even though KD has shown promise on a wide range of Natural Language Processing (NLP) applications…
View article: Transcriptome and DNA Methylation Profiles of Mouse Fetus and Placenta Generated by Round Spermatid Injection
Transcriptome and DNA Methylation Profiles of Mouse Fetus and Placenta Generated by Round Spermatid Injection Open
Low birth efficiency and developmental abnormalities in embryos derived using round spermatid injection (ROSI) limit the clinical application of this method. Further, the underlying molecular mechanisms remain elusive and warrant further i…
View article: How to Select One Among All ? An Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding
How to Select One Among All ? An Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding Open
Knowledge Distillation (KD) is a model compression algorithm that helps transfer the knowledge in a large neural network into a smaller one. Even though KD has shown promise on a wide range of Natural Language Processing (NLP) applications…
View article: Clinical analysis of human umbilical cord mesenchymal stem cell allotransplantation in patients with premature ovarian insufficiency
Clinical analysis of human umbilical cord mesenchymal stem cell allotransplantation in patients with premature ovarian insufficiency Open
Objective Premature ovarian insufficiency (POI) is a refractory disease that seriously affects female fertility. Growing body of evidence has indicated mesenchymal stem cells (MSCs) as promising resources in regenerative medicine. In this …
View article: Phase 1 trial for treatment of COVID‐19 patients with pulmonary fibrosis using hESC‐IMRCs
Phase 1 trial for treatment of COVID‐19 patients with pulmonary fibrosis using hESC‐IMRCs Open
To the Editor: Pulmonary fibrosis is a severe complication in COVID-19 patients. Based on our previous success with stem cell therapy of acute lung injury in mouse models and 2 COVID-19 patients in a pilot compassionate use study,1 we desc…
View article: DialBERT: A Hierarchical Pre-Trained Model for Conversation Disentanglement
DialBERT: A Hierarchical Pre-Trained Model for Conversation Disentanglement Open
Disentanglement is a problem in which multiple conversations occur in the same channel simultaneously, and the listener should decide which utterance is part of the conversation he will respond to. We propose a new model, named Dialogue BE…
View article: Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots
Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots Open
In this paper, we study the problem of employing pre-trained language models for multi-turn response selection in retrieval-based chatbots. A new model, named Speaker-Aware BERT (SA-BERT), is proposed in order to make the model aware of th…
View article: Pre-Trained and Attention-Based Neural Networks for Building Noetic Task-Oriented Dialogue Systems
Pre-Trained and Attention-Based Neural Networks for Building Noetic Task-Oriented Dialogue Systems Open
The NOESIS II challenge, as the Track 2 of the 8th Dialogue System Technology Challenges (DSTC 8), is the extension of DSTC 7. This track incorporates new elements that are vital for the creation of a deployed task-oriented dialogue system…
View article: Additional file 9 of Human umbilical cord mesenchymal stem cells restore the ovarian metabolome and rescue premature ovarian insufficiency in mice
Additional file 9 of Human umbilical cord mesenchymal stem cells restore the ovarian metabolome and rescue premature ovarian insufficiency in mice Open
Additional file 9: Supplementary table 2. Differential metabolites screened by volcano map in serum samples after chemotherapy. (XLS 21 kb)
View article: Additional file 10 of Human umbilical cord mesenchymal stem cells restore the ovarian metabolome and rescue premature ovarian insufficiency in mice
Additional file 10 of Human umbilical cord mesenchymal stem cells restore the ovarian metabolome and rescue premature ovarian insufficiency in mice Open
Additional file 10: Supplementary table 3. Differential lipid metabolomic changes in ovarian tissue samples of 3 groups (control, POI and POI+hUCMSCs). (XLS 314 kb)
View article: Additional file 8 of Human umbilical cord mesenchymal stem cells restore the ovarian metabolome and rescue premature ovarian insufficiency in mice
Additional file 8 of Human umbilical cord mesenchymal stem cells restore the ovarian metabolome and rescue premature ovarian insufficiency in mice Open
Additional file 8: Supplementary table 1. Differential metabolomic changes induced by chemotherapy in ovarian tissue samples. (XLS 108 kb)
View article: Additional file 11 of Human umbilical cord mesenchymal stem cells restore the ovarian metabolome and rescue premature ovarian insufficiency in mice
Additional file 11 of Human umbilical cord mesenchymal stem cells restore the ovarian metabolome and rescue premature ovarian insufficiency in mice Open
Additional file 11: Supplementary table 4. Pseudotargeted metabolic differences of nonlipid metabolites in ovarian tissue samples of 3 groups (control, POI and POI+hUCMSCs). (XLS 292 kb)
View article: Domesticated cynomolgus monkey embryonic stem cells allow the generation of neonatal interspecies chimeric pigs
Domesticated cynomolgus monkey embryonic stem cells allow the generation of neonatal interspecies chimeric pigs Open
Blastocyst complementation by pluripotent stem cell (PSC) injection is believed to be the most promising method to generate xenogeneic organs. However, ethical issues prevent the study of human chimeras in the late embryonic stage of devel…
View article: Several Experiments on Investigating Pretraining and Knowledge-Enhanced Models for Natural Language Inference
Several Experiments on Investigating Pretraining and Knowledge-Enhanced Models for Natural Language Inference Open
Natural language inference (NLI) is among the most challenging tasks in natural language understanding. Recent work on unsupervised pretraining that leverages unsupervised signals such as language-model and sentence prediction objectives h…
View article: Derivation of Mouse Haploid Trophoblast Stem Cells
Derivation of Mouse Haploid Trophoblast Stem Cells Open
Trophoblast stem (TS) cells are increasingly used as a model system for studying placentation and placental disorders. However, practical limitations of genetic manipulation have posed challenges for genetic analysis using TS cells. Here, …
View article: Mitochondrially produced ATP affects stem cell pluripotency <i>via</i> Actl6a‐mediated histone acetylation
Mitochondrially produced ATP affects stem cell pluripotency <i>via</i> Actl6a‐mediated histone acetylation Open
ATP is mainly generated by glycolysis in pluripotent stem cells (PSCs) and is consumed to maintain cell viability. Differences in mitochondrial activity among induced (i)PSCs with different degrees of pluripotency are poorly understood. In…
View article: Rat embryonic stem cells produce fertile offspring through tetraploid complementation
Rat embryonic stem cells produce fertile offspring through tetraploid complementation Open
Significance Tetraploid complementation, through which an entire organism is produced from pluripotent donor cells, is taken as the most stringent test for pluripotency. However, it remains unclear whether embryonic stem cells (ESCs) of ot…
View article: Generation of Mouse Haploid Somatic Cells by Small Molecules for Genome-wide Genetic Screening
Generation of Mouse Haploid Somatic Cells by Small Molecules for Genome-wide Genetic Screening Open
The recent success of derivation of mammalian haploid embryonic stem cells (haESCs) has provided a powerful tool for large-scale functional analysis of the mammalian genome. However, haESCs rapidly become diploidized after differentiation,…
View article: Efficient Production of Fluorescent Transgenic Rats using the piggyBac Transposon
Efficient Production of Fluorescent Transgenic Rats using the piggyBac Transposon Open
Rats with fluorescent markers are of great value for studies that trace lineage-specific development, particularly those assessing the differentiation potential of embryonic stem cells (ESCs). The piggyBac ( PB ) transposon is widely used …