Jingping Nie
YOU?
Author Swipe
View article: Breathing and Semantic Pause Detection and Exertion-Level Classification in Post-Exercise Speech
Breathing and Semantic Pause Detection and Exertion-Level Classification in Post-Exercise Speech Open
Post-exercise speech contains rich physiological and linguistic cues, often marked by semantic pauses, breathing pauses, and combined breathing-semantic pauses. Detecting these events enables assessment of recovery rate, lung function, and…
View article: Foundation Model Hidden Representations for Heart Rate Estimation from Auscultation
Foundation Model Hidden Representations for Heart Rate Estimation from Auscultation Open
Auscultation, particularly heart sound, is a non-invasive technique that provides essential vital sign information. Recently, self-supervised acoustic representation foundation models (FMs) have been proposed to offer insights into acousti…
View article: Model-driven Heart Rate Estimation and Heart Murmur Detection based on Phonocardiogram
Model-driven Heart Rate Estimation and Heart Murmur Detection based on Phonocardiogram Open
Acoustic signals are crucial for health monitoring, particularly heart sounds which provide essential data like heart rate and detect cardiac anomalies such as murmurs. This study utilizes a publicly available phonocardiogram (PCG) dataset…
View article: Joey: Supporting Kangaroo Mother Care with Computational Fabrics
Joey: Supporting Kangaroo Mother Care with Computational Fabrics Open
Kangaroo Mother Care (KMC), involving chest-To-chest skin contact between an infant and caregiver, is proven to be an effective intervention for preterm and full-Term infants. Accurate monitoring of KMC duration and infant's vital signs du…
View article: Demo: Supporting Kangaroo Mother Care with Computational Fabrics
Demo: Supporting Kangaroo Mother Care with Computational Fabrics Open
Kangaroo Mother Care (KMC), involving chest-To-chest skin contact between an infant and caregiver, is proven to be an effective intervention for preterm and full-Term infants. Accurate monitoring of KMC duration and infant's vital signs du…
View article: LLM-based Conversational AI Therapist for Daily Functioning Screening and Psychotherapeutic Intervention via Everyday Smart Devices
LLM-based Conversational AI Therapist for Daily Functioning Screening and Psychotherapeutic Intervention via Everyday Smart Devices Open
Despite the global mental health crisis, access to screenings, professionals, and treatments remains high. In collaboration with licensed psychotherapists, we propose a Conversational AI Therapist with psychotherapeutic Interventions (CaiT…
View article: Investigating salient representations and label Variance in Dimensional Speech Emotion Analysis
Investigating salient representations and label Variance in Dimensional Speech Emotion Analysis Open
Representations derived from models such as BERT (Bidirectional Encoder Representations from Transformers) and HuBERT (Hidden units BERT), have helped to achieve state-of-the-art performance in dimensional speech emotion recognition. Despi…
View article: Frequency-Aware Masked Autoencoders for Multimodal Pretraining on Biosignals
Frequency-Aware Masked Autoencoders for Multimodal Pretraining on Biosignals Open
Leveraging multimodal information from biosignals is vital for building a comprehensive representation of people's physical and mental states. However, multimodal biosignals often exhibit substantial distributional shifts between pretraini…
View article: AI Therapist for Daily Functioning Assessment and Intervention Using Smart Home Devices
AI Therapist for Daily Functioning Assessment and Intervention Using Smart Home Devices Open
In this demonstration, in collaboration with licensed therapists, we introduce an AI therapist that takes advantage of the smart-home environment to screen day-to-day functioning and infer mental wellness of an occupant. Our system can ass…
View article: Neural representation of linguistic feature hierarchy reflects second-language proficiency
Neural representation of linguistic feature hierarchy reflects second-language proficiency Open
Acquiring a new language requires a simultaneous and gradual learning of multiple levels of linguistic attributes. Here, we investigated how this process changes the neural encoding of natural speech by assessing the encoding of the lingui…