Jisu Nam
YOU?
Author Swipe
View article: MATRIX: Mask Track Alignment for Interaction-aware Video Generation
MATRIX: Mask Track Alignment for Interaction-aware Video Generation Open
Video DiTs have advanced video generation, yet they still struggle to model multi-instance or subject-object interactions. This raises a key question: How do these models internally represent interactions? To answer this, we curate MATRIX-…
View article: Appearance Matching Adapter for Exemplar-based Semantic Image Synthesis in-the-Wild
Appearance Matching Adapter for Exemplar-based Semantic Image Synthesis in-the-Wild Open
Exemplar-based semantic image synthesis generates images aligned with semantic content while preserving the appearance of an exemplar. Conventional structure-guidance models like ControlNet, are limited as they rely solely on text prompts …
View article: Local All-Pair Correspondence for Point Tracking
Local All-Pair Correspondence for Point Tracking Open
We introduce LocoTrack, a highly accurate and efficient model designed for the task of tracking any point (TAP) across video sequences. Previous approaches in this task often rely on local 2D correlation maps to establish correspondences f…
View article: DreamMatcher: Appearance Matching Self-Attention for Semantically-Consistent Text-to-Image Personalization
DreamMatcher: Appearance Matching Self-Attention for Semantically-Consistent Text-to-Image Personalization Open
The objective of text-to-image (T2I) personalization is to customize a diffusion model to a user-provided reference concept, generating diverse images of the concept aligned with the target prompts. Conventional methods representing the re…
View article: Diffusion Model for Dense Matching
Diffusion Model for Dense Matching Open
The objective for establishing dense correspondence between paired images consists of two terms: a data term and a prior term. While conventional techniques focused on defining hand-designed prior terms, which are difficult to formulate, r…
View article: DiffFace: Diffusion-based Face Swapping with Facial Guidance
DiffFace: Diffusion-based Face Swapping with Facial Guidance Open
In this paper, we propose a diffusion-based face swapping framework for the first time, called DiffFace, composed of training ID conditional DDPM, sampling with facial guidance, and a target-preserving blending. In specific, in the trainin…
View article: Neural Matching Fields: Implicit Representation of Matching Fields for Visual Correspondence
Neural Matching Fields: Implicit Representation of Matching Fields for Visual Correspondence Open
Existing pipelines of semantic correspondence commonly include extracting high-level semantic features for the invariance against intra-class variations and background clutters. This architecture, however, inevitably results in a low-resol…
View article: Cost Aggregation with 4D Convolutional Swin Transformer for Few-Shot Segmentation
Cost Aggregation with 4D Convolutional Swin Transformer for Few-Shot Segmentation Open
This paper presents a novel cost aggregation network, called Volumetric Aggregation with Transformers (VAT), for few-shot segmentation. The use of transformers can benefit correlation map aggregation through self-attention over a global re…
View article: Cost Aggregation Is All You Need for Few-Shot Segmentation
Cost Aggregation Is All You Need for Few-Shot Segmentation Open
We introduce a novel cost aggregation network, dubbed Volumetric Aggregation with Transformers (VAT), to tackle the few-shot segmentation task by using both convolutions and transformers to efficiently handle high dimensional correlation m…
View article: Estimation of Temperature Recovery Distance and the Influence of Heat Pump Discharge on Fluvial Ecosystems
Estimation of Temperature Recovery Distance and the Influence of Heat Pump Discharge on Fluvial Ecosystems Open
Temperature differences between the atmosphere and river water allow rivers to be used as a hydrothermal energy source. River-water heat pump systems are a relatively non-invasive renewable energy source; however, effluent discharged from …
View article: Estimation of Temperature Recovery Distance and the Influence of Heat Pump Discharge on Fluvial Ecosystems
Estimation of Temperature Recovery Distance and the Influence of Heat Pump Discharge on Fluvial Ecosystems Open
Temperature differences between the atmosphere and river water allow rivers to be used as a hydrothermal energy source. The river-water heat pump system is a relatively non-invasive renewable energy source; however, effluent discharged fro…