Yan‐Pei Cao
YOU?
Author Swipe
View article: Sketch3DVE: Sketch-based 3D-Aware Scene Video Editing
Sketch3DVE: Sketch-based 3D-Aware Scene Video Editing Open
Recent video editing methods achieve attractive results in style transfer or appearance modification. However, editing the structural content of 3D scenes in videos remains challenging, particularly when dealing with significant viewpoint …
View article: Integrated CT-derived radiomics for predicting ctDNA status and prognosis in resectable non-small cell lung cancer
Integrated CT-derived radiomics for predicting ctDNA status and prognosis in resectable non-small cell lung cancer Open
This study aimed to develop a radiomics signature for predicting ctDNA status and recurrence risk in non-small cell lung cancer (NSCLC) patients. A retrospective analysis of 631 patients was conducted, with 114 in the training set, 349 in …
View article: One Model to Rig Them All: Diverse Skeleton Rigging with UniRig
One Model to Rig Them All: Diverse Skeleton Rigging with UniRig Open
The rapid evolution of 3D content creation, encompassing both AI-powered methods and traditional workflows, is driving an unprecedented demand for automated rigging solutions that can keep pace with the increasing complexity and diversity …
View article: Sketch3DVE: Sketch-based 3D-Aware Scene Video Editing
Sketch3DVE: Sketch-based 3D-Aware Scene Video Editing Open
View article: OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesion
OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesion Open
The creation of 3D assets with explicit, editable part structures is crucial for advancing interactive applications, yet most generative methods produce only monolithic shapes, limiting their utility. We introduce OmniPart, a novel framewo…
View article: SeqTex: Generate Mesh Textures in Video Sequence
SeqTex: Generate Mesh Textures in Video Sequence Open
Training native 3D texture generative models remains a fundamental yet challenging problem, largely due to the limited availability of large-scale, high-quality 3D texture datasets. This scarcity hinders generalization to real-world scenar…
View article: AnimaX: Animating the Inanimate in 3D with Joint Video-Pose Diffusion Models
AnimaX: Animating the Inanimate in 3D with Joint Video-Pose Diffusion Models Open
We present AnimaX, a feed-forward 3D animation framework that bridges the motion priors of video diffusion models with the controllable structure of skeleton-based animation. Traditional motion synthesis methods are either restricted to fi…
View article: UniGeo: Taming Video Diffusion for Unified Consistent Geometry Estimation
UniGeo: Taming Video Diffusion for Unified Consistent Geometry Estimation Open
Recently, methods leveraging diffusion model priors to assist monocular geometric estimation (e.g., depth and normal) have gained significant attention due to their strong generalization ability. However, most existing works focus on estim…
View article: SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modeling
SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modeling Open
Creating high-fidelity 3D meshes with arbitrary topology, including open surfaces and complex interiors, remains a significant challenge. Existing implicit field methods often require costly and detail-degrading watertight conversion, whil…
View article: TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Models
TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Models Open
Recent advancements in diffusion techniques have propelled image and video generation to unprecedented levels of quality, significantly accelerating the deployment and application of generative AI. However, 3D shape generation technology h…
View article: Multi-omic and machine learning analysis of mitochondrial RNA modification genes in lung adenocarcinoma for prognostic and therapeutic implications
Multi-omic and machine learning analysis of mitochondrial RNA modification genes in lung adenocarcinoma for prognostic and therapeutic implications Open
Lung cancer remains the leading cause of cancer-related deaths, driven by complex pathogenesis and poor prognosis. Recognizing the pivotal role of mitochondrial RNA modifications (MRM) in cancer progression, this study aims to provide a co…
View article: Research trends and major developments in 3D vision in 2024
Research trends and major developments in 3D vision in 2024 Open
View article: Comprehensive Analysis of m6<scp>A</scp>‐Related Programmed Cell Death Genes Unveils a Novel Prognostic Model for Lung Adenocarcinoma
Comprehensive Analysis of m6<span>A</span>‐Related Programmed Cell Death Genes Unveils a Novel Prognostic Model for Lung Adenocarcinoma Open
Lung adenocarcinoma (LUAD) involves complex dysregulated cellular processes, including programmed cell death (PCD), influenced by N6‐methyladenosine (m6A) RNA modification. This study integrates bulk RNA and single‐cell sequencing data to …
View article: By integrating single-cell RNA sequencing and bulk RNA sequencing, plasma cells signature and tertiary lymphoid structures were verified to contribute to outcome in lung adenocarcinoma
By integrating single-cell RNA sequencing and bulk RNA sequencing, plasma cells signature and tertiary lymphoid structures were verified to contribute to outcome in lung adenocarcinoma Open
Plasma cells and TLS can effectively predict the prognosis of LUAD. In the tumor microenvironment (TME) of advanced tumors, plasma cells might be in a state of functional exhaustion. Comprehensive characterization of TLS and corresponding …
View article: AIGC 2D/3D technology development and creative industry applications
AIGC 2D/3D technology development and creative industry applications Open
View article: DI-PCG: Diffusion-based Efficient Inverse Procedural Content Generation for High-quality 3D Asset Creation
DI-PCG: Diffusion-based Efficient Inverse Procedural Content Generation for High-quality 3D Asset Creation Open
Procedural Content Generation (PCG) is powerful in creating high-quality 3D contents, yet controlling it to produce desired shapes is difficult and often requires extensive parameter tuning. Inverse Procedural Content Generation aims to au…
View article: Deformable Radial Kernel Splatting
Deformable Radial Kernel Splatting Open
Recently, Gaussian splatting has emerged as a robust technique for representing 3D scenes, enabling real-time rasterization and high-fidelity rendering. However, Gaussians' inherent radial symmetry and smoothness constraints limit their ab…
View article: NeRF-Texture: Synthesizing Neural Radiance Field Textures
NeRF-Texture: Synthesizing Neural Radiance Field Textures Open
Texture synthesis is a fundamental problem in computer graphics that would\nbenefit various applications. Existing methods are effective in handling 2D\nimage textures. In contrast, many real-world textures contain meso-structure in\nthe 3…
View article: MV-Adapter: Multi-view Consistent Image Generation Made Easy
MV-Adapter: Multi-view Consistent Image Generation Made Easy Open
Existing multi-view image generation methods often make invasive modifications to pre-trained text-to-image (T2I) models and require full fine-tuning, leading to (1) high computational costs, especially with large base models and high-reso…
View article: MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generation
MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generation Open
This paper introduces MIDI, a novel paradigm for compositional 3D scene generation from a single image. Unlike existing methods that rely on reconstruction or retrieval techniques or recent approaches that employ multi-stage object-by-obje…
View article: DetailGen3D: Generative 3D Geometry Enhancement via Data-Dependent Flow
DetailGen3D: Generative 3D Geometry Enhancement via Data-Dependent Flow Open
Modern 3D generation methods can rapidly create shapes from sparse or single views, but their outputs often lack geometric detail due to computational constraints. We present DetailGen3D, a generative approach specifically designed to enha…
View article: TEXGen: a Generative Diffusion Model for Mesh Textures
TEXGen: a Generative Diffusion Model for Mesh Textures Open
While high-quality texture maps are essential for realistic 3D asset rendering, few studies have explored learning directly in the texture space, especially on large-scale datasets. In this work, we depart from the conventional approach of…
View article: SAMPart3D: Segment Any Part in 3D Objects
SAMPart3D: Segment Any Part in 3D Objects Open
3D part segmentation is a crucial and challenging task in 3D perception, playing a vital role in applications such as robotics, 3D generation, and 3D editing. Recent methods harness the powerful Vision Language Models (VLMs) for 2D-to-3D k…
View article: DreamCraft3D++: Efficient Hierarchical 3D Generation with Multi-Plane Reconstruction Model
DreamCraft3D++: Efficient Hierarchical 3D Generation with Multi-Plane Reconstruction Model Open
We introduce DreamCraft3D++, an extension of DreamCraft3D that enables efficient high-quality generation of complex 3D assets. DreamCraft3D++ inherits the multi-stage generation process of DreamCraft3D, but replaces the time-consuming geom…
View article: OctFusion: Octree-based Diffusion Models for 3D Shape Generation
OctFusion: Octree-based Diffusion Models for 3D Shape Generation Open
Diffusion models have emerged as a popular method for 3D generation. However, it is still challenging for diffusion models to efficiently generate diverse and high-quality 3D shapes. In this paper, we introduce OctFusion, which can generat…
View article: TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Prompts
TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Prompts Open
Text-driven 3D scene editing has gained significant attention owing to its convenience and user-friendliness. However, existing methods still lack accurate control of the specified appearance and location of the editing result due to the i…
View article: Recent advances in 3D Gaussian splatting
Recent advances in 3D Gaussian splatting Open
The emergence of 3D Gaussian splatting (3DGS) has greatly accelerated rendering in novel view synthesis. Unlike neural implicit representations like neural radiance fields (NeRFs) that represent a 3D scene with position and viewpoint-condi…
View article: Splatter a Video: Video Gaussian Representation for Versatile Processing
Splatter a Video: Video Gaussian Representation for Versatile Processing Open
Video representation is a long-standing problem that is crucial for various down-stream tasks, such as tracking,depth prediction,segmentation,view synthesis,and editing. However, current methods either struggle to model complex motions due…
View article: Learning High-Quality Navigation and Zooming on Omnidirectional Images in Virtual Reality
Learning High-Quality Navigation and Zooming on Omnidirectional Images in Virtual Reality Open
Viewing omnidirectional images (ODIs) in virtual reality (VR) represents a novel form of media that provides immersive experiences for users to navigate and interact with digital content. Nonetheless, this sense of immersion can be greatly…
View article: SC-NeuS: Consistent Neural Surface Reconstruction from Sparse and Noisy Views
SC-NeuS: Consistent Neural Surface Reconstruction from Sparse and Noisy Views Open
The recent neural surface reconstruction approaches using volume rendering have made much progress by achieving impressive surface reconstruction quality, but are still limited to dense and highly accurate posed views. To overcome such dra…