Yusuke Monno
YOU?
Author Swipe
Assessment of early gastric cancer visibility in deep-learning-based virtual indigo carmine chromoendoscopy (with video) Open
Indigo carmine chromoendoscopy (IC) enhances diagnosis of early gastric cancer (EGC), but its clinical application is limited by procedure complexity and time. We developed a deep-learning system using a cycle-consistent generative adversa…
Polarization Denoising and Demosaicking: Dataset and Baseline Method Open
A division-of-focal-plane (DoFP) polarimeter enables us to acquire images with multiple polarization orientations in one shot and thus it is valuable for many applications using polarimetric information. The image processing pipeline for a…
TDM: Temporally-Consistent Diffusion Model for All-in-One Real-World Video Restoration Open
In this paper, we propose the first diffusion-based all-in-one video restoration method that utilizes the power of a pre-trained Stable Diffusion and a fine-tuned ControlNet. Our method can restore various types of video degradation with a…
Disparity Estimation Using a Quad-Pixel Sensor Open
A quad-pixel (QP) sensor is increasingly integrated into commercial mobile cameras. The QP sensor has a unit of 2$\times$2 four photodiodes under a single microlens, generating multi-directional phase shifting when out-focus blurs occur. S…
Dual-Pixel Raindrop Removal Open
Removing raindrops in images has been addressed as a significant task for various computer vision applications. In this paper, we propose the first method using a dual-pixel (DP) sensor to better address raindrop removal. Our key observati…
Neural Radiance Fields for Novel View Synthesis in Monocular Gastroscopy Open
Enabling the synthesis of arbitrarily novel viewpoint images within a patient's stomach from pre-captured monocular gastroscopic images is a promising topic in stomach diagnosis. Typical methods to achieve this objective integrate traditio…
Self-Supervised Spatially Variant PSF Estimation for Aberration-Aware Depth-from-Defocus Open
In this paper, we address the task of aberration-aware depth-from-defocus (DfD), which takes account of spatially variant point spread functions (PSFs) of a real camera. To effectively obtain the spatially variant PSFs of a real camera wit…
Reflection Removal Using Recurrent Polarization-to-Polarization Network Open
This paper addresses reflection removal, which is the task of separating reflection components from a captured image and deriving the image with only transmission components. Considering that the existence of the reflection changes the pol…
Joint Design of Camera Spectral Sensitivity and Color Correction Matrix with Noise Consideration Open
Camera spectral sensitivity (CSS) establishes the connection between scene radiance and device-captured RGB tristimulus values. Since the spectral sensitivity of most color imaging devices typically deviates from that of human vision or a …
Polarimetric PatchMatch Multi-View Stereo Open
PatchMatch Multi-View Stereo (PatchMatch MVS) is one of the popular MVS approaches, owing to its balanced accuracy and efficiency. In this paper, we propose Polarimetric PatchMatch multi-view Stereo (PolarPMS), which is the first method ex…
Polarimetric Multi-View Inverse Rendering Open
A polarization camera has great potential for 3D reconstruction since the angle of polarization (AoP) and the degree of polarization (DoP) of reflected light are related to an object's surface normal. In this paper, we propose a novel 3D r…
Dual-Pixel Raindrop Removal Open
Removing raindrops in images has been addressed as a significant task for various computer vision applications. In this paper, we propose the first method using a Dual-Pixel (DP) sensor to better address the raindrop removal. Our key obser…
Two-Step Color-Polarization Demosaicking Network Open
Polarization information of light in a scene is valuable for various image processing and computer vision tasks. A division-of-focal-plane polarimeter is a promising approach to capture the polarization images of different orientations in …
Deep Hyperspectral-Depth Reconstruction Using Single Color-Dot Projection Open
Depth reconstruction and hyperspectral reflectance reconstruction are two active research topics in computer vision and image processing. Conventionally, these two topics have been studied separately using independent imaging setups and th…
Single Image Deraining Network with Rain Embedding Consistency and Layered LSTM Open
Single image deraining is typically addressed as residual learning to predict the rain layer from an input rainy image. For this purpose, an encoder-decoder network draws wide attention, where the encoder is required to encode a high-quali…
Learning-Based Depth and Pose Estimation for Monocular Endoscope with Loss Generalization Open
Gastroendoscopy has been a clinical standard for diagnosing and treating conditions that affect a part of a patient's digestive system, such as the stomach. Despite the fact that gastroendoscopy has a lot of advantages for patients, there …
Spectral MVIR: Joint Reconstruction of 3D Shape and Spectral Reflectance Open
Reconstructing an object's high-quality 3D shape with inherent spectral reflectance property, beyond typical device-dependent RGB albedos, opens the door to applications requiring a high-fidelity 3D model in terms of both geometry and phot…
Stomach 3D Reconstruction Using Virtual Chromoendoscopic Images Open
Gastric endoscopy is a golden standard in the clinical process that enables medical practitioners to diagnose various lesions inside a patient's stomach. If a lesion is found, a success in identifying the location of the found lesion relat…
Spectral Reflectance Estimation Using Projector with Unknown Spectral Power Distribution Open
A lighting-based multispectral imaging system using an RGB camera and a projector is one of the most practical and low-cost systems to acquire multispectral observations for estimating the scene's spectral reflectance information. However,…
Deep Snapshot HDR Imaging Using Multi-Exposure Color Filter Array Open
In this paper, we propose a deep snapshot high dynamic range (HDR) imaging framework that can effectively reconstruct an HDR image from the RAW data captured using a multi-exposure color filter array (ME-CFA), which consists of a mosaic pa…
Spectral Reflectance Estimation Using Projector with Unknown Spectral Power Distribution Open
A lighting-based multispectral imaging system using an RGB camera and a projector is one of the most practical and low-cost systems to acquire multispectral observations for estimating the scene's spectral reflectance information. However,…
IDDF2020-ABS-0068 3D model reconstruction of the whole stomach from standard endoscope video Open
Background Endoscopy is a common clinical practice to evaluate gastrointestinal diseases. Although endoscopy assesses gastrointestinal mucosal surface, it cannot evaluate the shape and volume of gastrointestinal organs and localization of …
Monochrome and Color Polarization Demosaicking Using Edge-Aware Residual Interpolation Open
A division-of-focal-plane or microgrid image polarimeter enables us to acquire a set of polarization images in one shot. Since the polarimeter consists of an image sensor equipped with a monochrome or color polarization filter array (MPFA …
Polarimetric Multi-View Inverse Rendering Open
A polarization camera has great potential for 3D reconstruction since the angle of polarization (AoP) of reflected light is related to an object's surface normal. In this paper, we propose a novel 3D reconstruction method called Polarimetr…
Stomach 3D Reconstruction Based on Virtual Chromoendoscopic Image Generation Open
Gastric endoscopy is a standard clinical process that enables medical practitioners to diagnose various lesions inside a patient's stomach. If any lesion is found, it is very important to perceive the location of the lesion relative to the…
Pro-Cam SSfM: Projector-Camera System for Structure and Spectral Reflectance from Motion Open
In this paper, we propose a novel projector-camera system for practical and low-cost acquisition of a dense object 3D model with the spectral reflectance property. In our system, we use a standard RGB camera and leverage an off-the-shelf p…
3D Reconstruction of Whole Stomach from Endoscope Video Using Structure-from-Motion Open
Gastric endoscopy is a common clinical practice that enables medical doctors to diagnose the stomach inside a body. In order to identify a gastric lesion's location such as early gastric cancer within the stomach, this work addressed to re…
Whole Stomach 3D Reconstruction and Frame Localization From Monocular Endoscope Video Open
Gastric endoscopy is a common clinical practice that enables medical doctors to diagnose various lesions inside a stomach. In order to identify the location of a gastric lesion such as early cancer and a peptic ulcer within the stomach, th…