Geomagical Labs

Workshop on Inpainting Techniques
for Object Removal in Indoor Scenes

Content

  1. About the workshop
  2. Important dates
  3. Format and Agenda
  4. Call for participation
  5. Organizers
  6. Program committee members

About the Workshop

example furnished room example erased room

Removing an existing object from a scene is a hard problem. It not only requires the completion of geometry and texture, but also the removal of associated lighting effects (e.g. shadows, interreflections).

Major industrial players (e.g. IKEA, Amazon, Apple) offer Augmented Reality (AR) applications that allow users to place furniture virtually inside a room. There is an increasing interest in also performing the opposite: virtually removing existing furniture from a room. This empowers the users to completely reimagine their homes without having to physically move a single piece of furniture.

In this workshop, we invite researchers and industry practitioners to come together and discuss possible ways to efficiently tackle the problem of object removal. We separate the problem into several key components: room layout estimation, image inpainting and shadow removal. Each component is discussed within short presentation sessions. We also invite participants to discuss any relevant work comprising, but not limited to, Diminished Reality, inverse rendering, neural radiance fields, and room geometry estimation. The last session is a live Demo of our solution, which brings these components together to form a viable commercial Furniture Eraser application.

The workshop is in conjunction with the IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2022.

Important Dates

Paper Submission DeadlineJuly 27th, 2022 AoE
Paper NotificationAugust 8th, 2022 AoE
Camera-Ready Submission DeadlineAugust 29th, 2022 AoE
Workshop dateOctober 21st, 2022; 4pm-7pm SGT (Singapore Time)
*AoE: Anywhere on Earth

To submit your work, please make a submission through our EasyChair portal.

NOTE: For each presented paper, the presenter/speaker needs to make at least a one-day-conference pass registration payment (expected to be $350SGD).

Format and Agenda

TimeSessionSpeakerTitle & Description
15 minWelcome &
Introduction
[slides] [video]
Salma Jiddi
(Geomagical Labs)
Introduction
  • ∙ Setting the agenda and purpose of the workshop.
25 minPresentation
Shohei Mori
(Graz University
of Technology)
How Far Can We Go for Diminished Reality Without Neural Networks?
  • ∙ Summary of latest but conventional DR approaches.
  • ∙ Discussion on fundamental ideas and limitations of those approaches.
25 minpresentation and Demo
[slides] [video]
Prakhar Kulshreshtha
(Geomagical Labs)
RGB image inpainting for indoor scenes
  • ∙ Overview of related work in image inpainting.
  • ∙ Training image inpainting networks from scratch for indoor scenes.
  • ∙ A live, interactive demonstration of the Furniture Eraser application of Geomagical Labs, Inc.
25 minPresentation
[slides] [video]
Nektarios Lianos
(Geomagical Labs)
Room Layout estimation
  • ∙ Overview of related work.
  • ∙ Room layout estimation from a perspective image and photogrammetry.
15 mincoffee break
10 minWorkshop paper 1
[paper] [slides] [video]
Kiyoshi Kiyokawa
(Cybernetics & Reality
Engineering Laboratory,
NAIST)
Kato, Taiki, Naoya Isoyama,
Norihiko Kawai, Hideaki Uchiyama,
Nobuchika Sakata, and Kiyoshi Kiyokawa.
"Online Adaptive Integration of Observation and Inpainting for
Diminished Reality with Online Surface Reconstruction."
25 minPresentation
[slides] [video]
Dimitrios Zarpalas
Vasileios Gkitsas
(Centre for Research &
Technology, Hellas)
Diminished reality for indoor spherical panoramas
  • ∙ Overview of related work.
  • ∙ Discussion of limitations and challenges associated with these approaches.
25 minPresentation
[slides] [video]
Salma Jiddi
(Geomagical Labs)
Shadow Removal
  • ∙ Overview of related work.
  • ∙ Shadow removal for Diminished reality applications.
10 minConclusionClosing remarks

NOTE: We expect 10 minutes per presenter, 6-7 minutes for presentation, and 3-4 minutes for questions. These timings are subject to change as we collect and finalize the participants list.

Call for Participation

The goal of the workshop is to act as a very flexible platform for the participants to showcase their work, and open up discussions around emerging techniques in this domain. We accept submissions of length 2-6 pages excluding references. We are open to submissions of different kinds:

Submissions are invited on topics including:

The accepted papers will be published in ISMAR 2022 adjunct proceedings and IEEE Xplore. The submission template is the same as the ISMAR 2022 template for conference papers (IEEE Computer Society VGTC format).

To submit your work, please make a submission through our EasyChair portal.

Organizers

Prakhar Kulshreshtha

is an Applied Research Engineer at Geomagical Labs, Inc. He leads a research project focused on developing a commercial furniture eraser solution. He obtained his Masters in Computer Vision from Carnegie Mellon University, where he worked with Prof. Michael Kaess on long term mapping for SLAM in a dynamic environment.

His research interests are Computer Vision and Machine Learning, with a focus on utilizing Deep Learning and 3D geometry for Computer Vision applications.

Salma Jiddi

is a Research Scientist who heads the Research team at Geomagical Labs, Inc. She completed her PhD on Photometric Registration of Indoor Real Scenes using an RGB-D Camera with Application to Mixed Reality, at Technicolor and Irisa Rennes – Bretagne Atlantique, in the Rainbow team, under the supervision of Eric Marchand (Irisa) and Philippe Robert (Technicolor).

Her research interests are Computer Vision and Computer Graphics, with a focus on the geometric and photometric alignment of real and virtual worlds.

Nektarios Lianos

is an Applied Scientist, who leads the 3D Reconstruction team at Geomagical Labs, Inc. He previously obtained his Masters in Robotics at ETH Zürich, where he worked with Prof. Marc Pollefeys on visual odometry and deep learning.

His research interests include 3D Computer Vision, Machine Learning, and SLAM.

Program Committee Members

Prakhar Kulshreshtha
Geomagical Labs, Inc.
prakhar@geomagical.com
Salma Jiddi
Geomagical Labs, Inc.
salma@geomagical.com
Nektarios Lianos
Geomagical Labs, Inc.
nelianos@geomagical.com
Ajay Unagar
Geomagical Labs, Inc.
ajay@geomagical.com
Brian Pugh
Geomagical Labs, Inc.
bpugh@geomagical.com
Luis Puig
Geomagical Labs, Inc.
lpuig@geomagical.com
#51bfb9