01.10.object Removal by Exemplar-Based Inpainting
01.10.object Removal by Exemplar-Based Inpainting
Object Removal by
Exemplar-Based
Inpainting
Ye Hong
CS766
Fall 2004
Introduction
Object Removal
Idea: Remove object(s) from digital photographs,
and then fill the hole with information extracted
from the surrounding area.
Filled region should look “reasonable” to the
human eyes.
1
7-06-2009
An Example
Before After
Approaches
Texture Synthesis
Idea
Sample color values of the surrounding area
Generate textures with sampling result to fill the hole
Advantage
Cheap and effective
No blur or other degradation
Disadvantage
May lose linear structure and composite textures
2
7-06-2009
Approaches(cont.)
Inpainting
Fill holes by propagating linear structures into the
target region via diffusion
Advantage
Preserves the linear structures
Disadvantage
Diffusion will cause blurs, which are usually noticeable
Criminisi’s approach
Combine the strengths of two approaches
Use a texture synthesis algorithm
Give higher priority to linear structures
Result
Linear Structures are preserved
No blurs introduced
3
7-06-2009
Criminisi’s Algorithm
Assign each pixel with a priority value
Give linear structures higher priorities
Criminisi’s Algorithm(cont.)
Structure Propagation by exemplar-based texture
synthesis
4
7-06-2009
Expected Results
Criminisi’s Algorithm vs. Texture Synthesis
Expected Results
Criminisi’s Algorithm vs. Inpainting
Inpainting Criminisi
5
7-06-2009
Future Works
More accurate propagation of curved
structures
Object removal from videos
References
A. Criminisi, P. Perez, K. Toyama.
Region filling and object removal by exemplar-based inpainting.
In 2004 IEEE Transactions on Image Processing 9 1200-1212.