Journals A-Z
All Subjects
Free Journals
sciepub.com
Journal of Computer Sciences and Applications
ISSN (Print): 2328-7268 ISSN (Online): 2328-725X Website: http://www.sciepub.com/journal/jcsa Editor-in-chief: Minhua Ma, Patricia Goncalves
Open Access
Journal Browser
Go
Issue 1, Volume 5
Article Metrics
  • 10615
    Views
  • 8336
    Saves
  • 0
    Citations
  • 0
    Likes
Export Article
Journal of Computer Sciences and Applications. 2017, 5(1), 1-10
DOI: 10.12691/jcsa-5-1-1
Open AccessArticle

An Introduction to Various Algorithms for Video Completion and Their Features: A Survey

A. Ghanbari Talouki1, M. Majdi1 and S. A. Edalatpanah1,

1Department of Computer Engineering, Ayandegan Institute of higher education, Tonekabon, Mazandaran, Iran

Pub. Date: January 22, 2017
View Full Text Full Text PDF Full Text ePUB

Cite this paper:
A. Ghanbari Talouki, M. Majdi and S. A. Edalatpanah. An Introduction to Various Algorithms for Video Completion and Their Features: A Survey. Journal of Computer Sciences and Applications. 2017; 5(1):1-10. doi: 10.12691/jcsa-5-1-1

Abstract

Completion or inpainting is applied in order to reconstruct the hurted images and video frames. This study proposes a survey on algorithms which complete corrupted objects (mainly humans) in video frames. Firstly, image inpainting is proposed as a mathematical problem and then it is extended into video completion problem. In the following, different types of video completion methods that are based on different types of video contents and the status of the background, foreground and camera movement is introduced. According to the method of the completion or the idea of considering the frame as one distinct object or considering it as a set of some fundamentals, there are several approaches to inpaint the video. Each video completion type is surveyed with the help of several studies about that.

Keywords:
video inpainting video completion moving subjects background subtraction texture synthesis similarity measure

Creative CommonsThis work is licensed under a Creative Commons Attribution 4.0 International License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

References:

[1]  Satpute S.B., Gadge S.D., Kadnar G.T, “Super Resoloution-based Image with Video Inpainting”, International Journal of Engineering Science & Research Technology, 4(10), 202-205, 2015.
 
[2]  S. S. Cheung, J. Zhao,M. V. Venkatesh, “Efficient Object-Based Video Inpainting”, IEEE Int. Conf. Image Processing, pp. 705-708, 2006.
 
[3]  Tejasvee B. P., Dhar R., Rajasvee P. P., Jawalkar P.B., “Video Inpainting Using Image Inpainting”, International Journal of Computer Science and Mobile Computing, 4(10), 105-110, 2015.
 
[4]  A. J. Pawar, A. P. Phatale, “A comparative study of effective way to modify moving object in video: Using different inpainting methods”, 10th International Conference on Intelligent Systems and Control, 1-5, 2016.
 
[5]  P. N. Nya, C. Stuber, T. Wiegand, “Texture Synthesis Method for Generic Video Sequences”, IEEE Int. Conf. Image Processing, 3, 397-400, 2007.
 
[6]  Tejasvee B. P., Dhar R., Rajasvee P. P., Jawalkar P.B., “Video Inpainting Using Image Inpainting”, International Journal of Computer Science and Mobile Computing, 4(10), 105-110, 2015.
 
[7]  C. Ballester, M. Bertalmio, V. Caselles, G. Sapiro, J. Verdera, “Filling-in by Joint Interpolation of Vector Fields and Gray Levels”, IEEE Tran. Image Processing, 10, 1200-1211, 2001.
 
[8]  T. K. Shih, N. C. Tang, J. N. Hwang, “Exemplar-Based Video Inpainting Without Ghost Shadow Artifacts by Maintaining Temporal Continuity”, In Proc. IEEE Trans. Circuits and Systems for Video, 13(3), 347-360, 2009.
 
[9]  M. Soryani, A. Ghanbari, A. Koochari, “Dynamic Video Texture Inpainting Using Improving LDS”, British Journal of Mathematics & Computer Science, 4(20), 2872-2883, 2014.
 
[10]  M. Granados, J. Tompkin, K. Kim, O. Grau, J. Kautz, C. Theobalt, “How Not to Be Seen — Object Removal from Videos of Crowded Scenes” , In Computer Graphics Forum, 31(2), 219-228, 2012.
 
[11]  Newson A., Almansa A., Fradet M., Gousseau Y., Pérez P., “Video Inpainting of Complex Scenes”, SIAM Journal on Imaging Sciences, 7(4), 1993-2019, 2014
 
[12]  Vinod R. T. , Nitiket N. M., “An Intelligent Video Repairing Approach Using Object Inpainting: A Review”, Internation Journal Of Research in Advent Technology, 4(3), 236-240, 2016
 
[13]  Y. Wexler, E. Shechtman, M. Irani, “Space-Time Video Completion”, In Proc. IEEE Conf. Computer Vision and Pattern Recognition(CVPR), 1, 120-127, 2004.
 
[14]  Y. Wexler, E. Shechtman, M. Irani, “Space-Time Completion of Video”, IEEE Trans. Pattern Analysis Machine Intelligence, 29(3), 463-476, 2007.
 
[15]  Wang. M. , Yan B. , Ngan K. N., “An efficient framework for image/video inpainting”, Journal of Signal Processing: Image Communication, 28(7), 753-762, 2013.
 
[16]  K. A. Patwardhan, G. Sapiro, M. Bertalmio, “Video Inpainting Under Constrained Camera Motion”, In Proc. IEEE Trans. Image Processing, 16(2), 545-553, 2007
 
[17]  A. Efros, T. Leung, “Texture Synthesis By Non-parametric Sampling”, In Proc. 7th IEEE Int. Conf. Computer Vision(ICCV), 2, 1033-1038, 1999
 
[18]  A. Criminisi, P. Perez, K. Toyama, “Region Filling and Object Removal by Exemplar-based Inpainting”, IEEE Tran. Image Processing, 13(9), 1200-1212, 2004.
 
[19]  R. C. Chang, N. C. Tang, C. C. Chao, “Application of Inpainting Technology to Video Restoration”, In Proc.1st IEEE Int. Conf. Ubi-Media Computing, 359-364, 2008.
 
[20]  T. K. Shih, N. C. Tan, J. C. Tasi, H. Y. Zhong, “Video Falsifying by Motion Interpolation and Inpainting”, In Proc. IEEE Int. Conf. Computer Vision and pattern Recognition, 1-8, 2008.
 
[21]  C. Xiao, S. Liu, H. Fu, C. Lin, C. Song, Z. Huang, F. He, Q. Peng, “Video Completion and Synthesis”, Computer Animation and Virtual World, 19, 341-353, 2008.
 
[22]  http://cs229.stanford.edu/proj2009/BackerRolfsYu.pdf.
 
[23]  S. A. Takrouri, A. V. Savkin, “A Model Validation Approach to Texture Recognition and Inpainting”, Journal Of Pattern Recognition Letters, 43, 2054-2067, 2010.
 
[24]  A. Koochari, M. Soryani, “Exemplar-Based Video Inpainting with Large Patches”, Journal of Zhejiang University, 11(4), 270-277, 2010.
 
[25]  M. V. Venkatesh, S. S. Cheung, J. Zhao, “Efficient Object-Based Video Inpainting”, Journal Of Pattern Recognition Letters, 30(2), 168-179, 2009.
 
[26]  I. C. Chang, C. W. Hsu, “Video Inpainting Based on Multi-Layer Approach”, In. Proc. Asia-Pacific Signal and Information Processing Association Annual Summit and Conference(APSIPA ASC), 200-207, 2009.
 
[27]  Frantc V. A., Voronin V. V., Marchuck V. I., Egiazarian K. O., “Video Inpainting Using Scene Model and Object Tracking”, Proc. SPIE 8655, Image Processing: Algorithms and Systems XI, 2013.
 
[28]  Ahire B. A., Deshpande N. A., “Video Inpainting of Objects Using Modified Patch based Image Inpainting Algorithm”, Conf. on IT in Business, Industry and Government (CSIBIG), 1-5, 2014.
 
[29]  Y. Zhang, J. Xiao, M. Shah, “Motion Layer Based Object Removal in Videos”, In Proc. 7 th IEEE Workshop On Applications Of Computer Vision, 1, 516-521, 2005.
 
[30]  V. Kwatra, A. Schodl, I. Essa, G. Turk, A. Bobick, “Graphcut Textures: Image and Video Synthesis Using Graph Cut”, ACM Transactions on Graphics, 22(3), 277-286, 2003.
 
[31]  M. Bertalmio, G. Sapiro, C. Ballester, V. Caselles, “Image Inpainting”, Proc. ACM SIGGRAPH Conf. Computer Graphics, 417-424, 2000.
 
[32]  M. Bertalmio, A. L. Bertozzi, G. Sapiro, “Navier-Stokes, Fluid Dynamics, and Image and Video Inpainting”, In Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, 1, 355-362, 2001.
 
[33]  A. Gangal, B. Dizdaroglu, “Automatic Restoration of Old Motion Picture Films Using Spatiotemporal Exemplar-Based Inpainting”, Lecture Notes in Computer Science, 4179, 55-66, 2006.
 
[34]  T. Siratori, Y. Matsushita, S. B. Kang, X. Tang, “Video Completion by Motion Field Transfer”, In Proc. IEEE Computer Society Conf. Computer Vision and pattern Recognition, 1, 411-418, 2006.
 
[35]  Singh M. , Baghla E. S., “A Review on Object Removal using Examplar based Image Impainting Technique”, International Journal of Engineering Science & Research Technology, 4(6), 472-475, 2015.
 
[36]  C. K. Chui, “An MRA Approach to Surface Completion and Image Inpainting”, App. Comput. Harmon. Anal. , 26, 270-276, 2009.
 
[37]  Zakir Y. K. , Prajot R. , Krishna K. , Anish K. , “A Hierarchical Super Resoloution based Video Inpainting Tool”, Internation Journal Of Advance Research And Innovative Ideas In Education, 2(2), 236-240, 2016.
 
[38]  C. Wren, A. Azarbayejani, T. Darrell, A. Pentland, “Pfinder: Real-time Tracking of the Human Body”, IEEE Trans. Pattern Analysis Machine Intelligence, 19(7), 780-785, 1997.
 
[39]  G. Xiang, T. E. Boult, F. Coetzee, V. Ramesh, “Error Analysis of Background Adaption”, In. Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1, 503–510, 2000
 
[40]  C. Stauffer, W. E. L. Grimson, “Learning Patterns of Activity Using Real-time Tracking”, IEEE Trans. Pattern Analysis and Machine Intelligence, 22(8), 747–757, 2000
 
[41]  A. Elgammal, D. Harwood, L. Davis, “Non-parametric Model for Background Subtraction”, 2000, http://citeseer.ist.psu.edu/viewdoc/summary?doi=10.1.1.89.7134.
 
[42]  L. Li, M. K. H. Leung, “Integrating Intensity and Texture Differences for Robust Change Detection”, IEEE Trans. Image Processing, 11(2), 105-112, 2002.
 
[43]  K. Toyama, J. Krumm, B. Brumitt, B. Meyers, “Wallflower: Principles and Practice of Background Maintenance”, Proc. 7th IEEE Int. Conf. Computer Vision, 1, 255-261, 1999.
 
[44]  J. Zhong, S. Sclaroff, “Segmenting Foreground Objects from a Dynamic Textured Background via a Robust Kalman Filter”, Proc. 9th IEEE Int. Conf. Computer Vision, 1, 44-50, 2003.
 
[45]  J. Shi, C. Tomasi, “Good Features to Track”, Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, 593-600, 1994.
 
[46]  S. Birchfield, “Elliptical Head Tracking Using Intensity Gradients and Color Histograms”, Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, 232-237, 1998.
 
[47]  H. Schweitzer, J. W. Bell, F. Wu, “Very Fast Template Matching”, Lecture Notes in Computer Science, 2353, 145-148, 2006.
 
[48]  P. Fieguth, D. Terzopoulos, “Color-based Tracking of Heads and Other Mobile Objects at Video Frame Rates”, Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, 21-27, 1997.
 
[49]  D. Comaniciu, V. Ramesh, P. Meer, “Kernel-based Object Tracking”, 25(5), 564-577, 2003.
 
[50]  H. Tao, H. S. Sawhney, R. Kumar, “Object tracking with Bayesian estimation of dynamic layer representations”, IEEE Trans. Pattern Analysis and Machine Intelligence, 24(1), 75-89, 2002.
 
Manuscript template