An in Depth Review Paper on Numerous Image Mosaicing Approaches and Techniques

  • Mohamed Abdul – Rahim. M.I.
  • Zheng – Sheng Yu
Keywords: Image Mosaicing, Registration, Blending, Geometric Transformation, Homography, Low-level Feature, Transition Smoothening, Optimal Seam, Extraction

Abstract

Image mosaicing is one of the most important subjects of research in computer vision at current. Image mocaicing requires the integration of direct techniques and feature based techniques. Direct techniques are found to be very useful for mosaicing large overlapping regions, small translations and rotations while feature based techniques are useful for small overlapping regions. Feature based image mosaicing is a combination of corner detection, corner matching, motion parameters estimation and image stitching.

Furthermore, image mosaicing is considered the process of obtaining a wider field-of-view of a scene from a sequence of partial views, which has been an attractive research area because of its wide range of applications, including motion detection, resolution enhancement, monitoring global land usage, and medical imaging. Numerous algorithms for image mosaicing have been proposed over the last two decades.

In this paper the authors present a review on different approaches for image mosaicing and the literature over the past few years in the field of image masaicing methodologies. The authors take an overview on the various methods for image mosaicing.

This review paper also provides an in depth survey of the existing image mosaicing algorithms by classifying them into several groups. For each group, the fundamental concepts are first clearly explained. Finally this paper also reviews and discusses the strength and weaknesses of all the mosaicing groups.

Downloads

Download data is not yet available.

References

A. Behrens, M. Guski, T. Stehle, S. Gross, & T. Aach. (2010). Intensity based multi-scale blending for panoramic images in fluorescence endoscopy. IEEE International Symposium on Biomedical Imaging: From Nano to Macro, 1305–1308.

A. Dame & E. Marchand. (2010). Video mosaicing using a mutual information-based motion estimation process. IEEE International Conference on Image Processing (ICIP), 1493–1496.

A. Levin, A. Zomet, S. Peleg, & Y. Weiss. (2004). Seamless image stitching in the gradient domain. Computer Vision-ECCV, 377–389.

A. Nasibov, H. Nasibov, & F. Hacizade. (2009). Seamless image stitching algorithm using radiometric lens calibration for high resolution optical microscopy. International Conference on Soft Computing, Computing with Words and Perceptions in System Analysis, Decision and Control, 1–4.

A. Nemra & N. Aouf. (2009). Robust invariant automatic image mosaicing and super resolution for UAV mapping. International Symposium on Mechatronics and its Applications, 1–7.

A. Pandey & U.C. Pati. (2013). A novel technique for non-overlapping image mosaicing based on pyramid method. IEEE India Conference (INDICON), 1–6.

C. D. Kuglin & D. C. Hines. (1975). The phase correlation image alignment method.. IEEE International Conference on Cybernet. Society, New York, 163- 165.

C. de Cesare, M.-J.Rendas, A.-G. Allais, & M. Perrier. (2008). Low overlap image registration based on both entropy and mutual information measures. OCEANS, 1–9.

C. Wang, Y. Cheng, & C. Zhao. (2009). Robust subpixel registration for image mosaicing. Chinese Conference on Pattern Recognition, 1–5.

D. Ghosh, N. Kaabouch, & R.A. Fevig. (2014). Robust spatial-domain based super resolution mosaicing of cubesat video frames: Algorithm and evaluation. Computer and Information Science, 7(2), 68-81.

D. I. Barnea, & H. F. Silverman. (1972). A class of algorithms for fast digital registration. IEEE Transaction on Computer, C-21, 179- 186.

D. Liqian & J. Yuehui. (2010). Moon landform images fusion and Mosaic based on SIFT method. International Conference on Computer and Information Application (ICCIA), 29–32.

D. Vaghela & K. Naina. (2014). A review of image mosaicing techniques, International Journal of Advance Research in Computer Science and Management Studies, 2(3), 1-6.

D.G. Lowe. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Comput. Vision, 60, 91–110.

D.K. Jain, G. Saxena, & V.K. Singh. (2012). Image mosaicing using corner techniques. International Conference on Communication Systems and Network Technologies (CSNT), 79–84.

E. Zagrouba, W. Barhoumi, & S. Amri. (2009). An efficient image-mosaicing method based on multifeature matching. Mach. Vis. Appl. 20, 139–162.

F. Yang, L. Wei, Z. Zhang, H. Tang, Image mosaic based on phase correlation and Harris operator. Journal of Computational Information System, 8(6), 2647–2655.

F. Zhao, Q. Huang, & W. Gao. (2006). Image matching by normalized cross-correlation. IEEE International Conference on Acoustics, Speech and Signal Processing, 729-732.

G. Gao & K. Jia. (2007). A new image mosaics algorithm based on feature points matching. International Conference on Innovative Computing, Information and Control, 471–471.

G. Guandong & J. Kebin. (2007). A new image mosaics algorithm based on feature points matching, in: International Conference on Innovative Computing, Information and Control, 471–471

G. Jun-Hui, Z. Jun-Hua, A. Zhen-Zhou, Z. Wei-Wei, & L. Hui-Min. (2012). An approach for X-ray image mosaicing based on Speeded-up robust features, in: International Conference on Wavelet Active Media Technology and Information Processing (ICWAMTIP), 432–435.

H. Bay, T. Tuytelaar &, L. Van Gool. (2006). Surf: speeded up robust features. Computer Vision–ECCV, 404–417.

H. Joshi & K. Sinha. (2013). Novel techniques image mosaicing based on image fusion using harris aand SURF. International Conference on Computer Science and Information Technology, 1-11.

H. Joshi & M.K. Sinha. (2013). A survey on image mosaicing techniques. International Journal of Advanced Research in Computer Engineering & Technology, 2(2), 2013.

H. Wen & J. Zhou. (2008). An improved algorithm for image mosaic. International Symposium on Information Science and Engineering, 497–500.

H. Xie, N. Hicks, G.R. Keller, H. Huang, & V. Kreinovich. (2003). An IDL/ENVI implementation of the FFT-based algorithm for automatic image registration. Comput. Geosci. 29(8), 1045–1055.

J. Jiao, B. Zhao, & S. Wu. (2011). A speed-up and robust image registration algorithm based on fast. IEEE International Conference on Computer Science and Automation Engineering (CSAE), 160–164.

J. Prescott, M. Clary, G. Wiet, T. Pan, & K. Huang. (2006). Automatic registration of large set of microscopic images using high-level features. IEEE International Symposium on Biomedical Imaging: Nano to Macro, 1284–1287.

J. Seokhee & G.J. Kim. (2007). Mosaicing a wide geometric field of view for effective interaction in augmented reality. IEEE and ACM International Symposium on Mixed and Augmented Reality, 265–266.

J. Xiao, Y. Zhang, & M. Shah. (2005). Adaptive region-based video registration. IEEE Workshops on Application of Computer Vision, 215-220.

J. Zhu & M. Ren. (2014). Image mosaic method based on SIFT features of line segment. Computational and Mathematical Methods in Medicine, 1-11

J.M. Fitzpatrick, D.L. Hill, & C.R. Maurer Jr. (2004). Image registration, Handbook of Medical Imaging, 2, 447–513.

K. Berberidis & I. Karybali. (2002). A new efficient cross-correlation based image registration technique with improved performance. Proceedings of the European Signal Processing Conference, 3–6.

K. Peng & M. Hongbing. (2011). An automatic airborne image mosaicing method based on the SIFT feature matching. International Conference on Multimedia Technology (ICMT), 155–159.

K.-I. Okumura, S. Raut, Q. Gu, T. Aoyama, T. Takaki, & I. Ishii. (2013). Real-time feature based video mosaicing at 500 fps. International Conference on Intelligent Robots and Systems (IROS), 2665–2670.

L. Yao. (2008). Image mosaic based on SIFT and deformation propagation. IEEE International Symposium on Knowledge Acquisition and Modeling Workshop, 848–851.

Lisa G. Brown. (1992). A survey of image registration techniques. ACM Computing Surveys, 24(4), 325- 376.

M. Deshmukh & U. Bhosle. (2011). A survey of image registration, International Journal of Image Processing (IJIP), 5(3), 245-269.

M. El-Saban, M. Izz, A. Kaheel, & M. Refaat. (2011). Improved optimal seam selection blending for fast video stitching of videos captured from freely moving devices. IEEE International Conference on Image Processing (ICIP), 1481–1484.

M. Vivet, S. Peleg, & X. Binefa. (2011). Real-time stereo mosaicing using feature tracking. IEEE International Symposium on Multimedia (ISM), 577– 582.

M.B. Islam & M.M.J. Kabir. (2013). A new feature-based image registration algorithm. Computer Technology and Application, 4, 79–84.

M.H.M. Patel, A.P.P.J. Patel, & A.P.M.S.G. Patel. (2012). Comprehensive study and review of image mosaicing methods. International Journal of Engineering Research and Technology, 1(9), 1-7.

N. Geng, D. He, & Y. Song. (2012). Camera image mosaicing based on an optimized SURF algorithm, Indonesian Journal of Electrical Engineering, 10(8), 2183–2193.

N. Gracias, M. Mahoor, S. Negahdaripour, & A. Gleason. (2009). Fast image blending using watersheds and graph cuts. Image Vis. Comput, 27(5), 597–607.

P. Azzari, L. Di Stefano, F. Tombari, & S. Mattoccia. (2008). Markerless augmented reality using image mosaics. Image Signal Process., 5099, 413–420.

P. Jain & V.K. Shandliya. (2013). A review paper on various approaches for image mosaicing. International Journal of Computational Engineering, 3(4), 106-109.

P. Kolonia. (1994, Jan). When more is better. Popular Photography, 58(1), 30-34.

P. Liang, X. Zhiwei, & D. Jiguang. (2010). Joint edge detector based on Laplacian pyramid. International Congress on Image and Signal Processing (CISP), 978–982.

P.J. Burt. (1988). Smart sensing within a pyramid vision. Proceedings of the IEEE, 76(8), 1006-1015.

R. Abraham & P. Simon. (2013). Review on mosaicing techniques in image processing. International Conference on Advanced Computing and Communication Technologies (ACCT), 63–68.

R. Miranda-Luna, C. Daul, W.C. Blondel, Y. Hernandez-Mier, D. Wolf, & F. Guillemin. (2008). Mosaicing of bladder endoscopic image sequences: distortion calibration and registration algorithm, IEEE Transactions on Biomedical Engineering, 55, 541–553.

T. Vercauteren, A. Perchant, X. Pennec, & N. Ayache. (2005). Mosaicing of confocal microscopic in vivo soft tissue video sequences. Medical Image Computing and Computer-Assisted Intervention (MICCAI), 753–760.

R. Szeliski. (2006). Image alignment and stitching: A tutorial. Foundations and Trends in Computer Graphics and Vision, 2(1), 1–104.

M. J. Black & A. D. Jepson. (1998). Eigen tracking: Robust matching and tracking of articulated objects using a view-based representation. International Journal of Computer Vision, 26(1), 63–84.

R. Szeliski, M. Uyttendaele, & D. Steedly. (2011). Fast poisson blending using multisplines. International Conference on Computational Photography (ICCP), 1–8.

R. Wen, C. Hui, L. Jiaju, X. Yanyan, & R. Haeusler. (2009). Mosaicing of microscope images based on SURF. International Conference on Image and Vision Computing New Zealand, 271–275.

S. C. Chen. (1995). Quicktime VR: An image-based approach to virtual environment navigation. Interactive Technology, SIGGRAPH, 29–38.

S. Ghannam & A.L. Abbott. (2013). Cross correlation versus mutual information for image mosaicing. International Journal of Advanced Computer Science and Applications, 4(11), 94-102.

S.Z. Kovalsky, G. Cohen, & J.M. Francos. (2007). Registration of joint geometric and radiometric image deformations in the presence of noise. IEEE/SP Workshop on Statistical Signal Processing, 561–565.

Soo-Hyun CHO, Yun-Koo CHUNG, & Jae Yeon LEE. (2003). Automatic image mosaic system using image feature detection and taylor series, In Proceedings of the 7th International Conference on Digital Image Computing: Techniques and Applications, Sydney, Australia, 549-556.

T. Botterill, S. Mills, & R. Green. (2010). Real-time aerial image mosaicing. International Conference of Image and Vision Computing New Zealand (IVCNZ), 1–8.

T. Vercauteren, A. Meining, F. Lacombe, & A. Perchant. (2008). Real time autonomous video image registration for endomicroscopy: fighting the compromises. Biomedical Optics (BiOS), 68610C–68610C-8.

X. Wang, J. Sun, & H.-Y. Peng. (2012). Efficient panorama mosaicing based on enhanced FAST and graph cuts. Recent Advances in Computer Science and Information Engineering, 128, 757–762.

Y. Lei, W. Xiaoyu, Z. Jun, & L. Hui. (2011). A research of feature-based image mosaic algorithm. International Congress on Image and Signal Processing (CISP), 846–849.

Y. Li, Y. Wang, W. Huang, & Z. Zhang. (2008). Automatic image stitching using sift. International Conference on Audio, Language and Image Processing, 568–571.

Y. Shum & R. Szeliski. (1998). Construction and refinement of panoramic mosaics with global and local alignment. Internatioinal Conference on Computer Vision, 953–958.

Y. Xiong. (2009). Eliminating ghosting artifacts for panoramic images. IEEE International Symposium on Multimedia, 432–437.

Y. Xiong & K. Turkowski. (1998). Registration, calibration and blending in creating high quality panoramas. IEEE Workshop on Applications of Computer Vision Proceedings, 69–74.

Published
2018-04-30
How to Cite
Mohamed Abdul – Rahim. M.I., & Zheng – Sheng Yu. (2018). An in Depth Review Paper on Numerous Image Mosaicing Approaches and Techniques. International Journal of Engineering and Management Research, 8(2), 19-35. Retrieved from https://www.ijemr.net/ojs/index.php/ojs/article/view/358
Section
Articles