آمار

تعداد نشریات11
تعداد شماره‌ها226
تعداد مقالات2,285
تعداد مشاهده مقاله3,519,816
تعداد دریافت فایل اصل مقاله2,580,420
Roodaki, H.. (1402). An Efficient Region-of-Interest (ROI) based Scalable Framework for Free Viewpoint Video Application. فناوری آموزش, 12(1), 283-293. doi: 10.22061/jecei.2023.7934.455
H. Roodaki. "An Efficient Region-of-Interest (ROI) based Scalable Framework for Free Viewpoint Video Application". فناوری آموزش, 12, 1, 1402, 283-293. doi: 10.22061/jecei.2023.7934.455
Roodaki, H.. (1402). 'An Efficient Region-of-Interest (ROI) based Scalable Framework for Free Viewpoint Video Application', فناوری آموزش, 12(1), pp. 283-293. doi: 10.22061/jecei.2023.7934.455
Roodaki, H.. An Efficient Region-of-Interest (ROI) based Scalable Framework for Free Viewpoint Video Application. فناوری آموزش, 1402; 12(1): 283-293. doi: 10.22061/jecei.2023.7934.455

An Efficient Region-of-Interest (ROI) based Scalable Framework for Free Viewpoint Video Application

Journal of Electrical and Computer Engineering Innovations (JECEI)
دوره 12، شماره 1، فروردین 2024، صفحه 283-293    اصل مقاله (1.03 M)
نوع مقاله: Original Research Paper
شناسه دیجیتال (DOI): 10.22061/jecei.2023.7934.455
نویسنده
H. Roodaki*
Faculty of Computer Engineering, K. N. Toosi University of Technology, Tehran, Iran.
تاریخ دریافت: 02 شهریور 1402،  تاریخ بازنگری: 15 آبان 1402،  تاریخ پذیرش: 21 آذر 1402 
چکیده
Background and Objectives: From the multiview recorded video, free viewpoint video provides flexible viewpoint navigation. Thus, a lot of views need to be sent to the receivers in an encoded format. The scalable nature of the coded bitstream is one method of lowering the volume of data. However, adhering to the limitations of the free viewpoint application heavily relies on the kind of scalable modality chosen. The perceptual quality of the received sequences and the efficiency of the compression technique are significantly impacted by the scalable modality that was chosen.
Methods: In order to address the primary issues with free-viewpoint video, such as high bandwidth requirements and computational complexity, this paper suggests a scalable framework. The two components of the suggested framework are as follows: 1) introducing appropriate scalable modality and data assignment to the base and enhancement layers; and 2) bit budget allocation to the base and enhancement layers using a rate control algorithm. In our novel scalable modality, termed Tile-based scalability, the idea of Region of Interest (ROI) is employed, and the region of interest is extracted using the tile coding concept first presented in the MV-HEVC.
Results: When compared to the state-of-the-art techniques, our approach's computational complexity can be reduced by an average of 44% thanks to the concept of tile-coding with parallel processing capabilities. Furthermore, in comparison to standard MV-HEVC, our suggested rate control achieves an average 17.7 reduction in bandwidth and 1.2 improvement in video quality in the Bjøntegaard-Bitrate and Bjøntegaard-PSNR scales.
Conclusion: Using new tile-based scalability, a novel scalable framework for free-viewpoint video applications is proposed. It assigns appropriate regions to the base and enhancement layers based on the unique features of free viewpoint scalability. Next, a rate control strategy is put forth to allocate a suitable bitrate to both the base and enhancement layers. According to experimental results, the suggested method can achieve a good coding efficiency with significantly less computational complexity than state-of-the-art techniques that used the λ-domain rate control method.
کلیدواژه‌ها
Tile-based Scalability؛ Region of Interest؛ λ-domain rate control algorithm؛ MV-HEVC؛ Parallel processing
مراجع
[1] C. C. Lee, A. Tabatabai, K. Tashiro, “Free viewpoint video (FVV) survey and future research direction,” APSIPA Trans. Signal Inf. Process., 4: 1-10, 2015.

[2] Y. Zheng, J. Feng, H. Ma, Y. Chen, “H.264 ROI coding based on visual perception,” in Proc. 5th International Conference on Visual Information Engineering. Xian China, China: 829-834, 2008.

[3] J. Zhang, L. Zhuo, Y. Zhao, “Region of interest detection based on visual perception model,” Int. J. Pattern Recognit. Artif. Intell., 26(02), 2012.

[4] G. J Sullivan, J Ohm, W. J. Han, T. Wiegand, “Overview of the high efficiency video coding (HEVC) standard,” IEEE Trans. Circuits Syst. Video Technol., 22(12): 1649-1668, 2012.

[5] B. Li, H. Li, L. Li, J. Zhang, ”λ domain rate control algorithm for high efficiency video coding,” IEEE Trans. Image Process., 23(9): 3841-3854, 2014.

[6] H. Schwarz, D. Marpe, T. Wiegand, “Overview of the scalable video coding extension of the H.264/AVC standard,” IEEE Trans. Circuits Syst. Video Technol., 17(9): 1103-1120, 2007.

[7] D. Grois, E. Kaminsky, O. Hadar, “Dynamically adjustable and scalable ROI video coding,” in Proc. IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB): 1-5, 2010.

[8] S. Shimizu, M. Kitahara, H. Kimata, K. Kamikura, Y. Yashima, “View scalable multiview video coding using 3-D warping with depth map,” IEEE Trans. Circuits Syst. Video Technol. 17(11): 1485-1495, 2007.

[9] H. Yo Sung, O. Kwan Jung, “Overview of multi-view video coding. 14th International Workshop on Systems Signals and Image,” in Proc. 6th EURASIP Conference focused on Speech and Image Processing Multimedia Communications and Services, 2007.

[10] S. Shimizu, H. Kimata, K. Kamikura, Y. Yashima, “Free-viewpoint scalable multi-view video coding using panoramic mosaic depth maps,” in Proc. 16th European Signal Processing Conference, 2008.

[11] H. Roodaki, S. Shirmohammadi, “Scalable multiview video coding for immersive video streaming systems,” in Proc. Visual Communications and Image Processing (VCIP), 2016.

[12] N. Ozbek, A. Murat Tekalp, E. Turhan Tunali, “A new scalable multi-view video coding configuration for robust selective streaming of free-viewpoint TV,” in Proc. IEEE International Conference on Multimedia and Expo, Beijing: 1155-1158, 2007.

[13] T. Yan, I. H. Ra, Q. Zhang, H. Xu, L. Huang, “A novel rate control algorithm based on ρ model for multiview high efficiency video coding, “Electronics,  9(1): 166, 2020.

[14] T. Yan, I. H. Ra, D. Liu, D. Chen, Y. Youhao, S. Hou, “Rate control based on similarity analysis in multi-view video coding,” in Proc. 9th International Conference on Information Technology Convergence and Services (ITCSE 2020), 2020.

[15] T. Yan, I. H. Ra, Q. Zhang, H. Wen, H. Xu, S. Chen, “Rate control algorithm for multiview video coding based on human visual characteristics,” Int. J. Performability Eng., 14(8): 1913-1921, 2018.

[16] T. Yan, I. H. Ra, H. Wen, M. H. Weng, Q. Zhang, Y. Chen, “CTU layer rate control algorithm in scene change video for free-viewpoint video,” IEEE Access, 8: 24549-24560, 2020.

[17] T. Yan, P. An, L. Shen, Q. Zhang, Z. Zhang, “Rate control algorithm for multi-view video coding based on correlation analysis,” in Proc. Symposium on Photonics and Optoelectronics: 1-4, 2009.

[18] L. Li, B. Li, D. Liu, H. Li “λ-domain rate control algorithm for HEVC scalable extension,” IEEE Trans. Multimedia, 18(10): 2023-2039, 2016.

[19] P. J. Lee, Y. C. Lai, “Vision perceptual based rate control algorithm for multi-view video coding,” in Proc. International conference on system science and engineering (ICSSE), 2011.

[20] S. Park, D. Sim, “An efficient rate-control algorithm for multi-view video coding,” in Proc. IEEE 13th International Symposium on Consumer Electronics: 115-118, 2009.

[21] A. Fiengo, G. Chierchia, M. Cagnazzo, B. Pesquet-Popescu, “Convex optimization for frame-level rate allocation in MV-HEVC,” in Proc. IEEE International Conference on Image Processing (ICIP), 2016.

[22] M Cordina, C.J. Debono, “A depth map rate control algorithm for HEVC Multi-View Video plus Depth,” in proc. IEEE International Conference on Multimedia & Expo Workshops (ICMEW), 2016.

[23] R. Abolfathi, H. Roodaki, S. Shirmohammadi, "A novel rate control method for free-viewpoint video in MV-HEVC," in Proc. 2019 International Conference on Computing, Networking and Communications (ICNC): 582-587, 2019.

[24] T. Yan, I. Ra, H. Wen, M. Weng, Q. Zhang, Y. Che, "CTU layer rate control algorithm in scene change video for free-viewpoint video," IEEE Access, 8: 24549-24560, 2020.

[25] J. Kilner, J. Starck, A. Hilton, “A comparative study of free-viewpoint video techniques for sports events,” in proc. 3rd European Conference on Visual Media Production, 2006.

[26] C. M.  Privitera, L. W. Stark, “Algorithms for defining visual regions-of-interest: comparison with eye fixations,” IEEE Trans. Pattern Anal. Mach. Intell., 22(9): 970-982, 2000.

[27] J. L. Solka, D. J. Marchette, B. C. Wallet, V. L Irwin, G. W. Rogers, “Identification of man-made regions in unmanned aerial vehicle imagery and videos,” IEEE Trans. Pattern Anal. Mach. Intell., 20(8): 852-857, 1998.

[28] A. Mohan, C. Papageorgiou, T. Poggio, “Example-based object detection in images by components,” IEEE Trans. Pattern Anal. Mach. Intell., 23(4): 349-361, 2001.

[29] T. M. Stough, C. E. Brodley, “Focusing attention on objects of interest using multiple matched filters,” IEEE Trans. Image Process., 10(3): 419-426, 2001.

[30] K. Misra, A. Segall, M. Horowitz, S. Xu, A. Fuldseth, M. Zhou, “An overview of tiles in HEVC,” IEEE J. Sel. Top. Signal Process., 7(6): 969-977, 2013.

[31] G. Corrêa, P. Assunção, L. Agostini, A. L. da Silva Cruz, “Performance and computational complexity assessment of high-efficiency video encoders,” IEEE Trans. Circuits Syst. Video Technol., 22(12): 1899- 1909, 2012.

[32] M. Viitanen, J. Vanne, T. D. Hämäläinen, M. Gabbouj, J. Lainema, “Complexity analysis of next-generation HEVC decoder,” in Proc. IEEE International Symposium on Circuits and Systems: 882-885, 2012.

[33] A. Fuldseth, M. Horowitz, S. Xu, K. Misra, A. Segall, M. Zhou, “Tiles for managing computational complexity of video encoding and decoding,” in Proc. Picture Coding Symposium (PCS): 389-392, 2012.

[34] J. Wen, M. Fang, M. Tang, K. Wu, “R-(lambda) model based improved rate control for HEVC with Pre-Encoding,” in Proc. Data Compression Conference (DCC): 53-62, 2015.

[35] H. Roodaki, M. R. Hashemi, S. Shirmohammadi, “Rate-distortion optimization for scalable multi-view video coding,” in Proc. IEEE International Conference on Multimedia and Expo (ICME), 2014.

[36] G. Sullivan, J. M. Boyce, Y. Chen, J. R. Ohm, C. A. Segall, A. Vetro, “Standardized extensions of high efficiency video coding (HEVC),” IEEE J. Sel. Top. Signal Process., 7(6): 1001-1016, 2013.

[37] Tanimoto Laboratory, http://www.fujii.nuee.nagoya-u.ac.jp/~fukushima/mpegftv/, last access on. March, 2021.

[38] Merl, http://www.merl.com/pub/avetro/mvc-testseq/orig-yuv/vassar/, last access on March, 2021.

[39] ftp://ftp.research.microsoft.com/users/fvv/, last access on March, 2021.

[40] G. Bjøntegaard, “Calculation of average PSNR differences between RD curves,” ITU T SG16/Q6, Doc. VCEG-M33, 2001.

[41] Y. Zhang, S. Kwong, L. Xu, S. Hu, G. Jiang , C. J. Kuo, "Regional bit allocation and rate distortion optimization for multiview depth video coding with view synthesis distortion model," IEEE Trans. Image Process., 22(9): 3497-3512, 2013.

[42] Y. Zhang, G. Jiang, M. Yu, et al., “Stereoscopic visual attention-based regional bit allocation optimization for multiview video coding,” EURASIP J. Adv. Signal Process.  848713, 2010.

 

آمار
تعداد مشاهده مقاله: 244
تعداد دریافت فایل اصل مقاله: 342


سامانه مدیریت نشریات علمی. طراحی و پیاده سازی از سیناوب