Deep Features and Clustering Based Keyframes Selection with Security

Prachi Chauhan, Hardwari Lal Mandoria, Alok Negi


The digital world is developing more quickly than ever. Multimedia processing and distribution, however become vulnerable issues due to the enormous quantity and significance of vital information. Therefore, extensive technologies and algorithms are required for the safe transmission of messages, images, and video files. This paper proposes a secure framework by acute integration of video summarization and image encryption. Three parts comprise the proposed cryptosystem framework. The informative frames are first extracted using an efficient and lightweight technique that make use of the color histogram-clustering (RGB-HSV) approach's processing capabilities. Each frame of a video is represented by deep features, which are based on an enhanced pre-trained Inception-v3 network. After that summary is obtain using the K-means optimal clustering algorithm. The representative keyframes then extracted using the clusters highest possible entropy nodes. Experimental validation on two well-known standard datasets demonstrates the proposed methods superiority to numerous state-of-the-art approaches. Finally, the proposed framework performs an efficient image encryption and decryption algorithm by employing a general linear group function GLn (F). The analysis and testing outcomes prove the superiority of the proposed adaptive RSA.


Clustering; Color Histogram; General Linear Group; Image Encryption and Decryption; Inception-V3; Video Summarization

Full Text:



M. Ahmed, R. Seraj, and S. M. S. Islam. The k-means algorithm: A comprehensive survey and performance evaluation. Electronics, 9(8):1295, 2020. F. Alamdar and M. Keyvanpour. A new color feature extraction method based on quadhistogram. Procedia Environmental Sciences, 10:777–783, 2011.

M. Avi-Aharon, A. Arbelle, and T. R. Raviv. Deephist: Differentiable joint and color histogram layers for image-to-image translation. arXiv preprint arXiv:2005.03995, 2020.

S. Cheng, L. Wang, N. Ao, and Q. Han. A selective video encryption scheme based on coding characteristics. Symmetry, 12(3):332, 2020.

R. da Silva Torres and A. X. Falcao. Content-based image retrieval: theory and applications. RITA, 13(2):161–185, 2006.

Y. Ding, G. Wu, D. Chen, N. Zhang, L. Gong, M. Cao, and Z. Qin. Deepedn: a deep-learning-based image encryption and decryption network for internet of medical things. IEEE Internet of Things Journal, 8(3):1504–1518, 2020.

P. Gaherwar, S. Joshi, R. Joshi, and R. Khengare. Sisa: Securing images by selective alteration. In Information and Communication Technology for Competitive Strategies (ICTCS 2020), pages 729–740. Springer, 2022.

M. Gygli. Ridiculously fast shot boundary detection with fully convolutional neural networks. In 2018 International conference on content-based multimedia indexing (CBMI), pages 1–4. IEEE, 2018.

M. Gygli, H. Grabner, H. Riemenschneider, and L. V. Gool. Creating summaries from user videos. In European conference on computer vision, pages 505–520. Springer, 2014.

R. Hamza, A. Hassan, T. Huang, L. Ke, and H. Yan. An efficient cryptosystem for video surveillance in the internet of things environment. Complexity, 2019, 2019.

C. Huang and H. Wang. A novel key-frames selection framework for comprehensive video summarization. IEEE Transactions on Circuits and Systems for Video Technology, 30(2):577–589, 2019.

Z. Ji, K. Xiong, Y. Pang, and X. Li. Video summarization with attention-based encoder– decoder networks. IEEE Transactions on Circuits and Systems for Video Technology, 30(6):1709–1717, 2019.

M. Z. Khan, S. Jabeen, S. ul Hassan, M. Hassan, and M. U. G. Khan. Video summarization using cnn and bidirectional lstm by utilizing scene boundary detection. In 2019 International conference on applied and engineering mathematics (ICAEM), pages 197–202. IEEE, 2019.

K. Kumar and D. D. Shrimankar. F-des: Fast and deep event summarization. IEEE Transactions on Multimedia, 20(2):323–334, 2017.

M. Li and X. Jiang. An improved algorithm based on color feature extraction for image retrieval. In 2016 8th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC), volume 2, pages 281–285. IEEE, 2016.

B. Liang, N. Li, Z. He, Z. Wang, Y. Fu, and T. Lu. News video summarization combining surf and color histogram features. Entropy, 23(8):982, 2021.

J. Lu, G. Liu, Y. Liu, B. Sun, C. Li, and L. Liu. Improved neural distinguishers with (related-key) differentials: Applications in simon and simeck. arXiv preprint arXiv:2201.03767, 2022.

B. Mahasseni, M. Lam, and S. Todorovic. Unsupervised video summarization with adversarial lstm networks. In Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, pages 202–211, 2017.

K. Muhammad, T. Hussain, and S. W. Baik. Efficient cnn based summarization of surveillance videos for resource-constrained devices. Pattern Recognition Letters, 130:370–375, 2020.

M. Mukhedkar, P. Powar, and P. Gaikwad. Secure non real time image encryption algorithm development using cryptography & steganography. In 2015 Annual IEEE India Conference (INDICON), pages 1–6. IEEE, 2015.

A. Nazir, R. Ashraf, T. Hamdani, and N. Ali. Content based image retrieval system by using hsv color histogram, discrete wavelet transform and edge histogram descriptor. In 2018 international conference on computing, mathematics and engineering technologies (iCoMET), pages 1–6. IEEE, 2018.

D. P. Papadopoulos, V. S. Kalogeiton, S. A. Chatzichristofis, and N. Papamarkos. Automatic summarization and annotation of videos with lack of metadata information. Expert Systems with Applications, 40(14):5765–5778, 2013.

S. Ramanujam and M. Karuppiah. Designing an algorithm with high avalanche effect. IJCSNS International Journal of Computer Science and Network Security, 11 (1):106–111, 2011.

S. Rani and M. Kumar. Social media video summarization using multi-visual features and kohnen’s self organizing map. Information Processing & Management, 57(3): 102190, 2020.

A. Sahu and A. S. Chowdhury. Summarizing egocentric videos using deep features and optimal clustering. Neurocomputing, 398:209–221, 2020.

X. Sixing, S. Xin, L. Bing, et al. New image encryption technology of image based on computer generated hologram [j]. Laser & Optoelectronics Progress, 49(4):040902, 2012.

T. Soucek and J. Loko ˇ c. Transnet v2: an effective deep network architecture for fast shot transition detection. arXiv preprint arXiv:2008.04838, 2020.

D. Srivastava, R. Wadhvani, and M. Gyanchandani. A review: color feature extraction methods for content based image retrieval. International Journal of Computational Engineering & Management, 18(3):9–13, 2015.

C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna. Rethinking the inception architecture for computer vision. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 2818–2826, 2016.

Z. Wu and P. Xu. Shot boundary detection in video retrieval. In 2013 IEEE 4th International Conference on Electronics Information and Emergency Communication, pages 86–89. IEEE, 2013.

K. Zhang, W.-L. Chao, F. Sha, and K. Grauman. Video summarization with long short-term memory. In European conference on computer vision, pages 766–782. Springer, 2016.

Y. Zhang, X. Liang, D. Zhang, M. Tan, and E. P. Xing. Unsupervised object-level video summarization with online motion auto-encoder. Pattern Recognition Letters, 130: 376–385, 2020.

B. Zhao, X. Li, and X. Lu. Hsa-rnn: Hierarchical structure-adaptive rnn for video summarization. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 7405–7414, 2018.

U. Zia, M. McCartney, B. Scotney, J. Martinez, M. AbuTair, J. Memon, and A. Sajjad. Survey on image encryption techniques using chaotic maps in spatial, transform and spatiotemporal domains. International Journal of Information Security, pages 1–19, 2022.



  • There are currently no refbacks.

Copyright (c) 2023 Prachi Chauhan, Hardwari Lal Mandoria, Alok Negi

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Ratio Mathematica - Journal of Mathematics, Statistics, and Applications. ISSN 1592-7415; e-ISSN 2282-8214.