Extraction of aspects from Online Reviews Using a Convolution Neural Network

Kamma Vidya, Gutta Sridevi, Dandibhotla Teja Santosh

Abstract


The quality of the product is measured based on the opinions gathered from product reviews expressed on a product. Opinion mining deals with extracting the features or aspects from the reviews expressed by the users. Specifically, this model uses a deep convolutional neural network with three channels of input: a semantic word embedding channel that encodes the semantic content of the word, a part of speech tagging channel for sequential labelling and domain embedding channel for domain specific embeddings which is pooled and processed with a Softmax function. This model uses three input channels for aspect extraction. Experiments are conducted on amazon review dataset. This model achieved better results

Keywords


Neural network, softmax function and extraction

Full Text:

PDF

References


Cheung, D. W. L., Song, I. L., Chu, W., Hu, X. and Lin, J., “PROCEEDINGS OF THE 18TH ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT”, Association of Computing Machinery, 2009.

Schouten, K. and Frasincar, F., “SURVEY ON ASPECT-LEVEL SENTIMENT ANALYSIS”, IEEE Transactions on Knowledge and Data Engineering, 28(3), pp.813-830, 2015.

Jakob, N. and Gurevych, I., “EXTRACTING OPINION TARGETS IN A SINGLE-AND CROSS-DOMAIN SETTING WITH CONDITIONAL RANDOM FIELDS”, In Proceedings of the conference on empirical methods in natural language processing. Association for Computational Linguistics, pp.1035-1045, 2010.

Hu, M. and Liu, B., “MINING AND SUMMARIZING CUSTOMER REVIEWS”, In Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, pp.168-177, 2004.

Ye, H., Yan, Z., Luo, Z. and Chao, W., “DEPENDENCY-TREE BASED CONVOLUTIONAL NEURAL NETWORKS FOR ASPECT TERM EXTRACTION”, In Pacific-Asia Conference on Knowledge Discovery and Data Mining, Springer, Cham, pp.350-362, 2017.

Dong, F., Zhang, Y. and Yang, J., “ATTENTION-BASED RECURRENT CONVOLUTIONAL NEURAL NETWORK FOR AUTOMATIC ESSAY SCORING”, In Proceedings of the 21st Conference on Computational Natural Language Learning (Co NLL 2017), pp.153-162, 2017.

Poria, S., Cambria, E. and Gelbukh, A., “ASPECT EXTRACTION FOR OPINION MINING WITH A DEEP CONVOLUTIONAL NEURAL NETWORK”, Knowledge-based Systems, 108, pp.42-49, 2016.

Khalil, T. and El-Beltagy, S. R., “NILETMRG AT SEMEVAL-2016 TASK 5: DEEP CONVOLUTIONAL NEURAL NETWORKS FOR ASPECT CATEGORY AND SENTIMENT EXTRACTION”, In Proceedings of the 10th international workshop on semantic evaluation (SEMEVAL-2016), pp.271-276, 2016.

Liu, B., “SENTIMENT ANALYSIS AND OPINION MINING”, First Edition. San Rafael: Morgan & Claypool Publishers, 2012.

Macháček, J., “BUTKNOT AT SEMEVAL-2016 TASK 5: SUPERVISED MACHINE LEARNING WITH TERM SUBSTITUTION APPROACH IN ASPECT CATEGORY DETECTION”, In Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016), pp.301-305, 2016.

Toh, Z. and Su, J., “NLANGP AT SEMEVAL-2016 TASK 5: IMPROVING ASPECT BASED SENTIMENT ANALYSIS USING NEURAL NETWORK FEATURES”, In Proceedings of the 10th international workshop on semantic evaluation (SemEval-2016), pp.282-288, 2016.

Jihan, N., Senarath, Y., Tennekoon, D., Wickramarathne, M. and Ranathunga, S., “MULTI-DOMAIN ASPECT EXTRACTION USING SUPPORT VECTOR MACHINES”, In Proceedings of the 29th Conference on Computational Linguistics and Speech Processing (ROCLING 2017), pp.308-322, 2017.

Wang, W., Pan, S. J., Dahlmeier, D. and Xiao, X., “RECURSIVE NEURAL CONDITIONAL RANDOM FIELDS FOR ASPECT-BASED SENTIMENT ANALYSIS”, 2016. arXiv preprint arXiv:1603.06679.

Li, X., and Lam, W., “DEEP MULTI-TASK LEARNING FOR ASPECT TERM EXTRACTION WITH MEMORY INTERACTION”, In Proceedings of the conference on empirical methods in natural language processing, pp.2886-2892, 2017.

Ye, H., Yan, Z., Luo, Z. and Chao, W., “DEPENDENCY-TREE BASED CONVOLUTIONAL NEURAL NETWORKS FOR ASPECT TERM EXTRACTION”, In Pacific-Asia Conference on Knowledge Discovery and Data Mining, Springer, Cham, pp.350-362, 2017.

Tulkens, S. and Van Crane burgh, A., “EMBARRASSINGLY SIMPLE UNSUPERVISED ASPECT EXTRACTION”, 2020. arXiv preprint arXiv:2004.13580.

He, R., Lee, W. S., Ng, H. T. and Dahlmeier, D., “AN UNSUPERVISED NEURAL ATTENTION MODEL FOR ASPECT EXTRACTION”, In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 388-397, 2017.

Wang, T., Cai, Y., Leung, H. F., Lau, R. Y., Li, Q. and Min, H., “PRODUCT ASPECT EXTRACTION SUPERVISED WITH ONLINE DOMAIN KNOWLEDGE”, Knowledge-Based Systems, 71, pp.86-100, 2014.

Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K. and Kuksa, P., “NATURAL LANGUAGE PROCESSING (ALMOST) FROM SCRATCH”, Journal of machine learning research, 12, pp.2493-2537, 2011.

Xu, L., Lin, J., Wang, L., Yin, C. and Wang, J., “DEEP CONVOLUTIONAL NEURAL NETWORKBASED APPROACH FOR ASPECT-BASED SENTIMENT ANALYSIS”, Advanced Science and Technology Letters, 143, pp.199-204, 2017.

Li, X. and Lam, W., “DEEP MULTI-TASK LEARNING FOR ASPECT TERM EXTRACTION WITH MEMORY INTERACTION”, In Proceedings of the conference on empirical methods in natural language processing, pp.2886-2892, 2017.

Wang, L., Liu, K., Cao, Z., Zhao, J. and De Melo, G., “SENTIMENT-ASPECT EXTRACTION BASED ON RESTRICTED BOLTZMANN MACHINES”, In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp. 616-625, 2015.

Yang, Y., Chen, C., Qiu, M. and Bao, F., “ASPECT EXTRACTION FROM PRODUCT REVIEWS USING CATEGORY HIERARCHY INFORMATION”, In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers, pp.675-680, 2017.

Domingos, P., “A FEW USEFUL THINGS TO KNOW ABOUT MACHINE LEARNING”, Communications of the ACM, 55(10), pp.78-87, 2012.

Qiu, G., Liu, B., Bu, J. and Chen, C., “OPINION WORD EXPANSION AND TARGET EXTRACTION THROUGH DOUBLE PROPAGATION”, Computational linguistics, 37(1), pp.9-27, 2011.




DOI: http://dx.doi.org/10.23755/rm.v44i0.909

Refbacks

  • There are currently no refbacks.


Copyright (c) 2022 Kamma Vidya, Gutta Sridevi, Dandibhotla Teja Santosh

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Ratio Mathematica - Journal of Mathematics, Statistics, and Applications. ISSN 1592-7415; e-ISSN 2282-8214.