Conference material: "Scientific service & Internet: proceedings of the 21th All-Russian Scientific Conference (September 23-28, 2019, Novorossiysk)"
Authors:Begen P.N., Chugunov A.V.
Intellectual classifier development of citizens' messages on the «Our St. Petersburg» portal: experience in using machine learning methods
Abstract:
Functional features are investigated and shortcomings in the existing process of sending messages about city problems on the portal «Our St. Petersburg» are revealed. The approach to the development of automatic classification of citizens ' messages by existing on the portal categories is described. Based on the reports submitted by citizens in the amount of 1.5 million, training and test samples were formed in the ratio of 80% and 20% of the main volume of texts, respectively. Based on the training data sample and 194 categories, the algorithm of automatic classification was trained using such classical methods of machine learning as naive Bayes classifier, decision trees and artificial neural networks. Using the method of determining the effectiveness of the classification and the test sample, the trained algorithm was tested and checked. The analysis revealed that the algorithm based on the use of artificial neural networks shows the best result among the other methods used. The average classification accuracy of the algorithm was 82%. The trained algorithm was used in the development of an intelligent classifier, which is a web application and implements API mechanisms for interaction with the main modules of the portal information system.