Text Topic Recognition of Offensive Comments Based on CoSENT and Improved K-means

Jian-fei CHEN , Fan-liang BU , Yi-fan WANG

Science Technology and Engineering ›› 2024, Vol. 24 ›› Issue (31) : 13442 -13449.

PDF
Science Technology and Engineering ›› 2024, Vol. 24 ›› Issue (31) : 13442-13449 DOI: 10.12404/j.issn.1671-1815.2309664
research-article
Text Topic Recognition of Offensive Comments Based on CoSENT and Improved K-means
Author information +
History +
PDF

Abstract

To quickly identify users' hot topics in offensive comment texts and solve the problems of insufficient semantic description, loss of contextual information, and weak topic coherence of traditional topic models when dealing with comment texts, as well as the sensitivity of K-value and initial centroid of K-means clustering algorithm. The CoSENT (cosine sentence) model was used in this paper to obtain sentence-level vector features of comment texts containing offensive language. An improved K-means algorithm based on Canopy +was used for class clustering on the vector-matrix after dimensionality reduction through the UMAP(uniform manifold approximation and projection) model. c-TF-IDF (class term frequency-inverse document frequency) was used to identify the thematic features of each thematic cluster for thematic modeling. The validity of the method is verified through experiments comparing the offensive comment text dataset as well as the ordinary comment dataset. The results show that the method in this paper can get better topic consistency.

Keywords

natural language processing / topic modelling / CoSENT / K-means

Cite this article

Download citation ▾
Jian-fei CHEN, Fan-liang BU, Yi-fan WANG. Text Topic Recognition of Offensive Comments Based on CoSENT and Improved K-means. Science Technology and Engineering, 2024, 24(31): 13442-13449 DOI:10.12404/j.issn.1671-1815.2309664

登录浏览全文

4963

注册一个新账户 忘记密码

References

Funding

PDF (2545KB)

18

Accesses

0

Citation

Detail

Sections
Recommended

/

〈 〉