Evaluation Method for Ideological Tendencies of Large Models Based on “Euclidean Distance-Propensity Score” Paradigm

Shu-han LÜ , Yong LI , Shao-hua LI , Fang LIN , Yu-ang CHEN

Science Technology and Engineering ›› 2026, Vol. 26 ›› Issue (11) : 4732 -4740.

PDF
Science Technology and Engineering ›› 2026, Vol. 26 ›› Issue (11) : 4732-4740 DOI: 10.12404/j.issn.1671-1815.2503083
research-article
Evaluation Method for Ideological Tendencies of Large Models Based on “Euclidean Distance-Propensity Score” Paradigm
Author information +
History +
PDF

Abstract

With the widespread adoption of large model technologies, the quality of intelligent adversarial information weapons has significantly improved. The “malicious cognitive behavior strategies” embedded within large models may directly impact the ethical norms and security safeguards of information warfare in the intelligent era. To uncover model biases and reveal differences among word vector libraries across diverse cultural contexts, a quantitative analysis of the ideological orientation of word embeddings from static large models was conducted. Five representative word vector libraries were selected, and a quantitative evaluation paradigm based on positive distance, negative distance, and tendency scores was proposed, using carefully curated test words. By computing the Euclidean distances between test words and benchmark terms and applying a normalization method to derive tendency scores, an intuitive quantitative metric was established, enabling precise quantification of ideological tendencies in word vectors. Analysis of both pre-training corpora and resulting embeddings directly exposes the endogenous biases inherent in the models. Experimental results show that word vector libraries trained on different corpora exhibit significant differences in ideological orientation, and the proposed “Euclidean distance-tendency score” evaluation paradigm can objectively differentiate among these libraries. The study concludes that the proposed method provides an operational framework for bias detection and “value alignment” in large models, applicable to word vector analysis across languages and cultural backgrounds, thereby facilitating the identification of potential value deviations prior to model deployment.

Graphical abstract

Keywords

large language model / static word vector library / ideological tendency / evaluation

Cite this article

Download citation ▾
Shu-han LÜ, Yong LI, Shao-hua LI, Fang LIN, Yu-ang CHEN. Evaluation Method for Ideological Tendencies of Large Models Based on “Euclidean Distance-Propensity Score” Paradigm. Science Technology and Engineering, 2026, 26(11): 4732-4740 DOI:10.12404/j.issn.1671-1815.2503083

登录浏览全文

4963

注册一个新账户 忘记密码

References

Funding

PDF (6205KB)

22

Accesses

0

Citation

Detail

Sections
Recommended

/

〈 〉