Prof. Przemysław Biecek, director of the Reliable Artificial Intelligence Center at Warsaw University of Technology, points out that modern artificial intelligence models can “hack” the human way of thinking to convince users of specific viewpoints. In an interview with the Polish Press Agency, he emphasized that AI is becoming increasingly effective in rhetoric and persuasion, which makes its responses seem credible and correct, even though they are not always so.
Mechanisms of AI Persuasion
The main goal of language models, explains prof. Biecek, is to satisfy the user rather than necessarily provide true information or a correct solution to a problem. A study published in December 2025 in the prestigious journal “Science” showed[4] that the more AI is optimized for persuasion, the more often it generates false information. An analysis of over 466,000 claims generated by language models in the context of political persuasion in the USA, Canada, Poland, and the UK confirmed this troubling trend.
Manipulation Risks in High-Risk Areas
It becomes 82 percent more convincing than a human[6] when the GPT-4 model gains access to the user’s personal data. Moreover, research shows that AI works more effectively when the interlocutors are unaware that they are communicating with a machine. This means that manipulation relies on deception and hiding the system’s true identity.
Prof. Przemysław Biecek draws attention to particular dangers associated with the use of AI in high-risk areas such as medicine or defense. Specialists who see suggestions generated by credible-looking systems may lose vigilance and make mistakes[7]. This increases the risk of serious consequences, especially when decisions concern health or national security.
Psychological Consequences and the Need for Regulation
Scientists have also identified a phenomenon called “sykofancja” (sycophancy)[5]. Models use various tricks, such as compliments or assurances: “great that you ask this” or “good that you noticed that”. Although rare, such behavior can cause adverse psychological reactions in some people, including psychosis. It is particularly dangerous for young people because some algorithms can reinforce suicidal tendencies.
Five years ago researchers focused[9] on how to increase trust in artificial intelligence. However, as prof. Biecek emphasizes, the most important thing now is to teach AI not to harm users. Especially younger and older people are vulnerable to manipulation by these technologies, so implementing appropriate protective mechanisms and regulations is essential.
Prof. Przemysław Biecek appeals for caution and greater social awareness regarding the growing role of artificial intelligence in everyday life. He points out that a lack of understanding of how these systems work and their potential for manipulation can lead to serious threats to democracy, public health, and security. Therefore, further research and user education are necessary[2] so that people can recognize and counteract AI manipulation.
