A method of accelerated fake news recognition based on natural language processing and removal of vowels in words

Abstract

News web resources are gaining more popularity these days. Such sources of information can use the trust of the audience to manipulate facts and spread fakes. Thus, protection against such resources is a huge challenge today.

The most important part of any software is its speed. Fakes appear every day, but today there are no automatic fact-checking systems. All checks are done by journalists or by semi-automated systems that are either specific to small tasks or too slow. Therefore, this article proposes a fact-checking method using NLP and Levenshtein algorithm. At the same time, the method offers accelerated text analysis, making calculations with the minimum value of the vector representation of words. This was achieved at the level of NLP lemmatization by removing vowels from words.

In our time, the topic is studied quite deeply. But most research focuses on using NLP technology for natural speech analysis in specific fields such as text search, bots, text markup, etc. In addition, the reduction of the vector representation of words for accelerated text analysis and structuring of its tokens was not considered.

The main task of the research is to develop an effective forgery detection system using Natural Language Processing technology, which shows the result quite quickly by reducing the length of words, and not based on the previous training of the system.

The paper proves the ability of NLP technology to solve the task of fact checking. However, there are still several directions for further work. For example, using a learning neural network to detect the most common forgeries or investigating the occurrence of collisions in the vector representation of words without vowels.