Application of text mining technology for comparative analysis of trends in the field of competition

Abstract

Object: The main purpose of this article is to analyze the competition in the works of scientists to identify positive
and negative trends, as well as characteristic trajectories, by creating and applying a text mining program in python.
Methods: For this study, we used modern methods of word processing, in particular text mining. We used python
programming language and software MS Excel. We used data from the official website of the Wiley Online Library at
https://onlinelibrary.wiley.com/
Findings: The rapid development of modern technologies, Internet applications is accompanied by the generation
of large amounts of data, the timely processing of which is today one of the main problems in various spheres of life —
social, economic, political, and others. In solving this global problem, modern methods of processing text information,
the so-called text mining technologies, come to the rescue. These tools allow to increase the efficiency of solving problems of different levels. The algorithms embedded in the text mining technology reveal the basic concepts of the text,
the content and the relationship between them.
The integration of modern text mining systems and Python programming language makes it possible to conduct
research in the field of text analysis and processing. These systems, using statistical methods, process the rating of news
documents, materials of scientific documents, blogs, tweets, emails, advertisements and other information. The main
task of text analysis is to get a clear idea about the topics of interest, to extract important information. For the analysis
of texts, 600 articles from Wiley Online Library in English in PDF format were selected, including information on
trends in the business and competition for 1993–2023.
Conclusions: We have found that over the past 30 years, scientists who have written works in the field of competition mainly raised the problems of market, price, research, creativity, industry and others. There was also a huge increase in the study of consumers, innovations and products. The highest growth was associated with the word platform,
which was found in the 1993–1998 compilation only 11 times, but in the 2019–2023 compilation the same word was
used 4199 times, which showed an increase of more than 38,000 %.