DEVELOPMENT OF A VIRTUAL TEST STAND AND RESEARCH OF DATA STREAM DEDUPLICATION METHODS USING THE EXAMPLE OF TELECOM OPERATOR EVENTS

Potapov Ilya

When designing and developing services, there are situations when the incoming data stream may contain duplicates. This may occur due to various reasons, which is the cause of errors in the interpretation of information. This paper discusses various methods for finding duplicate messages in a data stream, and the development of a virtual test stand to test these methods.

Keywords:deduplication; load; performance; kafka; cassandra; testing; development; cluster