Evaluation of Text Entities for Redundancy Detection on Written and Multimedia Contents

Abstract

This study focuses on the determination of intrinsic and extrinsic redundancy on text entities for the study of information replication. Redundancy presumes on the one hand that different entities behave in the same way when we talk about software and on the other hand, it contains the same information when we talk about data structures. Text entities are practically large data structures that have been formally evaluated. Nowadays, while taking into account the ethics in the utilization of information technology, it is essential to establish whether a certain number of texts, written or listened to, contain similar ideas, which may not be appropriated ethically. Actions should be taken such as the addition, modification, or deletion of data according to the results of the evaluation procedure. The evaluation procedure should be done either partially or completely in an automatic way, technology allowing both methods. This study intends to present a way to proceed in the evaluation of content, by implementing a set of metrics on text entities, which have to lead to the evaluation conclusion, should any modifications or updates be necessary to achieve a level of desired originality.