Building Scalable Large-scale Distributed Function-dependent Discovery Platform (SmartFD) of Education Short Videos

Abstract

In the era of big data, the fragmentation of communication has facilitated the birth of short videos. With its "simple and concise" audio-visual language and unique narrative, short videos cater to the audience's viewing needs and thus have developed rapidly and accumulated huge data information. Big data technology is the underlying technology module of short video platform algorithm recommendation and is also the technical basis of short video communication. Therefore, this paper proposes an efficient and scalable large-scale distributed function-dependent discovery algorithm SmartFD, which provides a technical basis for the application of big data technology in short video communication from the underlying logic of the algorithm.