An efficient conversational smart compose system

1Citations
Citations of this article
7Readers
Mendeley users who have this article in their library.

Abstract

Online conversation is a ubiquitous way to share information and connect everyone but repetitive idiomatic text typing takes users a lot of time. This paper demonstrates a simple yet effective cloud based smart compose system to improve human-To-human conversation efficiency. Heuristics from different perspectives are designed to achieve the best trade-off between quality and latency. From the modeling side, the decoder-only model exploited the previous turns of conversational history in a computation lightweight manner. Besides, a novel phrase tokenizer is proposed to reduce latency without losing the composing quality further. Additionally, the caching mechanism is applied to the serving framework. The demo video of the system is available at https://youtu.be/U1KXkaqr60g. We opensourced our phrase tokenizer in https:// github.com/tensorflow/text.

Cite

CITATION STYLE

APA

Zhu, Y., Chen, X., Shu, L., Tan, B., Song, X., Liu, L., … Ruan, N. (2023). An efficient conversational smart compose system. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (Vol. 3, pp. 456–462). Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/2023.acl-demo.43

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free