We address the problem of embedding entities into Euclidean space over time based on co-occurrence data. We extend the CODE model of [1] to a dynamic setting. This leads to a non-standard factored state space model with real-valued hidden parent nodes and discrete observation nodes. We investigate the use of variational approximations applied to the observation model that allow us to formulate the entire dynamic model as a Kalman filter. Applying this model to temporal co-occurrence data yields posterior distributions of entity coordinates in Euclidean space that are updated over time. Initial results on per-year co-occurrences of authors and words in the NIPS corpus and on synthetic data, including videos of dynamic embeddings, seem to indicate that the model results in embeddings of co-occurrence data that are meaningful both temporally and contextually. © Springer-Verlag Berlin Heidelberg 2007.
CITATION STYLE
Sarkar, P., Siddiqi, S. M., & Gordon, G. J. (2007). Approximate Kalman filters for embedding author-word co-occurrence data over time. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 4503 LNCS, pp. 126–139). Springer Verlag. https://doi.org/10.1007/978-3-540-73133-7_10
Mendeley helps you to discover research relevant for your work.