We compute cosine similarity of the key-terms defined for each selected topic and topics discovered by the topic models over the years.
the lower bound on the log likelihood of the data takes the form: Year 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 total  ACL  58  73  250  83  79  70  177  112  134  134  307  204  214  243  270  349  227  398  331 3713  EMNLP  15  24  15  36  29  21  42  29  58  28  75  132  115  164  125  149  140  206  228 1756  ACL+EMNLP  73  97  265  119  108  91  219  141  192  162  382  336  329  407  395  498  367  604 559 5469  (Hinton et al., 2006), adding an extra layer improves lower bound on the log probability of data, we introduce the extra layer via RSM biases that propagates the prior via RNN connections.