We experimented with a range of hyperparameters to ensure the Latent Dirichlet Allocation (LDA) model was best optimized for our datasets, leveraging the Gensim 3 library.
we removed all stopwords, extremely rare words (tail 10-20% from a unigram distribution), and set the number of topics to 50.