Generally, ITransF with sparse attention has slightly better or comparable performance comparing to dense attention.
knowledge bases suffer from incompleteness despite their formidable sizes (Socher et al., 2013;West et al., 2014), leading to a number of studies on automatic knowledge base completion (KBC) (Nickel et al., 2015) or link prediction.