There are multiple proposals for "subconscious intrinsic evaluation" (Bakarov, 2018) based on correlations with psycholinguistic data such as N400 effect (Van Petten, 2014;, fMRI scans (Devereux et al., 2010;Søgaard, 2016), eye-tracking (Klerke et al., 2015;Søgaard, 2016), and semantic priming data (Lund et al., 1995;Lund and Burgess, 1996;Jones et al., 2006;Lapesa and Evert, 2013;Ettinger and Linzen, 2016;Auguste et al., 2017).
as for the extrinsic tasks, the immediate observation is the low correlation between all the intrinsic and 3 sequence labeling tasks.