The authors propose several probing tasks and divide them into those pertaining to surface, syntactic and semantic phenomena.
we decide to discard the 'syntactic versus semantic' distinction and consider all tasks either surface (see Section 3.1) or compositional (see Section 3.2).