One frequently resorts to largely qualitative evaluation: checking whether the conclusions reached via a particular approach have face validity and match pre-existing intuitions.
pre-existing intuitions are often not reliable when it comes to complex neural models applied to also very complex natural language data.