Our first approach relies on the usage of textbooks from specific domains of short answer grading.
we collect textbooks corresponding to the domains and chunk them into paragraphs and feed each paragraph as a document for pretraining.