Furthermore, chart reviews require specialized medical knowledge to be meaningful, and patient privacy concerns prevent the sharing of documents from a patient's EHR.
in our work, crowd-sourcing relevance judgments was not an option; rather, we have employed intra-institutional medical experts to take on the costly step of chart review to make patient-level relevance judgments.