Since the intention is to measure the student's reading ability, any difference in performance that is not due to reading ability confounds the measurement.
since comprehension complexity of a passage is known to impact reading comprehension, it seems reasonable to assume that it would also impact other aspects of reading skill, including oral reading fluency.