Heather,
You certainly have the right answer here -- case-by-case. And I agree with your premise that if the nondisabled student knows the material, all the extra time in the world won't make a difference. Just keep in mind that for a disabled student who knows the material, the extra time provides a real opportunity to demonstrate that learning.
Dr. Jane Jarrow