Advocates worry the federal government would not look out in the same way for poor students, those still learning English, disabled students and more.