District sees declining numbers, especially at middle schools