Jenn,
The COE camp grounds are for the most part closed at the end of October. Some close earlier, like in the next week.
The state parks generally have a limited section open for camping. Electric is on, but not sure about water. I have had no problem finding camping in the middle of winter...