My husband enjoyed teaching the most when he taught in the type of inner city school you describe. He had to commute two hours each way, but he loved it and was voted teacher of the year. He eventually moved to a closer school with a lot of helicopter parents and micromanagement, and he didn't like that as much. He retired when he turned 70.
Glad you have stuck with it, since the need for good, caring teachers is so great.