Here ( San Diego ) the water department publishes their water quality lab report to all consumers. They do tests at numerous distribution points around the city, and publish all the statistics.
It would be surprising if your city was overchlorinating, since that costs money, but in any event, they should tell you exactly what you have.
I do not personally recommend whole-house dechlorination filtering, because now you have the potential for "things" to "grow" inside your house piping. If chorine is an issue, you could do a drinking water filter system, and even a shower head chorine filter. This is what I do in my house.