It's always nice to have people compliment your vehicle. If your car doesn't get tons of looks, turn heads, etc. who really cares? My enjoyment doesn't depend on the opinions of other people and neither should yours.
Enjoy the relative rarity of the Challenger for now but in a few years it's going to be a much more common sight on the road.