I'm not an expert in anything to do with houses, but I think that it would look better with the brick painted or removed. The brick draws attention to its self rather than looking at the house as a whole....just my opinion though.
Your house has a nice shady feel to it and the shutters give it a charm![8)]