Why do so many houses with exterior stone look bad? Bottom line, you must choose your stone or brick first, and then you can coordinate the rest of your exterior finishes to relate.