Garrison Brown has been a part of the Sister Wives show since the beginning. He was an integral member, and viewers loved watching him