While you will need to live in a warm area to grow olive trees outside all year round, potted olive trees can always thrive indoors in cooler climates. There