"Oh hell, no!" Hannah Brown said her dad, Robert, said at the thought of his daughter getting back with her ex