Oliver being forced to say goodbye to his children