The Duke of Sussex has said the unity shown by his Invictus Games family can counter divisions based on politics or nationality after visiting his father the King.