Negotiations towards Brexit should be cross-party