Fresh trade deals will be difficult to negotiate, the former British Prime Minister said.