"It's fairly clear that both the government and Canadians in general have lost confidence in the leadership at Hockey Canada. And the longer it takes for Hockey Canada to realize that, the more difficulties they're going to face," Trudeau said at Rideau Hall on Wednesday