"And we will go with them, or without them. But we won’t have people shooting at us," US President said