According to the source, the US leader’s patience is "beginning to run out due to a lack of progress"