Al-Lu'lu Wal-Marjan 302 — The Book of Mosques and Places of Worship.

Al-Bara' bin 'Azib Narrated from:

Allâh's Messenger صلى الله عليه وسلم offered the Salât (prayer) facing Bait-ul-Maqdis for sixteen or seventeen months, but he loved to face the Ka'ba (at Makka) so Allâh تعالى revealed:"Verily! We have seen the turning of your (Muhammad's صلى الله عليه وسلم ) face towards the heaven." (V.2:144)So the Prophet صلى الله عليه وسلم faced the Ka'ba and the fools amongst the people namely "the Jews" said, "What has turned them from their Qiblah [prayer direction (toward Jerusalem — ( Bait-ul-Maqdis )] to which they used to face in Salât ?"(Allâh revealed): "Say, (O Muhammad ﷺ) 'To Allâh belongs both the east and the west. He guides whom he wills to a Straight Way.' " (V.2:142)A man offered Salât with the Prophet ﷺ (facing the Ka'ba) and went out. He saw some of the Ansâr offering the ' Asr prayer with their faces towards Bait-ul-Maqdis, he said, "I bear witness that I offered Salât with Allâh's Messenger ﷺ facing the Ka'ba." So all the people turned their faces towards the Ka'ba. ( Sahîh Al-Bukhârî, Hadîth No. 392, Vol. 1)