Madhevendra Puri accepted only that food, which was offered to him. But, he was not offered Kshira and thus he did not find its taste and left the temple. When the Pujari (priest) slept after the daily worship of Lord Krishna or Sri Gopinath, then Sri Gopinath told the Pujari in his dream to get up and carry the Kshira, which was hidden by the God himself under his garments forMadhvendra Puri. The pujari got the Kshira under the garment of God and carried it to Madhvendra Puri. As it was hidden by Sri Gopinath himself and thus, the place began to be known as Khirachora Gopinatha. Madhvendra Puri stayed for some time here in an Ashram; established by him. The sandalwood brought by him is worshipped by Pujaris these days.

Sri Chaitanya Mahaprabhu came and worshipped Lord Gopinath, while he was doing so; the flowers from the body of Deity fell on the head of Chaitanya. The latter took this as a sign of being blessed by the Lord Gopinath and he danced with joy. Panchalingeswar to Khirachora Gopinath Distance is 27 km

(Source)