Yongzin Ngagi Wangchuk (1517-1554), the son of Lam Ngawang Choegyel and the great grandfather of Zhabdrung Ngawang Namgyel considered the place sacred as it was found to be associated with Goddesses Dorji Phagmo. A monastery was then built in 1546 with so many sacred relics being housed, which became his main seat until his death. Like Khothangkha, Trongsa, Jakar and Lhuentse, it also came to be known as Dzong and the appointment of Dzongpon came into being for several decades until Dzongpon Lhadar was killed by Phagidung Gyelpo Gawa and Kidlung Gyelpo Dharma Poenchen as narrated in the history of the Lhuendrup Rinchen Tse Dzong.

Since then, the Dzong has been reduced to mere temple which can still be seen today.