The records of the Yao in China go back about 2000 years. In China, many Yao call themselves "Pan Yao", after their legendary ancestor and progenitor of the Yao race, Pan Hu or P'an Hung. Pan can be traced in historical Chinese records as far back as the 5th century AD. Later Chronicles tell the story of Pan Hu, the pet dog of Emperor Gao Xin (2435-2365BC) who killed his lord’s arch-enemy. The dog (now in human form!) was rewarded by marrying a young princess. Their descendants, known as the race of Pan Hu, became the forefathers of the Yao. They were given a charter that granted them tax benefits.  Copies of this document, called the King Ping Charter, still exist today.  Later rulers forgot about this charter.  Refusal to pay taxes led to the persecution of the Yao and their diaspora throughout SE Asia.

An interesting tradition held by some of the Kim Mueng group (now living in Lao Cai Province) is that they left China by boat, landed in Haiphong, and then travelled up the Red River to the Yen Bai area.  Some stayed there, but most went on to Lao Cai.  This event is called "The Sea Journey."  This tradition and many others are recorded in many ritual books and scrolls kept by the Yao.

Most Yao are said to have fled China to Vietnam in the late 1700s. Seven Yao subgroups live in all six provinces that lie along the north VN/China border.