Why desert sand & sea sand are not used in construction works?

In this video, the different reasons for not using the desert sand or sea sand in the construction works is explained.