What is cheaper...quartz counter tops or granite? What is the difference?
The river sand contains minerals other than silica/quartz and these other minerals are weakening your mortar. You should stick with quartz silica sand... there will be no disadvantages with it.