[@Smink] Google tells me that Oxy- derives from a Greed word for acridity or sharpness of taste, which actually parallels nicely to the Afrikaans word for the element. 'Suurstof', sour dust.

It looks like early chemists mistook the key element in acids to be Oxygen as opposed to Hydrogen, and named accordingly.