We provide conclusive evidence that organic ligands used to coat CdSe quantum dots (QDs) have a fundamentally important effect upon their magnetic properties. Using x-ray absorption spectroscopy, magnetometry and x-ray magnetic circular dichroism, we demonstrate that the choice of organic ligand can be used to tune the magnetic properties. Moreover, our results suggest that a π-backbonding mechanism between the surface Cd atoms and the organic surfactants is responsible for the magnetic behavior of the QDs and that, contrary to previous reports, they exhibit paramagnetic and not ferromagnetic behavior. The potential impact of this research in the field is considerable with the possibility of the development of new and exciting magneto-optic luminescent nanostructures.