Motivated by the phenomenology of MOND, we propose a theory based on a fundamental non Abelian Yang-Mills gauge field with gravitational coupling constant (a "graviphoton") emerging in a regime of weak acceleration, i.e. below the MOND acceleration scale. Using the formalism of the effective field theory and invoking a mechanism of gravitational polarization of the dark matter medium, we show that generic solutions of this theory reproduce the deep MOND limit without having to introduce in an ad hoc way an arbitrary function in the action. In this framework, MOND is due to the existence of a new sector of the standard model of particle physics. Furthermore, the model involves a fundamental violation of the local Lorentz invariance in the low acceleration regime. We show how to restore the general covariance of the model by adding one gravitational degree of freedom in the form of the scalar Khronon field.