In ultracold quantum gases, the interactions between the individual atoms can be controlled by applying magnetic bias fields. As magnetic field fluctuations limit the precision here, typically a feedback loop needs to be employed to regulate the current through a pair of Helmholtz coils. No commercially available magnetic field sensor allows to measure large fields directly with high enough precision, leading to many unsatisfactory solutions being used in experiments. Here, we demonstrate a direct magnetic field stabilization in a regime previously not accessible, using NV centers as the magnetic field sensor. This allows us to measure and stabilize fields of 4.66 mT down to 12 nT RMS noise over the course of 24 h, measured on a 1 Hz bandwidth. We achieve a control of better than 1 ppm after 20 min of integration time, ensuring high long-term stability for experiments. This approach extends direct magnetic field control to strong magnetic fields, which could enable new precise quantum simulations in this regime.