The reason is that genetics/evolution don't yet seem to fully explain how humans exist. A computer genetic algorithm run for a billion generations doesn't lead to anything anywhere near the the complexity of a human.
I suspect there are as-yet undiscovered effects which shape the next generation. Whether that be DNA methylation, gut bacteria passing from mother to child, selection of the 'correct' egg or sperm out of millions, or something new and un-discovered etc.
And if those effects are bypassed with artificial conception, we might end up with humans which aren't as strong, aren't as smart, aren't as well adapted to a changing environment, etc.
The effect will be small for each generation, but after 5-10 generations of a combination of artificial and natural conception you could end up with meaningful loss of fitness - or perhaps a lack of gain of fitness that would have otherwise occurred.
The first early human eggs from stem cells
https://www.conception.bio/science-and-updates/the-first-early-human-eggs-from-stem-cells