It will be incredibly fun to see the development of this!
My experience with Elevenlabs is that the voices created with cloning give better results.
I don't know why, but they feel more alive. But you need to have good sound quality on the voices you use to clone. But then you only need a...