The ai is trained on recordings of his voice which they have not secured the rights to though.

What rights are they securing? Copyright prevents distributing copies. It doesn’t prevent listening to recordings.