We understand the serious risks associated with creating speech that mimics real voices, especially during an election year. We are collaborating with partners from various sectors such as government, media, entertainment, education, and civil society to gather feedback and ensure responsible development.
The partners currently testing Voice Engine have agreed to abide by our usage policies, which prohibit unauthorized impersonation of individuals or organizations. They are also required to obtain explicit consent from the original speaker and disclose to their audience that the voices they hear are generated by AI. Additionally, developers are not permitted to enable users to create their own voices.
We have implemented safety measures like watermarking to track the source of any audio produced by Voice Engine and actively monitor its usage. We believe that widespread use of synthetic voice technology should include voice authentication processes to confirm the speaker’s consent and a mechanism to prevent the creation of voices resembling well-known figures.