AI narration
As a temporary experiment, I am using language models to generate scripts for some articles on this site, then generating narration of those scripts with modern text-to-speech synthesis.
If you want to read the text version of the script that was used to generate
audio, replace .opus with .txt in the url of the audio file.
Why
I know some readers wish they could listen to articles – particularly the longer ones – while they’re doing other things. I cannot take the time to do a proper spoken version myself, nor can I afford to pay someone else to do it. So when I heard from one reader that they did it this way, I figured I might try offering that to everyone who is interested.
This is so, so awkward for me, because the results, as you can hear, are nowhere near the level of quality I would prefer.1 Role adherence is bad, intonation is off, pacing is stiff, etc. Even frontier tts models occasionally generate words with weird artifacts. But even with the crappiness of the outputs of these models, they may be better than nothing. People who prefer quality (or reading) can still read the original article and ignore the experiment.
The obvious way to generate a spoken version would be a plain text-to-speech reading of the original article. I actually use that when I self-edit2 Some issues are easier found when one hears someone else read the words as written., but they are a terrible listening experience in general. The articles on this site are written to be read. They include code, plots, equations, tables, and I expect readers to jump back and forth and cross-reference as they read. Not possible in the more linear format of sound.
An earlier iteration of this experiment used a fake podcast format with two hosts discussing the article. The good thing about that format is that it gives the tts model some additional intonation clues, and it hides some voice inconsistencies between turns by the same virtual speaker. However, your feedback was clear enough in that you prefer to listen to a straighter reading, so that’s what I’m trying going forward.
Would like feedback
I’d much appreciate feedback on this experiment, so I know if it’s something I should bother keeping up with. I’m primarily interested in hearing from people who like listening to technical stuff: are the straight(er) readings of articles useful to you? If yes, why? If not, why not? Would you want me to go back to the fake podcast format?
If you have experience in this area and know of ways I could improve this, I’d love to hear more from you as well.
Comments
: Kyle Williams
I noticed this experiment today while reading your latest article. To be brief: I don’t think it sounds very good. The podcast format especially, which in its script is completely detached from you, just feels super weird. I enjoy listening to technical podcasts (Experimental History, the Replacing Guilt audiobook, and – in another life – the twit network), but this doesn’t hit the same. It comes off as way too corporate.
It’s a shame you can’t narrate the podcast yourself, but I don’t think having the computer do it for you is an appropriate compromise; I’d say you shouldn’t bother with putting more slop out into the world. But hey, that’s just me.
(Kyle doesn’t blog himself, but has a website none the less.)