Plan AF: AI Audiobook & Podcast

Text prep → voice selection → segmented recording → music & SFX → publish

Time
2-5 hours / 30-min episode
Cost
Medium
Difficulty
Advanced

Best for

For individuals and teams turning books, articles or topics into audiobooks, podcasts or spoken-word audio.

Steps

Text prep

20-30 min

ChatGPT / Claude

Convert the source into a spoken-style script: split into chapters, add paragraph markers, cut written-form language. Annotate emotion and pacing cues per paragraph for the TTS.

💡Keep each segment under ~30 seconds of speech so a bad take only needs one segment re-recorded.

Voice selection

20-30 min

ElevenLabs / Fish Speech

Preview 3-5 candidate voices and pick one that matches the content's tone. For Chinese, start with Fish Speech's stock voices; for long-form, prefer ElevenLabs.

💡Compare candidates reading the same opening line — don't choose from voice-list descriptions alone.

Segmented recording

1-2 hours

ElevenLabs / Fish Speech

Generate speech paragraph by paragraph and listen to each, fixing stress, phrasing and proper-noun pronunciation. Lock names and places in a pronunciation dictionary so the whole book stays consistent.

💡Fix unusual words in the dictionary before generating, or every segment will pronounce them differently.

Music & SFX

30-60 min

Suno + Descript

Use Suno for background music or intro/outro, keep it under about -20dB as a bed. Assemble segments in Descript with fades and pauses, and strip flubs and noise.

💡Duck the music side-chained to the voice so music steps aside when the narration speaks.

Publish

30 min

Podcast platform + Descript

Export a standard audio format, design a cover and title, upload to podcast platforms or distribution. Add chapter timestamps and a transcript so listeners can skip and search.

💡Ship one episode through the RSS and review flow first, then schedule the batch.

Tools involved

Pitfalls to avoid

Recording the whole book in one pass

Long-form TTS errors compound; segmenting lets you fix cheaply instead of expecting a one-shot master.

Voice that doesn't match the tone

The content decides the voice — audition first instead of chasing a trendy-sounding voice.

Music drowning the voice

Keep BGM low with voice priority; if you can't hear the narration, redo it.

Licensing and AI-voice disclosure

Platforms have rules for AI-generated speech; check them before publishing.

Related Workflows