Hello Robert,
I'm not actually sure to understand the procedure you're following, but to disable read aloud in a page, just go to the page inspector and disable "Enable Read Aloud", then click "OK" in the window that asks if you want to cleanup, as shown in the image below.

Don't worry if the audio files are still there after that, you can safely remove them from your project but, anyway, they won't be included in the export if they're not used.