Vocal patterns

Control of articulatory speech synthesis seems a lot like a very technical choreographic language.

From the example here: Articulatory synthesis

  1. To set the glottis to a position suitable for phonation, use the ArtwordEditor to set the Interarytenoid activity to 0.5 throughout the utterance. You set two targets: 0.5 at a time of 0 seconds, and 0.5 at a time of 0.5 seconds.
  2. To prevent air escaping from the nose, close the nasopharyngeal port by setting the LevatorPalatini activity to 1.0 throughout the utterance.
  3. To generate the lung pressure needed for phonation, you set the Lungs activity at 0 seconds to 0.2, and at 0.1 seconds to 0.
  4. To force a jaw movement that closes the lips, set the Masseter activity at 0.25 seconds to 0.7, and the OrbicularisOris activity at 0.25 seconds to 0.2.

It makes this sound:

Then the weird thing is if you mimic the sound you’re following the same program!

3 Likes

Moving this to its own thread… I guess patterns don’t get more visceral than the voice?

I love the patterns in Kurt Schwitters sound poem the Ursonate as it repeats and grows
http://www.costis.org/x/schwitters/ursonate.htm

Modelling control of the vocal tract is notoriously difficult…

and so much fun…

1 Like

The 1939 voder video linked at the bottom of the voder website is definitely worth a watch:

The interface reminds me of a stenographers keyboard (could it be one?)

Yes that reminds me of this that you posted elsewhere:

I like to link to Canntaireachd too:

https://www.ubu.com/ethno/soundings/masters.html

The mp3s in the above are the wrong way around, the first is the bagpipes and the second is the Canntaireachd oral instruction. I think if you listen to the bagpipes, then the oral instruction, then the bagpipes they sound a lot more accessible and interesting the second time!

1 Like

Have you ever played with this nifty little thing-
https://dood.al/pinktrombone/

1 Like

I’ve spent a great deal of time with Pink Trombone, and adapted my own version based on the underlying DSP: https://pbat.ch/proj/voc/

The underlying patterns here are in the various vocal tract shapes used to produce different phonemes. There are 44 discrete diameter sizes that can be adjusted in individual ways to produce target phonemes.

I turned a simplified version of Voc into a little android instrument to demonstrate how one can sculpt the virtual tract to produce different sounds. What’s interesting to me is that because it’s only 44 diameters, you can see them on screen, like some kind of low-res art:

2 Likes

I hooked @pbatch’s port of pink trombone up to tidalcycles for some patterning:

(I accidentally recorded from my webcam mic rather than straight from the synth)

1 Like