Speech-to-Song Illusion Project

Can speech ever sound like song?

Seemingly impossible, the “Speech-to-Song illusion” (S2S) is a striking example of a perceptual transformation effect where a spoken phrase repeated several times shifts to being heard as sung without any change to the speech sounds. Our previous work revealed that sound acoustics play a crucial role in S2S. While the acoustic shape of the spoken phrase has to remain unchanged during repetitions, some pitch and timing properties of the phrase are more supportive of the perceptual transformation than other. For example, compare tracks of the fundamental frequency on the left (flat) and on the right (dynamic). They both show the same spoken phrase, “Ducks can fly”. However, the phrase on the left is likely to transform into song quicker and easier for most people.

Listen: “Ducks can fly”

The same phrase with a flat and with a dynamic pitch track. Switch on repeat and listen to each one several times in a row.

F0 track of “Ducks can fly” with flat pitch on each word
Flat
F0 track of “Ducks can fly” with rising and falling pitch on each word
Dynamic

History

S2S was coined by the psychologist Diana Deutsch who included a looped phrase “but they sometimes behave so strangely” on her CD, “Phantom Words and Other Curiosities” (published in 2003). Although this phenomenon has been well known to musicians for a long time (cf. works by Steve Reich and others), it has started to attract researchers’ attention over the last decade, with recent publications from linguistics and psychology increasing in numbers.

The project

Most listeners, regardless of their musical skills and training, are likely to experience a transformation from speech to song during the third repetition of the phrase. There is, however, a lot of individual variability in S2S. Some people never perceive song after listening to a loop, some people always do. Our project examines the role of the individual perceiver in S2S, and studies which characteristics may predict listeners’ experience.

Research team

We have been fascinated by this speech-to-song effect for a long time. Our team combines the expertise from music psychology (Prof Simone Dalla Bella), neurolinguistics (Prof Simone Falk) and speech prosody (Prof. Dr. Tamara Rathcke).

The British Academy

The project was supported by a BA/Leverhulme Small Research Grant to Prof. Dr. Tamara Rathcke (SG152108).

Publications

Conference presentations

S2S database

In this project, we have created a database containing 60 sentences in two prosodically dissimilar languages, English and French. The sentences were produced by a male and female speaker in each language, and looped with 10 repetitions following the design of our previous studies. 120 out of 240 stimuli that we created, have been rated for their S2S-susceptibility by 40 native listeners in each language. This resource will soon be freely available to all interested researchers.

Here are examples of a high-transforming and a low-transforming sentence in each language. You can listen to the sentences looped, and see if you perceive the effect.

RecordingHigh-transformingLow-transforming
English, single
English, looped
French, single
French, looped

To register your interest in using S2S database, please contact Prof. Dr. Tamara Rathcke.