LING 620: Topics in Prosody

LING 620
Topics in Prosody
Spring 2006

LOGISTICS

Instructor

Jiahong Yuan, jiahong@babel.ling.upenn.edu (Office hours: TBA)

Time and Location
Thursdays, 3:00 - 5:00pm, WMS 616

Grading
Grading will be based on a term project and class presentations.

Course webpage
http://ling.upenn.edu/courses/ling620/

SYLLABUS

Date Topics Readings Notes

Week 1 (1/12) Introduction and overview of the course.
[1] Nooteboom S., "The prosody of speech: melody and rhythm", pp. 640-673 of The handbook of phonetic sciences, (Hardcastle W. and J. Laver, ed.). Backwell, 1997.

Week 2 (1/19) The phonetics and phonology of tone.
[1] Yip, M., Tone, Chapter 1-3 (pp. 1-64). CUP, 2002.
[2] Xu, Y., "Understanding tone from the perspective of production and perception," Language and Linguistics 5: 757-797, 2004.

Week 3 (1/26) Intonation models.
[1] Hirst, D. and A. Di Cristo, "A survey of intonation systems", pp. 1-44 of Intonation Systems: A Survey of Twenty Languages. CUP, 1998.
[2] Ladd, D.R., Intonational Phonology, Chapter 1 (pp. 6-41). CUP, 1996.
[3] Taylor, P., "A review of phonetic modeling", Chapter 2 (pp. 6-58) of A phonetic model of intonation in English, dissertation, University of Edinburgh, 1992.

Week4 (2/2) Stem-ML prosodic modeling.
[1] Kochanski, G. and C. Shih, "Prosody Modeling with Soft Templates," Speech Communication, 39, 311-352, 2003.
[2] Kochanski, G. and C. Shih, "Modeling intonation: Asking for Confirmation in English," Proceedings of the 15th ICPhS, Bacelona, Spain, 2003.
[3] Yuan, J., C. Shih, and G. Kochanski, "Comparison of Declarative and Interrogative Intonation in Chinese,", Proceedings of Speech Prosody 2002, Aix-en-Provence, France, pp. 711-714, 2002.

Week 5 (2/9) Stem-ML modeling lab. No reading.

Week 6 (2/16) Perception of intonation.
[1] Ladd D.R. and R. Morton, The perception of intonational emphasis: continuous or categorical?, Journal of Phonetics, 25, 313-342, 1997.
[2] Makarova V., Perceptual correlates of sentence-type intonation in Russian and Japanese, Journal of Phonetics, 29, 137-154, 2001.
[3] Gussenhoven, C. and A. Chen, Universal and language-specific effects in the perception of question intonation, Proceedings of ICSLP 6, Beijing, China, pp. 91-94, 2000.
[4] Yuan J. and C. Shih, Confusability of Chinese Intonation, Proceedings of Speech Prosody 2004, Nara, Japan, pp. 131-134, 2004.

Week 7 (2/23) Emotion in speech.
[1] Cowie R. and R.R. Cornelius, Describing the emotional states that are expressed in speech, Speech Communication, 40, 5-32, 2003.
[2] Alter K., et al., Affective encoding in the speech signal and in event-related brain potentials, Speech Communication, 40, 61-70, 2003.
[3] Scherer, K.R., Vocal communication of emotion: A review of research paradigms, Speech Communication, 40, 227-256, 2003.

Week 8 (3/2) Prosody in discourse.
[1] Hirschberg J., "Pragmatics and intonation", pp. 515-537 of The handbook of pragmatics, (Horn L.R. and G. Ward, ed.). Backwell, 2004.
[2] Shriberg, E., et al., Can Prosody Aid the Automatic Classification of Dialog Acts in Conversational Speech?, Language and Speech, 41, 439-487, 1998.
Final project proposal due.

Week 9 (3/9) Spring break.
Week 10 (3/16) Focus.
[1] Krahmer E. and M. Swerts, On the alleged existence of contrastive accents, Speech Communication, 34, 391-405, 2001.
[2] Beaver D., et al., When Semantics Meets Phonetics: Acoustical Studies of Second Occurrence Focus, under submission, 2004.
[3] Féry C. and S. Ishihara, Interpreting Second Occurrence Focus, under submission, 2005.

Week 11 (3/23) Theme and rheme.
[1] Steedman M., Information Structure and the Syntax-Phonology Interface, Linguistic Inquiry 31, 649-689, 2000.
[2] Calhoun S., The Nature of Theme and Rheme Accents, manuscript, 2003.

Week 12 (3/30) Boundary-adjacent lengthening.
[1] Byrd D. and E. Saltzman, Intragestural dynamics of multiple phrasal boundaries, Journal of Phonetics, 26, 173-199, 1998.
[2] Byrd D. and E. Saltzman, The elastic phrase: Modeling the dynamics of boundary-adjacent lengthening, Journal of Phonetics, 31, 149-180, 2003.

Week 13 (4/6) Prosody variation. ICSLP paper submission due on 4/7.

Week 14 (4/13) Prosody in speech synthesis and recognition.

Week 15 (4/20) Final project presentations.

LOGISTICS
Instructor	Jiahong Yuan, jiahong@babel.ling.upenn.edu (Office hours: TBA)
Time and Location	Thursdays, 3:00 - 5:00pm, WMS 616
Grading	Grading will be based on a term project and class presentations.
Course webpage	http://ling.upenn.edu/courses/ling620/

SYLLABUS
Date	Topics	Readings	Notes
Week 1 (1/12)	Introduction and overview of the course.	[1] Nooteboom S., "The prosody of speech: melody and rhythm", pp. 640-673 of The handbook of phonetic sciences, (Hardcastle W. and J. Laver, ed.). Backwell, 1997.
Week 2 (1/19)	The phonetics and phonology of tone.	[1] Yip, M., Tone, Chapter 1-3 (pp. 1-64). CUP, 2002. [2] Xu, Y., "Understanding tone from the perspective of production and perception," Language and Linguistics 5: 757-797, 2004.
Week 3 (1/26)	Intonation models.	[1] Hirst, D. and A. Di Cristo, "A survey of intonation systems", pp. 1-44 of Intonation Systems: A Survey of Twenty Languages. CUP, 1998. [2] Ladd, D.R., Intonational Phonology, Chapter 1 (pp. 6-41). CUP, 1996. [3] Taylor, P., "A review of phonetic modeling", Chapter 2 (pp. 6-58) of A phonetic model of intonation in English, dissertation, University of Edinburgh, 1992.
Week4 (2/2)	Stem-ML prosodic modeling.	[1] Kochanski, G. and C. Shih, "Prosody Modeling with Soft Templates," Speech Communication, 39, 311-352, 2003. [2] Kochanski, G. and C. Shih, "Modeling intonation: Asking for Confirmation in English," Proceedings of the 15th ICPhS, Bacelona, Spain, 2003. [3] Yuan, J., C. Shih, and G. Kochanski, "Comparison of Declarative and Interrogative Intonation in Chinese,", Proceedings of Speech Prosody 2002, Aix-en-Provence, France, pp. 711-714, 2002.
Week 5 (2/9)	Stem-ML modeling lab.	No reading.
Week 6 (2/16)	Perception of intonation.	[1] Ladd D.R. and R. Morton, The perception of intonational emphasis: continuous or categorical?, Journal of Phonetics, 25, 313-342, 1997. [2] Makarova V., Perceptual correlates of sentence-type intonation in Russian and Japanese, Journal of Phonetics, 29, 137-154, 2001. [3] Gussenhoven, C. and A. Chen, Universal and language-specific effects in the perception of question intonation, Proceedings of ICSLP 6, Beijing, China, pp. 91-94, 2000. [4] Yuan J. and C. Shih, Confusability of Chinese Intonation, Proceedings of Speech Prosody 2004, Nara, Japan, pp. 131-134, 2004.
Week 7 (2/23)	Emotion in speech.	[1] Cowie R. and R.R. Cornelius, Describing the emotional states that are expressed in speech, Speech Communication, 40, 5-32, 2003. [2] Alter K., et al., Affective encoding in the speech signal and in event-related brain potentials, Speech Communication, 40, 61-70, 2003. [3] Scherer, K.R., Vocal communication of emotion: A review of research paradigms, Speech Communication, 40, 227-256, 2003.
Week 8 (3/2)	Prosody in discourse.	[1] Hirschberg J., "Pragmatics and intonation", pp. 515-537 of The handbook of pragmatics, (Horn L.R. and G. Ward, ed.). Backwell, 2004. [2] Shriberg, E., et al., Can Prosody Aid the Automatic Classification of Dialog Acts in Conversational Speech?, Language and Speech, 41, 439-487, 1998.	Final project proposal due.
Week 9 (3/9)	Spring break.
Week 10 (3/16)	Focus.	[1] Krahmer E. and M. Swerts, On the alleged existence of contrastive accents, Speech Communication, 34, 391-405, 2001. [2] Beaver D., et al., When Semantics Meets Phonetics: Acoustical Studies of Second Occurrence Focus, under submission, 2004. [3] Féry C. and S. Ishihara, Interpreting Second Occurrence Focus, under submission, 2005.
Week 11 (3/23)	Theme and rheme.	[1] Steedman M., Information Structure and the Syntax-Phonology Interface, Linguistic Inquiry 31, 649-689, 2000. [2] Calhoun S., The Nature of Theme and Rheme Accents, manuscript, 2003.
Week 12 (3/30)	Boundary-adjacent lengthening.	[1] Byrd D. and E. Saltzman, Intragestural dynamics of multiple phrasal boundaries, Journal of Phonetics, 26, 173-199, 1998. [2] Byrd D. and E. Saltzman, The elastic phrase: Modeling the dynamics of boundary-adjacent lengthening, Journal of Phonetics, 31, 149-180, 2003.
Week 13 (4/6)	Prosody variation.		ICSLP paper submission due on 4/7.
Week 14 (4/13)	Prosody in speech synthesis and recognition.
Week 15 (4/20)	Final project presentations.