Probably, one of the most interesting and potentially useful applications of findings regarding the links between music and emotions is concerned with neurosciences and clinical
psychology. Recent functional imaging experiments (fMRI), using chord sequences
originally aimed at investigating the processing of musical structure, have shown activations of the orbital frontolateral cortex (OFLC) in response to unexpected chords. The orbitofrontal cortex is one of the least explored and least understood cerebral regions. Clinical evidence suggests that the orbitofrontal cortex is implicated in critical human functions such as mood control, social adjustment, drive and responsibility; characteristics that are decisive in the development of the personality of an individual.
Not only music but also audiovisual stimuli could be used to further inspect this brain structure, and interactive audiovisual tools may have a promising application in the psychopathology field. More specifically, within a disorder of affect regulation called alexithimia. Alexithimia is a subclinical phenomenon characterized by a reduced ability to identify and describe one’s feelings, difficulty in distinguishing feelings from the bodily sensations of emotional arousal and impaired symbolization, along with a tendency to focus on external events rather than inner experiences. Alexithimia has been reported as a
paradigmatic personality problem among psychosomatic disorders. Additionally, studies have shown that alexithimia regularly co-occurs with other severe psychopathologies such as autism, post-traumatic stress disorders, anorexia, bulimia, major depressive disorder and in substance abusers.
Still images have been historically employed for psychopathological diagnosis (TAT, Rorschach, etc.); and in the particular case of alexithymia, studies have shown correlation between this disorder and a lack of ability to recognize emotions in photographs of facial expressions. So far, the diagnosis of alexithimia has relied only on questionnaires (e.g. Toronto Alexithymia Scale - TAS); however, the findings covered through this thesis show that audiovisual interactive media could also be a very helpful tool for these purposes. Thus it is hoped that the work developed for this thesis will contribute to future research into the exploration of interactive media tools not only for diagnostic but also for therapeutic objectives.
B
IBLIOGRAPHYAnsermet, E. (1961). Les fondements de la musique dans la conscience humaine. Neuchâtel: Delachaux et Niestle.
Bharucha, J.J. (1984). Anchoring effects in music: The resolution of dissonance. Cognitive Psychology, 16, 485-518.
Bartlett, F. C. (1932). Remembering. London: Cambridge University Press.
Bigand, E., Parncutt, R., & Lerdahl, F. (1996). Perception of musical tension in short chord sequences: The influence of harmonic function, sensory dissonance, horizontal motion, and musical training. Perception & Psychophysics, 58, 125–141.
Bigand, E., & Parncutt, R. (1999). Perception of musical tension in long chord sequences. Psychological Research, 62, 237-254.
Blood, A.J., R.J. Zatorre, P. Bermudez & A.C. Evans. (1999). Emotional responses to pleasant and unpleasant music correlate with activity in paralimbic brain regions. Nat. Neurosci. 2: 382–387.
Blood, A. & R.J. Zatorre. (2001). Intensely pleasurable responses to music correlate with activity in brain regions implicated in reward and emotion. Proc. Natl. Acad. Sci. 98: 11818–11823.
Bolivar, V.J., Cohen, A.J. and Fentress, J.C. (1994/96). Semantic and formal congruency in music and motion Pictures: Effects on the interpretation of visual action.
Psychomusicology, 13, 28-59.
Boltz, M. G., Schulkind, M., & Kantra, S. (1991). Effects of background music on the remembering of filmed events. Memory & Cognition, 19, 593-606.
Boltz, M. G. (2001). Musical Soundtracks as a Schematic Influence on the Cognitive Processing of Filmed Events. Music Perception, 18, 427-454.
Brewer,W. F. (1980). Literacy,theory, and rhetoric: Implications for psychology. In R. J. Spiro, B. C. Bruce, & W. F.Brewer (Eds.), Theoretical issues in reading comprehension: Perspectives from cognitive psychology, linguistics, artificial intelligence, and education. (pp. 221-239). Hillsdale, NJ: Erlbaum.
Brown, R.S. (1994). Overtones and undertones: Reading film music. Berkeley: University of California Press.
Bullerjahn, C. (1997). Theories and experiments about the effects of film music. Hannover, Germany: Unpublished doctoral dissertation, Academy of Music and Performing Arts. Bullerjahn, C. (in press). Principles of the effects of film music. Augsburg, Germany. Bullerjahn, C. and Güldenring, M. (1994/96). An empirical investigation of effects of film
music using qualitative content analysis. Psychomusicology, 13, 99-118.
Chion, Michel (2005). L´Audio-Vision. Son et image au cinéma. [N.p.]: Nathan. English edition, edited and translated by Claudia Gorbman, as Audio-Vision: Sound on Screen (New York: Columbia University Press, 1994).
Costère, E. (1954). Lois et styles des harmonies musicales. Paris: Presses Universitaires de France.
Cycling ’74 Max/Msp/Jitter. Interactive visual programming environment for music, audio, and media. http://cycling74.com/products/maxmspjitter/
DeWitt, L.A. & Crowder, R.G. (1987). Tonal fusion of consonant musical intervals. Perception & Psychophysics, 41, 73-84.
Dowling, W.J., & Harwood, D.L. (1986). Music cognition. Orlando: Florida Academic Press. Eberlein, R. (1994). Die Entstehung der tonaler Klangsyntax. Frankfurt: Peter Lang.
Essl, K. & others (2010). RTC-lib: Real Time Composition Library for Max/MSP/Jitter. Software library for algorithmic composition in Max/MSP/Jitter.
Firmino, E. A., Bueno, J. L. O., & Bigand, E. (2009). Travelling through pitch space speeds up musical time. Music Perception, 26(3), 205-209.
Forte, A. (1973). The Structure of Atonal Music. Yale University Press.
Frijda, N. H. (1993). The place of appraisal in emotion. Cognition and Emotion, 7, 357–387. Gosselin, N., I. Peretz, M. Noulhiane, et al. (2005). Impaired recognition of scary music
following unilateral temporal lobe excision. Brain 128: 628–640.
Hashimoto, A., Clayton, M. (2009). Visual Design Fundamentals: A Digital Approach. Third Revised Edition. Cengage Learning.
Hastie, R. (1981). Schematic principles in human memory. In E. T. Higgins, C. P. Herman, & M. P. Zanna (Eds.), Social cognition: The Ontario symposium (Vol. 1, pp. 39-88). Hillsdale, NJ: Erlbaum.
Helmholtz, H. von (1954). On the Sensation of Tone as a Physiological Basis for the Theory of Music. New York: Dover. (Original German work published 1863).
Hindemith, P. (1942). Unterweisung im Tonsatz, 3 vols. (Mainz: Schott, 1937–70) [English edition, as The Craft of Musical Composition, vol. 1: Theoretical Part, trans. by Arthur Mendel (New York: Associated Music Publishers; London: Schott, 1942) & vol. 2: Exercises in Two-Part Writing, trans. by Otto Ortmann (New York: Associated Music Publishers; London: Schott, 1941)].
Isen, A. (1982). Toward understanding the relationship between feeling states and social behavior. In A. H. Hastorf & A. Isen (Eds.), Cognitive social psychology (pp. 73-108). New York:Elsevier/North Holland Press.
Isen, A. (1984). Toward understanding the role of affect in cognition. In R. S. Wyer & T. K. Srull (Eds.), Handbook of social cognition (Vol. 3, pp. 179-236). Hillsdale, NJ: Erlbaum Press.
Isen, A. (1987). Positive affect, cognitive processes, and social behavior. In L. Berkowitz (Ed.), Advances in experimental social psychology (Vol. 20, pp. 203-253). New York: Academic Press.
Kano M, Fukudo S, Gyoba J, Kamachi M, Tagawa M, Mochizuki H, Itoh M, Hongo M, Yanai K. (2003). Specific brain processing of facial expres- sions in people with alexithymia: an H215O-PET study. Brain, 126, 1474–84.
Klein, M. (1946). Notes on some schizoid mechanisms., Int. J. Psychoanal., 27:99-110. Koechlin, C. (1930). Traité de l'harmonie. Paris: Max Eschig.
Koelsch, S., T.C. Gunter, A.D. Friederici& E. Schroger. 2000. Brain indices of music processing: “Nonmusicians” are musical. J. Cogn. Neurosci. 12: 520–541.
Koelsch, S. & A.D. Friederici. 2003. Toward the neural basis of processing structure in music: comparative results of different neurophysiological investigation methods. Ann. N. Y. Acad. Sci. 999: 15–28.
Koelsch, S., T. Fritz, K. Schulze, et al. 2005. Adults and children processing music: An fMRI study. Neuroimage 25: 1068–1076.
Koelsch, S., T. Fritz, D.Y. Von Cramon, et al. (2005). Investigating emotion with music: an fMRI study. Hum. Brain Mapp. [Epub ahead of print].
Krumhansl, C. L. (1983). Perceptual structures for tonal music. Music Perception, 1, 28-62. Krumhansl, C.L. (1990). Cognitive foundations of musical pitch. New York: Oxford
University Press.
Krumhansl, C. L. (1996). A perceptual analysis of Mozart’s Piano Sonata K. 282: Segmentation, tension and musical ideas. Music Perception, 13, 401–432.
Krumhansl, C. L. (1997). An exploratory study of musical emotions and psychophysiology. Canadian Journal of Experimental Psychology, 51, 336–352.
Krumhansl, C. L. (2002). Music: A link between cognition and emotion. Current Directions in Psychological Science, 11, 45–50.
Lerdahl, F., Jackendoff, R. (1983). A Generative Theory of Tonal Music. MIT Press. Farwood.
Lerdahl, F. (1988). Tonal pitch space. Music Perception, 5, 315-345.
Lerdahl, F. (2001). Tonal pitch space. New York: Oxford University Press. Lerdahl, F. (2008). Poetry as music. Unpublished manuscript.
Lerdahl, F., & Krumhansl, C. L. (2007). Modeling tonal tension. Music Perception, 24, 329- 366.
Levitin, D.J. & V. Menom. 2003. Musical structure is processed in “language” areas of the brain: a possible role for Brodmann Area 47 in temporal coherence. Neuroimage 20: 2142–2152.
Lipscomb, S. D., & Kendall, R. A. (1994). Perceptual judgment of the relationship between music and visual components in film. Psychomusicology, 13, 60-98.
Marshall, S., & Cohen, A. J. (1988). Effects of musical soundtracks on attitudes toward animated geometric figures. Music Perception, 6, 95-112.
Mead, Geroge H. (1952). Mind, Self, and Society (Chicago: University of Chicago Press. Mega, M.S., J.L. Cummings, S. Salloway& P. Malloy. 1997. The Limbic System: An
Anatomic, Phylogenetic, and Clinical Perspective. In The Neuropsychiatry of Limbic and Subcortical Disorders. S. Salloway, P. Malloy & J.L. Cummings, Eds.: 3–18. American Psychiatric Press. Washington, D.C./London.
Meyer, L.B. (1956). Emotion and meaning in music. University of Chicago Press. Chicago. Murch, Walter (2001). In the Blink of an Eye: A Perspective on Film Editing (Silman-James
Neisser, U. (1976). Cognition and reality. San Francisco: W. H. Freeman.
Nemiah J., Freyberger H., Sifneos P. (1976). Alexithymia: a view of the psychosomatic process. In: Hillow, editor. Modern trends in psychosomatic medicine. Vol. 3. London: Butterworths; 43-9.
Parker J., Taylor G., Bagby R. (1993). Alexithymia and the recognition of facial expressions of emotion. Psychother Psychosom; 59: 197-202.
Parncutt, R. (1989). Harmony: A psychoacoustical approach. Berlin: Springer-Verlag. Plomp, R. & Levelt, W.J.M. (1965). Tonal consonance and the critical bandwidth. Journal of
the Acoustical Society of America, 38, 548-560.
Rameau, J.P. (1971). Treatise of Harmony (P. Gosset, Trans.). New York: Dover. (Original work published 1722).
Riemann, H. (1896). Harmony simplified (H. Bewerung, Trans.). London: Augener. (Original work published 1893).
Roberts, L.A., & Shaw, M.L.(1984). Perceived structure of triads. Music Perception, 2, 95- 124.
Schenker, H. (1979). Free Composition (E. Oster, Trans.). New York: Longman. (Original work published 1935).
Schoenberg, A. (1974). Tratado de armonía (R. Barce, Trans.). Madrid: Real Musical. (Original work published 1922).
Sifneos P. (1973). The prevalence of `alexithymic' characteristic mechanisms in psychosomatic patients. Psychother Psychosom; 21: 133-6.
Sinus, G., & Clarke, E. F. (1994). The perception of audiovisual relationships: A preliminary study. Psychomusicology, 13, 119-132.
Sloboda, J.A. 1991. Music structure and emotional response: some empirical findings. Psychol. Music 19: 110–120.
Sundberg (Ed.), Harmony and tonality. Stockholm: Royal Swedish Academy of Music, 54, 59-84.
Taylor G. (1994). The alexithymia construct: conceptualization, validation, and relationship with basic demensions of personality. New Trends Exp Clin Psychiatry; 10: 61-74. Taylor G. (2000). Recent developments in alexithymia theory and research. Can J
Psychiatry; 45: 134-42.
Taylor G., Bagby R., Parker J. (1991). The alexithymia construct: a potential paradigm for psychosomatic medicine. Psychosomatics; 32: 153-64.
Taylor, S. E., & Crocker,J. (1981). Schematic bases of social information processing. In E. T. Higgins, C. P.Herman, & M. P.Zanna (Eds.), Social cognition: The Ontario symposium (Vol. 1, pp. 89-134). Hillsdale, NJ: Erlbaum.
Thayer J., & Levenson, R. (1983). Effects of music on psychophysiological responses to a stressful film. Psychomusicology, 3, 44-54.
Vos, J. & van Vianen, B.G. (1984). Thresholds for discrimination between pure and tempered intervals: The relevance of nearly coinciding harmonics. Journal of the Acoustical Society of America, 77, 176-187.
Weis, E., Belton, J. (1985). Film Sound: Theory and Practice. Ed. Elisabeth Weis and John Belton. Columbia University Press: NY.
A
CKNOWLEDGMENTSI sincerely thank Dr. Christopher Hopkins for the opportunity of working with him, for all his guidance, support and encouragement during my graduate studies at ISU. I also would like to express my sincere gratitude to Prof. Anson Call and Prof. Steven Herrnstadt for their help, creative advice and fruitful discussions.
I am also grateful to the entire Music Department and College of Design at ISU, for their constant support of my work. Thank you to Dr. Mack Shelley for his statistical advice. I would like to honestly thank the Fulbright Commission and UCA for their invaluable help. Thank you to all my friends. Again, thank you to all my friends.
I would like to express my profound thanks to Nadia for being always by my side and supporting my life with her love. Thank you to Maximo Pujol and to all my family for accompanying my dreams everywhere I go.