Везде
RUSSIAN MULTICHANNEL DISCOURSE. PART I. SETTING UP THE PROBLEM
Table of contents
Annotation Estimate Publication content
References Comments
Share
QR
Metrics
RUSSIAN MULTICHANNEL DISCOURSE. PART I. SETTING UP THE PROBLEM
Annotation
PII
S0205-95920000338-8-1
DOI
10.31857/S20000338-8-1
Publication type
Article
Status
Published
Authors
Andrej A. Kibrik 
Abstract
Human communication is a multichannel process. A multitude of communication channels, belonging to the vocal and kinetic modalities are employed simultaneously and in conjunction with each other. Even though ordinary oral communication constitutes a major part of the everyday human activity, it is not sufficiently explored, because it normally leaves no material traces, and because various channels are traditionally studied by disparate academic disciplines. The first part of the paper considers the main phenomena of the verbal, prosodic, gestural, and oculomotor communication channels, as well as the principles of annotating the corresponding phenomena. The approach taken in this paper is proposed from the side of linguistics, but at the same time is of an interdisciplinary nature and is addressed to psychological readership.
Keywords
communication, discourse, multimodality, multichannel studies, prosody, gesticulation, eye movements.
Number of purchasers
8
Views
745
Readers community rating
0.0 (0 votes)
Cite   Download pdf

References



Additional sources and materials




    

  1. Barabanschikov V.A. Ehkspressii litsa i ikh vospriyatie. M.: Izd-vo “Institut psikhologii RAN”, 2012.
    2. 

  2. Barabanschikov V.A., Zhegallo A.V. Registratsiya i analiz napravlennosti vzora cheloveka. M.: Izd-vo “Institut psikhologii RAN”, 2013.
    3. 

  3. Belikov V.I., Krysin L.P. Sotsiolingvistika. Uchebnik dlya bakalavriata i magistratury. 2-e izd. M.: Yurajt, 2015.
    4. 

  4. Butovskaya M.L. Yazyk tela: priroda i kul'tura (ehvolyutsionnye i kross-kul'turnye osnovy neverbal'noj kommunikatsii cheloveka). M.: Nauchnyj mir, 2004.
    5. 

  5. Grishina E.A. Russkaya zhestikulyatsiya s lingvisticheskoj tochki zreniya (korpusnye issledovaniya). M.: YaSK, 2017.
    6. 

  6. Kibrik A.A. Mul'timodal'naya lingvistika  // Kognitivnye issledovaniya. Vyp. IV.  / Pod red. Yu.I. Aleksandrova, V.D. Solov'eva. M.: Izd-vo “Institut psikhologii RAN”, 2010. S. 134–152.
    7. 

  7. Kibrik A.A. Russkij mul'tikanal'nyj diskurs. Chast' II. Korpus i  napravleniya issledovanij  // Psikhologicheskij zhurnal. 2018. T. 39. № 2.
    8. 

  8. Kodzasov S.V. Issledovaniya v oblasti russkoj prosodii. M.: YaSK, 2009.
    9. 

  9. Kotov A.A., Zinina A.A. Funktsional'nyj analiz neverbal'nogo kommunikativnogo povedeniya  // Komp'yuternaya lingvistika i  intellektual'nye tekhnologii: Po materialam ezhegodnoj Mezhdunarodnoj konferentsii “Dialog” (Moskva, 27–30 maya 2015 g.). Vyp. 14 (21), t. 1. M.: RGGU, 2015. S. 308–320.
    10. 

  10. Krejdlin G.E. Neverbal'naya semiotika. M.: NLO, 2002.
    11. 

  11. Lapteva O.A. Russkij razgovornyj sintaksis. M.: Nauka, 1976.
    12. 

  12. Litvinenko A.O., Nikolaeva Yu.V., Kibrik A.A. Annotirovanie russkikh manual'nykh zhestov: teoreticheskie i prakticheskie voprosy // Komp'yuternaya lingvistika i intellektual'nye tekhnologii: Po materialam ezhegodnoj Mezhdunarodnoj konferentsii “Dialog” (Moskva, 31 maya – 4 iyunya 2017 g.). Vyp. 16 (23), t. 2. M.: RGGU, 2017. S. 271–286.
    13. 

  13. Markus O.V. Lokal'naya struktura diskursa v verkhnekuskokvimskom atabaskskom yazyke. Diplomnaya rabota. Otdelenie teoreticheskoj i  prikladnoj lingvistiki, filologicheskij fakul'tet MGU im. M.V. Lomonosova, 2009.
    14. 

  14. Nikolaeva Yu.V. Illyustrativnye zhesty v ustnom diskurse (tipy, funktsii, kommunikativnoe povedenie) // Moskovskij lingvisticheskij zhurnal. 2004. T. 8. № 2. S. 89–117.
    15. 

  15. Osnovy teorii kommunikatsii / Pod red. Venediktovoj T.D., Gudkova D.B. M.: Yurajt, 2016.
    16. 

  16. Problemy psikhologii diskursa  / Pod red. Pavlovoj N.D., Zachesovoj I.A. M.: Izd-vo “Institut psikhologii RAN”, 2005.
    17. 

  17. Rasskazy o snovideniyakh: korpusnoe issledovanie ustnogo russkogo diskursa / Pod red. Kibrika A.A., Podlesskoj V.I. M.: YaSK, 2009.
    18. 

  18. Russkaya razgovornaya rech' / Pod red. E.A. Zemskoj. M.: Nauka, 1973.
    19. 

  19. Sirotinina O.B. Sovremennaya razgovornaya rech' i ee osobennosti. M.: Prosveschenie, 1974.
    20. 

  20. Fedorova O.V. Ehksperimental'nyj analiz diskursa. M.: YaSK, 2014.
    21. 

  21. Fedorova O.V. Raspredelenie zritel'nogo vnimaniya sobesednikov v estestvennoj kommunikatsii: 50 let spustya // Pod red. E.V. Pechenkovoj, M.V. Falikman. Kognitivnaya nauka v Moskve: novye issledovaniya. Materialy konferentsii 15 iyunya 2017 g. M.: BukiVedi, IPPiP, 2017. S. 370–375.
    22. 

  22. Fedorova O.V., Kibrik A.A., Yazykov S.A. Perspektivy ispol'zovaniya ochkov-ajtrekerov v  kognitivnykh issledovaniyakh mul'timodal'nosti // Ajtreking v psikhologicheskoj nauke i praktike / Pod red. V.A. Barabanschikova. M.: Moskovskij institut psikhoanaliza, 2016. S. 79–86.
    23. 

  23. Fedorova O.V., Kibrik A.A., Korotaev N.A., Litvinenko A.O., Nikolaeva Yu.V. Vremennaya koordinatsiya mezhdu zhestovymi i rechevymi edinitsami v mul'timodal'noj kommunikatsii // Komp'yuternaya lingvistika i intellektual'nye tekhnologii: Po materialam ezhegodnoj Mezhdunarodnoj konferentsii “Dialog” (Moskva, 1–4 iyunya 2016 g.). Vyp. 15 (22). M.: Izd-vo RGGU, 2016. S. 159–170.
    24. 

  24. Adolphs S., Carter R. Spoken Corpus Linguistics: From Monomodal to Multimodal. London: Routledge, 2013.
    25. 

  25. Ariel M. Pragmatics and grammar. Cambridge: CUP, 2008.
    26. 

  26. Battison R. Phonological deletion in American Sign Language // Sign Language Studies. 1974. V. 5. P. 1–19.
    27. 

  27. Bolly C. CorpAGEst (2013–2015): “A corpus-based multimodal approach to the pragmatic competence of the elderly”. People Marie Curie Actions (PIEFGA-2012-328282). Multimodal annotation guidelines. With the collaboration of: Delphine Belin, Dominique Boutet, Julie Kairet, Alysson Lepeut, Anna Sáfár, Anaïs Thomas. 2016.
    28. 

  28. Bonacchi S., Karpiński M. Remarks about the use of the term “multimodality” // Journal of Multimodal Communication Studies. 2014. V. 1. P. 1–7.
    29. 

  29. Bressem J. Transcription systems for gestures, speech, prosody, postures, and gaze // Müller et al. eds. 2013. P. 1037–1060.
    30. 

  30. Bressem J. A linguistic perspective on the notation of form features in gestures.  // Müller et al. eds. 2013. P. 1079–1098.
    31. 

  31. Bressem J., Ladewig S.H. and Müller C. Linguistic annotation system for gestures // Müller et al. eds. 2013. P. 1098–1125.
    32. 

  32. Brône G., Oben B. InSight Interaction. A multimodal and multifocal dialogue corpus // Language Resources and Evaluation. 2015. V. 49(1). P. 195–214.
    33. 

  33. Chafe W. Discourse, consciousness, and time. Chicago: University of Chicago Press, 1994.
    34. 

  34. Gibbon D., Mertins I., Moore R.K. (eds.) Handbook of multimodal and spoken dialogue systems: Resources, terminology and product evaluation. Berlin: Springer, 2000.
    35. 

  35. Granström B., House D., Karlsson I. (eds.) Multimodality in language and speech systems. Dordrecht: Kluwer, 2002.
    36. 

  36. Hagemann J. Proxemics and axial orientation // Müller et al. eds. 2013. P. 1310–1323.
    37. 

  37. Holler J., Kendrick K.H. Unaddressed participants’ gaze in multi-person interaction: Optimizing recipiency // Frontiers in Psychology. 2015. 6: 98.
    38. 

  38. Iwasaki S., Tao H.-Y. A comparative study of the structure of the intonation unit in English, Japanese, and Mandarin Chinese. Paper presented at the annual meeting of LSA. 1993.
    39. 

  39. Jokinen K. Eye-trackers and multimodal communication studies // Proceedings from the 1st European Symposium on Multimodal Communication, University of Malta, Valletta, October 17–18, 2013.
    40. 

  40. Karpiński M., Jarmołowicz-Nowikow E., Czoska A. Gesture annotation scheme development and application for entrainment analysis in task-oriented dialogues in diverse cultures. Proceedings of GESPIN2015 Conference, Nantes, France. 2015. P. 161–166.
    41. 

  41. Kendon A. Gesticulation and speech: Two aspects of the process of utterance // M.R. Key (ed.), The relationship of verbal and nonverbal communication. The Hague: Mouton, 1980. P. 207–227.
    42. 

  42. Kendon A. Gesture. Visible action as utterance. Cambridge: Cambridge University Press, 2004.
    43. 

  43. Kendon A. Semiotic diversity in utterance production and the concept of ‘language’ // Phil. Trans. R. Soc. 2014. V. 369. № 1651. P. 20130293.
    44. 

  44. Kress G. The multimodal landscape of communication // Medien Journal. 2002. V. 4. P. 4–19.
    45. 

  45. Knight D. The future of multimodal corpora // Revista Brasileira de Linguística Aplicada. 2011. V. 2. P. 391–415.
    46. 

  46. Kousidis S., Malisz Z., Wagner P., Schlangen D. Exploring Annotation of Head Gesture Forms in Spontaneous Human Interaction // Proceedings of the Tilburg Gesture Meeting (TiGeR2013). 2013. https://tiger.uvt.nl/listof-accepted-papers.html (data obrascheniya 12.07.2017).
    47. 

  47. Ladewig S.H., Bressem J. A linguistic perspective on the notation of gesture phases  // Müller et al. eds. 2013. P. 1060–1079.
    48. 

  48. Linell P. The written language bias in linguistics. Linköping, Sweden: University of Linköping, 1982.
    49. 

  49. Matsumoto K. Japanese intonation units and syntactic structure  // Studies in Language. 2000. V. 24. P. 525–564.
    50. 

  50. McNeill D. Hand and Mind: What gestures reveal about thought. Chicago: University of Chicago Press, 1992.
    51. 

  51. Mondada L. Multimodal interaction // Müller et al. eds. 2013. P. 577–589.
    52. 

  52. Müller C., Bressem J. and Ladewig S.H. Towards a grammar of gestures: A form-based view // Müller et al. eds. 2013. P. 707–733.
    53. 

  53. Müller C., Cienki A., Fricke E., Ladewig S.H., McNeill D., Teßendorf S. (eds.) Body – Language – Communication: An International Handbook on Multimodality in Human Interaction. Berlin: de Gruyter Mouton, 2013.
    54. 

  54. Rasmussen G. Inclined to better understanding – The coordination of talk and ‘leaning forward’ in doing repair // Journal of Pragmatics. 2014. V. 65. P. 30–45.
    55. 

  55. Sidnell J. Conversation Analysis: an Introduction. Malden: Wiley-Blackwell, 2010.
    56. 

  56. Scollon R. Multimodality and the language of politics // Encyclopedia of language and linguistics / Ed.K. Brown. 2006. V. 9. P. 386–387.
    57. 

  57. Stokoe W. Sign Language Structure. Buffalo, NY: Buffalo University Press, 1960.
    58. 

  58. Vigliocco G., Perniss P., Vinson D. Language as a multimodal phenomenon: implications for language learning, processing and evolution // Phil. Trans. R. Soc. B2014. V. 369. № 1651. P. 20130292.
    59. 

  59. Wagner P., Malisz Z., Kopp S. Gesture and speech in interaction: An overview // Speech Communication. 2014. V. 57. P. 209–232.
    60. 

  60. Wouk F. The syntax of intonation units in Sasak // Studies in Language. 2008. V. 32. P. 137–162.
    61.

Comments

No posts found

Write a review
Translate