University of Groningen Visual semantics Schie, Hein Thomas van IMPORTANT NOTE: You are advised to consult the publisher's version (publisher's PDF) if you wish to cite from it. Please check the document version below. Document Version Publisher's PDF, also known as Version of record Publication date: 2003 Link to publication in University of Groningen/UMCG research database Citation for published version (APA): Schie, H. T. V. (2003). Visual semantics s.n. Copyright Other than for strictly personal use, it is not permitted to download or to forward/distribute the text or part of it without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license (like Creative Commons). Take-down policy If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim. Downloaded from the University of Groningen/UMCG research database (Pure): http://www.rug.nl/research/portal. For technical reasons the number of authors shown on this cover page is limited to 10 maximum. Download date: 10-02-2018
Visual Semantics
The research reported in this thesis was carried out under the PIONEER project The Neurological Basis of Language awarded to Dr. L.A. Stowe by the Dutch organization for scientific research (NWO). Cover-illustration by Donald van Tol and Jelmer Lesterhuis. Chapter-illustration by Henk van Schie. Typesetting by the Author using L A TEX. Printed by Universal Press, Veenendaal. Copyright c 2003 by Hein van Schie. Groningen Dissertations in Linguistics 43 ISSN 0928-0030
Promotor: Co-promotores: Beoordelingscommissie: Prof. dr. J. Koster Dr. L. A. Stowe Dr. A. A. Wijers Prof. dr. Y. R. M. Bastiaanse Prof. dr. J. M. Bouma Prof. dr. G. W. Humphreys
-v-..names heard, almost as readily excite certain ideas as if the objects themselves, which are apt to produce them, did actually affect the senses (Locke, 1690, bk. 3, ch. 2)
RIJKSUNIVERSITEIT GRONINGEN Visual Semantics Proefschrift ter verkrijging van het doctoraat in de Letteren aan de Rijksuniversiteit Groningen op gezag van de Rector Magnificus, Dr. F. Zwarts, in het openbaar te verdedigen op donderdag 27 maart 2003 om 14.15 uur door Hein Thomas van Schie geboren op 15 april 1972 te Utrecht
-vi-
Contents 1 General Introduction 1 1.1 Introduction.................................. 1 1.2 Issues and Outline.............................. 7 1.2.1 Chapter 2............................... 8 1.2.2 Chapter 3............................... 8 1.2.3 Chapter 4............................... 9 1.2.4 Chapter 5............................... 9 1.2.5 Final chapters............................ 10 I Behavioral Experiments 11 2 Inhibition of Return and Semantic Priming for Objects 13 2.1 Introduction.................................. 14 2.2 Method..................................... 17 2.2.1 Subjects................................ 17 2.2.2 Materials............................... 17 2.2.3 Procedure............................... 18 2.3 Results..................................... 19 2.4 Discussion................................... 21 2.5 Experiment 2.................................. 22 2.6 Method..................................... 23 2.6.1 Subjects................................ 23 2.6.2 Procedure............................... 23 2.7 Results..................................... 24 2.8 Discussion................................... 24 2.9 General Discussion.............................. 25 3 Semantics for Manipulable and Nonmanipulable Objects 29 3.1 Introduction.................................. 30 3.2 Method..................................... 34
-viii- Contents 3.2.1 Subjects................................ 34 3.2.2 Materials............................... 34 3.2.3 Procedure............................... 35 3.2.4 Data analysis............................. 36 3.3 Results..................................... 36 3.3.1 Overall analysis........................... 36 3.3.2 Analysis of experimental words.................. 38 3.4 Discussion................................... 42 3.4.1 LVF specialization for written language?............ 42 3.4.2 Word-type differences....................... 44 3.4.3 Manipulability and interactions with visual field....... 44 3.5 Conclusion................................... 45 II Event-related Potentials 47 4 Relationship between Semantics and Perception 49 4.1 Introduction.................................. 50 4.2 Method..................................... 53 4.2.1 Subjects................................ 53 4.2.2 Materials............................... 53 4.2.3 Procedure............................... 54 4.2.4 EEG recordings........................... 55 4.2.5 Data Analysis............................ 56 4.3 Results..................................... 57 4.3.1 Behavior............................... 57 4.3.2 Event-related Potentials...................... 57 4.4 Discussion................................... 64 4.4.1 Picture - word matching and interactions with probes.... 64 4.4.2 Retinotopic effects of picture - word matching......... 66 4.5 Experiment 2.................................. 68 4.6 Method..................................... 69 4.6.1 Subjects................................ 69 4.6.2 Materials............................... 69 4.6.3 Procedure............................... 70 4.6.4 EEG recording and data analysis................. 70 4.7 Results..................................... 70 4.7.1 Behavior............................... 70 4.7.2 Event-related Potentials...................... 71 4.8 Discussion................................... 74 4.9 General Discussion.............................. 75
Contents -ix- 5 Visual Object Working Memory and Visual Semantics 77 5.1 Introduction.................................. 78 5.2 Method..................................... 82 5.2.1 Subjects................................ 82 5.2.2 Stimuli and materials........................ 82 5.2.3 Procedure............................... 84 5.2.4 EEG recordings........................... 86 5.2.5 Data Analysis............................ 87 5.3 Results..................................... 88 5.3.1 Behavior............................... 88 5.3.2 Event-related Potentials...................... 92 5.4 Discussion................................... 104 5.4.1 Behavior............................... 105 5.4.2 ERPs.................................. 105 5.5 Conclusion................................... 111 6 Summary and General Discussion 113 6.1 Summary.................................... 113 6.1.1 Chapter 2............................... 114 6.1.2 Chapter 3............................... 116 6.1.3 Chapter 4............................... 117 6.1.4 Chapter 5............................... 119 6.2 General Discussion.............................. 120 6.2.1 The Investigation of Dorsal and Ventral Pathways....... 120 6.2.2 Visual Processes are included in Semantic Function...... 122 6.2.3 Objects as Basic Representations for Semantic Memory.... 123 6.3 General Conclusion.............................. 124 Bibliography 127 Appendices 137 Appendix Chapter 2............................. 137 Appendix Chapter 3............................. 141 Appendix Chapter 4............................. 148 Appendix Chapter 5............................. 155 Nederlandse Samenvatting 161 Inleiding.................................... 161 Samenvatting van de Experimentele Hoofdstukken........... 163 Inhibition of Return en Semantische Priming voor Objecten in het Bovenste en Onderste Visuele Veld............ 163 Semantische Specialisatie voor Manipuleerbare en Nietmanipuleerbare Objecten...................... 165
-x- Contents De Relatie tussen Semantische en Perceptuele Representatie. 166 Gemeenschappelijke Neurale Basis voor Visueel Objectwerkgeheugen en Visuele Semantiek............... 167 Conclusie.................................... 169 Dankwoord 171 Groningen dissertations in linguistics 172