A useful reference would be Forceville, G. C. et al. (2009). Multimodal Metaphor. Berlin: Walter de Gruyter.

Hi there,

we write about it in our recent book. You'll find some useful references there, too.

Łukasz Pakuła, Joanna Pawelczyk and Jane Sunderland. 2015. Gender and Sexuality in English Language Education: Focus on Poland. London: British Council.

HTH.

Best,

Łukasz

thanks

Thanks a lot, Rozalia. I would be extremely grateful if you sent me the whole book. I need it very much, really!!!!

You might also be interested in Moving Ideas, Multimodality and Embodied Learning in Communities and Schools (2013), published by Peter Lang.

Google Rick Iedema and resemiotization.

Text and Image: A Critical Introduction to the Visual/Verbal Divide

By John Bateman

This could be a good reference closed related to your topic. The book takes a multimodal approach to analysing text-image relations. It is comprehensive, covering different genres and review different theories.

https://www.routledge.com/products/9780415841986?utm_source=publicity&utm_medium=post&utm_campaign=sbu4_lmf_4mx_1em_9lin_00000_linglist

Hi, attaching my article dealing with this kind of topic. you will find some refererences which may be useful. I suggest Kress and Van Leeuwen as good authors, and also Bateman. It's a difficult area because, imo, analytical methodology for dealing with images is not particularly well-developed or unified at this moment..Best, dp

Multimodality, by Kress, and Multimodal Discourse Analysis, by Kress and van Leeuwen, are definiteky two references worth reading. It is a fact that multimodal analysis hasn't been systematically applied very often, but the work of Kress and Kress and van Leeuwen is sufficiently sound to be applied in any multimodal context. 

thank you very much

Reading images by Kress and van Leeuwen is a fundamental starting point. Jewitt's Handbook of multimodal analysis is a vry good reader, but it depends on the specific area you'll be working. If you're more interested in a critical multimodal analysis (that is analysing how meanings co-constructed by the interaction between images, texts, other resources), I suggest Machin and Mayr, An Introduction to Critical Discourse analysis. It is very good indeed. If you look for the very basics, I can send you some stuff by email. best of luck with your research

Hello!

Thanks a lot for reply, really. I am looking for very basucs . I will be very grateful if you send some stuff by email. Look forward for your reply!

With regards, Natalia

Unfortunatelly, I cannot send request for your textbook via research gate. I have read the content and I think that some information will be very useful and important for practical research. Could you please send your book on my email [email protected] or [email protected]? I will citate you if it will be necessary. Thank you very much for your help. I really rely on greatly.

With best regards, Natalia 

Hi. You can check Bateman (2014).

Hi Nata, in addition to the books recommended above, I can recommend a recent one by Bateman, Wildfeuer and Hiippala (2017): Book Multimodality: Foundations, Research and Analysis – A Proble...

Check also publications by Kay O'Halloran, Sabine Tan and Peter Wignell from Curtin University (Western Australia).

Hope it helps!

You can also look at the following paper:

Conference Paper Multimodal Classification Fusion in Real-World Scenarios

We also presented a real-world multi-modal dataset consisting of images and text descriptions.

thanks all for responses

I am attaching some references in which the multimodal nature of human communication, the concepts of multimodality, about semiotic resources & modes, the type of relationships that are established between different semiotic resources, etc. are discussed in detail:

van Leeuwen, T. (2005). Introducing Social Semiotics. London: Routledge