A Literature Review of Multimodal Semiotic Reasoning in Mathematics

In learning mathematics in the 21st century and after the Covid-19 pandemic, a multimodal role in the process of drawing conclusions involving mathematical symbols or signs is very much needed. This process is called multimodal semiotic reasoning. This research aims to study the literature on multimodal semiotic reasoning research articles. Until April 2023, there were 32 articles on the keyword multimodal semiotic reasoning with the subject of mathematics in the Scopus, Science Direct, and ERIC databases. Furthermore, it is identified based on a) suitability of criteria; b) the similarity of the articles in the three databases. Finally obtained 24 articles that meet the requirements for further research. A literature review on multimodal semiotic reasoning is explored based on a) kinds of mathematical reasoning involving symbols and signs using multimodal, b) multimodal used in research, c) the most researched mathematical concepts and the mathematization process that occurs, d) the role of multimodal semiotic reasoning in mathematics education. The results showed that a) the most dominant type of mathematical reasoning involving objects, symbols, and signs using multimodal was Algorithmic Reasoning (AR), b) the most multimodal source was verbal answers, c) the concept of geometry through a process of vertical-horizontal mathematization was the most researched, and 4) the biggest role of multimodal semiotic reasoning for the benefit of knowledge of mathematics education. In conclusion, multimodal semiotic reasoning has had a major impact on mathematics education and research on this multimodal semiotic reasoning will continue to thrive in the future.