Gesture Visualization from Babad Diponegoro (UNESCO’s MoW) into Digital Character using Motion Capture

  • Harry Nuriman Institut Teknologi Bandung, Indonesia
  • Setiawan Sabana Institut Teknologi Bandung, Indonesia
  • Intan Rizky Mutiaz Institut Teknologi Bandung, Indonesia
  • Rikrik Kusmara Andryanto Institut Teknologi Bandung, Indonesia
Keywords: Animation, 3D Model, Gesture, Pangeran Diponegoro, Motion Capture.

Abstract

 

The image of Prince Diponegoro as a national hero of Indonesia is very strong. However, there are controversies and myths regarding his characterization. The researcher deconstructs the character of Prince Diponegoro by appropriating Raden Saleh's painting entitled Penangkapan Pangeran Diponegoro by tracing the authentic script from the autobiography of Babad Diponegoro. The manuscript is examined using an intertextuality approach. Prince Diponegoro is constructed based on the physical characteristics contained in the Babad Diponegoro text into a three-dimensional digital model. The results are then rearranged using the deconstruction method by detaching from the existing stereotype of Prince Diponegoro and displaying his character and habits as written in Babad Diponegoro. A number of questions to be answered through this research are what can be visualized from the character of Prince Diponegoro using a textual approach, especially based on Babad Diponegoro, why does the character and identity based on Babad Diponegoro need to be visualized and what methods can be used to bring out the body and character. through the use of digital technology which includes embodiment, motion, gesture, sound, light, interactivity so as to provide a new experience for the audience. The result was a series of movements and visuals that enriched the characterization of Prince Diponegoro. All characters, both those that have been formed for a long time and those that were only known after the translation of Babad Diponegoro, were shown in the virtual experiment entitled Hikayat Dipanegara. The results showed that appropriation using different dimensions and technology resulted in a new image of Prince Diponegoro. The crossing of signs that occurs between real and virtual experiences and in the context of time can provide a new experience which may change the perspective or understanding of things.

References

Aristidou, A., Charalambous, P., & Chrysanthou, Y. (2015, September). Emotion analysis and classification: understanding the performers' emotions using the LMA entities. In Computer Graphics Forum (Vol. 34, No. 6, pp. 262-276).

Ardison, M. S. (2017). Diponegoro & Perang Jawa. Jakarta: Ecosystem Publishing.

Badi, H. S., & Hussein, S. (2014). Hand posture and gesture recognition technology. Neural Computing and Applications, 25(3), 871-878.

Carey, P. B. (1982). Raden Saleh, Dipanagara and the Painting of the Capture of Dipanagara at Magělang (28 March 1830). Journal of the Malaysian Branch of the Royal Asiatic Society, 55(1 (242), 1-25.

Carey, P. B. (2015). Kuasa Ramalan Jilid 1. Jakarta: Gramedia.

Carey, P. B. (2017). Takdir Riwayat Pangeran Diponegoro (1785-1855). Jakarta: Kompas.

Carey, P. B. (1987). Kesatria dan Santri: Beberapa Catatan Tentang Hubungan Pendukung Keraton and Agamawi Diponegoro, sari Babad dan hikayat sampai sejarah kritis. Yogyakarta: Gadjah Mada Uni¬versity Press.

So, C. K., & Baciu, G. (2005). Entropy‐based Motion Extraction for Motion Capture Animation. Computer Animation and Virtual Worlds, 16(3‐4), 225-235.

Courty, N., & Corpetti, T. (2007). Crowd motion capture. Computer Animation and Virtual Worlds, 18(4‐5), 361-370.

Creswell, J. W., (2016). Research Design, Pendekatan Metode Kualitatif, Kuantitatif, dan Campuran. Yogyakarta: Pustaka Pelajar.

Desmond, J. S. (1997). Meaning in Motion: New Cultural Studies of Dance (Post Contemporary Interventions). New York: Duke University Press.

Djamhari, S. A. (2014). Strategi menjinakkan Diponegoro: Stelsel Benteng 1827-1830, Depok: Komunitas Bambu.

Djelantik, A. A. M. (2001). Estetika Sebuah Pengantar: Bandung: MSPI (Masyarakat Seni Pertunjukan Indonesia).

Djordjevic, N. (2014). The Depiction of a (National) Hero: Pangeran Diponegoro in Paintings from the Nineteeth Century until Today. Surakarta: Master Thesis UNS.

Flick, U., Steinke, I., & Kardoff, E. V. (2017). Buku Induk Penelitian Kualitatif: Paradigma, Teori, Metode, Prosedur, dan Praktik. Yogyakarta. Cantrik Pustaka.

Fuery, K. (2009). New Media: Culture and Image. New York: Palgrave Macmillan.

Ghori, A. K., & Chung, K. C. (2007). Interpretation of hand signs in Buddhist art. The Journal of hand surgery, 32(6), 918-922.

Gunawan. (2016). Babad Dipanegara. Yogyakarta: Narasi.

Guntur. (2016). Metode Penelitian Artistik. Surakarta: ISI Press.

Hardiman, F. B. (2015). Seni Memahami. Yogyakarta: Kanisius.

Hashi, S., Tokunaga, Y., Yabukami, S., Kohno, T., Ozawa, T., Okazaki, Y., ... & Arai, K. I. (2005). Wireless motion capture system using magnetically coupled LC resonant marker. Journal of magnetism and magnetic materials, 290, 1330-1333.

Hayles, N. K. (1999). How We Became Post Human: Virtual Bodies in Cybernetics, Literature, and Informatics. Chicago: Univ. of Chicago Press.

Kartodirdjo, S. (1992). Pendekatan Ilmu Sosial dalam Metodologi Sejarah. Jakarta: Gramedia

Kimmel, M., & Preuschl, E. (2016). Dynamic Coordination Patterns in Tango Argentino: A Cross-Fertilization of Subjective Explication Methods and Motion Capture. Springer International Publishing Switzerland.

Kitagawa, M., & Windsor, B. (2008). MoCap for Artists. Oxford: Elsevier.

Kraus, W. (2005). Raden Saleh’s Interpretation of The Arrest of Diponegoro an Example of Indonesian “Proto-nationalist” Modernism. Archipel, 81(1/2).

Laumond, J. P., & Abe, N. (Eds.). (2016). Dance Notations and Robot Motion. Springer International Publishing.

Lazzeri, D., Xi, W., Zhang, Y. X., & Persichetti, P. (2014). A systematic reappraisal of the fifth finger in Renaissance paintings. Journal of the Royal Society of Medicine, 107(12), 474-479.

Liu, X., Mao, T., Xia, S., Yu, Y., & Wang, Z. (2008). Facial animation by optimized blendshapes from motion capture data. Computer Animation and Virtual Worlds, 19(3‐4), 235-245.

Louw, P. J. F. (1894). De Java Oorlog van 1825-1830. Batavia: Landsdrukkerij.

Mirzoeff, N. (1999). An Introduction to Visual Culture. London: Routledge.

Moeslund, T. B., & Granum, E. (2001). A Survey of Computer Vision-Based Human Motion Capture. Computer Vision and Image Understanding 81, 231–268.

Moeslund, T. B., Hilton, A., & Kruger, V. (2006). A survey of advances in vision-based human motion capture and analysis. Computer Vision and Image Understanding, 104, 90–126.

Nuriman, H., Sabana, S., Mutiaz, I. R., & Kusmara, R. A. (2020). From Real to Virtual: Adaptation Model of Performance Arts during Covid-19 Period. Jurnal Sosioteknologi, 19(2), 162-169.

Palmer, R. E. (1969). Hermeneutika Teori Baru Mengenai Interpretasi. Yogyakarta: Pustaka Pelajar.

Papadakis, A. (1989). Dekonstruksi: Volume Omnibus. London: Academi Editions.

Pettre, J., & Laumond, J. P. (2006). A motion capture‐based control‐space approach for walking mannequins. Computer Animation and Virtual Worlds, 17(2), 109-126.

Piliang, Y. A. (1998). Sebuah Dunia yang Dilipat. Bandung: Mizan.

Rahmatalla, S., Xia, T., Contratto, M., Kopp, G., Wilder, D., Law, L. F., & Ankrum, J. (2008). Three-dimensional motion capture protocol for seated operator in whole body vibration. International Journal of Industrial Ergonomics, 38(5-6), 425-433.

Ram, A. N., & Chung, K. C. (2008). Study of hand signs in Judeo-Christian art. The Journal of hand surgery, 33(7), 1182-1188.

Royle, N. (2003). Derrida. London: Routledge.

Sabana, S. (1999). Catatan Diri dalam Kertas. Retrieved from: http://www.setiawansabana.com/home/?page_id=140

Schneider, A. (2007). Appropriation as practice: art and identity in Argentina. Springer.

Simatupang, L. (2015). Aku Diponegoro. Jakarta: Gramedia.

Sumardjo, J. (2000). Filsafat Seni. Bandung: ITB.

Tang, J. K., Chan, J. C., & Leung, H. (2011, February). Interactive dancing game with real-time recognition of continuous dance moves from 3D human motion capture. In Proceedings of the 5th international conference on ubiquitous information management and communication (pp. 1-9).

Thüring, S., Herwig, J., & Schmitt, A. (2005). Silhouette‐based motion capture for interactive VR‐systems including a rear projection screen. Computer Animation and Virtual Worlds, 16(3‐4), 245-257.

Van der Kroef, J. M. (1949). Prince Diponegoro: Progenitor of Indonesian Nationalism. The Far Eastern Quarterly, 8(4), 424-450.

Vincs, K., & Barbour, K. (2014). Snapshots of complexity: using motion capture and principal component analysis to reconceptualise dance. Digital Creativity, 25(1), 62-78.

Wu, L., Yang, Y., & Li, X. (2015, August). Data Transform for Dance Motion Capture Based on Kinect. In 2015 7th International Conference on Intelligent Human-Machine Systems and Cybernetics (Vol. 2, pp. 108-111). IEEE.

Yahia‐Cherif, L., Gilles, B., Molet, T., & Magnenat‐Thalmann, N. (2004). Motion capture and visualization of the hip joint with dynamic MRI and optical systems. Computer Animation and Virtual Worlds, 15(3‐4), 377-385.

Published
2021-05-01
How to Cite
Nuriman, H., Sabana, S., Mutiaz, I. R., & Andryanto, R. K. (2021). Gesture Visualization from Babad Diponegoro (UNESCO’s MoW) into Digital Character using Motion Capture. International Journal of Science and Society, 3(2), 113-121. https://doi.org/10.200609/ijsoc.v3i2.322