Perancangan Awal Antarmuka Gesture Tangan Berbasis Visual

  • Rudy Hartanto Universitas Gadjah Mada
  • Marcus Nurtiantoro Aji Universitas Gadjah Mada
Keywords: hand gesture, human computer interaction, contours, convex hull, Lukas-Kanade Algorithm

Abstract

Human computer interaction has a long history to become more intuitive. For human being, gesture of different kind is one of the most intuitive and common communication. However, vision-based hand gesture recognition is a challenging problem, which are involved complex computation, due to high degree of freedom in humand hand.
In this paper we use hand gesture captured by web-cam instead of mice, for natural and intuitive human-computer interaction. Skin detections method is used to create a segmented hand image and to differentiate with the background. A contours and convex hull algorithm is used to recognize hand area as well as the number of finger tip of hand gesture image to be mapped with button. And for moving detection of hand gesture, the Lucas-Kanade pyramidal algorithm were used.
The result shows that this system can operate well so we can interact with computer using our hand gesture instead using a mice.

References

Maynes, D., Aminzade, Terry Winograd, Takeo Igarashi."Eyepatch: Prototyping Camera-based Interaction through Examples". Symposium on User Interface Software and Technology, Newport, Rhode Island, USA., ACM, 2007.

Molina, José P., Arturo S. García, Diego Martinez, Francisco J. Manjavacas, Victor Blasco, Victor López & Pascual González, “The Development of Glove-based Interfaces with the TRES-D Methodology”, VRST '06Proceedings of the ACM symposium on Virtual reality software and technology ACMNew York, NY, USA, 2006.

Iannizzotto, Giancarlo, Massimo Villari, Lorenzo Vita, “Hand tracking for human-computerinteraction with Graylevel VisualGlove: Turning back to the simple way”, PUI '01Proceedings of the 2001 workshop on Perceptive user interfaces, ACMNew York, NY, USA, 2001.

Freeman, William T., Michal Roth, “Orientation Histograms for Hand Gesture Recognition”, Mitsubishi Electric Research Laboratories Cambridge Research Center, TR-94-03a December 1994.

Terajima, Kazuhiro, Takashi Komuro,Masatoshi Ishikawa, “Fast Finger Tracking System for In-air Typing Interface”, CHI 2009, April 4 –9, Boston, MA, USA, 2009.

Pavlovic, Vladimir I., Rajeev Sharma, and Thomas S. Huang, "Visual interpretation of hand gestures for human-computer interaction: A review," IEEE Trans. on PAMI, July 1997.

Ic, Rajeev Sharma, and Thomas S. Huang, "Visual interpretation of hand gestures for human-computer interaction: A review," IEEE Trans. on PAMI, July 1997.

Bradski, Gary and Adrian Kaehler, “Learning OpenCV”, O’Reilly Media, Inc., 1005 Gravenstein Highway North, Sebastopol, CA 95472, 2008.

Youssef, Menatoallah M., “Hull Convexity Defect Features For Human Action Recognition”, Dissertation, The School of Engineering of the University of Dayton, 2011.

Intel, “Open Source Computer Vision Library”, Intel Corporation 2000-200.

Hojoon Park, “A Method for Controlling Mouse Movement using Real-Time Camera”, Master Theses and Project Report, Brown Computer Science, 2010.

How to Cite
Rudy Hartanto, & Marcus Nurtiantoro Aji. (1). Perancangan Awal Antarmuka Gesture Tangan Berbasis Visual. Jurnal Nasional Teknik Elektro Dan Teknologi Informasi, 1(1), 36-43. https://doi.org/10.22146/jnteti.v1i1.7
Section
Articles