# Effective Gesture Based Framework for Capturing User Input

**Authors:** Pabbathi Sri Charan, Saksham Gupta, Satvik Agrawal, Gadupudi Sahithi Sindhu  
**arXiv:** [2208.00913](https://arxiv.org/abs/2208.00913)  
**Date:** 2022-08-01  
**Summary page:** https://www.summarizepaper.com/en/paper/2208.00913v1/

## Key points

- Computers are now used on mobile devices such as smartphones and tablets
- QWERTY keyboard has remained largely unchanged for over 50 years
- Researchers have developed a framework that uses image processing to detect hand gestures with precise accuracy
- The system utilizes a camera to capture keyboard images and finger movements, creating a virtual keyboard
- The framework includes a visible virtual mouse that accepts finger coordinates as input
- This approach reduces peripheral costs and minimizes electronic waste generated by external devices
- The proposed gesture-based framework offers a sustainable and financially viable solution for modern computer users seeking more intuitive input methods

## Summary

The use of computers has expanded beyond traditional laptops and desktops to include mobile gadgets such as smartphones and tablets. To address the issue of the QWERTY keyboard, an input device that has been in use for over 50 years remaining largely unchanged, researchers have developed a novel framework that uses image processing to create an application for detecting hand gestures with precise accuracy. The system utilizes a camera to capture keyboard images and finger movements which act as a virtual keyboard. Additionally, the framework includes a visible virtual mouse that accepts finger coordinates as input. This approach not only reduces peripheral costs but also minimizes electronic waste generated by external devices while providing accessibility to individuals who cannot use traditional keyboards and mice. The proposed gesture-based framework offers a sustainable and financially viable solution for modern computer users seeking more intuitive input methods.