• Segment hand region from a real-time video sequence

  • Background Subtraction
  • Motion Detection and Thresholding
  • Contour Extraction

• Count fingers

  • Get convex hull of the segmented hand region and compute the most extreme points in the convex hull
  • Get center of palm using extremes points
  • Using center of palm, construct a circle with the maximum Euclidean distance as radius
  • Perform bitwise AND operation on thresholded hand image and the circular ROI
  • Compute count of fingers using the finger slices obtained in previous step

Memory Intensive Operation
This script creates screenshot for every frame captured and stores it in directory 'screenshots'
Hence, there is a little delay during frame capture

• Segment hand region
• Detect numbers using count of fingers
• Detect characters using finger motion
• Capture words using word motion
• Automate tasks with each character / word