An image from a camera on, e.g., a VR HMD is identified of a hand grasping a computer game controller. The image may be cropped to a region containing the controller and the hand to simplify processing, and a virtual representation of the hand is presented on a display such as the HMD, with the virtual representation being generated based on both image analysis of the region and a touch signal from the controller.