Управление
Hand tracking
Также известны как hand-tracking, controller-free input, gesture input, finger tracking
Hand tracking lets a headset see your bare hands with its cameras and turn finger movements into input, so you can point, pinch, grab and type without holding controllers.
Hand tracking uses the headset's outward-facing cameras and machine-learning models to recognize your hands and estimate the position of each finger joint in real time. Your virtual hands then follow your real ones, and simple gestures act as input.
Common gestures
- Pinch thumb and index finger to select, much like a mouse click.
- Pinch and drag to scroll or move windows.
- Poke virtual buttons and keyboards directly.
- Grab objects by closing your hand around them in supported apps.
Where it works well, and where it does not
Hand tracking is great for menus, media, browsing, social apps and casual games, and it makes a headset quicker to pick up. It is less suited to fast action games: there are no buttons or triggers, there is no haptic feedback, and tracking can drop when hands overlap, leave the cameras' view, or the room is dark.
Devices
The Apple Vision Pro is designed around hands and eye tracking with no controllers in the box. The Meta Quest 3, the Samsung Galaxy XR and the PICO 4 Ultra support both hands and controllers. The PlayStation VR2 relies on its Sense controllers instead.
Связанные термины
- Eye tracking
- Eye tracking uses small cameras inside a headset to follow where your eyes are looking, enabling gaze-based menus…
- Haptics
- Haptics is touch feedback in VR, usually vibration in controllers or the headset, that lets you feel impacts, textures…
- Inside-out tracking
- Inside-out tracking uses cameras and sensors on the headset itself to work out where you are in the room…