Researchers developed PropType, a novel AR interface that allows users to turn everyday objects (i.e., water bottles, mugs, books or soda cans) into usable typing surfaces. Instead of relying on floating virtual keyboards or external hardware, PropType overlays a virtual keyboard layout onto a physical object being held or manipulated, leveraging the object’s real tactile feedback and adapting the layout to the object’s shape and how the user grips it.
To create this system, the team conducted a study with 16 participants to understand how people hold different props and type using them; they then developed custom keyboard layouts and a configuration/editing tool so users can tailor their typing surface and visual feedback. Because people are already interacting with a tangible object, the approach promises better comfort (avoiding gorilla arm fatigue) and more intuitive text input in mobile or device-free AR scenarios.
More information:
https://interestingengineering.com/innovation/proptype-ar-interface-keyboard