Comprehensive Catalog of Over 170 Text Input Techniques to Enhance Typing in XR

Unlocking efficient text entry without a physical keyboard in XR headsets is a major hurdle in the industry. Recognizing this, researchers have compiled a detailed collection of existing text input techniques, assessing their advantages and drawbacks. By offering this catalog to the public at no cost, they aim to inspire the creation of more advanced methods in the future.

Max Di Luca, a notable figure leading the VR Lab at the University of Birmingham, has made significant strides in this field. With a rich background at Meta focusing on hand inputs and VR haptics, his efforts with various industry giants have earned recognition from ACM SIGCHI. His work, alongside others, has laid down essential guidelines for XR systems.

The growing sophistication of virtual and augmented reality demands seamless text entry. Whether firing off emails in digital offices or engaging in the social corridors of the metaverse, effective typing is critical for an enhanced XR experience.

To tackle this issue head-on, our team from the University of Birmingham, alongside colleagues from international institutions and industry leaders like Google, launched the XR TEXT Trove. This project catalogs over 170 text input techniques designed specifically for XR, providing a wealth of choices while detailing the strengths and limitations of each. These are classified into 32 unique codes based on interaction properties and performance metrics such as speed and accuracy, revealing a picture of the current landscape of XR text input.

Our findings show a few clear patterns. The number of input tools—be it fingers or other devices—significantly impacts typing speed, with multi-finger use closely matching traditional keyboard speeds. Data clearly show that adding a finger increases speed by about 5 words per minute.

Other insights reveal that interactions involving physical surfaces and haptic feedback improve comfort and effectiveness, reducing issues like muscle fatigue associated with freehand typing.

Despite various innovations, no current technology rivals the classic keyboard in speed, largely due to the learning involved. Advancements in machine learning might offer the breakthrough needed for XR typing, much like swipe typing revolutionized texting on phones.

The XR Text Trove marks a step forward in enhancing our understanding of input in immersive environments. This searchable database serves as an essential tool for those developing future-ready text entry solutions.

This endeavor showcases a significant opportunity for XR advancement, as detailed in our research soon to be shared at ACM CHI in Yokohama. Some team members have also contributed to the Locomotion Vault, a database designed to aid XR research, providing an early advantage in enhancing various VR techniques.