Apple is opening the Vision Pro to a wider ecosystem of hardware with visionOS 27. By introducing support for “spatial accessories,” the update enables third-party developers to create actively-tracked motion controllers and tools that use IR LED patterns and Bluetooth-connected IMUs for high-precision input.
How does visionOS 27 change Vision Pro input?
Until now, Vision Pro users primarily relied on a “look and pinch” system, using their eyes and hands to navigate. While effective for standard interfaces, this approach lacked the precision required for high-performance tasks. visionOS 27 changes this by moving beyond “passively-tracked” objects—which the headset tracks simply by their visual appearance—to “actively-tracked” spatial accessories.
According to Apple, these new spatial accessories communicate directly with the headset. They use a combination of infrared (IR) LED patterns and positional data streamed from an on-board Inertial Measurement Unit (IMU) via Bluetooth. This dual-method approach is the industry standard for VR motion controllers, offering significantly greater precision and lower latency than visual tracking alone.
This technical shift allows accessories to provide hundreds of updates per second. Apple notes that spatial accessories will be able to track at the headset’s display rate, which is nominally 90Hz but can reach up to 120Hz.
The new tracking capabilities allow accessories to match the headset’s display rate of up to 120Hz, ensuring that movement feels instantaneous and smooth to the user.
What kind of accessories can developers build?
The new software framework allows for much more than simple pointing tools. As detailed in a recent Apple developer session, spatial accessories can now transmit complex input data, including information from buttons and thumbsticks. This opens the door for traditional gaming controllers, specialized styluses, and industrial tools.
Developers can include a tracking profile within a visionOS app. According to Apple, once this profile is included, the accessory registers system-wide, meaning any app on the Vision Pro can utilize the hardware. However, there is a distinction in functionality: third-party accessories will not have the same level of integration as Apple’s official accessories, such as the PSVR 2 controllers or the Logitech stylus.
Developing with Reference Hardware
To accelerate this ecosystem, Apple has partnered with DFRobot and MIKROE to produce off-the-shelf trackers. These units are designed to serve as “reference hardware and development kits,” giving creators a physical starting point to build compatible Vision Pro accessories. Apple expects these trackers to be available later this year.
While third-party controllers offer high-precision tracking, remember that they won’t support the full VisionOS interface. Focus on optimizing your app’s custom input handling to get the most out of the new IMU and IR LED support.
Why is Apple shifting its hardware strategy?
When the Vision Pro first launched, its dismissal of motion controllers was a bold design choice. By focusing entirely on eye and hand tracking, Apple created a unique, intuitive way to interact with flat content. However, this choice created a barrier for the most demanding applications, specifically high-end VR gaming and professional simulations.
This update suggests Apple is responding to two distinct needs:
- Enterprise and Training: In professional settings, such as medical simulations or industrial training, the precision of a physical controller is often non-negotiable.
- The Gaming Gap: While Apple previously made the PSVR 2 controllers officially supported, the lack of a broad controller ecosystem meant many established VR titles could not run on the headset.
By opening the door to third-party manufacturers, Apple is moving from a closed, gesture-only ecosystem toward a versatile platform capable of supporting various professional and recreational use cases.
Frequently Asked Questions
Can I use my existing VR controllers with Vision Pro?
Not automatically. While visionOS 27 allows for third-party support, manufacturers must specifically design their products to include the necessary IR LED patterns and Bluetooth IMU data to be recognized as spatial accessories.
What is the difference between passive and active tracking?
Passive tracking relies on the headset’s cameras to recognize the shape of an object. Active tracking uses hardware like IR LEDs and IMUs to communicate precise movement and positional data directly to the headset.
When will new developer hardware be available?
Apple has stated that the reference hardware and development kits from DFRobot and MIKROE will be available later this year.
Will third-party controllers work with all Vision Pro apps?
If a developer includes a tracking profile in their app, the accessory can be registered system-wide. However, these accessories may not support the full, specialized interface features available to official Apple-supported accessories.
What do you think about Apple’s move toward motion controllers? Will this change how you use your headset? Let us know in the comments below!
