Apple Intelligence Coming to Vision Pro in April

# apple

Apple Intelligence is making its way to the Vision Pro with the upcoming visionOS 2.4 update. Apple announced on Friday that its generative AI platform will soon be available on the extended reality headset, with a beta version already accessible to developers. The public release is scheduled for April. Just like with the iPhone and Mac, the Vision Pro will get Apple Intelligence updates in stages. The initial batch includes familiar features, mainly centered around text and image generation. Apple believes that tools like Rewrite, Proofread, and Summarize will be vital for enhancing on-device productivity. It's important to remember that Apple has always marketed Vision Pro as a "spatial computing" device. Beyond its video, gaming, and entertainment capabilities, the company aims to distinguish it from other extended reality devices by presenting it as an extension of desktop computing—what TechCrunch called "The infinite desktop" in our review. Typing on the headset can be a bit of a hassle. The default method involves looking at a letter and then pinching two fingers to select it. While it works well, it becomes cumbersome for anything more than a few words. Voice dictation helps alleviate this issue to some extent, and the recent AI enhancements to Siri suggest a promising future for the smart assistant on Vision Pro. Apple is betting on a mix of voice dictation and AI-powered writing tools to create a smoother experience, encouraging more Vision Pro users to integrate the headset into their daily work. At the very least, features like Message Summaries and email Smart Reply make it easier to interact with different apps without disrupting your current task. Image Playground is another key feature coming with the visionOS 2.4 update, enabling image generation directly within the visionOS Photos app through voice commands. All these features have already been introduced on iOS, macOS, and iPadOS. There aren't any new Apple Intelligence features exclusive to Vision Pro in this update. Alongside visionOS 2.4, Apple has also released a Vision Pro iPhone app with iOS 18.4, currently in beta. This app serves multiple purposes, including browsing visionOS content like TV shows and movies, which can then be transferred to the headset. This is partly a solution to the headset's limitations in terms of comfort and battery life. It's much easier to scroll through content on your iPhone. When an iPhone is unlocked and near the headset, the new app can also manage guest accounts. The Vision Pro will notify its owner when someone tries to sign in as a guest, and the app provides a live stream of the guest's in-headset view.

Related article

Comments (29)