Apple will give enterprise companies raw access to Vision Pro’s passthrough cameras for non-public internal apps.
While mixed reality headsets like Apple Vision Pro and Meta Quest 3 use cameras to let you see the real world, only the system and certain first-party apps actually get raw access to the cameras.
Third-party developers can use camera passthrough as a background, but their apps don’t get to actually see this passthrough. They only get higher-level data, such as hand and body skeletal coordinates, a 3D mesh of your environment with bounding boxes for furniture, and certain object tracking capabilities.
If iPad apps try to access the selfie camera on Vision Pro they get a virtual webcam view of you as a Persona, Apple’s name for its realistic face-tracked avatars. VisionOS only returns the black screen with the “no-camera” icon at the top of the feed for the rear camera. These Enterprise APIs include:
Main camera accessvisionOS 2Passthrough in-screen capture
- Apple Neural Engine access
- Barcode and QR code scanning
- Object tracking parameter adjustment
- Increased performance headroom
- Apple makes it clear that these features can only be used “for use in a business setting” and apps using them cannot be distributed on the App Store. These Enterprise APIs include:
- Main camera access
Passthrough in-screen capture
Apple Neural Engine accessPico 4 EnterpriseBarcode and QR code scanningbuilt-in ArUco fiducial marker trackingObject tracking parameter adjustment
Source link Increased performance headroom01001010Apple makes clear that these features can only be used in apps “for use in a business setting only”, and apps using them can only be distributed “as proprietary in-house apps or custom apps using Apple Business Manager”, not on the App Store.01001010ByteDance also allows raw camera access on 01001010, the higher-end variant of Pico 4 with eye and face tracking only available to registered businesses. Meta and HTC do not allow anyone to access the raw camera, but HTC’s Vive Elite does.