Apple has announced the launch of Visual Intelligence, a revolutionary feature set to debut on iOS 18 later this year. This new addition to Apple’s Intelligence suite aims to revolutionize how users interact with the world around them, directly competing with Google Lens.
Visual Intelligence, unveiled during Apple’s September 2024 event, promises to let users “instantly learn about everything they see.” This innovative feature is enabled by Camera Control, a new capacitive camera button integrated into the iPhone 16 and 16 Pro models. By simply clicking and holding this button, users can point their camera at an object of interest, and the phone will provide relevant information in real-time.
How visual intelligence works
The technology behind Visual Intelligence combines on-device intelligence with Apple services, ensuring that user images are never stored. This privacy-focused approach means that users can confidently use the feature without worrying about their data being compromised. For instance, pointing your camera at a restaurant will instantly provide details such as operating hours, menus, and ratings. Similarly, aiming it at a flyer will automatically record details like the title, date, and location of an event.
More Read
Practical applications
Visual Intelligence is not just limited to basic information retrieval. It serves as a gateway to third-party models, allowing users to search for products on Google, get help with study notes through ChatGPT, or identify dog breeds effortlessly. This integration with external tools enhances the feature’s utility, making it a versatile tool for everyday use.
Privacy at the Forefront
Apple has emphasized that Visual Intelligence is designed with privacy in mind. The feature processes data on the device itself, ensuring that Apple does not have access to the specifics of what users are identifying or searching. This commitment to privacy is a significant selling point for Apple, setting it apart from competitors like Google Lens.
While Apple has not specified an exact release date, the feature is slated to debut later this year. The integration of Camera Control and the potential for third-party tool access suggest that Visual Intelligence will continue to evolve, offering even more capabilities in the future.