
Apple's iPhone is gearing up to join the AI-infused smartphone trend that has been dominating the Android market. A recent research paper by Cornell University researchers collaborating with Apple sheds light on the tech giant's plans to enhance its AI capabilities.
The paper titled 'Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs' introduces a multimodal large language model designed to comprehend mobile user interfaces, such as those found on iPhones. This model can identify icons, text, widgets, and describe on-screen elements, offering a more interactive user experience.