The idea of being able to keep your personal data private feels rather laughable at the moment. It feels as though it's all being collected and monitored to try and sell you more stuff. Throwing AI into the mix, and letting it scour your devices for information, feels like ramping this process up to 11. It feels like the digital equivalent of opening up all your doors and windows when you know there are looters in your neighbourhood.
Apple says that its take on AI is different, promising privacy is baked into Apple Intelligence by default. Considering how much Apple has been pushing the privacy angle for almost a decade, and the time it's taken to actually develop Siri AI, I'm inclined to believe that everything has been built with the goal of preserving user privacy.