{"id":8922,"date":"2024-06-11T13:49:29","date_gmt":"2024-06-11T17:49:29","guid":{"rendered":"https:\/\/tcn.tidbits.com\/?p=10490"},"modified":"2024-06-12T09:58:32","modified_gmt":"2024-06-12T13:58:32","slug":"at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features","status":"publish","type":"post","link":"https:\/\/www.macworks.com\/blog\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features\/","title":{"rendered":"Beyond iOS 18: A Look at Apple&#8217;s WWDC Highlights, Including &#8220;Apple Intelligence&#8221;"},"content":{"rendered":"<p>Apple\u2019s Worldwide Developer Conference keynote was a lightning-fast (even in the <a href=\"https:\/\/www.apple.com\/apple-events\/\" rel=\"noopener\">full 1:44-long video<\/a>\u2014or try the <a href=\"https:\/\/developer.apple.com\/videos\/play\/wwdc2024\/111976\/\" rel=\"noopener\">3-minute recap<\/a>) look at what Apple is bringing to the software side of the Apple experience in the next year. Although some past keynotes have introduced hardware like new Macs and the Vision Pro, this year\u2019s keynote stuck to new operating system features before previewing a suite of AI features collected under the umbrella term \u201cApple Intelligence.\u201d<\/p>\n<p>Apple previewed a boatload of new features and listed even more on its website. We\u2019ll focus on those we think will make the biggest splash in your Apple experience, but we recommend that you scroll through Apple\u2019s pages for each operating system to see more of what\u2019s coming. Those are linked below, along with basic hardware requirements so you can see if your devices will be eligible to upgrade (not all features will be available on all devices):<\/p>\n<ul>\n<li><a href=\"https:\/\/www.apple.com\/macos\/macos-sequoia-preview\/\" rel=\"noopener\"><b>macOS 15 Sequoia<\/b><\/a><b>:<\/b> iMac Pro from 2017, MacBook Pro and Mac mini from 2018 and later, iMac and Mac Pro from 2019 and later, MacBook Air from 2020 and later, and Mac Studio from 2022 and later<\/li>\n<li><a href=\"https:\/\/www.apple.com\/ios\/ios-18-preview\/\" rel=\"noopener\"><b>iOS 18<\/b><\/a><b>:<\/b> Second-generation iPhone SE, iPhone XR, and later (same as iOS 17)<\/li>\n<li><a href=\"https:\/\/www.apple.com\/ipados\/ipados-18-preview\/\" rel=\"noopener\"><b>iPadOS 18<\/b><\/a><b>:<\/b> Seventh-generation iPad and later, fifth-generation iPad mini and later, third-generation iPad Air and later (including M2 models), first-generation 11-inch iPad Pro and later, and third-generation 12.9-inch iPad Pro and later, and all M4 iPad Pro models<\/li>\n<li><a href=\"https:\/\/www.apple.com\/watchos\/watchos-preview\/\" rel=\"noopener\"><b>watchOS 11<\/b><\/a><b>:<\/b> Second-generation Apple Watch SE, Apple Watch Series 6 and later, and Apple Watch Ultra and later<\/li>\n<li><a href=\"https:\/\/www.apple.com\/newsroom\/2024\/06\/updates-to-the-home-experience-elevate-entertainment-and-bring-more-convenience\/\" rel=\"noopener\"><b>tvOS 18<\/b><\/a><b>:<\/b> Apple TV HD (with fewer features), Apple TV 4K<\/li>\n<li><a href=\"https:\/\/www.apple.com\/visionos\/visionos-2-preview\/\" rel=\"noopener\"><b>visionOS 2<\/b><\/a><b>:<\/b> All Vision Pro headsets<\/li>\n<\/ul>\n<p>Here are a handful of new features we think Apple users will find most interesting. Then we\u2019ll look at Apple Intelligence.<\/p>\n<h3>Personalize Your iPhone and iPad Home Screen<\/h3>\n<p>iOS 18 and iPadOS 18 introduce significantly enhanced Home Screen customization options aimed at letting your creativity shine through. You can leave blank spaces between icons and arrange icons and widgets however you like. Additionally, you can change the size of icons and widgets and apply color tints.<\/p>\n<div id=\"attachment_10493\" class=\"wp-caption aligncenter\" style=\"width: 1034px;\"><img loading=\"lazy\" decoding=\"async\" class=\"size-large wp-image-10493\" src=\"https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-1.jpg\" sizes=\"auto, (min-width: 0px) and (max-width: 480px) 480px, (min-width: 481px) and (max-width: 980px) 980px, (min-width: 981px) 1024px, 100vw\" srcset=\"https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-9.jpg 980w, https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-10.jpg 480w\" alt=\"\" width=\"1024\" height=\"576\" aria-describedby=\"caption-attachment-10493\" \/><\/p>\n<p id=\"caption-attachment-10493\" class=\"wp-caption-text\">Screenshot<\/p>\n<\/div>\n<h3>Tile Windows Automatically in Sequoia<\/h3>\n<p>macOS has long had a subtle window alignment effect that makes it easy to line up windows, but in macOS 15 Sequoia, when you drag a window to the side of the screen, macOS suggests a tiled position on your desktop, intelligently sizing it for the window\u2019s content. Window tiling makes it easy to put windows side-by-side and fill the screen without wasting space. Keyboard jockeys will appreciate new keyboard shortcuts for window tiling as well. (If you don\u2019t want to wait for Sequoia, numerous utilities offer similar features now, including\u00a0 <a href=\"https:\/\/ianyh.com\/amethyst\/\" rel=\"noopener\">Amethyst<\/a>, <a href=\"https:\/\/folivora.ai\/\" rel=\"noopener\">BetterTouchTool<\/a>, <a href=\"https:\/\/apps.apple.com\/us\/app\/magnet\/id441258766\" rel=\"noopener\">Magnet<\/a>, <a href=\"https:\/\/manytricks.com\/moom\/\" rel=\"noopener\">Moom<\/a>, <a href=\"https:\/\/rectangleapp.com\/\" rel=\"noopener\">Rectangle<\/a>, and <a href=\"https:\/\/github.com\/koekeishiya\/yabai\/wiki\" rel=\"noopener\">Yabai<\/a>.)<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-10498\" src=\"https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-2.jpg\" sizes=\"auto, (min-width: 0px) and (max-width: 480px) 480px, (min-width: 481px) 832px, 100vw\" srcset=\"https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-2.jpg 832w, https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-11.jpg 480w\" alt=\"\" width=\"832\" height=\"519\" \/><\/p>\n<h3>Notes and Phone Gain Audio Recording and Transcription<\/h3>\n<p>If you find yourself wanting to revisit what was said in a lecture, appointment, or phone call, a pair of upcoming features can boost your recall. The Notes app on all platforms will record audio and create live transcriptions, allowing you to pay attention during a talk rather than furiously taking notes. Plus, the Phone app in iOS 18 will let you record and transcribe a live call\u2014when you start recording, participants are automatically notified so everyone knows it\u2019s happening.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-large wp-image-10496\" src=\"https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-3.jpg\" sizes=\"auto, (min-width: 0px) and (max-width: 480px) 480px, (min-width: 481px) and (max-width: 980px) 980px, (min-width: 981px) 1024px, 100vw\" srcset=\"https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-12.jpg 980w, https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-13.jpg 480w\" alt=\"\" width=\"1024\" height=\"733\" \/><\/p>\n<h3>Mirror Your iPhone on Your Mac<\/h3>\n<p>If you frequently pull out your iPhone while working on your Mac, you\u2019ll appreciate Sequoia\u2019s new iPhone mirroring feature. It lets you use your Mac\u2019s pointing device and keyboard to interact with all your iPhone apps in a window on your Mac while the iPhone remains locked or in StandBy. Audio from the iPhone plays through your Mac, and you can share data between devices with drag and drop. A related Continuity feature displays iPhone notifications on your Mac\u2014when mirroring your iPhone, clicking those notifications opens the associated iPhone app.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-10497\" src=\"https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-4.jpg\" sizes=\"auto, (min-width: 0px) and (max-width: 480px) 480px, (min-width: 481px) and (max-width: 980px) 980px, (min-width: 981px) 992px, 100vw\" srcset=\"https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-4.jpg 992w, https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-14.jpg 980w, https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-15.jpg 480w\" alt=\"\" width=\"992\" height=\"615\" \/><\/p>\n<h3>Passwords Breaks Free of Settings<\/h3>\n<p>At long last, Apple has given us a dedicated Passwords app in Sequoia, iOS 18, iPadOS 18, and visionOS 2. The company\u2019s password management features have become quite good over the past few years, but they are awkward to access in Settings on the iPhone and iPad and System Settings on the Mac. We don\u2019t anticipate significant feature changes beyond the addition of categories, but the Passwords app should make managing your logins even easier. Passwords still won\u2019t fully match up to the likes of 1Password, but you won\u2019t go wrong with Apple\u2019s built-in solution. Remember that if you use a Web browser other than Safari, you\u2019ll need the <a href=\"https:\/\/chromewebstore.google.com\/detail\/icloud-passwords\/pejdijmoenmkgeppbflobdenhhabjlaj\" rel=\"noopener\">iCloud Passwords<\/a> extension we\u2019ve mentioned previously. You can also share your passwords with a Windows PC using <a href=\"https:\/\/support.apple.com\/guide\/icloud-windows\/what-is-icloud-for-windows-icwd3c1cca5e\/icloud\" rel=\"noopener\">iCloud for Windows<\/a>.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-large wp-image-10495\" src=\"https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-5.jpg\" sizes=\"auto, (min-width: 0px) and (max-width: 480px) 480px, (min-width: 481px) and (max-width: 980px) 980px, (min-width: 981px) 1024px, 100vw\" srcset=\"https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-5.jpg 1024w, https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-16.jpg 980w, https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-17.jpg 480w\" alt=\"\" width=\"1024\" height=\"734\" \/><\/p>\n<h3>Five More Welcome Features<\/h3>\n<p>For more reasons to upgrade once these new operating systems are out and stable, consider the following additional features:<\/p>\n<ul>\n<li><b>Customize Control Center:<\/b> iOS 18 and iPadOS 18 feature a thoroughly revamped Control Center, accessible with a continuous swipe down on the Home Screen. You can create custom groups of controls\u2014some from third-party apps\u2014with resizing and mixing options.<\/li>\n<li><b>iPad Calculator app and Math Notes:<\/b> Not only does the iPad finally get a Calculator app, but it also introduces Math Notes. You handwrite an equation with an Apple Pencil, and when you write an equals sign, Calculator solves the equation. Math Notes works with keyboards, too, and you can also find it in the Notes app.<\/li>\n<li><b>Lock and hide iPhone apps:<\/b> New privacy features in iOS 18 and iPadOS 18 let you lock apps with Face ID or Touch ID so the friend who\u2019s scrolling through your vacation photos can\u2019t also read your journal. You can also move apps to a hidden folder in the App Library that can\u2019t be opened without biometric authentication.<\/li>\n<li><b>More tapbacks:<\/b> In Messages, when you want to use a tapback to acknowledge a message without typing out a reply, you\u2019ll be able to use any emoji or sticker, or a new AI-powered Genmoji.<\/li>\n<li><b>Vitals app collects overnight data:<\/b> When you wear your Apple Watch to sleep, a new Vitals app in watchOS 11 collects and displays your overnight health metrics on your wrist, including heart rate, respiratory rate, temperature, blood oxygen, and sleep duration. It might help you rest up to fight off that cold that\u2019s going around.<\/li>\n<\/ul>\n<p>Apple usually releases its new operating systems in September or October; we\u2019ll write more about them as we get closer. Generally speaking, it\u2019s OK to upgrade to everything but macOS shortly after release; with macOS, we recommend caution to ensure your existing apps and workflows won\u2019t be impacted.<\/p>\n<h3>Apple Intelligence<\/h3>\n<p>Apple devoted a large chunk of the keynote to introducing <a href=\"https:\/\/www.apple.com\/apple-intelligence\/\" rel=\"noopener\">Apple Intelligence<\/a>, a collection of AI-powered features coming to the Apple ecosystem over the next year. These features will enable your iPhone, iPad, and Mac to understand language and create both text and images, plus take actions aimed at simplifying your interactions with apps. What sets Apple Intelligence apart from AI efforts from other companies is its focus on\u2014and understanding of\u2014your personal context. Apple Intelligence will know about your contacts, schedule, email, messages, photos, and much more.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-large wp-image-10492\" src=\"https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-6.jpg\" sizes=\"auto, (min-width: 0px) and (max-width: 480px) 480px, (min-width: 481px) and (max-width: 980px) 980px, (min-width: 981px) 1024px, 100vw\" srcset=\"https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-18.jpg 980w, https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-19.jpg 480w\" alt=\"\" width=\"1024\" height=\"457\" \/><\/p>\n<p>The most significant use of Apple Intelligence will come with Siri, which will let us speak more naturally and understand what we mean if we make mistakes. We\u2019ve trained ourselves to say only things Siri is likely to be able to handle, but that won\u2019t be necessary when Siri gains Apple Intelligence capabilities. You\u2019ll be able to search for photos of your child holding a fishing rod, for instance, or ask Siri to find something when you can\u2019t remember if it was in Mail or Messages. Siri will also gain context awareness, so you can ask what the weather will be like at the beach tomorrow, and if the response is good enough, have it schedule a trip there. Siri will even know a lot more about your Apple devices and can help you use them. For the most part, though, Siri won\u2019t have global knowledge. If Siri can\u2019t answer your query directly, it will offer to send it to ChatGPT for free.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-large wp-image-10499\" src=\"https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-7.jpg\" sizes=\"auto, (min-width: 0px) and (max-width: 480px) 480px, (min-width: 481px) and (max-width: 980px) 980px, (min-width: 981px) 1024px, 100vw\" srcset=\"https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-20.jpg 980w, https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-21.jpg 480w\" alt=\"\" width=\"1024\" height=\"576\" \/><\/p>\n<p>Apple Intelligence also includes writing tools, but unlike ChatGPT, it\u2019s not aimed at creating text from scratch. Instead, it can rewrite text you\u2019ve written to help you fine-tune the wording or adjust the tone to be more appropriate. It can also proofread text, helping you with grammar, word choice, and sentence structure (if you need this now, check out <a href=\"https:\/\/www.grammarly.com\/\" rel=\"noopener\">Grammarly<\/a>). Even when Apple Intelligence does create text, such as the Smart Reply feature coming to Mail, it asks you questions to guide its response.<\/p>\n<p>Text summarization powered by Apple Intelligence shows up repeatedly. In Notes, you\u2019ll be able to summarize a transcription. If you save a long article to Safari\u2019s Reader, it can provide a table of contents and summary. In Mail, instead of the first few sentences appearing in the message list, you\u2019ll get a short summary. Apple Intelligence can even prioritize and summarize notifications.<\/p>\n<p>Unsurprisingly, Apple Intelligence lets you create and edit images, but it\u2019s a far cry from the AI artbots that let you create photo-realistic images. Instead, Apple Intelligence lets you create custom emoji, called Genmoji, which let you express yourself graphically in ways that standard emoji can\u2019t support. Image Playground lets you create images for inclusion in conversations and documents, but it limits you to three styles: Sketch, Illustration, and Paint. Apple doesn\u2019t want anyone making deepfakes with Apple Intelligence. A new Image Wand feature in Notes even turns your rough sketches into polished images.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-large wp-image-10494\" src=\"https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-8.jpg\" sizes=\"auto, (min-width: 0px) and (max-width: 480px) 480px, (min-width: 481px) and (max-width: 980px) 980px, (min-width: 981px) 1024px, 100vw\" srcset=\"https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-22.jpg 980w, https:\/\/macworks.com\/blog\/wp-content\/uploads\/2024\/06\/at-wwdc-apple-unveils-apple-intelligence-and-previews-new-os-features-23.jpg 480w\" alt=\"\" width=\"1024\" height=\"575\" \/><\/p>\n<p>Apple took great pains to emphasize the privacy aspects of Apple Intelligence. Most Apple Intelligence tasks will take place entirely on your device, hence the need for powerful Apple silicon chips with their Neural Engines and Secure Enclaves. Some tasks require more processing power; to handle those, Apple has developed a highly secure system called <a href=\"https:\/\/www.apple.com\/newsroom\/2024\/06\/apple-extends-its-privacy-leadership-with-new-updates-across-its-platforms\/\" rel=\"noopener\">Private Cloud Compute<\/a>. It relies on Apple silicon servers, transfers only the data necessary to the task, and stores nothing.<\/p>\n<p>Apple Intelligence features will start arriving in the fall and continue to roll out in feature-release updates over the next 6\u20138 months. They will run only on the iPhone 15 Pro, iPhone 15 Pro Max, and iPads and Macs with M1 or later chips. Intel-based Macs and less-powerful iPads and iPhones need not apply. Apple Intelligence will also require Siri and the device language to be set to US English in the early releases, with other languages to follow.<\/p>\n<p>Overall, Apple appears to have put a great deal of thought and effort into integrating AI into the Apple experience in focused, helpful ways that offer new capabilities while preserving user privacy. We won\u2019t know how well these features will work until they ship, but we look forward to seeing how they can improve interactions with our Apple devices.<\/p>\n<p>(Featured image by Apple)<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Apple\u2019s Worldwide Developer Conference keynote was a lightning-fast (even in the full 1:44-long video\u2014or try the 3-minute recap) look at what Apple is bringing to the software side of the Apple experience in the next year. Although some past keynotes have introduced hardware like new Macs and the Vision Pro, this year\u2019s keynote stuck to [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":8923,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[9,69,106,112,185],"tags":[],"class_list":["post-8922","post","type-post","status-publish","format-standard","has-post-thumbnail","category-apple","category-apple-consulting-ct","category-apple-support-ct","category-mac-support-ct","category-mactech"],"_links":{"self":[{"href":"https:\/\/www.macworks.com\/blog\/wp-json\/wp\/v2\/posts\/8922","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.macworks.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.macworks.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.macworks.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.macworks.com\/blog\/wp-json\/wp\/v2\/comments?post=8922"}],"version-history":[{"count":3,"href":"https:\/\/www.macworks.com\/blog\/wp-json\/wp\/v2\/posts\/8922\/revisions"}],"predecessor-version":[{"id":8927,"href":"https:\/\/www.macworks.com\/blog\/wp-json\/wp\/v2\/posts\/8922\/revisions\/8927"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.macworks.com\/blog\/wp-json\/wp\/v2\/media\/8923"}],"wp:attachment":[{"href":"https:\/\/www.macworks.com\/blog\/wp-json\/wp\/v2\/media?parent=8922"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.macworks.com\/blog\/wp-json\/wp\/v2\/categories?post=8922"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.macworks.com\/blog\/wp-json\/wp\/v2\/tags?post=8922"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}