This years Apple’s WWDC event was one of the most talked event as it bring some amazing features to Apple’s ecosystem. Whether it be IOS18 feature or siri update it was filled will power packed AI. Some of the features will really change the way we use Apple devices. Especially the new calculator math note which really takes us to next level experience with Artificial Intelligence.

Here in this article we will discuss key takeaways from WWDC 2024 event.

VisionOS 2

First thing that they introduce in WWDC 24 event was VisionOS 2 for Vision Pro. It is VisionOS first major update since its launch in 2nd Feb 2024. Since then nearly 2000 apps has been created for Apple Vision Pro.
Now Apple VisionOS 2 is improved a lot. It propel spatial computing forward with new ways to connect with your most important memory, great enhancement to productivity and powerful new developer API for emersive experience.
These are some new key features:

Spatial Photo: VisionOS 2 allows you to turn normal photo to spatial photo with natural depth. That gives 3D feel to your images on Vision Pro.

SharePlay: Now you can have spatial persona of a person sitting miles away from you while sharing photo with that person. This makes photo sharing more enjoyable.

Enhanced Gestures: Now you can hold hand up and tap to open home screen. To check battery levels and time flip your hand over.
Tap to open control center, that gives you quick access to frequently used features like notification and max virtual display.

Max Virtual Display: Talking about Max virtual display now it comes with higher resolution and size, that can be expanded further to ultra wide display. Vision Pro will now support resolution equivalent to two 4k displays.

Train support: VisionOS now includes train support for better travel experience. Now you can view movies in ultra wide screen with high resolution during travel without disturbing others.

Powerful developer API: For developer Apple introduce new powerful API to create apps for its Vision Pro. These includes Volumetric API, Tabletopkit API, Enterprise API.

IOS 18 for IPhone

New features of Apple IPhone new IOS 18 was unveiled in WWDC 24. It mainly focus on customization and security.

Customizable Home Screen: IOS18 comes with highly customizable home screen. Now you can arrange Apps and Widgets as needed. You can customize color on home screen using Theme Engine and add icons for dark mode.

Control Center: In IOS18 new group of control were introduce like media player and home controls. Swipe top right corner down to open controls. You can get directly to any control group by continous swipe.
You can add new control from control gallery, resize and adjust controls as per your need.
In new IOS18 controls are also available from lock screen, you can replace torch with specific control.
You can use action button open controls.

AppLock: In IOS18 you can lock any of your installed app. Now you don’t have to worry about anyone getting access to your phone, you can simply lock apps that you don’t want other to see. Even if they have access to your phone they will need biometrics or password to authenticate before opening those locked apps.
The information from the app like search, notifications, spotlight suggestion, call history, siri suggestion will remain hidden. Your sensitive information will remain protected and hidden.
If you don’t want anyone to see that you have installed certain apps, then you can simply hide those apps and access it through hidden folder that’s locked by default.

Messages: In IOS18 you can use tapbacks to send any emoji or stickers, schedule messages to send later, format text to bold, italic or underline, add text effects to visually amplify messages that can animate text and emojis in different ways.
Not just that but now you can also send messages in both i message and sms via satellite. I think it is one big update for messaging with IPhone. Messages send via satellites and end to end encrypted.

Mail: IOS18 comes with on device categorization to manage emails. It includes categories like:

Primary for messages from people whom you know, time sensitive emails, etc.
Transaction categories include mails related to transactions like orders and receipts.
Update categories include newsletter or social media notifications.
Promotion include marketing and sales.
There is also category where you can see all your emails.

Map: Updated IOS18 map includes topographic maps with detailed trail network and hiking routes with voice assistance. It can be saved to phone and accessed offline.

Wallet: You can now simply tap to cash. It is a quick way to exchange Apple cash without sharing phone number or email.

Game Mode: Game mode is now coming to IPhone with more immersive experience. Game mode minimizes background activity to sustain higher framerates and it dramatically improves responsiveness with airpod and wireless game controllers.

Photos: IOS18 have redesigned photos app. The new photos app keeps library organised and makes it super easy to find photos fast. Now you can filter photo or view photo from specific year or month. It organises photo into collection that you can browse with topics. You can also organise these collections.

Audio and Home

Audio:

Now you can interact with siri through gesture by simply nodding and shaking you head.
New Air pod pro comes with voice isolation to remove background noise and give you best audio quality.
Personalised spatial audio for airpods to give great experience for gaming.
Need for speed mobile by tencent games and EA will be first game to get this feature.

Home and TVOS:

Apple TV+ comes with new feature like insight that gives you info about movie or show you are watching that includes artist, song and other details, you also add song to apple music playlist from insight.
Enhance dialogue now uses machine learning for better vocal clarity.
Apple TV now comes with 21:9 format projectors.

WatchOS 11 for watch

Training Load: WatchOS 11 introduces training load an insightful way of measuring intensity and duration of a workouts that is impacting your body over time.
To track intensity it comes with new way to rate workout by using calorimetry data like heart rate, pace and elevation along with personal data like age and weight, it determines effort rating with inbuilt alogrithm. You can review rating on summary page.
It is then used to calculate Training Load.
It also comes with customizable summary tab to show information that you want to see.

Vitals app: In vitals app you can check daily health status and important health metrics.
It gives you tailored message about your metrics.

Cycle tracking: Cycle tracking is enhanced with pregnancy tracking features. It now shows you gestational age to support you during this important time.

Smart stacks: It now automatically add new widget when you need it, like precipitation widget before rain or translation widget when you travel to new place.
It uses machine learning model for speech recoginition and translation.
You can now customize watch face powered by AI.

IPadOS 18

IPadOS 18 comes with same feature as IOS 18 for IPads like theme engine for changing colors and dark mode, updated control center and photos app. But it also comes with more features specific to IPad.

Floating Tab bar: IPadOS introduced new floating tab bar, that makes it easy to navigate and keeps content edge to edge.
For more options tab bar moves to side bar, so you get to view and choose from more options. You can also customize the tab bar.
Developers gets access to new animation API to add different animation to their apps.

Shareplay: It allows you to share screen and remotely controls other persons Ipad after their permission.

Freeforms: It add scenes to select sections of board and present them one by one.

Calculator: I think calculator was major highlight. IPad comes with a calculator with lot more options for calculations.
IPad calculator have now become even more powerful with apple pencil.
IPadOS introduced new Math Note, that can be accessed through calculator. Use apple pencil to write down mathematical equation like you do it on paper and it will solve it live.
It uses AI to recognise different equation and variables, and calculates value for you live in the same handwriting you wrote in.
It not just solve simple equation but it can also solve complex maths and physics problems.
And to your surprise can also create graph that update in real time with change in variable.
You can also use these feature in Notes app.

SmartScript: Notes app comes with smartscript that refines your handwriting while you are writing with pencil, you can scratch to erase, and drag and move lines to write in between lines and many more such amazing features powered by Artificial intelligience.

macOS Sequoia

Apple announced new macOs Sequoia at WWDC 2024.
macOS Sequoia enhances the continuity feature, which makes using Apple products together even better.

iPhone Mirroring: The new macOS Sequoia comes with iPhone mirroring. It allows you to view and control your iPhone with Mac. You can fully interact with iPhone and apps wirelessly using a trackpad. You can use a Mac keyboard to enter any text. Not only that you can also see your iPhone notifications directly on Mac and you can click on it and open it on the mirrored window of your iPhone.
Your iPhone stays locked while you are using your iPhone on your Mac. You can also edit things on the Mac book with apps on your Mac and directly drag and drop it on your iPhone to use on your iPhone.

Tile position: Now macOS automatically suggests tile position on the desktop when you drag any windows to the edge of the screen.

Conferencing: Video conferencing now comes with a presenter preview that lets you see what you are going to share before you share it. It currently works with FaceTime and Zoom app.
You can also replace the background during video conferencing with some built-in background or any of your photos. Background replacement uses Apple’s industry-leading segmentation to make you look perfect during video conferencing.

Passwords app: It is an app provided by Apple to store and manage all your credentials in one place. Password app organizes passwords, security alerts, verification codes, and other credential for you. You can also find this app on iPhone, iPad, and Vision Pro. You can sync passwords across devices and use them to autofill credentials when needed.

Safari: Apple claims that on macOS Sequoia Safari is the fastest browser in the world. It offers 4 hours more battery life than Chrome while streaming video. It allows secure and private browsing. It protects your history and prevents websites from seeing what you do while you browse. It is built on a WebKit that supports the latest web standards.

Highlight: When you visit any page safari helps you detect and give info on the page with highlights. Safari uses machine learning to automatically detect relevant information highlighted for you as you browse.
Reader: Safari reader that helps you to read articles distraction-free now includes a table of contents and helpful summary next to the article.
Viewer: It is built for a distraction-free video experience. When the video is detected by a safari viewer put that video in front and centre giving you full access to system playback controls like AirPlay and picture and picture.

Apple Intelligence

One of the biggest highlights of WWDC 2024 was the announcement of Apple intelligence by Tim Cook.

Apple intelligence is a personal intelligence system that is built for personal Apple products to make user experience even more delightful.
Recent developments in generative intelligence and large language models offer powerful capabilities to take the experience of using Apple products to new heights.
Apple intelligence will enable Apple devices to understand and create languages, and images and take action to simplify interaction across apps, that understand your context.
Apple intelligence also helps you create and personalize images. It allows you to create images as sketches, illustrations, and animation. This feature is built throughout the system like notes, keynote, freeform, and even pages.
AI lets you orchestrate a lot of actions like playing specific podcasts, opening and searching certain files, creating folders or new projects, and many more on command.
Personal context takes data from different apps you use and helps you with your task based on that data.
Apple processes most of these requests locally with Apple silicon chip powered with AI.
But if it cannot be processed on the device then it uses a cloud privately built for users called private cloud computing. It only sends data relevant to the task to be processed on Apple silicon server.

Private cloud computing: Private cloud computing allows Apple intelligence to scale its computational capacity and draw on an even larger server-based model for more complex requests.
This model runs on Apple’s specially created server using Apple silicon. This Apple silicon server offers privacy and security.
Apple claims it doesn’t store your data, it only uses it to fulfill your request. Independent experts can verify the code that runs on these servers.

Siri: Apple intelligence makes Siri more natural, relevant, and personal. It can understand you even if you make grammatical errors. You can switch between voice and text to talk with Siri.

Siri now understand your Apple product better and can help you to accomplish any task on your Apple product.
on-screen awareness: AI will provide Siri with on-screen awareness. So it will be able to understand and take action with things on your screen.
Siri can take action inside the app on your behalf, like finding a photo of the ID, getting the ID number, and autofilling the ID number into the form.
Developers can take benefit of AI using App Intents API.

Writing tools: AI enhances your system-wide writing tools for apps like Notes and Email.
Rewrite gives you different versions of what you have written, you can choose what you think is best. It shows suggestions inline, it fixes tone, does proofreading, and even summarizes what you have written. This writing tool is available system-wide including third-party apps.

Smart reply: AI also powers smart reply in mail. It suggests the response based on the email. It offers an intelligent selection to choose from your response.
AI creates a summary for your email list so you view proper summary for each email before opening it.
Not only that you can open the email and view the summary of the entire mail if the email is too long.

Genmoji: it allows you to create emojis using AI. Just provide description of how emojis will look and it will create emojis as per the description and you can select which one you like.

Image playground: A new way to create playful images just in second. It allows you to create images from a selected range of concepts like themes, costumes, accessories, places and more or if you have specific idea you can type a description to add it to the playground.
After selecting options from available concepts AI creates multiple previews of that image. Then you select image and send it directly in your message.

Image wand: It can transform rough sketches into polished images that complement your notes and make them more visual. Image wand uses on-device intelligence to analyze the sketch and words and create perfect image.

Photo editing: AI helps in editing photos by removing unwanted objects in images.
It can also help you with creating movies from your photos and videos as per your description.

Natural language searching: With AI now you can search for things in your app like photos in your photo gallery by just describing the image.

ChatGPT: Now Apple devices are integrated with ChatGPT.

Siri is powered by ChatGPT. After you ask a question it will ask permission to share your question with ChatGPT and will get an answer from ChatGPT and display it for you.
ChatGPT is also integrated with system-wide writing tools with compose. You can create content with ChatGPT for whatever you are writing about.
It also uses ChatGPT image capabilities to generate images.
ChatGPT is free for Apple devices and no account creation is required.
Apple Intelligence will be available on iPhone 15 Pro and iPad and Mac with M1 and later.