New AI, iPhone control from Mac, and other features: the most important from WWDC 2024

Apple has once again amazed its fans. On June 10, during the WWDC developers conference, we saw updates to the operating systems of Apple devices. These include the latest visionOS for Apple Vision Pro augmented reality headsets, macOS 15 Sequoia, iOS 18, WatchOS 11, iPadOS 18, as well as features for AirPods Pro and Apple TV. The presentation of Apple Intelligence, the company’s own AI system, created a real sensation. We will present you the most important highlights.

VisionOS 2

• The new version of the operating system for virtual reality headsets will feature a special photo mode. With the “volumetric” 3D mode, it will be possible to view regular photos from iCloud, giving a sense of presence as if the person is nearby.
• Additionally, new gestures will be added to control the device.
• The virtual screen will become even larger, equivalent to two 4K monitors placed side by side. The customization options will also be enhanced.
• And one more piece of news: very soon, the Vision Pro will be available for sale in eight new countries.

iOS 18

Customization, security, functionality—this is how the new iPhone operating system can be briefly described, which will be released for all users in the fall. iOS 18 has added new features that were previously missing.

• You can move icons on the desktop as you like. You can also change their size and color. When using Dark mode, you can make the icons dark. Or apply a single filter to them. This gives them a more stylish look.

• Customizable Control Center: Users will be able to change the layout of elements, and developers will be able to add new modules.
• Updated Photos App Design: Includes filtering by content type, and collections are created online.
• Lock Screen App Selection: Choose which apps can be launched from the Lock screen. Currently, only “Flashlight” and “Camera” are available, but in the future, any app can be added for one-touch access.
• App Protection: Any app can be password-protected or authorized via Face ID or Touch ID. Apps can also be completely hidden from the device.
• Wallet Update: Allows money transfers between people simply by bringing their phones close together (however, this Tap to Cash feature is not yet available to us).
• New Gaming Mode: Enhances iPhone’s maximum performance, much to the delight of gamers.
• iMessage Updates in Fall: Will include message scheduling, text editing, and quick replies. Text can be corrected before the recipient reads it, and messages can be pre-sent with a set delivery time.
• Automatic Email Sorting: The Mail app will now automatically sort emails into folders.

Audio & Home

The AirPods Pro will also receive new features, but only the new 2nd generation.

• Gesture Recognition: The earbuds will recognize gestures. For example, if you’re listening to music and receive a call, you can answer by nodding your head or reject the call by shaking your head.
• Improved Noise Isolation: AirPods Pro has updated noise isolation, allowing you to be heard even in the noisiest places, as all surrounding sounds will be suppressed during conversations. You can even speak directly from a construction site if needed.
• Apple TV InSight Function: Displays information about the movie’s director, actors, or soundtrack performers. However, it will only work with Apple content.
• Enhanced Dialog Feature: Uses machine learning to improve voice clarity, working with any speaker or headphone.
• 21:9 Aspect Ratio Support: Now supported for projectors.

WatchOS 11

• Health Monitoring: With the help of Apple technologies, monitoring your health becomes a bit easier and more enjoyable.
• Training Load Calculation: The update introduced the ability to calculate training load, allowing you to track your progress for the next workout.
• Vitals Feature: Designed to monitor any health deviations you might have.
• Customizable Activity Rings: Activity rings can be adjusted according to the day of the week. For example, you can set fasting days on weekends or pause activity tracking during vacations.
• Widget Collection Customization: The new OS allows changing the collection of widgets, thus customizing the gadget.
• Real-Time Voice Translation: Another useful feature is voice translation on the fly. Conversations between two people can be translated into another language in real-time, which is very convenient for travel and communication abroad.

iPadOS 18

• Updated Calculator: You’ve been waiting for it, and now it’s here. The iPad has updated its Calculator, which now includes handwritten input and Apple Pencil support. Using the stylus in Notes, you can write formulas, equations, examples, and problems, then solve them using the calculator.
• Handwritten Graphs and Text: You can also draw graphs and write text by hand, and the app will recognize everything, making your handwriting smooth and readable. A dream come true for any student.
• Customizable Control Center: You will be able to customize the Control Center, similar to iOS 18.
• Gaming Mode: Added for improved performance in games.
• Drawing on Desktop: A new feature allows you to draw on the Desktop.
• Remote Control of Other Apple Tablets: This feature is very convenient if the other device is not nearby, allowing remote control.

MacOS 15

Apple has introduced the new macOS 15, called Sequoia, which brings numerous interactive opportunities.

• • The indicator for iPhone Mirroring or “Mirroring”: You can now seamlessly connect your iPhone to your Mac and all its applications. You will receive all notifications directly on your computer and can send alerts from your iPhone to Mac speakers. In this case, the smartphone will remain silent. Uploading photos, videos, or other files is not easier. Just connect your iPhone to Mac.
  • A new application for managing passwords, which was previously part of Settings: It will also be available in iOS and iPadOS 18. The program will collect all your passwords in one place and encrypt them. At the same time, you can use them in a grid.
  • Safari has received security updates to enhance the security of the main page of the page and the “Image in Image” regime.
  • Games on Mac will become more interesting with the upgrade to Metal 3 and the introduction of Game Porting Toolkit 2 for transferring games between computers and phones. Yes, Prince of Persia and Assassin of Shadows will be released on Mac. How is this new development for you, players?

Apple Intelligence

Apple has unveiled its AI development, integrated across all of the company’s operating systems under Apple Intelligence, marking the highlight of WWDC. It’s anticipated that Apple Intelligence will understand any language and can work not only with text but also with images and videos. It will also help you better understand context and find connections in your actions—emails, websites, etc. Suggestions related to your interests will also be provided. Don’t worry, Apple Intelligence operates solely on devices and does not send any data to remote servers

Other Interesting Features

• One of the accessible artistic intelligence capabilities, it enhances the significance of messages in terms of the system. The system will determine the priority of emails, newsletters, and notes.
• Siri will receive a new animation, and now you can get involved not only through commands but also in a familiar language. You can also ask directly on the iPhone screen with the virtual assistant. Another interesting feature of Siri is its ability to search for a description based on a photo. Tell the voice assistant “Find me in summer camp” and it will display a picture like that (if it is in the gallery). The intriguing detail is that you do not need to add any other applications or resources to use AI. Everything is built into the system. And it doesn’t require an internet connection.
• With AI’s assistance, it will be possible to generate images and create your personal stickers or images in social media or email exchanges.
• OpenAI’s ChatGPT is integrated into iOS 18, iPadOS 18, and macOS 15:
• And the update many were waiting for: Now you can remove additional tasks or human pictures. Remove an amazing task from a picture without using additional programs: It’s ideal to enjoy, don’t you think?

With this summer, Apple’s AI will be available in English, with a little wait. But remember. Apple Intelligence will be available on the A17 Pro and more recent devices (when available) and from M1 (on Mac and iPad)

Apple’s announced some services that won’t be available until forever. We’ll tell you more about the new possibilities for your iPhone, iPad, Mac, Apple Watch, AirPods, and Apple TV on our blog and social networks. Subscribe so you don’t miss out!