Published on Jun 4, 2018
Topic: Apple
It’s that time of year again – Apple’s World-Wide Developer Conference. The first day, June 4, Apple announces new software, and sometimes new hardware, that will be upcoming around Q3 of the year. I’m here to break down and summarize what they’re releasing and what I expect it to actually look like once it’s released. This year’s WWDC was expected to have less major changes than in the past, as Apple just made major hardware announcements and changes last year, as well as because this year (according to rumor) they’ve been largely focused on internal improvements in terms of performance and bugfixes over adding on new features.
Of course, while Apple has a few leaks, they still manage to be very secretive, so there are of course new things that were not necessarily expected.
Software Announcements
iOS 12
The changes made to iOS were primarily targeted at improving the existing experience and addressing existing problems or shortcomings in the ecosystem, as well as adding on content to existing functionality.
Performance Improvements
One of the major focuses of this release was improving the performance of iOS 12. Apple trotted out its metrics for the iPhone 6 plus, a model that’s about 3.5 years old. In the past, I’ve found that Apple’s performance metrics tend to be fairly accurate, if just a smidge optimistic, so these are probably relatively fair benchmarks.
- Apps load 40% faster
- Keyboard slides up 50% faster
- Camera opens 70% faster
There’s a special emphasis on the way that iOS performs under load. In particular, they’ve paid attention to how they speed up the CPU under load so that it ramps up its performance more quickly, and ramps down its performance more quickly, which should improve performance for little cost (or even a small benefit) in battery life.
ARKit 2
I’m a believer in Augmented Reality having a lot of potential (virtual reality, on the other hand, I’m much more skeptical about). Apple is continuing to work on ARKit, adding a whole bunch of new functionality.
Their flagship creation for the next iteration of their AR platform, ARKit 2, is the USDZ file format. USDZ is an open (meaning anyone can integrate it without licensing costs) file format for 3D models. Adobe, Autodesk, and other major producers of 3D content software, have already signed on to support it. USDZ will be supported natively on iOS across the platform. This means someone could create a 3D animated model, put it on their website, and on iOS you can visualize it in the real world immediately. Adobe has also committed to adding USDZ support to Creative Cloud in the near future, allowing for What You See Is What You get (WYSIWYG) editing of 3D models and animations. These have the cumulative effect of making 3D content much easier to create and distribute, which will proliferate it to some extent.
Apple has announced the Measure app, which looks a lot like MeasureKit but with less features. Their demo worked well, but I did notice a few things:
- There was very bright lighting, which likely means that they have issues operating in dim (or even just not blindingly bright) lighting. MeasureKit has similar issues.
- They measured by moving the phone, rather than rotating the camera. MeasureKit is more accurate when measuring using this technique, so it’s likely they encountered the same issues.
- While the Measure app looks a lot like MeasureKit (albeit with a more polished UI), it lacks some of the features that MeasureKit has, which means Apple is likely copying MeasureKit rather than actually acquiring the software, as they’ve done in other places.
Apple is also modifying ARKit to support shared experiences across multiple devices, along with several other features (such as saving the state of an ARKit experience). This means that you can have multiple people all looking at the same 3D environment, which stays the same across multiple devices by recognizing shared geography and objects and binding the AR environment to those things. The demos of this Apple shared were games, where multiple people were all looking at the same environment to play a shared game together. Apple partnered with LEGO to demonstrate a hybrid virtual/physical LEGO game based on a real physical set, where the people could be controlled and events/stories could unfold. I’m skeptical of how much value this adds, but I’m also not their target audience. Here’s a video of the demo (the link seems a bit sketchy so I won’t be surprised if it gets taken down).
Overall, I think this is a healthy way to flesh out and grow the platform, and I’m interested to see where it goes from here.
Siri & Shortcuts
A while ago, Apple acquired an app called Workflowy, which allowed users to use simple drag-and-drop programming to set up their own automations with iOS. Here, we’re seeing that Apple has done some tweaking (the UI looks almost exactly the same though) to that app and released it as their own, called Shortcuts. However, Shortcuts is also supported by Siri, which means that you can easily set up your own automations (or download automations others have made) to do most anything, including interacting with most third-party apps. You can also link these automations to Siri, effectively letting users create and share basic Siri support for apps without Apple needing to create the integrations for developers to do this, and without the developers needing to actually implement it.
These shortcuts can also work based on context, and have some auto-filled options from Apple. For example, if you’re running late for a meeting and aren’t in the correct geographical location, Siri will prepare a text to the organizer to let them know you’re on your way (of course, you need to push a button to send it).
Overall, I’m really happy with these changes because it’s a simple tool that can be used for just about anything, and it will really open up the possibilities available through Siri and go some ways towards catching up with more advanced virtual assistants, without compromising data privacy.
Notifications Control
Apple is rolling out refined notifications control to iOS. It’s still missing some key features I’d like to see (like allowing some apps to bypass Do Not Disturb mode), but it’s a step in the right direction by allowing people more control over the ways apps can subtly manipulate you to spend more time on them. I have a software-based pager for work that I need to respond to, so I often can’t use DND mode on my phone.
Here are some of the features being added:
- Do Not Disturb (During Bedtime). This allows you to set a special Do Not Disturb session for the time when you (plan to be) sleeping. This not only silences notifications, but it also hides them from the lock screen, hopefully making it easier to avoid getting distracted when you’re trying to go to sleep.
- Notifications are grouped together by application, topic, or thread, so that your lock screen won’t get spammed with 50 notifications from the same conversation. You can still see all these notifications, they’re just grouped together.
- Smart suggestions for tuning of your notification preferences, and easier access to modify them.
- Weekly “Activity Summaries” of what you’re spending time on, and what you’re getting notifications for, to make it easier to avoid spending too much time on time-waster apps, or to quiet notifications that you get a lot of but don’t necessarily care about.
- Set “limits” (that can be bypassed) for how much time per day you want to spend in an app, to remind you not to use it so much.
- Ad-Hoc Do Not Disturb can be set to turn itself back off after a period of time, so that you don’t forget to turn it off and miss important notifications.
There are also a series of related parental controls expansions, allowing parents to see or limit how their children use the device. It’s not necessarily as much of an invasion of privacy as some parents may like, but it does give parents some useful tools for addressing how their kids are using the devices.
- These settings can be controlled remotely, from the parent’s iOS device.
- Parents can see the same “Weekly Activity” reports that their kids can see.
- Parents can set limits for how long children can use some apps, or even the device overall, but can also set “always available” apps, like the phone.
- Content controls.
Many of these features are based around the idea of limiting screen time and around control, but as someone whose personal beliefs skew towards the idea of minors having autonomy, I feel that (for the most part) these modifications are reasonable. That said, I can’t help but feel that if children are young enough to need parental controls, they may be a bit young to have personal smartphones (though I may be starting to show my age). I probably won’t personally benefit too much from most of these changes, but I’d imagine that for some people these will be very useful tools to practice better self-control with device usage.
Apps
Several apps on iOS 12 are being updated with new layouts or functionality as well.
- The News app is being updated to support curated content.
- The Stocks app is being updated with a new layout, iPad support, macOS support, and Apple News integration.
- Voice Memos is being updated with a new layout, iPad support, macOS support, and iCloud Sync.
- iBooks is being renamed to Apple Books and is getting a UI redesign.
- CarPlay is adopting support for 3rd party navigation apps, like Google Maps and MapQuest.
The Messages and Facetime apps are getting some additional content.
4 new animojis have been announced: Ghost, Koala, Tiger, and T-Rex. Notably, the T-Rex doesn’t have feathers, which I personally object to. Apple seems to be really excited about animojis, and I’m not sure why. They’ve also added “Memoji”, which are basically Bitmoji (cartoony self-portraits), but you can make them follow your face. Animoji, including Memoji, can be used in Messages as before, but can also plant them over your face during a Facetime call. I don’t really understand why any of this is interesting or exciting, but Apple sure seems to think it is. That said, I’ve never used animoji. If you use animoji and enjoy it, send me an email explaining what it adds to your experience (Contact in the menu bar) and let me know; I’m genuinely curious.
The main FaceTime feature being rolled out is Group Facetime, supporting up to 32 people. The UI looks pretty, but a bit clunky, and without support for Android/Windows I don’t personally see that as being very useful (although I’m aware plenty of people disagree with me – more power to them). That said, group video chat is a pretty basic feature for video calling, so it’s good to see FaceTime finally gaining support for it.
iOS 12 and macOS 10.14
Some improvements apply to both iOS and macOS, and here is the place where it will (hopefully) be easiest to find.
Safari
Safari is coming out with better built-in privacy support, building on the foundation of the cross-site-tracking prevention they released last year. The main additional feature is “fingerprint obfuscation”. A “fingerprint” in this case is unique device information that can be used to track you. Here’s how it works. A data company records lots of things when you access a site with some of their code on it (hint: pretty much all of them), like the fonts your system has, your screen size, and other things that tell them about your device. Then, when you visit another page their code lives on, they can cross-reference that information to figure out that you were the same person who looked at the other page, and track you without even knowing who you are. Of course, if they can figure out who you are through another means (like a Facebook integration), they can put that data to a name and develop an in-depth profile of you, even if you’re preventing cross-site tracking. Apple is making efforts in Safari to make devices running Safari (iOS and macOS) look much more similar to each other, making this method of tracking much more difficult.
Safari is also limiting social media fields on sites, which can be used to harvest a lot of information about you (even if you don’t interact with them), disabling them by default and requiring you to explicitly allow them if you want to use them.
Cross-Platform Support
Apple is working on making it easier (still not trivial) to port applications between iOS and macOS by consolidating some of the libraries and removing what used to be custom logic and replacing it with reasonable defaults, based on how users will interact with their device. In short, this will make it much easier to develop cross-platform apps between macOS and iOS. Apple actually used this new functionality to migrate previously iOS-only apps to macOS, including Apple News, Stocks, Voice Memos, and Apple Home.
macOS 10.14 Mojave
The new macOS changes have a lot of long-needed improvements, and shouldn’t really interrupt anyone’s workflows. There are many features that have been long-awaited, but that we haven’t seen from Apple until now, as well as features that people likely won’t have realized they needed until they came out.
Dark Mode
Apple is rolling out a long-awaited “Dark Mode” for macOS. Unfortunately, it doesn’t look like it integrates with Night Shift, but it is a long-awaited feature from many a user. Not only are the dock and menu bar darkened, but apps are as well, including support for Mail, Photos, XCode, and most other Apple apps. If you want this, you most likely already know.
Desktop
Apple is adding in some dynamic desktops. In their example, they had a landscape where the lighting changes depending on the time of day. They also have a feature for cleaning up desktops (this is useless for me – 3 items on my desktop is cluttered by my standards) called “Stacks”. Essentially, this allows you to automatically group items on your desktop by kind, date, or tag, rather than having all the items just be free-floating. If you have a cluttered desktop and want to get a handle on it, check out this feature when it comes out.
Finder
Finder is getting a new view, “Gallery”. Gallery is based around thumbnails, and seems to me like a Quicklook-based view where the content is placed before the actual structure of the file system. To photographers and videographers, this will be a boon. It also supports quick actions, like rotating a photo or combining several photos into a multi-page PDF. There’s also a new pane in all the other views (column view already has it) that allows you to access the same functionality from your preferred finder view. QuickLook has also gotten some love, as Apple’s standard Markup tools are now available in Quicklook. If you’re a power user, Automator actions can be added to Finder as quick buttons (this is useful for me).
Screenshots
Screenshots are getting the same treatment as they got on iOS, so if you take a screenshot, it will immediately show up in the corner of your screen, allowing you to perform quick markups, or to immediately use it without having to navigate to your screenshots folder. Video capture has also been pulled out of QuickTime Player and added directly to the Operating System itself, which is also nice.
Security and Privacy
Aside from the privacy improvements made to Safari, better controls are being rolled out surrounding what applications are allowed to access what system features. For example, apps must now explicitly request permission before they’re allowed to modify the camera. Likewise, certain locations on the file system, like the mail database, are protected with a prompt. This will help you be sure that developers can’t take information for integrations that they don’t need for their app to run, and give you more control over your device.
Metal
Apple’s graphics platform, Metal, is gaining support for external GPUs, making it easier to perform intensive workloads and play games (if you’re willing to spend the money on an external GPU). The performance scales very well with additional GPUs, up to 4.
Apple has also been working on making machine learning more accessible through multiple means. First, it’s integrating with existing machine learning frameworks, like Tensorflow, to use Metal for GPU processing instead of CPU processing, which makes it work dramatically faster. In the use case they provided, training was 30x faster and the resulting model was 30x smaller on the disk. They’re also releasing new machine learning developer tools to make it easier for developers to use machine learning in their applications, hopefully without the extensive expertise in machine learning previously required.
watchOS 5
watchOS 5 will bring several new features, largely aimed around continuous improvements to the things that the device is already good at.
- Health and Exercise.
- Allows you to create week-long competitions with your friends to see who fills more activity rings.
- Several new workout types.
- Improvements for exercise tracking of runs.
- Automatic workout start and finish detection, if you forget to turn workout mode on/off.
- Walkie Talkie - this lets you communicate people by voice in short spurts, using a push-to-talk mechanism, over a cellular or WiFi connection. I could see this being useful in some scenarios (I prefer PTT over a mute button).
- Web content support - if someone texts or emails you a link, you can look at it on your watch rather than needing your phone.
- Can function as a student ID card (for a few major campuses).
- Podcasts app.
- Uses the context of a wrist raise to trigger Siri’s background listening, rather than “Hey Siri”, which will shave as much as a whole second off your time to issue a command.
tvOS 12
tvOS has a few more minor improvements, with the Keynote mostly talking about expanding integrations with Cable TV providers.
- Dolby Atmos sound now supported, and free upgrades given to content you’ve already bought that supports it. Atmos is a surround sound system, but more sophisticated in that it models how it should sound in 3D space, rather than just having multiple audio channels.
- Live sports & live news.
- Developing better integration with cable providers.
- Developing support for Apple TV to work with universal remotes.
Looking Ahead – Q3 Hardware
Aside from the changes here, Apple is expected in Q3 to perform its regular hardware announcements. The primary expected announcements are centered around iPhones, and you can check the MacRumors iPhone 2018 roundup for a summary of the expected changes. MacRumors is my primary rumors source, as I’ve found them to have competent journalistic practices surrounding acknowledging the credibility of their rumors and sources, and as a result their information tends to be fairly reliable. There’s not much point in me doing a writeup on that since I’d pretty much just be parroting their information.
Also, I find their Facebook comments section to be a hilarious microcosm of the iOS vs Android “console wars”. I find it entertaining to watch people vehemently argue about whose preference in cellular phone is better.