Build Next-Gen Mobile Spatial Computing Apps

Master RealityKit, ARKit, SwiftUI and AI frameworks, in preparation for the next 'iPhone moment'.

What you'll learn

Master Apple Spatial Computing Frameworks (RealityKit and ARKit)

Create AI Powered Apps Using CoreML And CreateML

Create beautiful UI using SwiftUI

Integration With Native iOS Frameworks

Build a full-stack iOS spatial computing app

Requirements

Basic understanding of programming fundamentals (classes, functions, variables).

Experience with Swift programming language would be beneficial but not neccessary.

A MacBook and an iOS device with a front-facing TrueDepth camera. See hardware and software requirements free preview session, for more details.

Description

Back in 2008, Steve Jobs unveiled the iPhone and soon after, there was an "App Gold Rush". Demand high, supply low and prepared developers rode the wave!The 'App Era' might be over, but the next big thing is in the making - spatial computing, which Apple introduced to the world with its Vision Pro headset.Yes, it is a pricey device but remember, this is just the start. With a more affordable 'Vision Pro Glasses' in the making, the next 'iPhone moment' would happen any time this decade. Will you be ready by then, to ride the wave and create killer apps for it?Now is the time to prepare and no, you don’t need to spend $3k+ on a Vision Pro headset: instead, you can learn the same skillsets and frameworks used for visionOS development, using just your phone.That is what this course is for - to help you get your foot in the ladder into the world of Apple Spatial Computing, so you can be prepared for the next ‘iPhone moment’.What you will learn?Master Spatial Frameworks: Learn the fundamentals of ARKit and RealityKit, the foundations of Apple Spatial Computing. Topics covered include: face tracking, architecture, video materials, 3D text and many more. Learning these gears you up for visionOS development too, as they use the same frameworks.Create AI Based Apps:  Learn to use Apple AI frameworks like CoreML and CreateML, to train and integrate your own machine learning models into your app. More specifically, you will be using the magic of AI to build a hand-gesture based user interfaceBuild A “Value-Adding” App: You will be building David Goggin’s accountability mirror in AR, an app that has real-world value and not just another “AR for AR sake app”. This will teach you how to break down a large problem into smaller pieces, and build an idea one feature at a time.Unleash Your Creativity: This is not a 'copy-paste' style online course. We will put heavy emphasis on the fundamentals: e.g. app architecture, AR fundamentals, writing clean code and more. By the end, you should feel confident building your own ideas out and not just copy-paste templates!Who is this course for?Developers who want to master the spatial computing skill-stack, without investing in a pricey Vision Pro headset.Students who want to learn a software stack with high future potential.Forward looking individuals who wants to prepare for the ‘Next Big Skill’ in tech.Who am I?I am a 3D first iOS Engineer. I have experience building software for healthcare, ed-tech and futuristic industries like spatial computing, in addition to a PhD in Brain Computer Interfacing. I have also published a book on spatial computing 'The Next Big Skill' and on the side, run an Apple Spatial Computing themed Youtube channel, with over 75 videos uploaded to date.Check Out What Others Have To Say"This course really got me going quickly with a cool practical AR project. It's got me excited to learn more Swift and Reality based apps." - Blade, Ex-Google/Apple/Amazon Product Professional"If you are starting or even if you have some self-taught experience (I am the latter), this course is a great match. It provides a great and practical overview of what is possible with Apple's developer tools and gives you the knowledge you need to move forward by yourself. Nikhil is also very good at explaining technical concepts by providing visuals and explanations of how the different packages work together. If you have been thinking of starting iOS development (for mixed reality or not), I really recommend this course, it is the perfect start for your developer journey! "-  Luigi Ditrono, Product Manager"I have completed the course till the CoreData module so far, and I must say that the level of detail provided throughout the course is truly impressive. Each topic was explained meticulously, leaving no room for confusion. As a newcomer to this subject, I found the course to be an excellent starting point for my learning journey. "-  Yashraj, University StudentDon't believe them, try it out for yourself and prepare for the "Next Big Skill" in tech!

Overview

Section 1: Introduction

Lecture 1 The Big Why: "The Next iPhone Moment"

Lecture 2 Hardware and Software Requirements

Lecture 3 Setting Up Your Dev Environment

Lecture 4 What You Will Be Building?

Section 2: Creating The User Interface Using SwiftUI

Lecture 5 SwiftUI For Dummies

Lecture 6 Getting Started With SwiftUI

Lecture 7 Adding An ARView In SwiftUI

Lecture 8 Building Your Own Custom Buttons

Lecture 9 Designing the Add Goals Screen

Lecture 10 Designing the Goals Display Screen

Lecture 11 iOS 16 Update: Change Background Colour

Lecture 12 A Simple Design Hack Using Colour Theory

Lecture 13 Revamping And Refreshing Our App Design

Section 3: App Architecture And Data Persistence

Lecture 14 Core Data For Dummies

Lecture 15 Creating A Database Manager

Lecture 16 Adding Persistence Using Core Data

Lecture 17 The MVVM App Architecture

Lecture 18 Applying MVVM To Our App

Lecture 19 State Objects vs Observed Objects

Section 4: Adding Face Tracking Using RealityKit

Lecture 20 RealityKit Architecture For Dummies

Lecture 21 Face Tracking Fundamentals (Part 1)

Lecture 22 Face Tracking Fundamentals (Part 2)

Lecture 23 Anchoring 3D Text On Your Forehead

Lecture 24 Using Video Materials For Text Animations

Lecture 25 Swipe Detection And Dynamic Text Generation (Part 1)

Lecture 26 Swipe Detection And Dynamic Text Generation (Part 2)

Lecture 27 Polishing Up The UX!

Section 5: Machine Learning For Hand Gesture Detection

Lecture 28 Machine Learning For Dummies

Lecture 29 Introduction To CoreML And CreateML

Lecture 30 Gathering Training Data For Hand Gestures

Lecture 31 Using CreateML To Train A Hand Gesture Model

Lecture 32 Creating A Machine Learning Manager

Lecture 33 Integrating The CoreML Model Into The App

Section 6: Conclusion

Lecture 34 Get The Full Source Code

Lecture 35 Where To Go From Here?

Lecture 36 Bonus Lecture

Developers curious about Apple Spatial Computing,Developers who wants to learn cutting edge AI and spatial computing frameworks,Aspiring developers who want to get their 'foot in the door' into the world of spatial computing.