The speaker shares his vision for controlling a Tello drone with a HoloLens to create more engaging and exciting coding experiences.
An overview of the key technologies used, including the Unity 3D game engine, ChatGPT for code inspiration, and the Mixed Reality Toolkit (MRTK) for HoloLens.
The Tello drone is introduced as a lightweight, programmable device comparable to a flying Raspberry Pi, controllable via its SDK.
A breakdown of the reality-virtuality continuum defines augmented reality (AR), virtual reality (VR), and how mixed reality (MR) blends the physical and digital worlds.
The Microsoft HoloLens is presented as an enterprise-focused MR headset enabling natural, hands-free interaction for use cases like remote assistance and healthcare.
ChatGPT is used as a tool to understand the drone's documentation and generate initial C# code for UDP communication, including IP addresses and ports.
A look inside the Unity project and the C# script for the UDP client, which handles connecting to the drone, entering SDK mode, and sending commands.
A live demo shows the Tello drone taking off, moving, and flipping, all controlled by commands from the mixed reality application on the HoloLens.
The speaker addresses audience questions on Unreal Engine as an alternative, the development status of HoloLens, and using mixed reality on mobile devices.
35:26Zaid Zaim
31:50Zaid Zaim
31:39Rainer Stropek
30:24Markus Walker
58:06Anna Fritsch-Weninger
26:12Ayoub Alouane
32:26Krzysztof Cieślak
29:35Liuba Gonta & Yuliya Khadasevich
Jobs that call for the skills explored in this talk.
DTS Systeme GmbH
Tether
Barcelona, Spain
Conrad Electronic SE