“I started computing when there was no screen, no colour, no pixel, the pixel had not been invented yet, literally!” (Dov Jacobson)

Dov is a long-time game developer with a special background in Game-Based Learning and is currently experimenting with approaches for enabling non-programmers to create games using a special framework he has developed that includes a live AI shaped character using OpenAI's ChatGPT4 API in TWINE.

In this talk Dov explores the development of the many features of immersive technology building up to AR and VR but going beyond these towards Game Based Learning and touching on AI. At each step - each immersive feature - we talk about its relevance to learning and how students might exploit it and illustrate with examples from the studio.

(for a link to the slides click here).

The talk took place on September 12th at 2pm in the Augmented and Virtual Reality class in UCD Computer Science (COMP47930). The lecture and recording was supported by Abey Campbell, Xuanhui (Issac) Xu, and Donal Fullam.

Notes, extra questions, and further reading:

Dov’s website: dov.jacobson.net

Dov’s game “Mike Builds a Shelter” was acquired by MoMA (Museum of Modern Art, NY) and is now on playable exhibit on the 2nd floor (link)

Article: 12 Steps Toward Immersive Learning by Dov Jacobson, 2018 (link)

Article: Milgram, P., and Kishino, F. (1994). A taxonomy of mixed reality visual displays. IEICE Trans. Inform. Syst. 77, 1321–1329. (search link)

Twine / An open-source tool for telling interactive, nonlinear stories (link)

Acknowledgements

Music 

Title: Harsh Computer Dual Saw Vapor Games Arp 1 Akustichor Stripped Down Sample Kit 108 bpm

Artist: Allen Higgins

Source:  a-Tue12Nov2024.wav

License: CC BY-NC-SA 4.0. Includes samples from Ableton Live by Ableton AG and by KORG Inc.

Cover Art 

Title: Dov

Artist: Xuanhui (Issac) Xu and Allen Higgins

Source: Dov.pptx

License: CC BY-NC-SA 4.0

Podcast License

Design Talk (dot IE) CC BY-NC-SA 4.0 

The license can be viewed at https://creativecommons.org/licenses/by-nc-sa/4.0

By taking part you give permission for your voice to be recorded, for the recording to be edited, and for it to be posted and published as a podcast.

Hosted on Acast. See acast.com/privacy for more information.