08 May 2024

ERCIM News XR4ED Article 2024

Recently, a co-authored article entitled ‘Extended Reality Intelligent Assistant for Education’ was published at ERCIM News. The article introduces an intelligent Extended Reality (XR) teaching assistant communicating with the users in natural language. The application uses artificial intelligence (ChatGPT) to understand and communicate with the students using realistic-looking avatars with body language. Teachers can customise the application by adding their slides to be taught or choosing a teaching topic that will be discussed by two intelligent agents.

Although the application is primarily presented in an AR environment, it offers a panoramic image mode that can optionally be used to surround the user in the XR space. This shift towards VR along the MR spectrum brings more immersion and is especially suitable for certain learning scenarios, e.g. featuring learning about historical sites, natural ecosystems, or other content that is bound to a place. The XR Intelligent Assistant has been implemented on Magic Leap 2 AR head-mounted display (HMD) and for Android for usage on phones.

More information:

https://ercim-news.ercim.eu/en137/special/extended-reality-intelligent-assistant-for-education