Extended Reality

From Open Source Ecology
Jump to: navigation, search
  • Explanation of Extended reality - [1]. A live screen behind you immerses you in an environment where you can be videod, and the background can be switched to any setting. The camera motion of the main camera is refleceted in the images projected on the screen. Essentially, this is like a live screen behind you providing footage, but the perspective in the live screen can change because there is camera-based feedback.
  • Blender now has VR support - you can navigate your model in 3D with 3D glasses, but not with open source VR Glasses. Only Oculus Rift and the like. [2].
    • Support is implemented in OpenXR [3]
  • Relativity is an open source VR Set, but currently only supports games with SteamVR - [4]. However, since it's an open source project, it can be extended. Current model can be built for $200.
  • There is already open source vr software - [5], which means the hardware is not open source.
  • Google Cardboard - [6] - VR headset which tracks your head orientation, on a cell phone. [7]. You can move forward by clicking or staring at something which is detected as a click. [8]
  • OpenXR - open source software standard for XR (extended reality = augemented or virtual reality) [9]
  • Mozilla A-Frame allows you to embed 360 Degree Images in browser? [10]

Build Training

  • Ex - SimBuild - software for training carpenters - [11]. Use Blender to demonnstrate tools, or Sweet Home or FreeCAD to build things? To teach people how things go together.
  • Does Blender have capacity to push button to make an action happen? For example, Apple app for controlling 3D created in Blender - [12]
  • AR can overlay information, and recognize images. Usefulness is when it recognizes things tha are photographed - and provides you with extra information. For example, in a build program for a tractor - you can lay out all the parts, and by part recognition, it will provide instructionals for you. So it will tell you which thing to do first, one after another. Effectively, it replaces cognitive function with kinesthetic function. Could be useful, say in a complete walk-through of you getting a drop shipped kit, and guiding you to put it togther. As simple as identification of all parts received for inventory purposes could be very useful - rapid inventory where the program helps you determine if everything was delivered. [13]

Interactive Web

  • Blend4Web - yes! [14]. Tutorial on getting a WebGL file - [15]. For example, download the html file - at [16]. Tried cube. Can I embed it in wiki? No, doesn't work.

Architecture

  • Blender interactive using visual programming using Verge3D - for interactive interiors - [17]. Somewhat like SweetHome3D - but preprogrammed more effectively for good user experience? Tutorial - [18]. Tutorial overall - [19]
  • Interactive environments with OS software - book - [20]