Programming VR with openFrameworks

-
To work with VR using openFrameworks, you can use ofxOpenVR addon: https://github.com/perevalovds/ofxOpenVR

It's implementation of Valve Software's OpenVR API, which was originally developed by smallfly https://github.com/smallfly/ofxOpenVR, next I forked it into Kuflex repo, and finally to my repo. The most important fix comparing original version is about problem of one eye's vertical shift due matrices computations errors.
This addon lets create VR applications (using HTC Vive) on openFrameworks, Windows 10.
It's using oF's programmable render.

Requirements

  • HTC Vive (though, it is not required to compile projects, just to deploy) and Steam VR
  • Visual Studio 2017
  • openFrameworks 10.1
  • ofxOpenVR addon folder, which should be placed to openFrameworks/addons/ofxOpenVR.

Running examples

  • To check addons is working, compile and run its examples located in openFrameworks/addons/ofxOpenVR.
  • There are two examples: example-360Player - draw panoramic image in VR, and example-drawing - drawing lines in VR using joysticks.
  • Note, examples are intended to be compiled in 64-bit mode because they contain 64-bit version of openvr_api.dll.

Using addon

For developing your own projects, use examples as a scretch, or create the project using Project Generator, and copy openvr_api.dll file to the bin folder of the project from copy_to_bin addon's folder (depending on 64 or 32 bits mode you are required).

Comments

  1. Ganiodayo8 October 2019 at 06:54

    I have ofxopenvr examples running in windows 10 with the vive but the vive is only showing the deafult steamvr intro game. The openframeworks example is just a grey window with the help text. Did you encounter similar issues?

    ReplyDelete
  2. Denis Perevalov20 October 2019 at 21:54

    It look liks oF doesn't see Vive. Did you install OpenVR drivers?

    ReplyDelete
    Replies
    1. Ganiodayo2 December 2019 at 07:29

      There were so many issues with getting the ofxOpenVR examples running that I just took out what I needed from the addon files and mostly used OpenVR directly.

      Currently I am trying to get ofxShadertoy code running using an FBO to pass a texture. Unfortunately it is only showing up in the right eye.

      If I set up and load the FBO in setup it shows up in both eyes but I can't refresh the time uniform in the shader so the point of using Shadertoy is lost.

      Do you offer consulting? Please. Or send me in someone's direction. Please.

      Delete
  3. newBit2 April 2020 at 12:43

    Hi, can i make VR in Android with oF?

    ReplyDelete

Post a Comment

Popular posts from this blog

Computing ray origin and direction from Model View Projection matrices for raymarching

-
When performing raymarching (as well a raycasting and raytracing) using fragment shaders in OpenGL, it's required to compute ray's origin and direction. Here we will give solution for finding it from the Model View Projection matrices in OpenGL, implemented in openFrameworks. Using it, you can combine raymarching/raycasting/raytracing with forward OpenGL rendering, so obtain hybrid rendering modes. Also, you can use it for creating VE applications based on raymarching or hybrid rendering. (Actually, we checked what this approach is corrent by creating VR rendering app in HTC Vive). The algorithm can be used on any OpenGL platform with any language supporting matrix inversion computation (in our case it's C++ with GLM library, included in openFrameworks 0.10.1). The approach is based on this hint by  GClements in this discussion on the topic: https://community.khronos.org/t/ray-origin-through-view-and-projection-matrices/7257
Read more

Forward and backward alpha blending for raymarching

-
When implementing raymatching by scanning a ray to accumulating scene's colors, containing semi-transparent colors (for example, scene with clouds), it's required to properly combine colors using alpha blending method. Here we discuss how to do it and obtain corresponding formula. (So, here we propose that objects has "uniform" ambient lighting and some transparency and all we need to accumulate their colors). The forward alpha blending formula, used "everywhere" - in OpenGL, VJ software, photo and video editors, can be formulated in the following way: Formula for "forward" alpha blending ---------------------------------- Let C is a current RGB color, c is a new RGB color and alpha is a new color's opaqueness (alpha is a float value from 0 to 1). Then updating rule for C is the following:     C = (1- alpha )* C + alpha * c    ---------------------------------- So, the more alpha , the more c affec
Read more

Forward, Deferred and Raytracing rendering in openFrameworks and web

-
Image
Currently, there are three basic approaches for rendering computer graphics scenes: forward rendering, deferred rendering, raytracing. 1. Forward rendering It's that OpenGL does, you create vertices, then make faces, and rasterize them, all passing via shaders. The rendering process is straightworward and fast, but rendering shadows, making degree-of-field effect and drawing clouds is hard here. Most of openFrameworks examples use forward rendering. 2. Deferred rendering It's the same as forward rendering, but additionally some extra data is rendered for computing shadows. The lighting pass is performed after the scene geometry is drawn. See detailed explanation here: https://learnopengl.com/Advanced-Lighting/Deferred-Shading Shadows, degree-of-field effect and some kind of reflections are possible with deferred rendering. Unreal Engine 4 and Unity currently (2019) are based on deferred rendering. openFrameworks: https://github.com/perevalovds
Read more