Fractalnator - Tech Demo 2

A partial proof-of-concept of a VR game I thought of. Have you ever pointed a webcam at a monitor displaying that webcam, and gotten trippy effects? That's a bit like what this is, but in 3D!

I've only tested it with Oculus Rift S, but it uses OpenXR, so it should work across most popular headsets.

I had an idea for a trippy  new VR experience, inspired by:

1. The phone app Fraksl, which uses mirrored and inverted video feedback to produce trippy fractal videos. You change the visuals by pinch zooming/rotating and panning around. (Play with an online version I made here.)
2. The VR app Cosmic Flow, which uses trippy mirrored textures on 3D objects to produce a very unique 3D kaleidoscope effect. It has an incredible shifting sense of depth and space.
3. That cool thing that happens when you point a webcam at a monitor displaying the webcam's image fullscreen, and tilt the camera or move it closer, further, in circles, etc. It's a little like Fraksl, but so much more unsteady due to light glare, small human movements, etc.
4. The VR app SoundSelf, which is primarily a meditation aid/teacher that uses toning and chanting. It looks a bit like a more dynamic version of Cosmic Flow, but the way that it responds to the input from the player entranced me, literally. It uses mostly sound and visual feedback, but also some head motion feedback to help you know if your gaze is wandering.
5. Mind Massaging Machine, which is a meditation/hypnosis VR app that lets you use trippy visuals, play audio tracks, and do a few other things that aren't relevant. Unfortunately, while I am impressed with the work that has been done on the project, I am just not happy with the visual or user experience.

I'm learning Unity right now in order to develop a VR experience that uses aspects from all of these. Here are the core mechanics I hope to implement:

1. Mapping the player's visual field onto a "Feedback Texture" in real-time. This texture will be inverted and hue shifted.
2. Having one or more tunnel(s) that change shape and have mirrored and tiled Feedback Texture. These and the rest of the "Feedback Geometry" are locked to the user's head, with a moderate lag, like the tunnel has inertia.
3. Having one main "Feedback Screen" that also follows the user's head. This can either be a single plane with the feedback texture, or multiple planes tiled that have mirror images.
4. Having 3D Feedback Geometry that intersects with the tunnel and forms rings of abstract geometry, which are animated to move and rotate rhythmically. They intersect often, causing a kaleidoscope feedback effect.
5. Having a "Base Visuals" texture as a skybox, which is ideally mostly obscured at all times by the Feedback Geometry. This will provide color and shape information in the edges and gaps around the 3D geometry while allowing most of the visual field to form a feedback loop with the Feedback Texture. This can be static or animated. Even a solid color can produce very cool effects.
6. Adding a seamless and minimalist audio player, with the ability to create and load playlists in-app and provide unobtrusive media controls during a session.

In this second tech demo, you can see I've added post-processing on the video feedback so it inverts and hue shifts the feedback texture, like Fraksl. I've also replaced the ground and skybox with a solid pale blue color, like Fraksl, meaning all visuals are defined by geometry and head placement.  I've also mirrored some cube walls, all of this results in some REALLY cool effects! I'm going to keep learning the basics of Unity and work on developing this idea further in my free time.

GitHub: https://github.com/nimaid/Fractalnator