Q: What is R3in3D in one sentence?
A: R3in3D delivers real-time, photorealistic 3D representations of humans and objects to revolutionise remote training and collaboration in XR environments.
Q: What problem are you solving? What makes your solution unique?
A: We address the growing need for immersive, high-fidelity remote training and collaboration tools in industrial and educational settings. Traditional XR systems lack realism, responsiveness, and human presence. R3in3D introduces a modular holographic communication pipeline that supports multiple 3D representation formats — RGBD, stereo, and 2D chroma — enabling seamless, lifelike interaction over next-gen networks (5G/6G). Our solution uniquely blends real-time volumetric capture, Unity-based rendering, and WebRTC transmission for scalable, low-latency XR experiences.
Q: What are R3in3D’s main objectives?
A:
- Enable immersive, real-time remote training using photorealistic 3D representations.
- Integrate RGBD and stereo capture formats into the CORTEX2 platform.
- Optimise communication efficiency and rendering quality for XR applications.
- Validate the system through real-world use cases in technical training and remote collaboration.
CORTEX2 support programme progress
Q: What were the main activities implemented and milestones achieved during Sprint 1 of the CORTEX2 Support Programme?
A:
- Completed benchmarking and integration planning with the CORTEX2 platform.
- Designed the R3in3D architecture, including Capture Module, Unity Client, and Signalling Server.
- Developed a Unity-based client for transmitting and rendering volumetric video using Rainbow SDK.
- Defined KPIs and test plans for use case validation.
Q: What have you achieved so far?
A:
- Integrated RGBD and stereo 3D formats into the CORTEX2 pipeline.
- Developed a fully functional Unity client with real-time audio/video/metadata streaming.
- Demonstrated the system at IMX’25 and ICT.Open, receiving strong industry interest and a Best Demo nomination.
- Published and submitted multiple peer-reviewed papers, advancing the state of XR-based remote training.
Q: How is participating in CORTEX2 supporting R3in3D?
A: CORTEX2 has been instrumental in accelerating our development through access to cutting-edge SDKs, expert mentorship, and a collaborative innovation ecosystem. The program enabled rapid prototyping, real-world testing, and visibility across the European XR community.
Q: What are your next steps within the CORTEX2 Programme?
A:
- Finalise rendering integration and support for all three representation formats.
- Launch user studies to evaluate training effectiveness and system usability.
- Prepare for broader deployment and commercialisation.
We’re excited to be shaping the future of XR-based training and collaboration. R3in3D is not just a prototype — it’s a platform for scalable, immersive learning and communication across industries.
Learn more about R3in3D and stay updated on its progress!
Want to explore more XR innovation? Browse all our supported projects on the CORTEX2 website: