Q: What is VISIXR in one sentence?
A: VISIXR aims to develop and deploy an innovative Smart Generator tool for real-time, AI-driven 3D asset modification within XR environments, aligning with the broader CORTEX2 vision of accessible and advanced immersive platforms.
Q: What problem are you solving? What makes your solution unique?
A: VISIXR provides a platform that breaks down 3D models into particular segments, analyses them and can modify them using voice or text input. At the same time, questions can be asked about the segments, which are then answered by the AI bot.
Q: What are VISIXR’s main objectives?
A:
- ¡Automatic Image Segmentation (2D und 3D)
- Unity 3D Integration
- Enhanced 3D asset modification in real-time
- User-friendly UI
CORTEX2 support programme progress
Q: What were the main activities implemented and milestones achieved during Sprint 1 of the CORTEX2 Support Programme?
A: During Sprint 1 of the Support Programme, the main activities involved three core tasks. First, the team created foundational components for image segmentation and real-time modification, resulting in a prototype that could independently identify and act on image regions. Second, they integrated these tools with Unity3D, enabling real-time 3D rendering for use in extended reality (XR) environments. Finally, they conducted preliminary testing and refinement to optimise the prototype’s performance, stability, and resource allocation.
The key milestones achieved were the successful development of a functional prototype capable of real-time segmentation, the successful integration with Unity3D for 3D manipulation, and the establishment of a robust system foundation for future sprints. Despite challenges with real-time processing and AI integration, all tasks were completed within the revised timeframe.
Q: What have you achieved so far?
A: In Sprint 2, the project made significant progress by extending the Smart Generator to interactive 3D applications and preparing its integration into the CORTEX2 framework. A key milestone was the extension to 3D assets, which means that users can now select and modify components of 3D models using voice and text input. New camera controls and enhanced visualisation methods, such as highlighting and animated exploded views, were developed for this purpose.
At the same time, the user interface was fundamentally revised based on user tests in order to make the operation more intuitive and significantly enhance the user experience. At the same time, the technical integration into the CORTEX2 environment was planned in detail, creating a clear roadmap for the future connection. In particular, the concept of “function calls” lays the foundation for being able to control the generator dynamically and contextually using external services.
To summarise, Sprint 2 has produced a much more interactive and immersive application, and at the same time set the decisive technical course for future integration and extended functionality.
Q: How is participating in CORTEX2 supporting VISIXR?
A: The CORTEX2 project has helped us in that it is a great environment to be part of a much larger project. In this way, you come into contact with other project groups and also see what others are currently working on, what ideas they have and accordingly what problems they are trying to solve. The dialogue within the project was also a great support. This took place either in the form of meetings with our mentor or in keynote sessions where approaches to various topics proposed by project groups were presented and discussed.
Q: What are your next steps within the CORTEX2 Programme?
A: The next steps in the program are to try to complete all outstanding tasks by the end of the 3rd sprint so that the generator can then be used. These include, for example, improving real-time modification and user-friendliness.
Learn more about VISIXR and stay updated on its progress!
Want to explore more XR innovation? Browse all our supported projects on the CORTEX2 website: