Workflow
In order to accomplish S-iBA Vision’s goals, N-iX MR provided end-to-end development of VIRTRACON™ application.
Our team proposed an efficient development plan of the client app using the Unity engine. For the Backend architecture, we choose the next stack of technologies: the apps’ back-end logic will be written on Scala, the Admin Control Panel will be developed on Python using Django framework, and the shared database of Backend and Admin Panel – PostgreSQL.
To speed-up content creation for VIRTRACON™, our team created a standalone VLM Editor with a simple drag and drop interface and visual nodes representing different actions of “Virtual Actors” inside the VIRTRACON™ virtual classroom. VLM Editor allows creating new virtual lectures and courses even if the Designer which uses Editor has no special tech expertise or any programming knowledge.
One of the main requirements of the project was its high immersion; the user should feel as if he was in a real classroom. To achieve this, N-iX team developed a voice recognition system based on Google Speech-to-text API. With its help, the user can interact with the Trainer and virtual students using nothing, but his voice. To help the user progress through his mistakes we implemented a self-evaluation system, based on a questionnaire. After finishing each module, the user answers questions regarding the possible points of self-improvement, the recordings of his answers are stored in the cloud, and the user receives the links to these self-evaluation recordings via email.
We paid extra attention to the visual part of VIRTRACON™, our talented artists created a pleasant-looking classroom, leaned on the client’s preferences. Our animation team made several full-body animation sets for NPCs using mocap technology; the facial animation was created using blendshapes and lipsync.
In addition, N-iX team created two training modules, based on S-iBA Vision scripts and vocalized them by engaging professional actors.