Our technology is agnostic for the client development environment. Core components run on our server and are accessed through our Cloud API
We support FBX and glTF file formats, with accompanying texture maps in png and jpg. We have a glTF extension to allow for specification of extra maps. Standard FBX and glTF loaders will be able to load, render, and play the animations of your didimos, but the extra maps are required for greater rendering quality. Our Unity SDK will handle all this automatically.
Yes. We have built a Unity SDK that provides you with tools and examples to get you up and running at speed.
Sort of. We will be building an SDK to make it super easy though in the meantime, developers can connect directly to our API docs and import a didimo using a glTF importer. Sign up for our newsletter to find out when new features will launch.
Didimos come in FBX and glTF format. The FBX format doesn't support PBR materials. Although glTF supports PBR, the spec isn't enough to properly render a character's skin nor hair. We assign the standard texture maps we can on the FBX and glTF files, and for glTF we created a didimo extension, that feeds our shaders the extra information required to render the didimos with as much detail and realism as possible.
Animation is composed of individual animation tracks for different poses. They're mostly the poses defined by ARKit's facial features, visemes, and a few others such as basic facial expressions (smile, surprised, etc). To animate your character, simply blend between these poses. For more information, check the Facial Animations page.
Not yet, but soon. At the moment, our publicly released tools support the generation of human heads. We will expand public support for full-body generation soon. If you need to attach pre-existent bodies to our head mesh, contact us so we can help you set it up and automate the process.
Yes, for detailed control of the mouth that can match specific vocal phonemes, visemes are a specific set of facial poses to mimic the unique shapes of the mouth when creating these phonemes. Included in many TTS solutions, such as Amazon Polly, is a data stream to drive visemes to a 3D model, thereby generating a perfect lip-sync and believable visual speech. The visemes option will provide your didimo with 21 viseme-specific shapes.
Updated about 1 year ago