Changes
- 💡Add support for AI emotion detection (video demo)
- Improve the scaling of bounding box during face tracking, especially when face is extremely near to the camera
- Add setting to change image classification AI model under object tracking options, usable by props that can track visibility such as musical instrument
- Add "Vowel" setting under emotion tracking options
- Stabilize shoulder motion
- Add support of helpers for some operations when configuring instrument props
- Change the lower limit of detection/tracking score threshold settings of object tracking options to 10%
- Improve sad/angry mocap expression for MMD model
- Support shader mode of 3D wallpaper for MMD model
- Remove some duplicated files
- Fix error when shoulder was not visible at the very beginning during body tracking
- Fix error in VRM model swapping when the new model had no icon defined
- Fix bug in object tracking of instrument prop in which some prop-specific settings were ignored
- Fix bug in plane-type position magnet (mainly used in instrument prop) which caused reversed pull effect when target position was beyond effective distance
- Update MediaPipe (v0.10.20)
- Update three-vrm (v3.3.1)
- Update transformers.js (v3.2.3)
More details about the changes can be found on my following Ko-fi and FANBOX posts.
Backports
- Support macOS (BETA testing) (backported from v0.33.3)
- Apply a default, non-mandatory frame rate setting (30) for webcam (backported from v0.33.2)
- Change the behavior of non-default frame rate setting of webcam input to mandatory (NOTE: webcam may not load if the required frame rate is not supported) (backported from v0.33.2)
- Add "Escape" key function to "/" key on virtual numpad in mobile web app, allowing functions such as toggling of UI display and closing of speech bubbles (backported from v0.33.5)
- Send VRM 1.0 blendshape names by default for VRM 1.0 model when using VMC protocol (backported from v0.34.4-b)
- Improve the animation and performance of "2D-to-3D Wallpaper" app mode (backported from v0.34.2)
- Fix various BVH exporter issues (backported from v0.34.0)
- Fix startup error related to an electron-only feature about window position which shouldn't exist in web app mode (backported from v0.34.2)
- Fix bug in which the frame rate setting of webcam was not properly applied (backported from v0.33.2)
- Fix regression in 3D scene builder in which deleting a 3D object would return error (backported from v0.33.3)
- Fix regression regarding 3D camera control in System Animator application outside of XR Animator (backported from v0.34.3)
- Fix webcam listing in web app mode (backported from v0.33.5/v0.36.0)
- Fix webcam issue in macOS web app mode (backported from v0.34.2)
🧪Beta testing for macOS version🍎
The macOS version of XR Animator is now under beta testing. Make sure that you read the readme included for installation instructions. Please report any bug or issue🙏
🎵Musical instrument mocap🎵
The 3D prop of each supported instrument can be downloaded below.
- Guitar collection (acoustic, electric, bass and ukulele)
- Violin
- Cello
- Piano
- Electric piano
- Flute
- Saxophone
- Harp
❤️Support this project❤️
The future of XR Animator relies on your support🙇 Some IRL family issues have significantly increased my financial burden. While it was fun to develop the app, financial return was next to minimal. Reality forces me to evaluate the sustainability of this project, or soon I will have to give up...😢
If you like XR Animator, please consider making a donation🙇 Or even better, join my membership with perks such as EARLY ACCESS to the latest version XR Animator (at least 6 months ahead of the public release on GitHub), insider stories/tips and other benefits🎁 Sponsor us, and help keep this project free and sustainable🙏