Releases: ButzYung/SystemAnimatorOnline
XR Animator 0.32.0 - Windows, Linux and macOS version
Changes
- 💡Add support for AI emotion detection (video demo)
- Improve the scaling of bounding box during face tracking, especially when face is extremely near to the camera
- Add setting to change image classification AI model under object tracking options, usable by props that can track visibility such as musical instrument
- Add "Vowel" setting under emotion tracking options
- Stabilize shoulder motion
- Add support of helpers for some operations when configuring instrument props
- Change the lower limit of detection/tracking score threshold settings of object tracking options to 10%
- Improve sad/angry mocap expression for MMD model
- Support shader mode of 3D wallpaper for MMD model
- Remove some duplicated files
- Fix error when shoulder was not visible at the very beginning during body tracking
- Fix error in VRM model swapping when the new model had no icon defined
- Fix bug in object tracking of instrument prop in which some prop-specific settings were ignored
- Fix bug in plane-type position magnet (mainly used in instrument prop) which caused reversed pull effect when target position was beyond effective distance
- Update MediaPipe (v0.10.20)
- Update three-vrm (v3.3.1)
- Update transformers.js (v3.2.3)
More details about the changes can be found on my following Ko-fi and FANBOX posts.
Backports
- Support macOS (BETA testing) (backported from v0.33.3)
- Apply a default, non-mandatory frame rate setting (30) for webcam (backported from v0.33.2)
- Change the behavior of non-default frame rate setting of webcam input to mandatory (NOTE: webcam may not load if the required frame rate is not supported) (backported from v0.33.2)
- Add "Escape" key function to "/" key on virtual numpad in mobile web app, allowing functions such as toggling of UI display and closing of speech bubbles (backported from v0.33.5)
- Send VRM 1.0 blendshape names by default for VRM 1.0 model when using VMC protocol (backported from v0.34.4-b)
- Improve the animation and performance of "2D-to-3D Wallpaper" app mode (backported from v0.34.2)
- Fix various BVH exporter issues (backported from v0.34.0)
- Fix startup error related to an electron-only feature about window position which shouldn't exist in web app mode (backported from v0.34.2)
- Fix bug in which the frame rate setting of webcam was not properly applied (backported from v0.33.2)
- Fix regression in 3D scene builder in which deleting a 3D object would return error (backported from v0.33.3)
- Fix regression regarding 3D camera control in System Animator application outside of XR Animator (backported from v0.34.3)
- Fix webcam listing in web app mode (backported from v0.33.5/v0.36.0)
- Fix webcam issue in macOS web app mode (backported from v0.34.2)
🧪Beta testing for macOS version🍎
The macOS version of XR Animator is now under beta testing. Make sure that you read the readme included for installation instructions. Please report any bug or issue🙏
🎵Musical instrument mocap🎵
The 3D prop of each supported instrument can be downloaded below.
- Guitar collection (acoustic, electric, bass and ukulele)
- Violin
- Cello
- Piano
- Electric piano
- Flute
- Saxophone
- Harp
❤️Support this project❤️
The future of XR Animator relies on your support🙇 Some IRL family issues have significantly increased my financial burden. While it was fun to develop the app, financial return was next to minimal. Reality forces me to evaluate the sustainability of this project, or soon I will have to give up...😢
If you like XR Animator, please consider making a donation🙇 Or even better, join my membership with perks such as EARLY ACCESS to the latest version XR Animator (at least 6 months ahead of the public release on GitHub), insider stories/tips and other benefits🎁 Sponsor us, and help keep this project free and sustainable🙏
XR Animator 0.31.0 - Windows, Linux and macOS version
Changes
- 💡Support using 2D video file as 3D animated wallpaper (video demo)
- 💡Support pre-converting image and video files to 3D wallpaper format with depth map attached, without re-calculation of depth map on repeated usage
- 💡Support object tracking (visibility) for some instrument props
- 💡Add "Hide on tracking loss" body tracking option, determining during tracking loss whether to hide 3D avatar or just freeze the pose
- Add "Parallel" and "Synced" modes to "Standalone web worker" hand tracking option
- Add "depth-anything-v2-large" option, the best and largest depth AI model for 3D wallpaper
- Improve the stability of leg tracking when leg is only partially visible or hip is near the lower edge of the screen
- Improve the functionality of "Camera face-locking" feature to ignore manual camera panning
- Increase the limit of some settings of "Camera face-locking" to ±200%
- Change "3D camera lock" (Ctrl+L by default) to only consider manual camera adjustment, ignoring adjustment from other camera effects
- Update 3D wallpaper position when camera is locked via "3D camera lock"
- Improve VRM loading and performance in general
- Improve FBX loader accuracy and compatibility regarding the default position of hip bone
- Improve backward compatibility for depth estimation and object tracking features on devices that don't support WebGPU
- Fix blendshape output for motion recording in VMD format when only face tracking is enabled
- Update three-vrm (v3.3.0)
Backports
- Support macOS (BETA testing) (backported from v0.33.3)
- Apply a default, non-mandatory frame rate setting (30) for webcam (backported from v0.33.2)
- Change the behavior of non-default frame rate setting of webcam input to mandatory (NOTE: webcam may not load if the required frame rate is not supported) (backported from v0.33.2)
- Add "Escape" key function to "/" key on virtual numpad in mobile web app, allowing functions such as toggling of UI display and closing of speech bubbles (backported from v0.33.5)
- Send VRM 1.0 blendshape names by default for VRM 1.0 model when using VMC protocol (backported from v0.34.4-b)
- Improve the animation and performance of "2D-to-3D Wallpaper" app mode (backported from v0.34.2)
- Fix startup error related to an electron-only feature about window position which shouldn't exist in web app mode (backported from v0.34.2)
- Fix bug in which the frame rate setting of webcam was not properly applied (backported from v0.33.2)
- Fix regression in 3D scene builder in which deleting a 3D object would return error (backported from v0.33.3)
- Fix regression regarding 3D camera control in System Animator application outside of XR Animator (backported from v0.34.3)
- Fix webcam listing in web app mode (backported from v0.33.5)
- Fix webcam issue in macOS web app mode (backported from v0.34.2)
- Remove and fix obsolete/redundant files
🧪Beta testing for macOS version🍎
The macOS version of XR Animator is now under beta testing. Make sure that you read the readme included for installation instructions. Please report any bug or issue🙏
🎵Musical instrument mocap🎵
The 3D prop of each supported instrument can be downloaded below.
- Guitar collection (acoustic, electric, bass and ukulele)
- Violin
- Cello
- Piano
- Electric piano
- Flute
- Saxophone
- Harp
❤️Support this project❤️
The future of XR Animator relies on your support🙇 Some IRL family issues have significantly increased my financial burden. While it was fun to develop the app, financial return was next to minimal. Reality forces me to evaluate the sustainability of this project, or soon I will have to give up...😢
If you like XR Animator, please consider making a donation🙇 Or even better, join my membership with perks such as EARLY ACCESS to the latest version XR Animator (at least 6 months ahead of the public release on GitHub), insider stories/tips and other benefits🎁 Sponsor us, and help keep this project free and sustainable🙏
XR Animator 0.30.0 - Windows, Linux and macOS version
Changes
- 💡Support exporting 3D wallpaper to glTF model (video demo)
- 💡Fix VRM joint stiffness issue once and for all that affects some models
- Add "AI model inference device" option for face tracking, supporting switching between CPU and GPU to run the face tracking model
- Improve BVH motion importer and exporter to be more faithful to the format specification
- Reduce head rotation jerkiness caused by the occasional loss of face tracking
- Improve the handling of lost body tracking and prevent T pose from appearing before the loss of tracking
- Improve idle arm's elbow rotation during upper body mocap
- Change animation parameters to fit better with the aspect ratio of the image in the desktop mode of 3D wallpaper
- Fix missing foot frames when exporting motion to BVH or glTF while leg IK is in use
- Fix the display of 3D wallpaper loading complete message
Backports
- Support macOS (BETA testing) (backported from v0.33.3)
- Apply a default, non-mandatory frame rate setting (30) for webcam (backported from v0.33.2)
- Change the behavior of non-default frame rate setting of webcam input to mandatory (NOTE: webcam may not load if the required frame rate is not supported) (backported from v0.33.2)
- Add "Escape" key function to "/" key on virtual numpad in mobile web app, allowing functions such as toggling of UI display and closing of speech bubbles (backported from v0.33.5)
- Send VRM 1.0 blendshape names by default for VRM 1.0 model when using VMC protocol (backported from v0.34.4-b)
- Support 3D wallpaper feature (depth estimation) on browsers without WebGPU (using WASM as fallback) (backported from v0.31.0)
- Improve the animation and performance of "2D-to-3D Wallpaper" app mode (backported from v0.34.2)
- Fix startup error related to an electron-only feature about window position which shouldn't exist in web app mode (backported from v0.34.2)
- Fix bug in which the frame rate setting of webcam was not properly applied (backported from v0.33.2)
- Fix regression in 3D scene builder in which deleting a 3D object would return error (backported from v0.33.3)
- Fix regression regarding 3D camera control in System Animator application outside of XR Animator (backported from v0.34.3)
- Fix webcam listing in web app mode (backported from v0.33.5)
- Fix webcam issue in macOS web app mode (backported from v0.34.2)
- Remove and fix obsolete/redundant files
🧪Beta testing for macOS version🍎
The macOS version of XR Animator is now under beta testing. Make sure that you read the readme included for installation instructions. Please report any bug or issue🙏
🎵Musical instrument mocap🎵
The 3D prop of each supported instrument can be downloaded below.
- Guitar collection (acoustic, electric, bass and ukulele)
- Violin
- Cello
- Piano
- Electric piano
- Flute
- Saxophone
- Harp
❤️Support this project❤️
The future of XR Animator relies on your support🙇 Some IRL family issues have significantly increased my financial burden. While it was fun to develop the app, financial return was next to minimal. Reality forces me to evaluate the sustainability of this project, or soon I will have to give up...😢
If you like XR Animator, please consider making a donation🙇 Or even better, join my membership with perks such as EARLY ACCESS to the latest version XR Animator (at least 5 months ahead of the public release on GitHub), insider stories/tips and other benefits🎁 Sponsor us, and help keep this project free and sustainable🙏
XR Animator 0.29.1-b - Windows, Linux and macOS version
Changes
- 💡Add "Arm IK" option, enforcing the use of IK to calculate arm position and preventing arm jitter when switching between IK and FK (video demo)
- 💡Add "Portrait mode" option, which allows vertical video input from webcam
- 💡Add "Keep worker thread" option for 3D wallpaper, which significantly reduces resident memory usage when set to "No" (default)
- Stabilize upper body mocap when leaning near the camera while standing
- Stabilize prop alignment when getting too close to the target
- Update the parameters of some preset poses
- Improve elbow positioning during upper body mocap
- Fix regression affecting the adjustment of arm position during upper body mocap
- Fix bugs concerning the detaching of prop in which some parameters didn't reset properly
- Update MediaPipe (v0.10.18)
- Update electron (v33.2.0)
Backports
- Support macOS (BETA testing) (backported from v0.33.3)
- Apply a default, non-mandatory frame rate setting (30) for webcam (backported from v0.33.2)
- Change the behavior of non-default frame rate setting of webcam input to mandatory (NOTE: webcam may not load if the required frame rate is not supported) (backported from v0.33.2)
- Add "Escape" key function to "/" key on virtual numpad in mobile web app, allowing functions such as toggling of UI display and closing of speech bubbles (backported from v0.33.5)
- Support 3D wallpaper feature (depth estimation) on browsers without WebGPU (using WASM as fallback) (backported from v0.31.0)
- Improve the animation and performance of "2D-to-3D Wallpaper" app mode (backported from v0.34.2)
- Fix startup error related to an electron-only feature about window position which shouldn't exist in web app mode (backported from v0.34.2)
- Fix bug in which the frame rate setting of webcam was not properly applied (backported from v0.33.2)
- Fix regression in 3D scene builder in which deleting a 3D object would return error (backported from v0.33.3)
- Fix webcam listing in web app mode (backported from v0.33.5)
- Fix webcam issue in macOS web app mode (backported from v0.34.2)
- Remove and fix obsolete/redundant files
🧪Beta testing for macOS version🍎
The macOS version of XR Animator is now under beta testing. Make sure that you read the readme included for installation instructions. Please report any bug or issue🙏
🎵Musical instrument mocap🎵
The 3D prop of each supported instrument can be downloaded below.
- Guitar collection (acoustic, electric, bass and ukulele)
- Violin
- Cello
- Piano
- Electric piano
- Flute
- Saxophone
- Harp
❤️Support this project❤️
The future of XR Animator relies on your support🙇 Some IRL family issues have significantly increased my financial burden. While it was fun to develop the app, financial return was next to minimal. Reality forces me to evaluate the sustainability of this project, or soon I will have to give up...😢
If you like XR Animator, please consider making a donation🙇 Or even better, join my membership with perks such as EARLY ACCESS to the latest version XR Animator (at least 5 months ahead of the public release on GitHub), insider stories/tips and other benefits🎁 Sponsor us, and help keep this project free and sustainable🙏
XR Animator 0.29.0 - Windows, Linux and macOS version
Changes
- 💡Add support for object detection AI, which tracks specific IRL objects on webcam feed (video demo)
- Fix VRM1.0 bone rotation issues when connecting to Warudo via VMC protocol
- Fix scene reset
- Fix settings reset
- Fix bug in "2D-to-3D Wallpaper" for desktop and use default wallpaper when the last used image no longer exists
- Update Transformers.js (v3.0.0)
Backports
- Support macOS (BETA testing) (backported from v0.33.3)
- Apply a default, non-mandatory frame rate setting (30) for webcam (backported from v0.33.2)
- Change the behavior of non-default frame rate setting of webcam input to mandatory (NOTE: webcam may not load if the required frame rate is not supported) (backported from v0.33.2)
- Add "Escape" key function to "/" key on virtual numpad in mobile web app, allowing functions such as toggling of UI display and closing of speech bubbles (backported from v0.33.5)
- Fix startup error related to an electron-only feature about window position which shouldn't exist in web app mode (backported from v0.34.1)
- Fix bug in which the frame rate setting of webcam was not properly applied (backported from v0.33.2)
- Fix regression in 3D scene builder in which deleting a 3D object would return error (backported from v0.33.3)
- Fix webcam listing in web app mode (backported from v0.33.5)
- Remove and fix obsolete/redundant files
🧪Beta testing for macOS version🍎
The macOS version of XR Animator is now under beta testing. Make sure that you read the readme included for installation instructions. Please report any bug or issue🙏
🎵Musical instrument mocap🎵
The 3D prop of each supported instrument can be downloaded below.
- Guitar collection (acoustic, electric, bass and ukulele)
- Violin
- Cello
- Piano
- Electric piano
- Flute
- Saxophone
- Harp
❤️Support this project❤️
The future of XR Animator relies on your support🙇 Some IRL family issues have significantly increased my financial burden. While it was fun to develop the app, financial return was next to minimal. Reality forces me to evaluate the sustainability of this project, or soon I will have to give up...😢
If you like XR Animator, please consider making a donation🙇 Or even better, join my membership with perks such as EARLY ACCESS to the latest version XR Animator (at least 5 months ahead of the public release on GitHub), insider stories/tips and other benefits🎁 Sponsor us, and help keep this project free and sustainable🙏
XR Animator 0.28.1 - Windows/Linux/macOS version
Changes
- 💡Add "Super resolution" option for 3D wallpaper, which uses AI to upscale low-res image input (video demo)
- 💡Add "Create 3D desktop wallpaper shortcut" option for 3D wallpaper, which launches XR Animator in a special 3D-wallpaper-only mode for desktop use
- 💡Add options for 3D wallpaper to switch AI model for depth map generation and super resolution
- Add support for accepting scene JSON input anywhere and anytime after app start
- Add "Image input handler" setting under background image options, which allows handling any image input as wallpaper by default
- Move some calculations of 3D wallpaper from CPU to GPU shader which improves real-time responsiveness
- Reduce unused resource loading when avatar model is not used
- Suppress error message when creating desktop shortcut
- Fix bug which prevented depth map from being applied to 3D wallpaper when depth map was not transformed
- Fix bug and accept video wallpaper only when 3D wallpaper is disabled
- Fix legacy settings window which failed to update when only SELECT inputs changed
- Fix regression which broke file dropping when running in desktop wallpaper mode
- Update three-vrm (v3.1.2)
- Update electron-as-wallpaper (v1.0.8)
- Update transformers.js (v3.0.0-alpha.19)
Backports
- Support macOS (BETA testing) (backported from v0.33.3)
- Apply a default, non-mandatory frame rate setting (30) for webcam (backported from v0.33.2)
- Change the behavior of non-default frame rate setting of webcam input to mandatory (NOTE: webcam may not load if the required frame rate is not supported) (backported from v0.33.2)
- Add "Escape" key function to "/" key on virtual numpad in mobile web app, allowing functions such as toggling of UI display and closing of speech bubbles (backported from v0.33.5)
- Fix bug in which the frame rate setting of webcam was not properly applied (backported from v0.33.2)
- Fix regression in 3D scene builder in which deleting a 3D object would return error (backported from v0.33.3)
- Fix webcam listing in web app mode (backported from v0.33.5)
- Remove and fix obsolete/redundant files
🧪Beta testing for macOS version🍎
The macOS version of XR Animator is now under beta testing. Make sure that you read the readme included for installation instructions. Please report any bug or issue🙏
Instrument mocap
The 3D prop of each supported instrument can be downloaded below.
- Guitar collection (acoustic, bass, stratocaster and ukulele)
- Violin
- Cello
- Piano
- Electric piano
- Flute
- Saxophone
- Harp
❤️Support this project❤️
The future of XR Animator relies on your support🙇 Some IRL family issues have significantly increased my financial burden. While it was fun to develop the app, financial return was next to minimal. Reality forces me to evaluate the sustainability of this project, or soon I will have to give up...😢
If you like XR Animator, please consider making a donation🙇 Or even better, join my membership with perks such as EARLY ACCESS to the latest version XR Animator (at least 3 months ahead of the public release on GitHub), insider stories/tips and other benefits🎁 Sponsor us, and help keep this project free and sustainable🙏
XR Animator 0.28.0 - Windows/Linux/macOS version
Changes
- 💡Add 3D wallpaper support by turning 2D image into 3D backdrop with AI-generated depth map (video demo)
- 💡Enhance "Camera face-locking" feature with customizable options
- Reduce avatar movement jitters during full body mocap
- Fix some options with missing buttons on mouse hover
- Fix bug when using mouse to change option values via buttons which might break the 3D camera control
Backports
- Support macOS (BETA testing) (backported from v0.33.3)
- Apply a default, non-mandatory frame rate setting (30) for webcam (backported from v0.33.2)
- Change the behavior of non-default frame rate setting of webcam input to mandatory (NOTE: webcam may not load if the required frame rate is not supported) (backported from v0.33.2)
- Fix bug in which the frame rate setting of webcam was not properly applied (backported from v0.33.2)
- Fix regression in 3D scene builder in which deleting a 3D object would return error (backported from v0.33.3)
- Remove and fix obsolete/redundant files
🧪Beta testing for macOS version🍎
The macOS version of XR Animator is now under beta testing. Make sure that you read the readme included for installation instructions. Please report any bug or issue🙏
Instrument mocap
The 3D prop of each supported instrument can be downloaded below.
- Guitar collection (acoustic, bass, stratocaster and ukulele)
- Violin
- Cello
- Piano
- Electric piano
- Flute
- Saxophone
- Harp
❤️Support this project❤️
The future of XR Animator relies on your support🙇 Some IRL family issues have significantly increased my financial burden. While it was fun to develop the app, financial return was next to minimal. Reality forces me to evaluate the sustainability of this project, or soon I will have to give up...😢
If you like XR Animator, please consider making a donation🙇 Or even better, join my membership with perks such as EARLY ACCESS to the latest version XR Animator (at least 3 months ahead of the public release on GitHub), insider stories/tips and other benefits🎁 Sponsor us, and help keep this project free and sustainable🙏
XR Animator 0.27.4b - Windows and Linux version
Changes
- (Backported from v0.33.2) Apply a default, non-mandatory frame rate setting (30) for webcam
- (Backported from v0.33.2) Change the behavior of non-default frame rate setting of webcam input to mandatory (NOTE: webcam may not load if the required frame rate is not supported)
- (Backported from v0.33.2) Fix bug in which the frame rate setting of webcam was not properly applied
- (Backported) Remove and fix obsolete/redundant files
Changes from v0.27.4
- Support syncing of prop scaling when connected to Warudo (video demo)
- Improve the ease of use of UI options that require keys (namely ⬅️➡️➕➖) to change value with clickable buttons as alternative to key press
- Improve eye tracking during blinks, especially when eyes are not centered
- Improve 3D scene builder by allowing +/- key input from keyboard without keypad
- Fix "Z-depth scale" option of AI model quality which failed to change on first click when the value was "Medium"
Instrument mocap
The 3D prop of each supported instrument can be downloaded below.
- Guitar collection (acoustic, bass, stratocaster and ukulele)
- Violin
- Cello
- Piano
- Electric piano
- Flute
- Saxophone
- Harp
❤️Support this project❤️
The future of XR Animator relies on your support🙇 Some IRL family issues have significantly increased my financial burden. While it was fun to develop the app, financial return was next to minimal. Reality forces me to evaluate the sustainability of this project, or soon I will have to give up...😢
If you like XR Animator, please consider making a donation🙇 Or even better, join my membership with perks such as EARLY ACCESS to the latest version XR Animator (at least 2 months ahead of the public release on GitHub), insider stories/tips and other benefits🎁 Sponsor us, and help keep this project free and sustainable🙏
XR Animator 0.27.4 - Windows and Linux version
Changes
- Support syncing of prop scaling when connected to Warudo (video demo)
- Improve the ease of use of UI options that require keys (namely ⬅️➡️➕➖) to change value with clickable buttons as alternative to key press
- Improve eye tracking during blinks, especially when eyes are not centered
- Improve 3D scene builder by allowing +/- key input from keyboard without keypad
- Fix "Z-depth scale" option of AI model quality which failed to change on first click when the value was "Medium"
Instrument mocap
The 3D prop of each supported instrument can be downloaded below.
- Guitar collection (acoustic, bass, stratocaster and ukulele)
- Violin
- Cello
- Piano
- Electric piano
- Flute
- Saxophone
- Harp
❤️Support this project❤️
The future of XR Animator relies on your support🙇 Some IRL family issues have significantly increased my financial burden. While it was fun to develop the app, financial return was next to minimal. Reality forces me to evaluate the sustainability of this project, or soon I will have to give up...😢
If you like XR Animator, please consider making a donation🙇 Or even better, join my membership with perks such as EARLY ACCESS to the latest version XR Animator (at least 2 months ahead of the public release on GitHub), insider stories/tips and other benefits🎁 Sponsor us, and help keep this project free and sustainable🙏
XR Animator 0.27.3 - Windows and Linux version
Changes
- Add "Camera auto-zoom" option (video demo)
- Adjust motion parameters of various poses and motions for upper body mocap
- Fix random arm glitches when switching body collider mode from on to off during full body mocap
- Fix "VRM joint stiffness" setting when imported from external settings JSON
- Update MediaPipe Tasks Vision (v0.10.15)
- Update electron (v32.0.1)
Instrument mocap
The 3D prop of each supported instrument can be downloaded below.
- Guitar collection (acoustic, bass, stratocaster and ukulele)
- Violin
- Cello
- Piano
- Electric piano
- Flute
- Saxophone
- Harp
❤️Support this project❤️
The future of XR Animator relies on your support🙇 Some IRL family issues have significantly increased my financial burden. While it was fun to develop the app, financial return was next to minimal. Reality forces me to evaluate the sustainability of this project, or soon I will have to give up...😢
If you like XR Animator, please consider making a donation🙇 Or even better, join my membership with perks such as EARLY ACCESS to the latest version XR Animator (at least 2 months ahead of the public release on GitHub), insider stories/tips and other benefits🎁 Sponsor us, and help keep this project free and sustainable🙏