Is there a way to remove StaticSound Data loaded on AudioManager?

[dolto]

Hello.
I'm studying Rust language, and I'm currently experimenting with a front-end library called dioxus and several other things (in this case kira).

I was implementing a part where characters make sounds when they speak (such as Animal Crossing), which is used a lot in other games.

From too complicated cpal to roadio or rubato... and I found a library called kira and tried it, and it's been successful to some extent.

However, if you play a sound file imported into the reqwest library, AudioManager's num_sounds() will continue to build up, and if it is approximately 20 to 30, the browser will experience severe lag.

And this num_sounds() doesn't seem to shrink at all, so the StaticSoundData you created doesn't seem to be released from memory.

So the temporary measures I have adopted are as follows.

    pub fn play(&self) -> Result<(), Box<dyn Error>> {
        let sound = self.base_sound.clone();
        let sound = sound.playback_rate(self.speed);
        let sound = sound.volume(self.volum);
        let sound = sound.reverse(self.is_rev);
        // let track = AUDIO_MANAGER.write().add_sub_track({
        //     let mut builder = TrackBuilder::new();
        //     if self.reverb != 0. {
        //         builder.add_effect(ReverbBuilder::new().damping(self.reverb));
        //     }
        //     // builder.add_effect(LfoBuilder::new().frequency(self.pitch));
        //     // builder.add_effect(CompressorBuilder::new().ratio(self.speed));
        //     // builder.add_effect();
        //     builder
        // })?;

        info!("{}", AUDIO_MANAGER.write().num_sounds()); // AUDIO_MANAGER is static value (GlobalSignal<AudioManager>) for dioxus system
        let num_sound = AUDIO_MANAGER.write().num_sounds();
        let num_cap = AUDIO_MANAGER.write().sound_capacity() - 1;
        if num_sound >= num_cap {
            *AUDIO_MANAGER.write() = {
                let mut settings = AudioManagerSettings::default();
                let mut capercities = Capacities::default();
                capercities.sound_capacity = CAPS;
                info!("사운드 캐퍼시티 {}", capercities.sound_capacity);

                settings.capacities = capercities;
                let manager: AudioManager<DefaultBackend> = AudioManager::new(settings).unwrap();
                manager
            };
        }
        (*AUDIO_MANAGER.write()).play(sound)?;

        Ok(())
    }

When AudioManager's maximum acceptable sound is full (CAPS is temporarily set to 16), replace it with a new AudioManager, and this method has been quite successful...

But I think this is a temporary way, and if the sound should run once every 10 ms, there is also a problem that some sounds don't play, so I want to improve it.

Is there a way to remove StaticSound Data loaded on AudioManager?

[tesselode]

Each time you play a sound, previously played sounds that are now finished are supposed to be unloaded. So I'm wondering if this is some kind of Kira wasm bug. I have a couple questions:

• What kind of Sound are you using? StaticSoundData? StreamingSoundData? Something custom?
• Can you post the audio file?

[dolto]

the sound is make loeaded binary from request like this
(An audio file is a short file of about 0.3 seconds)

    let sound: Resource<Result<(), Box<dyn Error>>> = use_resource(move || async move {
        info!("start audio load");
        let res = reqwest::get("http://localhost:8080/umm.wav").await?;
        info!("umm.wav loaded");
        let bytes = res.bytes().await?.to_vec();
        info!("make Vec<u8>");

        SOUND_EFFECTS.write().insert("umm".to_string(), bytes); // this is just static hashmap<String, Vec<u8>>
        info!("audio save in SOUDN_EFFECTES");
        Ok(())
    });

and audio manager is static value

const CAPS: u16 = 16;
pub static AUDIO_MANAGER: GlobalSignal<AudioManager> = Signal::global(|| {
    let mut settings = AudioManagerSettings::default();
    let mut capercities = Capacities::default();
    capercities.sound_capacity = CAPS;

    settings.capacities = capercities;
    let manager: AudioManager<DefaultBackend> = AudioManager::new(settings).unwrap();
    manager
});

and make static sound data from cursor

#[derive(Debug, PartialEq, Clone)]
pub struct SoundEffect {
    // pub context: AudioContext,
    pub base_sound: StaticSoundData,
    pub pitch: f64,
    pub speed: f64,
    pub volum: f64,
    pub is_rev: bool,
    pub reverb: f64,
}

impl SoundEffect {
    pub fn new(data: Vec<u8>) -> Result<Self, Box<dyn Error>> {
        let cursor = Cursor::new(data);
        let sound_data = StaticSoundData::from_cursor(cursor)?;

        Ok(SoundEffect {
            // context: sink,
            base_sound: sound_data,
            pitch: 1.,
            speed: 1.,
            volum: 1.,
            is_rev: false,
            reverb: 0.,
        })
    }
// ellipsis, omit
}

finally i play audio like next code

    pub fn play(&self) -> Result<(), Box<dyn Error>> {
        let sound = self.base_sound.clone();
        let sound = sound.playback_rate(self.speed);
        let sound = sound.volume(self.volum);
        let sound = sound.reverse(self.is_rev);

        info!("{}", AUDIO_MANAGER.write().num_sounds());
        let num_sound = AUDIO_MANAGER.write().num_sounds();
        let num_cap = AUDIO_MANAGER.write().sound_capacity() - 1;

        // This code temporarily corrects errors
        if num_sound >= num_cap { 
            *AUDIO_MANAGER.write() = {
                let mut settings = AudioManagerSettings::default();
                let mut capercities = Capacities::default();
                capercities.sound_capacity = CAPS;

                settings.capacities = capercities;
                let manager: AudioManager<DefaultBackend> = AudioManager::new(settings).unwrap();
                manager
            };
        }
        (*AUDIO_MANAGER.write()).play(sound)?;

        Ok(())
    }

i'm not good at audio system, so i readed to document but i'm not sure what am i done

I hope my case will be helpful.

[tesselode]

Can you post a simple example that I can run? Without being able to run the code it's hard to tell what's wrong.

[dolto]

of course! here my test repo

https://github.com/dolto/sound-test

you can see how to started https://dioxuslabs.com/learn/0.5/getting_started

[tesselode]

OK, I found the bug. It's not a wasm-specific bug, but one that happens if you play a static sound backwards. It's fixed now in v0.9.4. Thank you for helping me catch it!

[dolto]

Wow! that a amaging!
Thank you for fixe it have a good day!!