Application freezes on first voice request

[jeffries7]

I think this is more of a question than a bug but we're seeing large spikes when processing text.

We're using the latest version of the SDK & Unity 2021.3.21f1.
This is running on a Meta Quest 3 but we're also seeing this when running in the editor.

Pretty much all requests we make after the first one are absolutely fine but the first one freezes the application for a second or two.

I've taken a look at the samples but it has the same results.

Below is the code we've been using for a while.

    public void ExecuteTask(string answer)
    {
         if (_isReady)
             Execute(answer);
    }
    
    private async void Execute(string answer)
    {
        _isReady = false;

        var api = new ElevenLabsClient();

        var voice = await api.VoicesEndpoint.GetVoiceAsync(voiceData.DefaultVoice.ID);

        var voiceClip = await api.TextToSpeechEndpoint.TextToSpeechAsync(answer, voice, model: Model.EnglishTurboV2);

        if (_audioSource.isPlaying)
        {
            _audioSource.Stop();
        }

        onAudioProcessed?.Invoke();

        _audioSource.clip = voiceClip.AudioClip;
        _audioSource.Play();

        StartCoroutine(CheckAudio());
    }

[StephenHodgson]

the freeze you're likely seeing is the voice clip being loaded into memory.

you might see better performance with the streaming endpoint.

[StephenHodgson]

I bet it is the client credential setup phase.

Are you also getting the warnings about perf and passing in the configuration through the constrictor?

How are you passing the API key?

[jeffries7]

We're passing the api key via a scriptable object. I assume we should be using a config file instead as I don't think we can use an environment variable on the Quest.

I've just seen we have these warnings.

[StephenHodgson]

Ideally you shouldn't be shipping your API keys in your app anyway.

[StephenHodgson]

See API proxy instructions.

And to get around the performance impact create the auth and settings objects before constructing your client.

[jeffries7]

Thank you so much for this. Its a 10/10 package, keep up the great work and great support!

[StephenHodgson]

By the way you can await this coroutine:

await CheckAudio();

[jeffries7]

You're right, thanks 👍

[StephenHodgson]

Duplicate of #69