Realtime API Server Always Fails

[taylorbrown2686]

using System;
using System.Threading;
using System.Threading.Tasks;
using System.Collections.Generic;
using UnityEngine;
using OpenAI;
using OpenAI.Realtime;
using OpenAI.Models;

public class RealtimeSessionRunner : MonoBehaviour
{
    async void Start()
    {
        var api = new OpenAIClient("MYKEY");
        var cancellationTokenSource = new CancellationTokenSource();
        var tools = new List<Tool>
        {
            Tool.FromFunc("goodbye", () =>
            {
                cancellationTokenSource.Cancel();
                return "Goodbye!";
            })
        };
        var configuration = new SessionConfiguration(Model.GPT4oRealtime, tools: tools);
        using var session = await api.RealtimeEndpoint.CreateSessionAsync(configuration);
        var responseTask = session.ReceiveUpdatesAsync<IServerEvent>(ServerEvents, cancellationTokenSource.Token);
        await session.SendAsync(new ConversationItemCreateRequest("Hello!"));
        await session.SendAsync(new CreateResponseRequest());
        await session.SendAsync(new InputAudioBufferAppendRequest(new ReadOnlyMemory<byte>(new byte[1024 * 4])), cancellationTokenSource.Token);
        await session.SendAsync(new ConversationItemCreateRequest("GoodBye!"));
        await session.SendAsync(new CreateResponseRequest());
        await responseTask;
    }

    void ServerEvents(IServerEvent @event)
    {
        switch (@event)
        {
            case ResponseAudioTranscriptResponse transcriptResponse:
                Debug.Log(transcriptResponse.ToString());
                break;
            case ResponseFunctionCallArgumentsResponse functionCallResponse:
                if (functionCallResponse.IsDone)
                {
                    ToolCall toolCall = functionCallResponse;
                    toolCall.InvokeFunction();
                }
                break;
        }
    }
}

I have taken this code directly from the documentation but it always fails. I get some generic exception 'ServerResponse Failed!' Is this on the end of OpenAI or is something wrong in the example or how I have set it up?

EDIT: Formatting won't work for some reason. Pasted the code many times using the `` tags. Also removed my API key despite it being deleted already.

[StephenHodgson]

Pretty sure this is a temporary outage. All of my unit tests and sample scene testing passed before I made the latest release for realtime endpoint.

[taylorbrown2686]

Re-opening this, I have had the same error as before appearing for the past 2 days. I have changed API keys multiple times, and see no reflected outages on the outage page. This happens in a fresh project with just this package installed as well (on the Realtime sample).

Unity 2023.2.20f1, most recent version of this plugin.

[StephenHodgson]

Ok, can you send me a snippet of what you are using in your class?

[StephenHodgson]

Can you also double check that the sample scene is also broken for you as well? Send me the debug info from the realtime sample scene (please remove any sensitive info from logs)

[taylorbrown2686]

Upon further investigation, this appears to be a quota issue. A response object comes through with the info nested inside of it, this is surprising since I haven't used realtime for more than a few conversations.

I will have to check their platform to see how I can upgrade. Thanks for your help!