MediaStreamAudioSourceNode

[brettdavidbowles]

Feature Request

Like with the Web Audio API, would like to be able to connect to the mic using createMediaStreamSource, thus allowing the source to take an analyser from the audioContext as a parameter. The current Web Audio Api usage that I'm hoping you can replicate is roughly like this:

const analyser = audioContext.createAnalyser()
navigator.mediaDevices.getUserMedia(constraints)
        .then(
          function (stream) {
            source = audioContext.createMediaStreamSource(stream);
            source.connect(analyser);
          })

Obviously the mediaDevices bit here is web specific and the native implementation would use the current microphone functionality.

This would be continuing to replicate the Web Audio API, so apologies if it's already on the roadmap. Thanks for everything, incredible work so far!

[mdydek]

I modified our example for you, I hope that it would match your basic needs. https://gist.github.com/mdydek/298bdb700e85127221a78bc56bf98c10
Note that it is not at all elegant solution (connecting gain with parameter = 0), but it's working

[brettdavidbowles]

@mdydek thank you so much for your response. I'm currently getting the following errors in my terminal when I start the recorder:

[AVFAudio]            AVAEInternal.h:83    required condition is false: [AVAudioEngineGraph.mm:1419:Initialize: (IsFormatSampleRateAndChannelCountValid(inputHWFormat))]
[AVFAudio]          AVAudioEngine.mm:189   Engine@0x6000000583b0: could not initialize, error = -10875
[AVFAudio]            AVAEInternal.h:83    required condition is false: [AVAudioEngineGraph.mm:1419:Initialize: (IsFormatSampleRateAndChannelCountValid(inputHWFormat))]

I have a feeling expo isn't playing nice, but I'm not sure. Any suggestions would be much appreciated.

[brettdavidbowles]

Think I figured it out, actually. Had to put AudioManager.setAudioSessionActivity(false) after AudioManager.setAudioSessionOptions and on pause in handlePlayPause, and set it to true on play. Now it appears to be working. Thanks for your help @mdydek ! Cheers!