IAudioHandler - How to save to a playable file

Having problems with building or using the CefSharp .NET binding? Ask your CEF-related questions here. Please ask general usage questions on StackOverflow.

Moderator: amaitland

IAudioHandler - How to save to a playable file

Postby Thawing » Fri Nov 20, 2020 6:17 pm

In CefSharp there is the AudioHandler, which implements IAudioHandler. I have looked at the example code(https://github.com/cefsharp/CefSharp/blob/76e5a8d5c0541dfe5235c6d43d2b41187ce6ef0f/CefSharp.Example/Handlers/AudioHandler.cs#L23).

How do I take the raw PCM data from OnAudioStreamPacket and save it to a playable file?
Thawing
Newbie
 
Posts: 3
Joined: Fri Nov 20, 2020 5:04 pm

Re: IAudioHandler - How to save to a playable file

Postby ndesktop » Mon Nov 23, 2020 3:02 am

I think you need OnAudioStreamPacket, which seems missing from the AudioHandler.cs (either OnAudioStreamPacket was added after, or the C# implementation ignored it).

Code: Select all
///
  // Called on the audio stream thread when a PCM packet is received for the
  // stream. |data| is an array representing the raw PCM data as a floating
  // point type, i.e. 4-byte value(s). |frames| is the number of frames in the
  // PCM packet. |pts| is the presentation timestamp (in milliseconds since the
  // Unix Epoch) and represents the time at which the decompressed packet should
  // be presented to the user. Based on |frames| and the |channel_layout| value
  // passed to OnAudioStreamStarted you can calculate the size of the |data|
  // array in bytes.
  ///
  /*--cef()--*/
  virtual void OnAudioStreamPacket(CefRefPtr<CefBrowser> browser,
                                   const float** data,
                                   int frames,
                                   int64 pts) = 0;
ndesktop
Master
 
Posts: 750
Joined: Thu Dec 03, 2015 10:10 am

Re: IAudioHandler - How to save to a playable file

Postby amaitland » Mon Nov 23, 2020 4:05 am

ndesktop wrote:I think you need OnAudioStreamPacket, which seems missing from the AudioHandler.cs (either OnAudioStreamPacket was added after, or the C# implementation ignored it).


The example linked is from an older branch. See https://github.com/cefsharp/CefSharp/blob/cefsharp/85/CefSharp.Example/Handlers/AudioHandler.cs for the link relevant to 85 release which is the current stable release.
Maintainer of the CefSharp project.
amaitland
Virtuoso
 
Posts: 1290
Joined: Wed Jan 14, 2015 2:35 am

Re: IAudioHandler - How to save to a playable file

Postby Thawing » Mon Nov 23, 2020 5:53 pm

I am using OnAudioStreamPacket.

So, how do I calculate the array size in bytes? Or actually in float/single?

The comments say:

Code: Select all
  // Based on |frames| and the |channel_layout| value
  // passed to OnAudioStreamStarted you can calculate the size of the |data|
  // array in bytes.


My current values are as follows:

Code: Select all
   // ChannelLayout = LayoutStereo
   // FramesPerBuffer = 1024
   // SampleRate = 44100
   // channels = 2


I am trying to use NAudio to read the samples from the data array into a WAV file.

Code: Select all
        public void OnAudioStreamPacket(IWebBrowser chromiumWebBrowser, IBrowser browser, IntPtr data, int noOfFrames, long pts)
        {
            // ChannelLayout = LayoutStereo
            // FramesPerBuffer = 1024
            // SampleRate = 44100
            // channels = 2

            var length = noOfFrames / 4;  // <== I am pretty sure I am calculating the length incorrectly.
            var array = new float[length];

            Marshal.Copy(data, array, 0, length);

            this.waveFileWriter.WriteSamples(array, 0, length);
        }


However, the file that is create is too small (10 second recording is only a couple of seconds long) and has no sound.
Thawing
Newbie
 
Posts: 3
Joined: Fri Nov 20, 2020 5:04 pm

Re: IAudioHandler - How to save to a playable file

Postby ndesktop » Tue Nov 24, 2020 2:18 am

This might help.
ndesktop
Master
 
Posts: 750
Joined: Thu Dec 03, 2015 10:10 am

Re: IAudioHandler - How to save to a playable file

Postby Thawing » Tue Dec 15, 2020 8:55 am

I have been struggling with this for over a month. Last night, I decided to use "unsafe" instead of using a marshal copy. Instead of the "exception of type 'system.executionengineexception'" error message I have been receiving I got "Attempted to read or write protected memory. This is often an indication that other memory is corrupt". After some research, I found this is a x64 versus x86 issue. I am using Visual Studio (which is still 32 bit). I had the project set to 64 bit.

Set my project to be x86, and I was able to access the memory pointers data. The WAV file I was able to create was the correct length. The audio was the original test audio, but muffled. I still have more work to get the audio sounding perfectly, however I am getting closer.

If you are using Visual Studio to debug and you want to retrieve audio, make sure to use x86.
Thawing
Newbie
 
Posts: 3
Joined: Fri Nov 20, 2020 5:04 pm


Return to CefSharp Forum

Who is online

Users browsing this forum: No registered users and 15 guests