How to custom WebRTC video source?

Question

Does someone know how to change WebRTC (https://cocoapods.org/pods/libjingle_peerconnection) video source?

I am working on an screen sharing app. At the moment, I retrieve the rendered frames in real-time in CVPixelBuffer. Does someone know how I could add my frames as video source please? Is it possible to set an other video source instead of camera device source ? Is yes, which format the video has to be and how to do it ?

Thanks.

Did you find any solution for this – MacDeveloper May 30 '18 at 06:23 — MacDeveloper, May 30 '18 at 06:23

score 4 · Answer 1 · edited Jun 05 '18 at 05:29

4

var connectionFactory :  RTCPeerConnectionFactory = RTCPeerConnectionFactory()
let videoSource :  RTCVideoSource = factory.videoSource()
videoSource.capturer(videoCapturer, didCapture: videoFrame!)

edited Jun 05 '18 at 05:29

MacDeveloper

1,244
1
14
46

answered Jun 04 '18 at 11:38

Mouni

131
1
7

6

This answer would be a lot more helpful if you explained what it does and why it solves the problem. – divibisan Jun 04 '18 at 15:18
1

he alludes to use two instances, `RTCVideoSource` and `RTCVideoCapturer`, first of all you create `videoSource` from factory and than create capturer `RTCVideoCapturer(delegate: videoSource)`. Than you create `videoTrack` with `videoSource` and `trackId` and add it to the `peer.localStream`. And than if you want to processes your own frame to the webRTC you create frame and call `videoSource.capturer(videoCapturer, didCapture: videoFrame!)` – Bws Sluk Jul 02 '18 at 13:29

score 3 · Answer 2 · edited May 20 '20 at 03:23

Mounis answer is wrong. This leads to nothing. At least not at the time of this writing. There is simply nothing happening.

In fact, you would need to satisfy this delegate

- (void)capturer:(RTCVideoCapturer *)capturer didCaptureVideoFrame:(RTCVideoFrame *)frame;

(Note the difference to the Swift version: didCapture vs. didCaptureVideoFrame)

Since this delegate is for unclear reasons not available at Swift level (the compiler says you have to use didCapture, since it has been renamed from didCaptureVideoFrame with Swift3) you have to put the code int an ObjC class. I did copy this and this (which is a part of this sample project)into my project, made my videoCapturer an instance of ARDBroadcastSampleHandler

self.videoCapturer = ARDExternalSampleCapturer(delegate: videoSource)

and within the capture callback I'm calling it

let capturer = self.videoCapturer as? ARDExternalSampleCapturer
capturer?.didCapture(sampleBuffer)

How to custom WebRTC video source?

2 Answers2

Linked