<br><div itemprop="text">

<p>I've implemented a <code>RPScreenRecorder</code>, which records screen as well as mic audio. After multiple recordings are completed I stop the recording and merge the Audios with Videos using <code>AVMutableComposition</code> and then Merge all the videos to form Single Video.</p>

<p>For screen recording and getting the video and audio files, I am using </p>

<pre><code>- (void)startCaptureWithHandler:(nullable void(^)(CMSampleBufferRef sampleBuffer, RPSampleBufferType bufferType, NSError * _Nullable error))captureHandler completionHandler:
</code></pre>

<p>For stopping the recording. I Call this function:</p>

<pre><code>- (void)stopCaptureWithHandler:(void (^)(NSError *error))handler;
</code></pre>

<p>And these are pretty Straight forward.</p>

<p>Most of the times it works great, I receive both video and audio CMSampleBuffers. 
But some times it so happens that <strong><code>startCaptureWithHandler</code> only sends me audio buffers but not video buffers.</strong>
And once I encounter this problem, it won't go until I restart my device and reinstall the app. This makes my app so unreliable for the user. 
I think this is a replay kit issue but unable to found out related issues with other developers. 
let me know if any one of you came across this issue and got the solution.</p>

<p>I have check multiple times but haven't seen any issue in configuration.
But here it is anyway. </p>

<pre><code>NSError *videoWriterError;
videoWriter = [[AVAssetWriter alloc] initWithURL:fileString fileType:AVFileTypeQuickTimeMovie
                                           error:&amp;videoWriterError];


NSError *audioWriterError;
audioWriter = [[AVAssetWriter alloc] initWithURL:audioFileString fileType:AVFileTypeAppleM4A
                                           error:&amp;audioWriterError];

CGFloat width =UIScreen.mainScreen.bounds.size.width;
NSString *widthString = [NSString stringWithFormat:@"%f", width];
CGFloat height =UIScreen.mainScreen.boNSString *heightString = [NSString stringWithFormat:@"%f", height];unds.size.height;

NSDictionary  * videoOutputSettings= @AVVideoCodecKey : AVVideoCodecTypeH264,
                                       AVVideoWidthKey: widthString,
                                       AVVideoHeightKey : heightString;
videoInput  = [[AVAssetWriterInput alloc] initWithMediaType:AVMediaTypeVideo outputSettings:videoOutputSettings];

videoInput.expectsMediaDataInRealTime = true;

AudioChannelLayout acl;
bzero( &amp;acl, sizeof(acl));
acl.mChannelLayoutTag = kAudioChannelLayoutTag_Mono;
NSDictionary * audioOutputSettings = [ NSDictionary dictionaryWithObjectsAndKeys:
                                      [ NSNumber numberWithInt: kAudioFormatAppleLossless ], AVFormatIDKey,
                                      [ NSNumber numberWithInt: 16 ], AVEncoderBitDepthHintKey,
                                      [ NSNumber numberWithFloat: 44100.0 ], AVSampleRateKey,
                                      [ NSNumber numberWithInt: 1 ], AVNumberOfChannelsKey,
                                      [ NSData dataWithBytes: &amp;acl length: sizeof( acl ) ], AVChannelLayoutKey,
                                      nil ];

audioInput = [[AVAssetWriterInput alloc] initWithMediaType:AVMediaTypeAudio outputSettings:audioOutputSettings];

;

;
    ;

    [[AVAudioSession sharedInstance] setCategory: AVAudioSessionCategoryPlayAndRecord withOptions:AVAudioSessionCategoryOptionDefaultToSpeaker error:nil];

[RPScreenRecorder.sharedRecorder startCaptureWithHandler:^(CMSampleBufferRef  _Nonnull sampleBuffer, RPSampleBufferType bufferType, NSError * _Nullable myError) 

Block


</code></pre>

<p>The startCaptureWithHandler function has pretty straight forward functionality as well:</p>

<pre><code>[RPScreenRecorder.sharedRecorder startCaptureWithHandler:^(CMSampleBufferRef  _Nonnull sampleBuffer, RPSampleBufferType bufferType, NSError * _Nullable myError) {

                    dispatch_sync(dispatch_get_main_queue(), ^{


                        if(CMSampleBufferDataIsReady(sampleBuffer))
                        

                            if (self-&gt;videoWriter.status == AVAssetWriterStatusUnknown)
                            
                                    self-&gt;writingStarted = true;
                                    [self-&gt;videoWriter startWriting];
                                    [self-&gt;videoWriter startSessionAtSourceTime:CMSampleBufferGetPresentationTimeStamp(sampleBuffer)];

                                    [self-&gt;audioWriter startWriting];
                                    [self-&gt;audioWriter startSessionAtSourceTime:CMSampleBufferGetPresentationTimeStamp(sampleBuffer)];
                            
                            if (self-&gt;videoWriter.status == AVAssetWriterStatusFailed) 
                                return;
                            

                            if (bufferType == RPSampleBufferTypeVideo)
                            

                                if (self-&gt;videoInput.isReadyForMoreMediaData)
                                
                                        [self-&gt;videoInput appendSampleBuffer:sampleBuffer];
                                
                            
                            else if (bufferType == RPSampleBufferTypeAudioMic)
                            
                                //                                printf("n+++ bufferAudio received %d n",arc4random_uniform(100));
                                if (writingStarted)
                                    if (self-&gt;audioInput.isReadyForMoreMediaData)
                                    
                                            [self-&gt;audioInput appendSampleBuffer:sampleBuffer];
                                    
                                
                            

                        
                    });

                }
</code></pre>

<p>Also, when this situation occurs, the system screen recorder gets corrupted as well. On clicking system recorder, this error shows up:</p>

<p><img src="https://satoshinakamotoblog.com/wp-content/uploads/2018/09/ios-Replaykit-startCaptureWithHandler-not-sending-CMSampleBufferRef-of-Video-type-in-captureHandler.jpg" alt="mediaservice error"/><br/></p>

<p>The error says "Screen recording has stopped due to: Failure during recording due to Mediaservices error".</p>

<p>There must be two reasons:</p>

<ol><li>iOS Replay kit is in beta, which is why it is giving problem after sometimes of usage.</li>
<li>I have implemented any problematic logic, which is cause replaykit to crash. </li>
</ol><p>If it's issue no. 1, then no problem. 
If this is issue no. 2 then I have to know where I might be wrong?</p>

<p>Opinions and help will be appreciated.</p>
    </div>
<br>
<br><a href="https://stackoverflow.com/questions/51440249/replaykit-startcapturewithhandler-not-sending-cmsamplebufferref-of-video-type">Source link </a> <br /><center><hr/><em>Posted from my blog with <a href='https://wordpress.org/plugins/steempress/'>SteemPress</a> : https://satoshinakamotoblog.com/ios-replaykit-startcapturewithhandler-not-sending-cmsamplebufferref-of-video-type-in-capturehandler </em><hr/></center>