多人聊天视频卡顿，音视频输出延时如何优化？

WCNDY

您好，我参考了官方文档进行了开发。所有的基本功能都已经实现了。现在唯一的问题就是多人聊天时出现卡顿，音频和视频的输出有时候回很卡，有时候回延时。想请问一下如何进行优化。
网速因素也是其中之一，另外是不是只有修改传输音视频的质量？服务器端需要做什么改进吗？

佰锐科技-邵光清

您好，请将客户端日志发上来，我们详细分析。

WCNDY

佰锐科技-邵光清 发表于 2016-3-10 11:01
您好，请将客户端日志发上来，我们详细分析。

2016-03-10 11:09:27.142 MchatDemo[6045:449475] Regist failError Domain=NSCocoaErrorDomain Code=3010 "REMOTE_NOTIFICATION_SIMULATOR_NOT_SUPPORTED_NSERROR_DESCRIPTION" UserInfo={NSLocalizedDescription=REMOTE_NOTIFICATION_SIMULATOR_NOT_SUPPORTED_NSERROR_DESCRIPTION}
2016-03-10 11:09:27.162 MchatDemo[6045:449475] Regist failError Domain=NSCocoaErrorDomain Code=3010 "REMOTE_NOTIFICATION_SIMULATOR_NOT_SUPPORTED_NSERROR_DESCRIPTION" UserInfo={NSLocalizedDescription=REMOTE_NOTIFICATION_SIMULATOR_NOT_SUPPORTED_NSERROR_DESCRIPTION}

佰锐科技-邵光清

您好，Anychat的日志在沙盒的文稿中：BRAnyChatcore.log，谢谢！

WCNDY

佰锐科技-邵光清 发表于 2016-3-10 11:36
您好，Anychat的日志在沙盒的文稿中：BRAnyChatcore.log，谢谢！

啊，是这样啊，谢谢。我之前没有设置 视频参数 帧率什么的。我下午在测试测试。谢谢你

WCNDY

佰锐科技-邵光清 发表于 2016-3-10 11:36
您好，Anychat的日志在沙盒的文稿中：BRAnyChatcore.log，谢谢！

file:///D:\Documents\Tencent Files\313911762\Image\Group\Image1\NMB2I0RF(72C0U_UW~C54$H.jpg[2016-03-10 14:24:17(170)]        ---------------------------AnyChat Platform Core SDK Client Log---------------------------
[2016-03-10 14:24:17(173)]        Load libanychatcore.so success!(V5.3 Build Time:Aug 10 2015 12:28:11)
[2016-03-10 14:24:17(178)]        Load libmediautil.so success!(V5.3 Build Time:Aug 10 2015 12:28:28)
[2016-03-10 14:24:17(180)]        Load libmediashow.so success!(V5.3 Build Time:Aug 10 2015 12:28:26)
[2016-03-10 14:24:17(182)]        Load libmediacore.so success!(V5.3 Build Time:Aug 10 2015 12:28:23)
[2016-03-10 14:24:18(209)]        Invoke        Connect(117.135.239.160,8906)=0
[2016-03-10 14:24:18(211)]        Invoke        LoginServer(username=kenshin)
[2016-03-10 14:24:18(233)]        CheckClientSocketLink         Connect(ip=117.135.239.160,port=8906)
[2016-03-10 14:24:18(290)]        Server version: V5.1(Build Time:2014-11-05 22:20:07, Server OS:Windows)
[2016-03-10 14:24:18(291)]        Message        OnConnect(bSuccess:1, errorcode=0)
[2016-03-10 14:24:18(530)]        Message        OnLoginSystem(userid=-1212,errorcode=0,username=kenshin), msg deliver worked(0)
[2016-03-10 14:24:18(532)]        Load libmediautil.so success!(V5.3 Build Time:Aug 10 2015 12:28:28)
[2016-03-10 14:24:18(534)]        Load libmediashow.so success!(V5.3 Build Time:Aug 10 2015 12:28:26)
[2016-03-10 14:24:18(545)]        Load libmediacore.so success!(V5.3 Build Time:Aug 10 2015 12:28:23)
[2016-03-10 14:24:18(548)]        Server running time: 7 days, 11 hours, 13 minutes, license mode:0
[2016-03-10 14:24:18(555)]        Invoke        EnterRoom(roomid=530)
[2016-03-10 14:24:18(829)]        Message        OnEnterRoom(roomid=530,errorcode=0,siteindex=0)
[2016-03-10 14:24:19(568)]        Audio Playback Device Init(0, 1, 16000, 16), ios Playback Driver
[2016-03-10 14:24:19(570)]        Message        OnReceiveOnlineUser(count=1,roomid=530)
[2016-03-10 14:24:19(789)]        Invoke        UserSpeakControl(userid=-1,bOpen=1)
[2016-03-10 14:24:19(791)]        Audio record control:1, result:-1
[2016-03-10 14:24:19(795)]        Invoke        SetSDKOption(BRAC_SO_NETWORK_AUTORECONNECT=1)
[2016-03-10 14:24:19(810)]        Default Audio Capture Driver()
[2016-03-10 14:24:19(811)]        Audio Init, error:0, device:0, 1, 16000, 16, capmode:0
[2016-03-10 14:24:19(827)]        Audio codec init, handle:1, 11, 1, 16000, 16, 15850
[2016-03-10 14:24:22(376)]        Message        OnUserEnterRoom(userid=-1213,nickname=kenshin,siteindex=1)
[2016-03-10 14:24:22(388)]        Invoke        SetSDKOption(BRAC_SO_NETWORK_P2PPOLITIC=1)
[2016-03-10 14:24:22(391)]        Invoke        SetVideoPos(dwUserId:-1213, hWnd:0xd35ef150, l:0, t:0, r:0, b:0)
[2016-03-10 14:24:22(393)]        Invoke        UserSpeakControl(userid=-1213,bOpen=1)
[2016-03-10 14:24:22(394)]        Invoke        UserCameraControl(userid=-1213, bOpen=1, stream=0)
[2016-03-10 14:24:22(605)]        On Remote UserSpeakControl(dwUserId:-1213, bOpen:1)
[2016-03-10 14:24:22(619)]        Warning: The UDP communication with the server abnormal!
[2016-03-10 14:24:22(671)]        On Remote UserCameraControl(dwUserId:-1213, bOpen:1)
[2016-03-10 14:24:22(816)]        Message        OnP2PConnectState(userid=-1213, state=1)
[2016-03-10 14:24:23(054)]        Message        OnP2PConnectState(userid=-1213, state=3)
[2016-03-10 14:24:23(114)]        userid(-1213) audio decode, codec:11, 1 channel, 16000Hz
[2016-03-10 14:24:24(936)]        userid(-1213) video decode, codec:1, 640x480, delay:11ms
[2016-03-10 14:24:37(936)]        Message        OnUserEnterRoom(userid=-1214,nickname=my_name,siteindex=2)
[2016-03-10 14:24:37(942)]        Invoke        SetSDKOption(BRAC_SO_NETWORK_P2PPOLITIC=1)
[2016-03-10 14:24:37(945)]        Invoke        SetVideoPos(dwUserId:-1213, hWnd:0xd35ef150, l:0, t:0, r:0, b:0)
[2016-03-10 14:24:37(946)]        Invoke        UserSpeakControl(userid=-1213,bOpen=1)
[2016-03-10 14:24:37(946)]        Invoke        UserCameraControl(userid=-1213, bOpen=1, stream=0)
[2016-03-10 14:24:37(947)]        Invoke        SetVideoPos(dwUserId:-1214, hWnd:0xd35ef300, l:0, t:0, r:0, b:0)
[2016-03-10 14:24:37(948)]        Invoke        UserSpeakControl(userid=-1214,bOpen=1)
[2016-03-10 14:24:37(950)]        Invoke        UserCameraControl(userid=-1214, bOpen=1, stream=0)
[2016-03-10 14:24:38(079)]        Message        OnP2PConnectState(userid=-1214, state=1)
[2016-03-10 14:24:38(583)]        On Remote UserCameraControl(dwUserId:-1214, bOpen:1)
[2016-03-10 14:24:38(926)]        Message        OnP2PConnectState(userid=-1214, state=3)
[2016-03-10 14:24:38(934)]        userid(-1214) audio decode, codec:11, 1 channel, 16000Hz
[2016-03-10 14:24:39(663)]        userid(-1214) video decode, codec:1, 640x480, delay:3ms
[2016-03-10 14:25:23(871)]        socket error, disconnected by peer!, bTcp(1) - userid(-1214)
[2016-03-10 14:25:23(876)]        OnSocketClose, index(4)-errorcode(0-3), flags:0x81, bTcp(1),userid(-1214), list:0

[2016-03-10 14:25:23(891)]        Message        OnP2PConnectState(userid=-1214, state=2)
[2016-03-10 14:25:23(917)]        Message        OnUserLeaveRoom(userid=-1214,siteindex=2)
[2016-03-10 14:25:23(952)]        Invoke        SetSDKOption(BRAC_SO_NETWORK_P2PPOLITIC=1)
[2016-03-10 14:25:23(955)]        Invoke        SetVideoPos(dwUserId:-1213, hWnd:0xd35ef150, l:0, t:0, r:0, b:0)
[2016-03-10 14:25:23(959)]        Invoke        UserSpeakControl(userid=-1213,bOpen=1)
[2016-03-10 14:25:23(960)]        Invoke        UserCameraControl(userid=-1213, bOpen=1, stream=0)
[2016-03-10 14:25:29(241)]        socket error, disconnected by peer!, bTcp(1) - userid(-1213)
[2016-03-10 14:25:29(243)]        OnSocketClose, index(3)-errorcode(0-3), flags:0x81, bTcp(1),userid(-1213), list:0

[2016-03-10 14:25:29(256)]        Message        OnP2PConnectState(userid=-1213, state=2)
[2016-03-10 14:25:29(277)]        On Remote UserSpeakControl(dwUserId:-1213, bOpen:0)
[2016-03-10 14:25:29(278)]        On Remote UserCameraControl(dwUserId:-1213, bOpen:0)
[2016-03-10 14:25:29(279)]        Message        OnUserLeaveRoom(userid=-1213,siteindex=1)
[2016-03-10 14:25:29(281)]        Invoke        SetSDKOption(BRAC_SO_NETWORK_P2PPOLITIC=1)
[2016-03-10 14:25:45(790)]        Message        OnUserEnterRoom(userid=-1215,nickname=my_name,siteindex=1)
[2016-03-10 14:25:45(801)]        Invoke        SetSDKOption(BRAC_SO_NETWORK_P2PPOLITIC=1)
[2016-03-10 14:25:45(804)]        Invoke        SetVideoPos(dwUserId:-1215, hWnd:0xd35ef150, l:0, t:0, r:0, b:0)
[2016-03-10 14:25:45(807)]        Invoke        UserSpeakControl(userid=-1215,bOpen=1)
[2016-03-10 14:25:45(810)]        Invoke        UserCameraControl(userid=-1215, bOpen=1, stream=0)
[2016-03-10 14:25:45(944)]        On Remote UserCameraControl(dwUserId:-1215, bOpen:1)
[2016-03-10 14:25:46(296)]        OnSocketClose, index(3)-errorcode(0-54), flags:0x81, bTcp(1),userid(-1), list:0

[2016-03-10 14:25:46(537)]        Message        OnP2PConnectState(userid=-1215, state=2)
[2016-03-10 14:25:46(877)]        userid(-1215) audio decode, codec:11, 1 channel, 16000Hz
[2016-03-10 14:25:47(629)]        Message        OnP2PConnectState(userid=-1215, state=3)
[2016-03-10 14:25:47(754)]        userid(-1215) video decode, codec:1, 640x480, delay:1ms
[2016-03-10 14:26:01(652)]        Message        OnUserEnterRoom(userid=-1216,nickname=kenshin,siteindex=2)
[2016-03-10 14:26:01(657)]        Invoke        SetSDKOption(BRAC_SO_NETWORK_P2PPOLITIC=1)
[2016-03-10 14:26:01(659)]        Invoke        SetVideoPos(dwUserId:-1215, hWnd:0xd35ef150, l:0, t:0, r:0, b:0)
[2016-03-10 14:26:01(660)]        Invoke        UserSpeakControl(userid=-1215,bOpen=1)
[2016-03-10 14:26:01(661)]        Invoke        UserCameraControl(userid=-1215, bOpen=1, stream=0)
[2016-03-10 14:26:01(662)]        Invoke        SetVideoPos(dwUserId:-1216, hWnd:0xd35ef300, l:0, t:0, r:0, b:0)
[2016-03-10 14:26:01(664)]        Invoke        UserSpeakControl(userid=-1216,bOpen=1)
[2016-03-10 14:26:01(671)]        Invoke        UserCameraControl(userid=-1216, bOpen=1, stream=0)
[2016-03-10 14:26:01(946)]        On Remote UserSpeakControl(dwUserId:-1216, bOpen:1)
[2016-03-10 14:26:01(947)]        On Remote UserCameraControl(dwUserId:-1216, bOpen:1)
[2016-03-10 14:26:02(211)]        Message        OnP2PConnectState(userid=-1216, state=1)
[2016-03-10 14:26:02(446)]        Message        OnP2PConnectState(userid=-1216, state=3)
[2016-03-10 14:26:02(521)]        userid(-1216) audio decode, codec:11, 1 channel, 16000Hz
[2016-03-10 14:26:04(005)]        userid(-1216) video decode, codec:1, 640x480, delay:10ms
[2016-03-10 14:26:06(203)]        Message        OnUserEnterRoom(userid=-1217,nickname=my_name,siteindex=3)
[2016-03-10 14:26:06(210)]        Invoke        SetSDKOption(BRAC_SO_NETWORK_P2PPOLITIC=1)
[2016-03-10 14:26:06(216)]        Invoke        SetVideoPos(dwUserId:-1215, hWnd:0xd35ef150, l:0, t:0, r:0, b:0)
[2016-03-10 14:26:06(219)]        Invoke        UserSpeakControl(userid=-1215,bOpen=1)
[2016-03-10 14:26:06(221)]        Invoke        UserCameraControl(userid=-1215, bOpen=1, stream=0)
[2016-03-10 14:26:06(224)]        Invoke        SetVideoPos(dwUserId:-1216, hWnd:0xd35ef300, l:0, t:0, r:0, b:0)
[2016-03-10 14:26:06(226)]        Invoke        UserSpeakControl(userid=-1216,bOpen=1)
[2016-03-10 14:26:06(227)]        Invoke        UserCameraControl(userid=-1216, bOpen=1, stream=0)
[2016-03-10 14:26:06(229)]        Invoke        SetVideoPos(dwUserId:-1217, hWnd:0xd35ef4b0, l:0, t:0, r:0, b:0)
[2016-03-10 14:26:06(231)]        Invoke        UserSpeakControl(userid=-1217,bOpen=1)
[2016-03-10 14:26:06(233)]        Invoke        UserCameraControl(userid=-1217, bOpen=1, stream=0)
[2016-03-10 14:26:06(408)]        Message        OnP2PConnectState(userid=-1217, state=1)
[2016-03-10 14:26:06(978)]        Message        OnP2PConnectState(userid=-1217, state=3)
[2016-03-10 14:26:06(993)]        userid(-1217) audio decode, codec:11, 1 channel, 16000Hz
[2016-03-10 14:26:07(229)]        On Remote UserCameraControl(dwUserId:-1217, bOpen:1)
[2016-03-10 14:26:07(977)]        userid(-1217) video decode, codec:1, 640x480, delay:6ms
[2016-03-10 14:26:35(025)]        Invoke        UserSpeakControl(userid=-1,bOpen=0)
[2016-03-10 14:26:35(037)]        Invoke        UserCameraControl(userid=-1, bOpen=0, stream=0)
[2016-03-10 14:26:35(041)]        Invoke        UserSpeakControl(userid=-1215,bOpen=0)
[2016-03-10 14:26:35(042)]        Invoke        UserCameraControl(userid=-1215, bOpen=0, stream=0)
[2016-03-10 14:26:35(055)]        Invoke        UserSpeakControl(userid=-1216,bOpen=0)
[2016-03-10 14:26:35(059)]        Invoke        UserCameraControl(userid=-1216, bOpen=0, stream=0)
[2016-03-10 14:26:35(063)]        Invoke        UserSpeakControl(userid=-1217,bOpen=0)
[2016-03-10 14:26:35(065)]        Invoke        UserCameraControl(userid=-1217, bOpen=0, stream=0)
[2016-03-10 14:26:35(077)]        Invoke        LeaveRoom(roomid=-1)        Elapse:9 ms
[2016-03-10 14:26:35(101)]        Invoke        LogoutServer(userid=-1212)        Elapse:22 ms

WCNDY

你好，这是我客户端的参数设置，    int  iVideoBitrate        = 400;        //视频码率   [bps] 60 120 180 240 300 400 500 800 1000
    int  iVideoFrameRate      = 25;         //视频帧率   [25fps]
    int  iVideoPreset         = 3;          //预设参数   [1效率优先、2性能均衡、3质量优先]
    int  iVideoQuality        = 2;          //视频质量   [2普通、3中等、4较好]

    // P2P
    [AnyChatPlatform SetSDKOptionInt:BRAC_SO_NETWORK_P2PPOLITIC : (bUseP2P ? 1 : 0)];
   
    int iWidth, iHeight;
        switch (cuUserNum)//视频分辨率 [根据当前房间人数动态修改]
        {
            case 0:     iWidth = screenWidth;     iHeight = screenWidth;    break;//当前只有自己
            case 1:     iWidth = screenWidth/2;   iHeight = screenWidth/2;  break;
            case 2:     iWidth = screenWidth/2;   iHeight = screenWidth/2;  break;
            case 3:     iWidth = screenWidth/2;   iHeight = screenWidth/2;  break;
            case 4:     iWidth = screenWidth/3;   iHeight = screenWidth/3;  break;
            case 5:     iWidth = screenWidth/3;   iHeight = screenWidth/3;  break;
            default:    iWidth = screenWidth/3;   iHeight = screenWidth/3;  break;
        }
        
        [AnyChatPlatform SetSDKOptionInt:BRAC_SO_LOCALVIDEO_WIDTHCTRL   :iWidth];
        [AnyChatPlatform SetSDKOptionInt:BRAC_SO_LOCALVIDEO_HEIGHTCTRL  :iHeight];
        [AnyChatPlatform SetSDKOptionInt:BRAC_SO_LOCALVIDEO_BITRATECTRL :iVideoBitrate];
        [AnyChatPlatform SetSDKOptionInt:BRAC_SO_LOCALVIDEO_FPSCTRL     :iVideoFrameRate];
        [AnyChatPlatform SetSDKOptionInt:BRAC_SO_LOCALVIDEO_PRESETCTRL  :iVideoPreset];
        [AnyChatPlatform SetSDKOptionInt:BRAC_SO_LOCALVIDEO_QUALITYCTRL :iVideoQuality];
        
        // 采用本地视频参数设置，使参数设置生效
        [AnyChatPlatform SetSDKOptionInt:BRAC_SO_LOCALVIDEO_APPLYPARAM  :1];

佰锐科技-邵光清

WCNDY 发表于 2016-3-10 14:30
你好，这是我客户端的参数设置，    int  iVideoBitrate        = 400;        //视频码率    60 120 180 2 ...

您好 1.将UDP打开，进行测试看看， Warning: The UDP communication with the server abnormal!
       2. 将码率和分辨率调到320*240 码率150测试试试，另外您的场景通过手机端是接收多少路？

WCNDY

佰锐科技-邵光清 发表于 2016-3-10 15:08
您好 1.将UDP打开，进行测试看看， Warning: The UDP communication with the server abnormal!
        ...

thank you 我正在测试