AnyChat技术支持论坛

标题: 关于surface上运行anychat遇到的问题 [打印本页]

作者: kinghong 时间: 2015-9-6 15:41
标题: 关于surface上运行anychat遇到的问题

你好，最近我们在开发surface上的应用，我们的客户反馈在surface上打开内置摄像头画面有延迟的问题，另外从摄像头切换到桌面共享功能没有成功，下面是客户提供的日志，请帮忙分析下!

[2015-09-03 10:52:20(319)] ---------------------------AnyChat Platform Core SDK Client Log---------------------------
[2015-09-03 10:52:20(319)] Load BRAnyChatCore.dll success!(V5.3 Build Time:Jul 31 2015 22:08:48)
[2015-09-03 10:52:20(335)] Load BRMiscUtil.dll failed,SDK some functions will fail!(Error:126)
[2015-09-03 10:52:20(335)] Load BRMediaUtil.dll success!(V5.3 Build Time:Jul 31 2015 22:08:30)
[2015-09-03 10:52:20(350)] Load BRMediaShow.dll success!(V5.3 Build Time:Jul 31 2015 22:09:17)
[2015-09-03 10:52:20(350)] Load BRMediaCore.dll success!(V5.3 Build Time:Aug 11 2015 19:20:45)
[2015-09-03 10:52:20(397)] Apply video parameter:1920x1080, bitrate:1000kbps, quality:5, gop:30, fps:30, preset:5, codec:0
[2015-09-03 10:52:20(397)] Invoke Connect(10.196.176.118,8906)=0
[2015-09-03 10:52:20(444)] CheckClientSocketLink Connect(ip=10.196.176.118,port=8906)
[2015-09-03 10:52:20(600)] Server version: V5.2(Build Time:2015-02-10 14:08:34, Server OS:Windows)
[2015-09-03 10:52:20(663)] Message OnConnect(bSuccess:1, errorcode=0)
[2015-09-03 10:52:20(663)] Invoke LoginServer(username=101)
[2015-09-03 10:52:21(006)] Message OnLoginSystem(userid=101,errorcode=0,username=101), msg deliver worked(1)
[2015-09-03 10:52:21(006)] Server running time: 0 days, 0 hours, 21 minutes, license mode:0
[2015-09-03 10:52:21(053)] Connection to streaming media server successfully!(udp delay:23ms)
[2015-09-03 10:52:21(491)] Invoke VideoCallControl(EventType:1, UserId:201, ErrorCode:0, dwFlags:0, dwParam:0, UserStr:doube screen)=0
[2015-09-03 10:52:21(678)] Message OnVideoCallEvent(EventType:2, UserId:201, ErrorCode:0, dwFlags:0x0, dwParam:0
[2015-09-03 10:52:34(106)] Message OnVideoCallEvent(EventType:3, UserId:201, ErrorCode:0, dwFlags:0x0, dwParam:1
[2015-09-03 10:52:34(122)] Invoke EnterRoom(roomid=1)
[2015-09-03 10:52:34(372)] Message OnEnterRoom(roomid=1,errorcode=0,siteindex=1)
[2015-09-03 10:52:34(387)] Message OnReceiveOnlineUser(count=2,roomid=1)
[2015-09-03 10:52:34(419)] WaveIn Audio Capture Driver(Microphone (Realtek High Defini)
[2015-09-03 10:52:34(434)] Audio Init, error:0, device:0, 1, 16000, 16, capmode:0
[2015-09-03 10:52:34(434)] Audio codec init, handle:1, 11, 1, 16000, 16, 15850
[2015-09-03 10:52:34(434)] Invoke UserCameraControl(userid=101,bOpen=1)
[2015-09-03 10:52:34(450)] Invoke UserSpeakControl(userid=101,bOpen=1)
[2015-09-03 10:52:34(450)] Invoke SetVideoPos(dwUserId:101, hWnd:0x90374, l:0, t:0, r:320, b:180)
[2015-09-03 10:52:34(466)] Audio Playback Device Init(0, 1, 16000, 16), WaveOut Playback Driver
[2015-09-03 10:52:34(466)] Invoke UserCameraControl(userid=201,bOpen=1)
[2015-09-03 10:52:34(481)] Invoke UserSpeakControl(userid=201,bOpen=1)
[2015-09-03 10:52:34(481)] Invoke SetVideoPos(dwUserId:201, hWnd:0x120294, l:0, t:0, r:1440, b:960)
[2015-09-03 10:52:34(513)] On Remote UserCameraControl(dwUserId:201, bOpen:1)
[2015-09-03 10:52:34(513)] Audio FX Status: VAD:1, NS:1, AGC:1, AEC:1
[2015-09-03 10:52:34(521)] On Remote UserSpeakControl(dwUserId:201, bOpen:1)
[2015-09-03 10:52:34(621)] userid(201) audio decode, codec:11, 1 channel, 16000Hz
[2015-09-03 10:52:34(842)] Message OnP2PConnectState(userid=201, state=1)
[2015-09-03 10:52:34(951)] MinCroppingSize(640, 360) MaxCroppingSize(640, 360) Format(YUY2, 0x32595559, 30fps)
[2015-09-03 10:52:34(951)] Message OnP2PConnectState(userid=201, state=3)
[2015-09-03 10:52:34(951)] MinCroppingSize(640, 360) MaxCroppingSize(640, 360) Format(YUY2, 0x8d2681, 30fps)
[2015-09-03 10:52:34(951)] MinCroppingSize(640, 480) MaxCroppingSize(640, 480) Format(YUY2, 0x32595559, 30fps)
[2015-09-03 10:52:34(967)] MinCroppingSize(640, 480) MaxCroppingSize(640, 480) Format(YUY2, 0x8d2681, 30fps)
[2015-09-03 10:52:34(967)] MinCroppingSize(480, 270) MaxCroppingSize(480, 270) Format(YUY2, 0x32595559, 30fps)
[2015-09-03 10:52:34(982)] MinCroppingSize(480, 270) MaxCroppingSize(480, 270) Format(YUY2, 0x8d2681, 30fps)
[2015-09-03 10:52:34(982)] MinCroppingSize(424, 240) MaxCroppingSize(424, 240) Format(YUY2, 0x32595559, 30fps)
[2015-09-03 10:52:34(982)] MinCroppingSize(424, 240) MaxCroppingSize(424, 240) Format(YUY2, 0x8d2681, 30fps)
[2015-09-03 10:52:34(998)] MinCroppingSize(320, 240) MaxCroppingSize(320, 240) Format(YUY2, 0x32595559, 30fps)
[2015-09-03 10:52:34(998)] MinCroppingSize(320, 240) MaxCroppingSize(320, 240) Format(YUY2, 0x8d2681, 30fps)
[2015-09-03 10:52:34(998)] MinCroppingSize(320, 180) MaxCroppingSize(320, 180) Format(YUY2, 0x32595559, 30fps)
[2015-09-03 10:52:35(014)] MinCroppingSize(320, 180) MaxCroppingSize(320, 180) Format(YUY2, 0x8d2681, 30fps)
[2015-09-03 10:52:35(014)] MinCroppingSize(160, 120) MaxCroppingSize(160, 120) Format(YUY2, 0x32595559, 30fps)
[2015-09-03 10:52:35(029)] MinCroppingSize(160, 120) MaxCroppingSize(160, 120) Format(YUY2, 0x8d2681, 30fps)
[2015-09-03 10:52:35(029)] MinCroppingSize(848, 480) MaxCroppingSize(848, 480) Format(YUY2, 0x32595559, 30fps)
[2015-09-03 10:52:35(029)] MinCroppingSize(848, 480) MaxCroppingSize(848, 480) Format(YUY2, 0x8d2681, 30fps)
[2015-09-03 10:52:35(029)] MinCroppingSize(1920, 1080) MaxCroppingSize(1920, 1080) Format(YUY2, 0x32595559, 30fps)
[2015-09-03 10:52:35(045)] MinCroppingSize(1920, 1080) MaxCroppingSize(1920, 1080) Format(YUY2, 0x8d1181, 30fps)
[2015-09-03 10:52:35(045)] MinCroppingSize(1280, 720) MaxCroppingSize(1280, 720) Format(YUY2, 0x32595559, 30fps)
[2015-09-03 10:52:35(061)] MinCroppingSize(1280, 720) MaxCroppingSize(1280, 720) Format(YUY2, 0x8d1181, 30fps)
[2015-09-03 10:52:35(061)] MinCroppingSize(960, 540) MaxCroppingSize(960, 540) Format(YUY2, 0x32595559, 30fps)
[2015-09-03 10:52:35(076)] MinCroppingSize(960, 540) MaxCroppingSize(960, 540) Format(YUY2, 0x8d1181, 30fps)
[2015-09-03 10:52:35(076)] MinCroppingSize(2592, 1944) MaxCroppingSize(2592, 1944) Format(YUY2, 0x32595559, 15fps)
[2015-09-03 10:52:35(076)] MinCroppingSize(2592, 1944) MaxCroppingSize(2592, 1944) Format(YUY2, 0x8d1181, 15fps)
[2015-09-03 10:52:35(076)] MinCroppingSize(2592, 1728) MaxCroppingSize(2592, 1728) Format(YUY2, 0x32595559, 15fps)
[2015-09-03 10:52:35(092)] MinCroppingSize(2592, 1728) MaxCroppingSize(2592, 1728) Format(YUY2, 0x8d1181, 15fps)
[2015-09-03 10:52:35(092)] MinCroppingSize(1296, 864) MaxCroppingSize(1296, 864) Format(YUY2, 0x32595559, 30fps)
[2015-09-03 10:52:35(092)] MinCroppingSize(1296, 864) MaxCroppingSize(1296, 864) Format(YUY2, 0x8d1181, 30fps)
[2015-09-03 10:52:35(107)] Prepare config video capture: 1920x1080, 30fps
[2015-09-03 10:52:35(107)] SetFormat(1920x1080, YUY2) = 0
[2015-09-03 10:52:35(123)] Video Config Size(1920, 1080) Format(YUY2, 30fps)
[2015-09-03 10:52:35(141)] video init finish:1920x1080, YUY2, fps:30, codecid:1
[2015-09-03 10:52:35(845)] userid(201) video decode, codec:1, 1920x1080, delay:63ms
[2015-09-03 10:52:36(447)] video codec init:codec:1, 30fps, 1920x1080, bitrate:1000kbps, quality:5, preset:5, gop:30, handle:4
[2015-09-03 10:52:43(868)] Message OnVideoCallEvent(EventType:4, UserId:201, ErrorCode:100106, dwFlags:0x0, dwParam:0
[2015-09-03 10:52:43(918)] Invoke UserCameraControl(userid=-1,bOpen=0)
[2015-09-03 10:52:43(921)] Message OnUserLeaveRoom(userid=201,siteindex=0)
[2015-09-03 10:52:44(312)] Invoke UserSpeakControl(userid=-1,bOpen=0)
[2015-09-03 10:52:44(318)] Invoke UserCameraControl(userid=201,bOpen=0)
[2015-09-03 10:52:44(323)] Invoke UserSpeakControl(userid=201,bOpen=0)
[2015-09-03 10:52:44(386)] Invoke LeaveRoom(roomid=-1) Elapse:63 ms
[2015-09-03 10:52:44(402)] Invoke UserCameraControl(userid=201,bOpen=0)
[2015-09-03 10:52:44(402)] Invoke UserSpeakControl(userid=201,bOpen=0)
[2015-09-03 10:52:45(574)] OnSocketClose, index(3)-errorcode(0-0), flags:0x481, bTcp(1),userid(201), list:0

[2015-09-03 10:57:32(710)] Invoke LogoutServer(userid=101) Elapse:78 ms
[2015-09-03 10:57:32(772)] Invoke BRAC_Release Elapse:63 ms

作者: 佰锐科技-邵光清 时间: 2015-9-6 16:00
您好，是运行我们的demo程序吗？另外，降低一下音视频参数，不要设置那么高，看有没有问题。

作者: kinghong 时间: 2015-9-7 17:29

佰锐科技-邵光清发表于 2015-9-6 16:00
您好，是运行我们的demo程序吗？另外，降低一下音视频参数，不要设置那么高，看有没有问题。

不是demo程序，但也是在你们demo的基础上修改的程序，同样的程序跑在surface上就会有问题。

作者: kinghong 时间: 2015-9-7 17:31

佰锐科技-邵光清发表于 2015-9-6 16:00
您好，是运行我们的demo程序吗？另外，降低一下音视频参数，不要设置那么高，看有没有问题。

还有之所以参数设置的高，是之前要提高视频画质向你们咨询的要这样设置，你现在说让我降低参数，那么画面质量不也降低了吗。还有surface上切换桌面共享失败，通过日志你们能发现什么吗？

作者: 佰锐科技-邵光清 时间: 2015-9-7 17:58

kinghong 发表于 2015-9-7 17:31
还有之所以参数设置的高，是之前要提高视频画质向你们咨询的要这样设置，你现在说让我降低参数，那么画面 ...

您好，共享桌面失败在日志上看一切换到桌面共享，就挂断通话了。切换到桌面共享过程中有其他操作吗？

关于内置摄像头延迟问题，有可能跟摄像头支持的参数有关，这点还需认证。

作者: 佰锐科技-邵光清 时间: 2015-9-7 18:24
请问，使用内置摄像头画面延迟，如果使用外置摄像头会不会延迟？

使用内置摄像头发生延迟是必然的吗？把视频参数降低一些还会延迟吗？

作者: 佰锐科技-邵光清 时间: 2015-9-7 18:25
方便将桌面共享的那部分代码发过来看看不？

作者: kinghong 时间: 2015-9-8 09:09

佰锐科技-邵光清发表于 2015-9-7 18:24
请问，使用内置摄像头画面延迟，如果使用外置摄像头会不会延迟？

使用内置摄像头发生延迟是必然的吗？把 ...

内置摄像头延迟是必然的，换成外置摄像头就不会延迟。

作者: kinghong 时间: 2015-9-8 09:12

佰锐科技-邵光清发表于 2015-9-7 18:25
方便将桌面共享的那部分代码发过来看看不？

private void UseDestopSharing()
      {
         pan_conversation.Hide();
         //pan_call.Show();

         // 获取当前视频采集设备
         StringBuilder sb = new StringBuilder(1024);
         AnyChatCoreSDK.GetCurVideoCapture(sb, sb.Capacity);
         defaultVideo = sb.ToString();

         int iDeviceCount = -1;
         int ret = AnyChatCoreSDK.EnumVideoCapture(null, ref iDeviceCount);

         string capture = iDeviceCount+"-Naitve Screen Camera";
         int value = AnyChatCoreSDK.SelectVideoCapture(capture);

         int m_Refw = AnyChatCoreSDK.SetSDKOption(AnyChatCoreSDK.BRAC_SO_LOCALVIDEO_WIDTHCTRL, ref screenWidth, sizeof(int));
         int m_Refh = AnyChatCoreSDK.SetSDKOption(AnyChatCoreSDK.BRAC_SO_LOCALVIDEO_HEIGHTCTRL,  ref screenHeight, sizeof(int));

         //应用本地视频编码参数，使得前述修改即时生效（参数为int型：1 使用新参数，0 使用默认参数）
         int m_AppLocal = 1;
         AnyChatCoreSDK.SetSDKOption(AnyChatCoreSDK.BRAC_SO_LOCALVIDEO_APPLYPARAM, ref m_AppLocal, sizeof(int));

      }

作者: 佰锐科技-李友勤 时间: 2015-9-8 11:52

kinghong 发表于 2015-9-8 09:12
private void UseDestopSharing()
{
pan_conversation.Hide();

您好，以下代码有实现吗
//开启屏幕共享
int bEnableScreenCamera = 1;
AnyChatCoreSDK.SetSDKOption(AnyChatCoreSDK.BRAC_SO_CORESDK_SCREENCAMERACTRL, ref bEnableScreenCamera, sizeof(int));

作者: kinghong 时间: 2015-9-8 13:07

佰锐科技-李友勤发表于 2015-9-8 11:52
您好，以下代码有实现吗
//开启屏幕共享
int bEnableScreenCamera = 1;

有实现，请看我源码：
private void initAnychat()
      {
         if (hallForm != null && !hallForm.bReleased)
         {
            AnyChatCoreSDK.Logout();
            AnyChatCoreSDK.Release();

         }
         else
         {
            hallForm = null;
            hallForm = new VideoForm(m_myUserID, m_userName, m_firendID, m_LocalVideoWidth, m_LocalVideoHeight,deviceList);
            hallForm.OnVideoCall_Reply += new EventHandler<NotifyMessageEventArgs>(hallForm_OnVideoCall_Reply);
            //this.Hide();
            hallForm.Show();
            hallForm.LoadBg(loading);
         }

         SystemSetting.Init(this.Handle);

         int bEnableScreenCamera = 1;
         int x = AnyChatCoreSDK.SetSDKOption(AnyChatCoreSDK.BRAC_SO_CORESDK_SCREENCAMERACTRL, ref bEnableScreenCamera, sizeof(int));

         //设置视频分辨率
         int m_Refw = AnyChatCoreSDK.SetSDKOption(AnyChatCoreSDK.BRAC_SO_LOCALVIDEO_WIDTHCTRL, ref m_LocalVideoWidth, sizeof(int));
         int m_Refh = AnyChatCoreSDK.SetSDKOption(AnyChatCoreSDK.BRAC_SO_LOCALVIDEO_HEIGHTCTRL, ref m_LocalVideoHeight, sizeof(int));
         AnyChatCoreSDK.SetSDKOption(AnyChatCoreSDK.BRAC_SO_LOCALVIDEO_BITRATECTRL, ref m_LocalVideoBitrate, sizeof(int));
         AnyChatCoreSDK.SetSDKOption(AnyChatCoreSDK.BRAC_SO_LOCALVIDEO_FPSCTRL, ref m_LocalVideoFps, sizeof(int));
         AnyChatCoreSDK.SetSDKOption(AnyChatCoreSDK.BRAC_SO_LOCALVIDEO_PRESETCTRL, ref m_LocalPreset, sizeof(int));
         AnyChatCoreSDK.SetSDKOption(AnyChatCoreSDK.BRAC_SO_LOCALVIDEO_GOPCTRL, ref m_LocalGop, sizeof(int));
         AnyChatCoreSDK.SetSDKOption(AnyChatCoreSDK.BRAC_SO_LOCALVIDEO_QUALITYCTRL, ref m_LocalQuality, sizeof(int));

         //应用本地视频编码参数，使得前述修改即时生效（参数为int型：1 使用新参数，0 使用默认参数）
         int m_AppLocal = 1;
         AnyChatCoreSDK.SetSDKOption(AnyChatCoreSDK.BRAC_SO_LOCALVIDEO_APPLYPARAM, ref m_AppLocal, sizeof(int));

         //AnyChatCoreSDK.SelectVideoCapture(capture);

         AnyChatCoreSDK.Connect(videoServerIP, videoPort);
      }

作者: bairui.tony 时间: 2015-9-8 20:27

kinghong 发表于 2015-9-8 09:12
private void UseDestopSharing()
{
pan_conversation.Hide();

你好，通过对您帖上的代码分析，发现是没有正常设置包括帧率(BRAC_SO_LOCALVIDEO_FPSCTRL)、关键帧(BRAC_SO_LOCALVIDEO_GOPCTRL)、码率(BRAC_SO_LOCALVIDEO_BITRATECTRL)等视频参数导致的共享桌面的视频没有正常显示。在代码中增加这些视频参数设置语句即可正常显示共享桌面的视频。

另外代码中是假设“Native Screen Camera"设备在被枚举时始终为最后一个设备，从代码严谨的角度来看还是通过判断语句去选择设备更合适。

可以参考如下的代码：

int deviceNum = 0;
AnyChatCoreSDK.EnumVideoCapture(null, ref deviceNum);
IntPtr[] deviceList = new IntPtr[deviceNum];
AnyChatCoreSDK.EnumVideoCapture(deviceList, ref deviceNum);
for (int idx = 0; idx < deviceNum; idx++)
{
IntPtr intPtr = deviceList[idx];
int len = 100;
byte[] byteArray = new byte[len];
Marshal.Copy(intPtr, byteArray, 0, len);
string m_DeviceName = Encoding.Default.GetString(byteArray);
m_DeviceName = m_DeviceName.Substring(0, m_DeviceName.IndexOf('\0'));
if (m_DeviceName.IndexOf("Native Screen Camera") > 0)
{
AnyChatCoreSDK.SelectVideoCapture(m_DeviceName);
//设置视频参数
int screenWidth = 800;
int screenHeight = 600;
AnyChatCoreSDK.SetSDKOption(AnyChatCoreSDK.BRAC_SO_LOCALVIDEO_WIDTHCTRL, ref screenWidth, sizeof(int));
AnyChatCoreSDK.SetSDKOption(AnyChatCoreSDK.BRAC_SO_LOCALVIDEO_HEIGHTCTRL, ref screenHeight, sizeof(int));
int bitrateCtrl = 0;
AnyChatCoreSDK.SetSDKOption(AnyChatCoreSDK.BRAC_SO_LOCALVIDEO_BITRATECTRL, ref bitrateCtrl, sizeof(int));
int fpsCtrl = 15;
AnyChatCoreSDK.SetSDKOption(AnyChatCoreSDK.BRAC_SO_LOCALVIDEO_FPSCTRL, ref fpsCtrl, sizeof(int));
int gopCtrol = 60;
AnyChatCoreSDK.SetSDKOption(AnyChatCoreSDK.BRAC_SO_LOCALVIDEO_GOPCTRL, ref gopCtrol, sizeof(int));
int presetCtrl = 3;
AnyChatCoreSDK.SetSDKOption(AnyChatCoreSDK.BRAC_SO_LOCALVIDEO_PRESETCTRL, ref presetCtrl, sizeof(int));
int qualityCtrl = 3;
AnyChatCoreSDK.SetSDKOption(AnyChatCoreSDK.BRAC_SO_LOCALVIDEO_QUALITYCTRL, ref qualityCtrl, sizeof(int));
int m_AppLocal = 1;
AnyChatCoreSDK.SetSDKOption(AnyChatCoreSDK.BRAC_SO_LOCALVIDEO_APPLYPARAM, ref m_AppLocal, sizeof(int));
break;
}
}

复制代码

作者: kinghong 时间: 2015-9-9 09:20

bairui.tony 发表于 2015-9-8 20:27
你好，通过对您帖上的代码分析，发现是没有正常设置包括帧率(BRAC_SO_LOCALVIDEO_FPSCTRL)、关键帧(BRAC_ ...

谢谢你的回答，根据你上面的视频分辨率设置共享桌面就达不到全屏共享了，还有我用台式机来设置共享的话是没有问题的，也可以设置全屏共享。

作者: 佰锐科技-邵光清 时间: 2015-9-9 09:30

kinghong 发表于 2015-9-9 09:20
谢谢你的回答，根据你上面的视频分辨率设置共享桌面就达不到全屏共享了，还有我用台式机来设置共享的话是 ...

您好，上面代码仅供参考，可以将分辨率设置高一些以达到全屏效果。

作者: kinghong 时间: 2015-9-9 09:55

佰锐科技-邵光清发表于 2015-9-9 09:30
您好，上面代码仅供参考，可以将分辨率设置高一些以达到全屏效果。

请看我在第一页发的日志，同样的参数设置在台式机上共享桌面没有问题，但是在surface上就有问题，请问我参数设置哪里有问题了？

作者: kinghong 时间: 2015-9-9 09:55

bairui.tony 发表于 2015-9-8 20:27
你好，通过对您帖上的代码分析，发现是没有正常设置包括帧率(BRAC_SO_LOCALVIDEO_FPSCTRL)、关键帧(BRAC_ ...

请看我在第一页发的日志，同样的参数设置在台式机上共享桌面没有问题，但是在surface上就有问题，请问我参数设置哪里有问题了？

作者: 佰锐科技-邵光清 时间: 2015-9-9 10:09

kinghong 发表于 2015-9-9 09:55
请看我在第一页发的日志，同样的参数设置在台式机上共享桌面没有问题，但是在surface上就有问题，请问我 ...

您好，视频参数选项中视频质量和预设都是5最高级别，这对运算能力更高要求，CPU压力稍高；另外gop：30这个设置不合理，gop一般为fps的3到4倍。

欢迎光临 AnyChat技术支持论坛 (http://bbs.anychat.cn/)

Powered by Discuz! X3