RM视频播放器 [2011-4-20更新异步模式可以融合进 RM 画面]

ssjr · 发表于 2011-4-24 00:40:14

为什么我用同样的格式视频不能播放视频，只能听到声音，用默认的那个却很正常？

蕾米莉亚·斯卡雷特 · 发表于 2011-4-23 15:46:12

回复 yangff 的帖子

那咱去试试看. FPS 掉不多的话还好~~~

炎影者 · 发表于 2011-4-23 13:11:42

这个要支持！！

yangff · 发表于 2011-4-22 22:45:42

本帖最后由 yangff 于 2011-4-22 22:49 编辑

蕾米莉亚·斯卡雷特发表于 2011-4-22 22:37
回复 yangff 的帖子

解码链都是会找可以使用的，基本上算是最优的组合方法。

啥……反正我是记得FFmpge可以解几乎所有的……当然现在这么多乱七八糟的也不好说，但是至少常用的没问题的说……
Bitmap我的意思是这样的
class Video < Bitmap
  def address

buffer, ad = "xxxx", object_id * 2 + 16

RtlMoveMemory_pi.call(buffer, ad, 4); ad = buffer.unpack("L")[0] + 8

RtlMoveMemory_pi.call(buffer, ad, 4); ad = buffer.unpack("L")[0] + 16

RtlMoveMemory_pi.call(buffer, ad, 4); return buffer.unpack("L")[0]

  end
  def initialize(url)
@handle,w,h=GetRect.call(url).unpack("L*")
super(w,h)
SetAddr(@handle,address)
  end
  def update
if (FPS)
   MovieUpdate.call(@handle)
end
  end
  def dispose
MovieDispose.call(@handle)
  end
end
效率不用担心，我写过一个斜切的，每桢PIA一个新的Bitmap然后用新的度数切一遍再XXXXXX再修改透明度，FPS在50无压力只是加一个A更无压力了肯定……我担心的是Dx但效率反而（d7说他能到60我才不信……）
只不过我对RM统计的FPS各种怀疑不需要原因的那种

蕾米莉亚·斯卡雷特 · 发表于 2011-4-22 22:37:39

回复 yangff 的帖子

解码链都是会找可以使用的，基本上算是最优的组合方法。

A 通道什么的， DX 不应该不支持才对。这个问题不大。主要是 blt 的效率问题。

Bitmap 先 new 的话，也应该在内存里才对吧。

而且视频最少需要 24FPS 才流畅。估计效率上很麻烦。

解码库什么的，有空有需求了再说。万能解码库啥的，还没遇见过。

QQPlayer 还不算是万能的。它的解码库是用 dll 堆起来的。 = =

yangff · 发表于 2011-4-22 21:49:24

蕾米莉亚·斯卡雷特发表于 2011-4-22 21:38
回复 yangff 的帖子

少了个 A 感觉少了好多。

不会，扫一遍不会影响FPS的= =虽然是Blt但是直接搞内存还是很快的 = =
GetCurrentBuffer不知道支不支持A通道= =但是Dx的话因该是可以的吧
至于解码……我觉得弄个FFmpge什么的就差不多了吧，Kmp用的也就是FF啊
不过GPL很讨厌就是了

蕾米莉亚·斯卡雷特 · 发表于 2011-4-22 21:38:43

回复 yangff 的帖子

少了个 A 感觉少了好多。

视频 Filter 都是可以截图的。摄像头本来想添加进去，不过想想这个貌似用处不大。开着 RM 视频聊天么？ = =

总感觉每帧截图再转换再加载再显示，效率能达到 10FPS 就不错了。这样可使每帧 Blt 啊。

yangff · 发表于 2011-4-22 21:20:11

本帖最后由 yangff 于 2011-4-22 21:22 编辑

蕾米莉亚·斯卡雷特发表于 2011-4-22 20:48
回复 yangff 的帖子

GetCurrentBuffer

这种方法的FPS在30左右时无压力的……不知道60会不会……大不了跳帧= =反正有几个视屏的FPS到60了= =
但是据说CPU各种吃没试过= =这个导的是摄像头的

这段代码本来是用来把DS的那一坨转成Ocv的那一坨……
显然这种玩意返回的东西可以在RM里面直接用
Rm的Bitmap是BGRA的Top-down=int
这个返回的是BGR模式的Top-down
到时候怎么位移一下就好了= =

蕾米莉亚·斯卡雷特 · 发表于 2011-4-22 20:48:14

回复 yangff 的帖子

GetCurrentBuffer

截图什么的功能打算在 3.1 3.2 的时候添加。不过每帧都截图是不是太那个啊。而且要想真的和 Rm 合体什么的，有点难度。

不过目前最大的问题还是解码链路还是自动连接，对系统的要求比较大就是了。手动连接就好多了。不过要求很高。

对于返回的那个内存图片的内存结构会不会还没研究过。（大概是一样的）

yangff · 发表于 2011-4-22 20:38:58

本帖最后由 yangff 于 2011-4-22 20:40 编辑

蕾米莉亚·斯卡雷特发表于 2011-4-22 20:23
回复 yangff 的帖子

核心是 DirectShow ，解码链返回的是 IPin 接口。显示啥的，是框架问题。不是 Bi ...

DS 貌似可以导出Bitmap矩阵的
GetCurrentBuffer(size,buff)
一段有关的代码……欢迎蛋疼……表示没装Dx/Platform SDK= =
能成的话就用Mp4做真战斗背景神马的了-= = |||

//////////////////////////////////////////////////////////////////////
// Video Capture using DirectShow
// Author: Shiqi Yu ([email protected])
// Thanks to:
// HardyAI@OpenCV China
// flymanbox@OpenCV China (for his contribution to function CameraName, and frame width/height setting)
// Last modification: April 9, 2009
//////////////////////////////////////////////////////////////////////
//////////////////////////////////////////////////////////////////////
// 使用说明：
// 1. 将CameraDS.h CameraDS.cpp以及目录DirectShow复制到你的项目中
// 2. 菜单 Project->Settings->Settings for:(All configurations)->C/C++->Category(Preprocessor)->Additional include directories
// 设置为 DirectShow/Include
// 3. 菜单 Project->Settings->Settings for:(All configurations)->Link->Category(Input)->Additional library directories
// 设置为 DirectShow/Lib
//////////////////////////////////////////////////////////////////////
// CameraDS.cpp: implementation of the CCameraDS class.
//
//////////////////////////////////////////////////////////////////////
#include "CameraDS.h"
#pragma comment(lib,"Strmiids.lib")
//////////////////////////////////////////////////////////////////////
// Construction/Destruction
//////////////////////////////////////////////////////////////////////
CCameraDS::CCameraDS()
{
m_bConnected = m_bLock = m_bChanged = false;
m_nWidth = m_nHeight = 0;
m_nBufferSize = 0;
m_pFrame = NULL;
m_pNullFilter = NULL;
m_pMediaEvent = NULL;
m_pSampleGrabberFilter = NULL;
m_pGraph = NULL;
CoInitialize(NULL);
}
CCameraDS::~CCameraDS()
{
CloseCamera();
CoUninitialize();
}
void CCameraDS::CloseCamera()
{
if(m_bConnected)
{
m_pMediaControl->Stop();
}
m_pGraph = NULL;
m_pDeviceFilter = NULL;
m_pMediaControl = NULL;
m_pSampleGrabberFilter = NULL;
m_pSampleGrabber = NULL;
m_pGrabberInput = NULL;
m_pGrabberOutput = NULL;
m_pCameraOutput = NULL;
m_pMediaEvent = NULL;
m_pNullFilter = NULL;
m_pNullInputPin = NULL;
if (m_pFrame)
{
cvReleaseImage(&m_pFrame);
}
m_bConnected = m_bLock = m_bChanged = false;
m_nWidth = m_nHeight = 0;
m_nBufferSize = 0;
}
bool CCameraDS::OpenCamera(int nCamID, bool bDisplayProperties, int nWidth, int nHeight)
{
HRESULT hr = S_OK;
CoInitialize(NULL);
// Create the Filter Graph Manager.
hr = CoCreateInstance(CLSID_FilterGraph, NULL, CLSCTX_INPROC, IID_IGraphBuilder, (void **)&m_pGraph);
hr = CoCreateInstance(CLSID_SampleGrabber, NULL, CLSCTX_INPROC_SERVER, IID_IBaseFilter, (LPVOID *)&m_pSampleGrabberFilter);
hr = m_pGraph->QueryInterface(IID_IMediaControl, (void **) &m_pMediaControl);
hr = m_pGraph->QueryInterface(IID_IMediaEvent, (void **) &m_pMediaEvent);
hr = CoCreateInstance(CLSID_NullRenderer, NULL, CLSCTX_INPROC_SERVER, IID_IBaseFilter, (LPVOID*) &m_pNullFilter);
hr = m_pGraph->AddFilter(m_pNullFilter, L"NullRenderer");
hr = m_pSampleGrabberFilter->QueryInterface(IID_ISampleGrabber, (void**)&m_pSampleGrabber);
AM_MEDIA_TYPE mt;
ZeroMemory(&mt, sizeof(AM_MEDIA_TYPE));
mt.majortype = MEDIATYPE_Video;
mt.subtype = MEDIASUBTYPE_RGB24;
mt.formattype = FORMAT_VideoInfo;
hr = m_pSampleGrabber->SetMediaType(&mt);
MYFREEMEDIATYPE(mt);
m_pGraph->AddFilter(m_pSampleGrabberFilter, L"Grabber");
// Bind Device Filter. We know the device because the id was passed in
BindFilter(nCamID, &m_pDeviceFilter);
m_pGraph->AddFilter(m_pDeviceFilter, NULL);
CComPtr<IEnumPins> pEnum;
m_pDeviceFilter->EnumPins(&pEnum);
hr = pEnum->Reset();
hr = pEnum->Next(1, &m_pCameraOutput, NULL);
pEnum = NULL;
m_pSampleGrabberFilter->EnumPins(&pEnum);
pEnum->Reset();
hr = pEnum->Next(1, &m_pGrabberInput, NULL);
pEnum = NULL;
m_pSampleGrabberFilter->EnumPins(&pEnum);
pEnum->Reset();
pEnum->Skip(1);
hr = pEnum->Next(1, &m_pGrabberOutput, NULL);
pEnum = NULL;
m_pNullFilter->EnumPins(&pEnum);
pEnum->Reset();
hr = pEnum->Next(1, &m_pNullInputPin, NULL);
//SetCrossBar();
if (bDisplayProperties)
{
CComPtr<ISpecifyPropertyPages> pPages;
HRESULT hr = m_pCameraOutput->QueryInterface(IID_ISpecifyPropertyPages, (void**)&pPages);
if (SUCCEEDED(hr))
{
PIN_INFO PinInfo;
m_pCameraOutput->QueryPinInfo(&PinInfo);
CAUUID caGUID;
pPages->GetPages(&caGUID);
OleCreatePropertyFrame(NULL, 0, 0,
L"Property Sheet", 1,
(IUnknown **)&(m_pCameraOutput.p),
caGUID.cElems, caGUID.pElems,
0, 0, NULL);
CoTaskMemFree(caGUID.pElems);
PinInfo.pFilter->Release();
}
pPages = NULL;
}
else
{
//////////////////////////////////////////////////////////////////////////////
// 加入由 lWidth和lHeight设置的摄像头的宽和高的功能，默认320*240
// by flymanbox @2009-01-24
//////////////////////////////////////////////////////////////////////////////
IAMStreamConfig *iconfig = NULL;
hr = m_pCameraOutput->QueryInterface(IID_IAMStreamConfig, (void**)&iconfig);
AM_MEDIA_TYPE *pmt;
if(iconfig->GetFormat(&pmt) !=S_OK)
{
//printf("GetFormat Failed ! \n");
return false;
}
// 3、考虑如果此时的的图像大小正好是 nWidth * nHeight，则就不用修改了。
if ((pmt->lSampleSize != (nWidth * nHeight * 3)) && (pmt->formattype == FORMAT_VideoInfo))
{
VIDEOINFOHEADER *phead = (VIDEOINFOHEADER*)(pmt->pbFormat);
phead->bmiHeader.biWidth = nWidth;
phead->bmiHeader.biHeight = nHeight;
if((hr = iconfig->SetFormat(pmt)) != S_OK)
{
return false;
}
}
iconfig->Release();
iconfig=NULL;
MYFREEMEDIATYPE(*pmt);
}
hr = m_pGraph->Connect(m_pCameraOutput, m_pGrabberInput);
hr = m_pGraph->Connect(m_pGrabberOutput, m_pNullInputPin);
if (FAILED(hr))
{
switch(hr)
{
case VFW_S_NOPREVIEWPIN :
break;
case E_FAIL :
break;
case E_INVALIDARG :
break;
case E_POINTER :
break;
}
}
m_pSampleGrabber->SetBufferSamples(TRUE);
m_pSampleGrabber->SetOneShot(TRUE);
hr = m_pSampleGrabber->GetConnectedMediaType(&mt);
if(FAILED(hr))
{
return false;
}
VIDEOINFOHEADER *videoHeader;
videoHeader = reinterpret_cast<VIDEOINFOHEADER*>(mt.pbFormat);
m_nWidth = videoHeader->bmiHeader.biWidth;
m_nHeight = videoHeader->bmiHeader.biHeight;
m_bConnected = true;
pEnum = NULL;
return true;
}
bool CCameraDS::BindFilter(int nCamID, IBaseFilter **pFilter)
{
if (nCamID < 0)
{
return false;
}
// enumerate all video capture devices
CComPtr<ICreateDevEnum> pCreateDevEnum;
HRESULT hr = CoCreateInstance(CLSID_SystemDeviceEnum, NULL, CLSCTX_INPROC_SERVER, IID_ICreateDevEnum, (void**)&pCreateDevEnum);
if (hr != NOERROR)
{
return false;
}
CComPtr<IEnumMoniker> pEm;
hr = pCreateDevEnum->CreateClassEnumerator(CLSID_VideoInputDeviceCategory, &pEm, 0);
if (hr != NOERROR)
{
return false;
}
pEm->Reset();
ULONG cFetched;
IMoniker *pM;
int index = 0;
while(hr = pEm->Next(1, &pM, &cFetched), hr==S_OK, index <= nCamID)
{
IPropertyBag *pBag;
hr = pM->BindToStorage(0, 0, IID_IPropertyBag, (void **)&pBag);
if(SUCCEEDED(hr))
{
VARIANT var;
var.vt = VT_BSTR;
hr = pBag->Read(L"FriendlyName", &var, NULL);
if (hr == NOERROR)
{
if (index == nCamID)
{
pM->BindToObject(0, 0, IID_IBaseFilter, (void**)pFilter);
}
SysFreeString(var.bstrVal);
}
pBag->Release();
}
pM->Release();
index++;
}
pCreateDevEnum = NULL;
return true;
}
//将输入crossbar变成PhysConn_Video_Composite
void CCameraDS::SetCrossBar()
{
int i;
IAMCrossbar *pXBar1 = NULL;
ICaptureGraphBuilder2 *pBuilder = NULL;
HRESULT hr = CoCreateInstance(CLSID_CaptureGraphBuilder2, NULL, CLSCTX_INPROC_SERVER, IID_ICaptureGraphBuilder2, (void **)&pBuilder);
if (SUCCEEDED(hr))
{
hr = pBuilder->SetFiltergraph(m_pGraph);
}
hr = pBuilder->FindInterface(&LOOK_UPSTREAM_ONLY, NULL, m_pDeviceFilter,IID_IAMCrossbar, (void**)&pXBar1);
if (SUCCEEDED(hr))
{
long OutputPinCount, InputPinCount;
long PinIndexRelated, PhysicalType;
long inPort = 0, outPort = 0;
pXBar1->get_PinCounts(&OutputPinCount, &InputPinCount);
for( i =0;i<InputPinCount;i++)
{
pXBar1->get_CrossbarPinInfo(TRUE,i,&PinIndexRelated,&PhysicalType);
if(PhysConn_Video_Composite==PhysicalType)
{
inPort = i;
break;
}
}
for( i =0;i<OutputPinCount;i++)
{
pXBar1->get_CrossbarPinInfo(FALSE,i,&PinIndexRelated,&PhysicalType);
if(PhysConn_Video_VideoDecoder==PhysicalType)
{
outPort = i;
break;
}
}
if(S_OK==pXBar1->CanRoute(outPort,inPort))
{
pXBar1->Route(outPort,inPort);
}
pXBar1->Release();
}
pBuilder->Release();
}
/*
The returned image can not be released.
*/
IplImage* CCameraDS::QueryFrame()
{
long evCode, size = 0;
m_pMediaControl->Run();
m_pMediaEvent->WaitForCompletion(INFINITE, &evCode);
m_pSampleGrabber->GetCurrentBuffer(&size, NULL);
//if the buffer size changed
if (size != m_nBufferSize)
{
if (m_pFrame)
{
cvReleaseImage(&m_pFrame);
}
m_nBufferSize = size;
m_pFrame = cvCreateImage(cvSize(m_nWidth, m_nHeight), IPL_DEPTH_8U, 3);
}
m_pSampleGrabber->GetCurrentBuffer(&m_nBufferSize, (long*)m_pFrame->imageData);
cvFlip(m_pFrame);
return m_pFrame;
}
int CCameraDS::CameraCount()
{
int count = 0;
CoInitialize(NULL);
// enumerate all video capture devices
CComPtr<ICreateDevEnum> pCreateDevEnum;
HRESULT hr = CoCreateInstance(CLSID_SystemDeviceEnum, NULL, CLSCTX_INPROC_SERVER, IID_ICreateDevEnum, (void**)&pCreateDevEnum);
CComPtr<IEnumMoniker> pEm;
hr = pCreateDevEnum->CreateClassEnumerator(CLSID_VideoInputDeviceCategory, &pEm, 0);
if (hr != NOERROR)
{
return count;
}
pEm->Reset();
ULONG cFetched;
IMoniker *pM;
while(hr = pEm->Next(1, &pM, &cFetched), hr==S_OK)
{
count++;
}
pCreateDevEnum = NULL;
pEm = NULL;
return count;
}
int CCameraDS::CameraName(int nCamID, char* sName, int nBufferSize)
{
int count = 0;
CoInitialize(NULL);
// enumerate all video capture devices
CComPtr<ICreateDevEnum> pCreateDevEnum;
HRESULT hr = CoCreateInstance(CLSID_SystemDeviceEnum, NULL, CLSCTX_INPROC_SERVER, IID_ICreateDevEnum, (void**)&pCreateDevEnum);
CComPtr<IEnumMoniker> pEm;
hr = pCreateDevEnum->CreateClassEnumerator(CLSID_VideoInputDeviceCategory, &pEm, 0);
if (hr != NOERROR) return 0;
pEm->Reset();
ULONG cFetched;
IMoniker *pM;
while(hr = pEm->Next(1, &pM, &cFetched), hr==S_OK)
{
if (count == nCamID)
{
IPropertyBag *pBag=0;
hr = pM->BindToStorage(0, 0, IID_IPropertyBag, (void **)&pBag);
if(SUCCEEDED(hr))
{
VARIANT var;
var.vt = VT_BSTR;
hr = pBag->Read(L"FriendlyName", &var, NULL); //还有其他属性,像描述信息等等...
if(hr == NOERROR)
{
//获取设备名称
WideCharToMultiByte(CP_ACP,0,var.bstrVal,-1,sName, nBufferSize ,"",NULL);
SysFreeString(var.bstrVal);
}
pBag->Release();
}
pM->Release();
break;
}
count++;
}
pCreateDevEnum = NULL;
pEm = NULL;
return 1;
}

复制代码

//////////////////////////////////////////////////////////////////////
// Video Capture using DirectShow
// Author: Shiqi Yu ([email protected])
// Thanks to:
// HardyAI@OpenCV China
// flymanbox@OpenCV China (for his contribution to function CameraName, and frame width/height setting)
// Last modification: April 9, 2009
//
// 使用说明：
// 1. 将CameraDS.h CameraDS.cpp以及目录DirectShow复制到你的项目中
// 2. 菜单 Project->Settings->Settings for:(All configurations)->C/C++->Category(Preprocessor)->Additional include directories
// 设置为 DirectShow/Include
// 3. 菜单 Project->Settings->Settings for:(All configurations)->Link->Category(Input)->Additional library directories
// 设置为 DirectShow/Lib
//////////////////////////////////////////////////////////////////////
#ifndef CCAMERA_H
#define CCAMERA_H
#define WIN32_LEAN_AND_MEAN
#include <atlbase.h>
#include "qedit.h"
#include "dshow.h"
#include <windows.h>
#include <cxcore.h>
#define MYFREEMEDIATYPE(mt) {if ((mt).cbFormat != 0) \
{CoTaskMemFree((PVOID)(mt).pbFormat); \
(mt).cbFormat = 0; \
(mt).pbFormat = NULL; \
} \
if ((mt).pUnk != NULL) \
{ \
(mt).pUnk->Release(); \
(mt).pUnk = NULL; \
}}
class CCameraDS
{
private:
bool m_bConnected, m_bLock, m_bChanged;
int m_nWidth, m_nHeight;
long m_nBufferSize;
IplImage *m_pFrame;
CComPtr<IGraphBuilder> m_pGraph;
CComPtr<ISampleGrabber> m_pSampleGrabber;
CComPtr<IMediaControl> m_pMediaControl;
CComPtr<IMediaEvent> m_pMediaEvent;
CComPtr<IBaseFilter> m_pSampleGrabberFilter;
CComPtr<IBaseFilter> m_pDeviceFilter;
CComPtr<IBaseFilter> m_pNullFilter;
CComPtr<IPin> m_pGrabberInput;
CComPtr<IPin> m_pGrabberOutput;
CComPtr<IPin> m_pCameraOutput;
CComPtr<IPin> m_pNullInputPin;
bool BindFilter(int nCamIDX, IBaseFilter **pFilter);
void SetCrossBar();
public:
CCameraDS();
virtual ~CCameraDS();
//打开摄像头，nCamID指定打开哪个摄像头，取值可以为0,1,2,...
//bDisplayProperties指示是否自动弹出摄像头属性页
//nWidth和nHeight设置的摄像头的宽和高，如果摄像头不支持所设定的宽度和高度，则返回false
bool OpenCamera(int nCamID, bool bDisplayProperties = true, int nWidth = 320, int nHeight = 240);
//关闭摄像头，析构函数会自动调用这个函数
void CloseCamera();
//返回摄像头的数目
//可以不用创建CCameraDS实例，采用int c=CCameraDS::CameraCount();得到结果。
static int CameraCount();
//根据摄像头的编号返回摄像头的名字
//nCamID: 摄像头编号
//sName: 用于存放摄像头名字的数组
//nBufferSize: sName的大小
//可以不用创建CCameraDS实例，采用CCameraDS::CameraName();得到结果。
static int CameraName(int nCamID, char* sName, int nBufferSize);
//返回图像宽度
int GetWidth(){return m_nWidth;}
//返回图像高度
int GetHeight(){return m_nHeight;}
//抓取一帧，返回的IplImage不可手动释放！
//返回图像数据的为RGB模式的Top-down(第一个字节为左上角像素)，即IplImage::origin=0(IPL_ORIGIN_TL)
IplImage * QueryFrame();
};
#endif

复制代码

帐号		自动登录	找回密码
密码			注册会员

[RMVX发布] RM视频播放器 [2011-4-20更新异步模式可以融合进 RM 画面]

烫烫烫

开拓者

[RMVX发布] RM视频播放器 [2011-4-20更新异步模式 可以融合进 RM 画面]

烫烫烫

开拓者

[RMVX发布] RM视频播放器 [2011-4-20更新异步模式可以融合进 RM 画面]