RM视频播放器 [2011-4-20更新异步模式可以融合进 RM 画面]

一箭烂YiJL · 发表于 2011-4-21 22:58:26

回复蕾米莉亚·斯卡雷特的帖子

这样?Thread.new{loop{影片.update;sleep(1/Graphics.frame_rate)}}

于是有关详细Ruby的线程(Thread)的操作送上：
http://www.kuqin.com/rubycndocum ... _object_thread.html

实际上我还真没试过这个RM播放器呢~
还有就是Flash不是必须安装FlashPlayer的吗?

蕾米莉亚·斯卡雷特 · 发表于 2011-4-21 23:13:52

回复一箭烂YiJL 的帖子

不是必须的, 安装了 FlashXX.ocx 的 ActiveX 控件就可以了~~

killkill2298 · 发表于 2011-4-22 00:21:39

全屏播放AVI闪屏，播放范例的却正常，不知道是何原因

爱丽丝·玛格特罗依德 · 发表于 2011-4-22 11:25:54

回复 killkill2298 的帖子

目前脚本是使用自动链接到合适的解码链的, 但是自动的代价就是不是最优的.

而且 AVI 的编码很多. 所以请查看一下您所使用的 AVI视频的编码格式, 方便的话请告诉我(最好是有这个格式的视频文件给我), 我帮你找一下合适的解码库~~

killkill2298 · 发表于 2011-4-22 15:15:34

本帖最后由 killkill2298 于 2011-4-22 15:22 编辑

在WMP中查看信息：

视频长度 03:53
比特率 - （估计无法识别）
音频解码器：- （我这视频本来就没声音）
视频解码器： MPEG Video Decoder

是在这里看么？

yangff · 发表于 2011-4-22 17:43:20

蕾米莉亚·斯卡雷特发表于 2011-4-21 23:13
回复一箭烂YiJL 的帖子

不是必须的, 安装了 FlashXX.ocx 的 ActiveX 控件就可以了~~ ...

话说视屏是怎么显示的？DD？解码器返回的是什么？是Bitmap矩阵么？如果是的话可以考虑用61的那个获取Bitmap内存地址的方法把视屏嵌到Bitmap里面，这样就不会挡住别的东西了……
解码什么的不是很熟&……

蕾米莉亚·斯卡雷特 · 发表于 2011-4-22 20:23:06

回复 yangff 的帖子

核心是 DirectShow ，解码链返回的是 IPin 接口。显示啥的，是框架问题。不是 Bitmap 就是了。

yangff · 发表于 2011-4-22 20:38:58

本帖最后由 yangff 于 2011-4-22 20:40 编辑

蕾米莉亚·斯卡雷特发表于 2011-4-22 20:23
回复 yangff 的帖子

核心是 DirectShow ，解码链返回的是 IPin 接口。显示啥的，是框架问题。不是 Bi ...

DS 貌似可以导出Bitmap矩阵的
GetCurrentBuffer(size,buff)
一段有关的代码……欢迎蛋疼……表示没装Dx/Platform SDK= =
能成的话就用Mp4做真战斗背景神马的了-= = |||

//////////////////////////////////////////////////////////////////////
// Video Capture using DirectShow
// Author: Shiqi Yu ([email protected])
// Thanks to:
// HardyAI@OpenCV China
// flymanbox@OpenCV China (for his contribution to function CameraName, and frame width/height setting)
// Last modification: April 9, 2009
//////////////////////////////////////////////////////////////////////
//////////////////////////////////////////////////////////////////////
// 使用说明：
// 1. 将CameraDS.h CameraDS.cpp以及目录DirectShow复制到你的项目中
// 2. 菜单 Project->Settings->Settings for:(All configurations)->C/C++->Category(Preprocessor)->Additional include directories
// 设置为 DirectShow/Include
// 3. 菜单 Project->Settings->Settings for:(All configurations)->Link->Category(Input)->Additional library directories
// 设置为 DirectShow/Lib
//////////////////////////////////////////////////////////////////////
// CameraDS.cpp: implementation of the CCameraDS class.
//
//////////////////////////////////////////////////////////////////////
#include "CameraDS.h"
#pragma comment(lib,"Strmiids.lib")
//////////////////////////////////////////////////////////////////////
// Construction/Destruction
//////////////////////////////////////////////////////////////////////
CCameraDS::CCameraDS()
{
m_bConnected = m_bLock = m_bChanged = false;
m_nWidth = m_nHeight = 0;
m_nBufferSize = 0;
m_pFrame = NULL;
m_pNullFilter = NULL;
m_pMediaEvent = NULL;
m_pSampleGrabberFilter = NULL;
m_pGraph = NULL;
CoInitialize(NULL);
}
CCameraDS::~CCameraDS()
{
CloseCamera();
CoUninitialize();
}
void CCameraDS::CloseCamera()
{
if(m_bConnected)
{
m_pMediaControl->Stop();
}
m_pGraph = NULL;
m_pDeviceFilter = NULL;
m_pMediaControl = NULL;
m_pSampleGrabberFilter = NULL;
m_pSampleGrabber = NULL;
m_pGrabberInput = NULL;
m_pGrabberOutput = NULL;
m_pCameraOutput = NULL;
m_pMediaEvent = NULL;
m_pNullFilter = NULL;
m_pNullInputPin = NULL;
if (m_pFrame)
{
cvReleaseImage(&m_pFrame);
}
m_bConnected = m_bLock = m_bChanged = false;
m_nWidth = m_nHeight = 0;
m_nBufferSize = 0;
}
bool CCameraDS::OpenCamera(int nCamID, bool bDisplayProperties, int nWidth, int nHeight)
{
HRESULT hr = S_OK;
CoInitialize(NULL);
// Create the Filter Graph Manager.
hr = CoCreateInstance(CLSID_FilterGraph, NULL, CLSCTX_INPROC, IID_IGraphBuilder, (void **)&m_pGraph);
hr = CoCreateInstance(CLSID_SampleGrabber, NULL, CLSCTX_INPROC_SERVER, IID_IBaseFilter, (LPVOID *)&m_pSampleGrabberFilter);
hr = m_pGraph->QueryInterface(IID_IMediaControl, (void **) &m_pMediaControl);
hr = m_pGraph->QueryInterface(IID_IMediaEvent, (void **) &m_pMediaEvent);
hr = CoCreateInstance(CLSID_NullRenderer, NULL, CLSCTX_INPROC_SERVER, IID_IBaseFilter, (LPVOID*) &m_pNullFilter);
hr = m_pGraph->AddFilter(m_pNullFilter, L"NullRenderer");
hr = m_pSampleGrabberFilter->QueryInterface(IID_ISampleGrabber, (void**)&m_pSampleGrabber);
AM_MEDIA_TYPE mt;
ZeroMemory(&mt, sizeof(AM_MEDIA_TYPE));
mt.majortype = MEDIATYPE_Video;
mt.subtype = MEDIASUBTYPE_RGB24;
mt.formattype = FORMAT_VideoInfo;
hr = m_pSampleGrabber->SetMediaType(&mt);
MYFREEMEDIATYPE(mt);
m_pGraph->AddFilter(m_pSampleGrabberFilter, L"Grabber");
// Bind Device Filter. We know the device because the id was passed in
BindFilter(nCamID, &m_pDeviceFilter);
m_pGraph->AddFilter(m_pDeviceFilter, NULL);
CComPtr<IEnumPins> pEnum;
m_pDeviceFilter->EnumPins(&pEnum);
hr = pEnum->Reset();
hr = pEnum->Next(1, &m_pCameraOutput, NULL);
pEnum = NULL;
m_pSampleGrabberFilter->EnumPins(&pEnum);
pEnum->Reset();
hr = pEnum->Next(1, &m_pGrabberInput, NULL);
pEnum = NULL;
m_pSampleGrabberFilter->EnumPins(&pEnum);
pEnum->Reset();
pEnum->Skip(1);
hr = pEnum->Next(1, &m_pGrabberOutput, NULL);
pEnum = NULL;
m_pNullFilter->EnumPins(&pEnum);
pEnum->Reset();
hr = pEnum->Next(1, &m_pNullInputPin, NULL);
//SetCrossBar();
if (bDisplayProperties)
{
CComPtr<ISpecifyPropertyPages> pPages;
HRESULT hr = m_pCameraOutput->QueryInterface(IID_ISpecifyPropertyPages, (void**)&pPages);
if (SUCCEEDED(hr))
{
PIN_INFO PinInfo;
m_pCameraOutput->QueryPinInfo(&PinInfo);
CAUUID caGUID;
pPages->GetPages(&caGUID);
OleCreatePropertyFrame(NULL, 0, 0,
L"Property Sheet", 1,
(IUnknown **)&(m_pCameraOutput.p),
caGUID.cElems, caGUID.pElems,
0, 0, NULL);
CoTaskMemFree(caGUID.pElems);
PinInfo.pFilter->Release();
}
pPages = NULL;
}
else
{
//////////////////////////////////////////////////////////////////////////////
// 加入由 lWidth和lHeight设置的摄像头的宽和高的功能，默认320*240
// by flymanbox @2009-01-24
//////////////////////////////////////////////////////////////////////////////
IAMStreamConfig *iconfig = NULL;
hr = m_pCameraOutput->QueryInterface(IID_IAMStreamConfig, (void**)&iconfig);
AM_MEDIA_TYPE *pmt;
if(iconfig->GetFormat(&pmt) !=S_OK)
{
//printf("GetFormat Failed ! \n");
return false;
}
// 3、考虑如果此时的的图像大小正好是 nWidth * nHeight，则就不用修改了。
if ((pmt->lSampleSize != (nWidth * nHeight * 3)) && (pmt->formattype == FORMAT_VideoInfo))
{
VIDEOINFOHEADER *phead = (VIDEOINFOHEADER*)(pmt->pbFormat);
phead->bmiHeader.biWidth = nWidth;
phead->bmiHeader.biHeight = nHeight;
if((hr = iconfig->SetFormat(pmt)) != S_OK)
{
return false;
}
}
iconfig->Release();
iconfig=NULL;
MYFREEMEDIATYPE(*pmt);
}
hr = m_pGraph->Connect(m_pCameraOutput, m_pGrabberInput);
hr = m_pGraph->Connect(m_pGrabberOutput, m_pNullInputPin);
if (FAILED(hr))
{
switch(hr)
{
case VFW_S_NOPREVIEWPIN :
break;
case E_FAIL :
break;
case E_INVALIDARG :
break;
case E_POINTER :
break;
}
}
m_pSampleGrabber->SetBufferSamples(TRUE);
m_pSampleGrabber->SetOneShot(TRUE);
hr = m_pSampleGrabber->GetConnectedMediaType(&mt);
if(FAILED(hr))
{
return false;
}
VIDEOINFOHEADER *videoHeader;
videoHeader = reinterpret_cast<VIDEOINFOHEADER*>(mt.pbFormat);
m_nWidth = videoHeader->bmiHeader.biWidth;
m_nHeight = videoHeader->bmiHeader.biHeight;
m_bConnected = true;
pEnum = NULL;
return true;
}
bool CCameraDS::BindFilter(int nCamID, IBaseFilter **pFilter)
{
if (nCamID < 0)
{
return false;
}
// enumerate all video capture devices
CComPtr<ICreateDevEnum> pCreateDevEnum;
HRESULT hr = CoCreateInstance(CLSID_SystemDeviceEnum, NULL, CLSCTX_INPROC_SERVER, IID_ICreateDevEnum, (void**)&pCreateDevEnum);
if (hr != NOERROR)
{
return false;
}
CComPtr<IEnumMoniker> pEm;
hr = pCreateDevEnum->CreateClassEnumerator(CLSID_VideoInputDeviceCategory, &pEm, 0);
if (hr != NOERROR)
{
return false;
}
pEm->Reset();
ULONG cFetched;
IMoniker *pM;
int index = 0;
while(hr = pEm->Next(1, &pM, &cFetched), hr==S_OK, index <= nCamID)
{
IPropertyBag *pBag;
hr = pM->BindToStorage(0, 0, IID_IPropertyBag, (void **)&pBag);
if(SUCCEEDED(hr))
{
VARIANT var;
var.vt = VT_BSTR;
hr = pBag->Read(L"FriendlyName", &var, NULL);
if (hr == NOERROR)
{
if (index == nCamID)
{
pM->BindToObject(0, 0, IID_IBaseFilter, (void**)pFilter);
}
SysFreeString(var.bstrVal);
}
pBag->Release();
}
pM->Release();
index++;
}
pCreateDevEnum = NULL;
return true;
}
//将输入crossbar变成PhysConn_Video_Composite
void CCameraDS::SetCrossBar()
{
int i;
IAMCrossbar *pXBar1 = NULL;
ICaptureGraphBuilder2 *pBuilder = NULL;
HRESULT hr = CoCreateInstance(CLSID_CaptureGraphBuilder2, NULL, CLSCTX_INPROC_SERVER, IID_ICaptureGraphBuilder2, (void **)&pBuilder);
if (SUCCEEDED(hr))
{
hr = pBuilder->SetFiltergraph(m_pGraph);
}
hr = pBuilder->FindInterface(&LOOK_UPSTREAM_ONLY, NULL, m_pDeviceFilter,IID_IAMCrossbar, (void**)&pXBar1);
if (SUCCEEDED(hr))
{
long OutputPinCount, InputPinCount;
long PinIndexRelated, PhysicalType;
long inPort = 0, outPort = 0;
pXBar1->get_PinCounts(&OutputPinCount, &InputPinCount);
for( i =0;i<InputPinCount;i++)
{
pXBar1->get_CrossbarPinInfo(TRUE,i,&PinIndexRelated,&PhysicalType);
if(PhysConn_Video_Composite==PhysicalType)
{
inPort = i;
break;
}
}
for( i =0;i<OutputPinCount;i++)
{
pXBar1->get_CrossbarPinInfo(FALSE,i,&PinIndexRelated,&PhysicalType);
if(PhysConn_Video_VideoDecoder==PhysicalType)
{
outPort = i;
break;
}
}
if(S_OK==pXBar1->CanRoute(outPort,inPort))
{
pXBar1->Route(outPort,inPort);
}
pXBar1->Release();
}
pBuilder->Release();
}
/*
The returned image can not be released.
*/
IplImage* CCameraDS::QueryFrame()
{
long evCode, size = 0;
m_pMediaControl->Run();
m_pMediaEvent->WaitForCompletion(INFINITE, &evCode);
m_pSampleGrabber->GetCurrentBuffer(&size, NULL);
//if the buffer size changed
if (size != m_nBufferSize)
{
if (m_pFrame)
{
cvReleaseImage(&m_pFrame);
}
m_nBufferSize = size;
m_pFrame = cvCreateImage(cvSize(m_nWidth, m_nHeight), IPL_DEPTH_8U, 3);
}
m_pSampleGrabber->GetCurrentBuffer(&m_nBufferSize, (long*)m_pFrame->imageData);
cvFlip(m_pFrame);
return m_pFrame;
}
int CCameraDS::CameraCount()
{
int count = 0;
CoInitialize(NULL);
// enumerate all video capture devices
CComPtr<ICreateDevEnum> pCreateDevEnum;
HRESULT hr = CoCreateInstance(CLSID_SystemDeviceEnum, NULL, CLSCTX_INPROC_SERVER, IID_ICreateDevEnum, (void**)&pCreateDevEnum);
CComPtr<IEnumMoniker> pEm;
hr = pCreateDevEnum->CreateClassEnumerator(CLSID_VideoInputDeviceCategory, &pEm, 0);
if (hr != NOERROR)
{
return count;
}
pEm->Reset();
ULONG cFetched;
IMoniker *pM;
while(hr = pEm->Next(1, &pM, &cFetched), hr==S_OK)
{
count++;
}
pCreateDevEnum = NULL;
pEm = NULL;
return count;
}
int CCameraDS::CameraName(int nCamID, char* sName, int nBufferSize)
{
int count = 0;
CoInitialize(NULL);
// enumerate all video capture devices
CComPtr<ICreateDevEnum> pCreateDevEnum;
HRESULT hr = CoCreateInstance(CLSID_SystemDeviceEnum, NULL, CLSCTX_INPROC_SERVER, IID_ICreateDevEnum, (void**)&pCreateDevEnum);
CComPtr<IEnumMoniker> pEm;
hr = pCreateDevEnum->CreateClassEnumerator(CLSID_VideoInputDeviceCategory, &pEm, 0);
if (hr != NOERROR) return 0;
pEm->Reset();
ULONG cFetched;
IMoniker *pM;
while(hr = pEm->Next(1, &pM, &cFetched), hr==S_OK)
{
if (count == nCamID)
{
IPropertyBag *pBag=0;
hr = pM->BindToStorage(0, 0, IID_IPropertyBag, (void **)&pBag);
if(SUCCEEDED(hr))
{
VARIANT var;
var.vt = VT_BSTR;
hr = pBag->Read(L"FriendlyName", &var, NULL); //还有其他属性,像描述信息等等...
if(hr == NOERROR)
{
//获取设备名称
WideCharToMultiByte(CP_ACP,0,var.bstrVal,-1,sName, nBufferSize ,"",NULL);
SysFreeString(var.bstrVal);
}
pBag->Release();
}
pM->Release();
break;
}
count++;
}
pCreateDevEnum = NULL;
pEm = NULL;
return 1;
}

复制代码

//////////////////////////////////////////////////////////////////////
// Video Capture using DirectShow
// Author: Shiqi Yu ([email protected])
// Thanks to:
// HardyAI@OpenCV China
// flymanbox@OpenCV China (for his contribution to function CameraName, and frame width/height setting)
// Last modification: April 9, 2009
//
// 使用说明：
// 1. 将CameraDS.h CameraDS.cpp以及目录DirectShow复制到你的项目中
// 2. 菜单 Project->Settings->Settings for:(All configurations)->C/C++->Category(Preprocessor)->Additional include directories
// 设置为 DirectShow/Include
// 3. 菜单 Project->Settings->Settings for:(All configurations)->Link->Category(Input)->Additional library directories
// 设置为 DirectShow/Lib
//////////////////////////////////////////////////////////////////////
#ifndef CCAMERA_H
#define CCAMERA_H
#define WIN32_LEAN_AND_MEAN
#include <atlbase.h>
#include "qedit.h"
#include "dshow.h"
#include <windows.h>
#include <cxcore.h>
#define MYFREEMEDIATYPE(mt) {if ((mt).cbFormat != 0) \
{CoTaskMemFree((PVOID)(mt).pbFormat); \
(mt).cbFormat = 0; \
(mt).pbFormat = NULL; \
} \
if ((mt).pUnk != NULL) \
{ \
(mt).pUnk->Release(); \
(mt).pUnk = NULL; \
}}
class CCameraDS
{
private:
bool m_bConnected, m_bLock, m_bChanged;
int m_nWidth, m_nHeight;
long m_nBufferSize;
IplImage *m_pFrame;
CComPtr<IGraphBuilder> m_pGraph;
CComPtr<ISampleGrabber> m_pSampleGrabber;
CComPtr<IMediaControl> m_pMediaControl;
CComPtr<IMediaEvent> m_pMediaEvent;
CComPtr<IBaseFilter> m_pSampleGrabberFilter;
CComPtr<IBaseFilter> m_pDeviceFilter;
CComPtr<IBaseFilter> m_pNullFilter;
CComPtr<IPin> m_pGrabberInput;
CComPtr<IPin> m_pGrabberOutput;
CComPtr<IPin> m_pCameraOutput;
CComPtr<IPin> m_pNullInputPin;
bool BindFilter(int nCamIDX, IBaseFilter **pFilter);
void SetCrossBar();
public:
CCameraDS();
virtual ~CCameraDS();
//打开摄像头，nCamID指定打开哪个摄像头，取值可以为0,1,2,...
//bDisplayProperties指示是否自动弹出摄像头属性页
//nWidth和nHeight设置的摄像头的宽和高，如果摄像头不支持所设定的宽度和高度，则返回false
bool OpenCamera(int nCamID, bool bDisplayProperties = true, int nWidth = 320, int nHeight = 240);
//关闭摄像头，析构函数会自动调用这个函数
void CloseCamera();
//返回摄像头的数目
//可以不用创建CCameraDS实例，采用int c=CCameraDS::CameraCount();得到结果。
static int CameraCount();
//根据摄像头的编号返回摄像头的名字
//nCamID: 摄像头编号
//sName: 用于存放摄像头名字的数组
//nBufferSize: sName的大小
//可以不用创建CCameraDS实例，采用CCameraDS::CameraName();得到结果。
static int CameraName(int nCamID, char* sName, int nBufferSize);
//返回图像宽度
int GetWidth(){return m_nWidth;}
//返回图像高度
int GetHeight(){return m_nHeight;}
//抓取一帧，返回的IplImage不可手动释放！
//返回图像数据的为RGB模式的Top-down(第一个字节为左上角像素)，即IplImage::origin=0(IPL_ORIGIN_TL)
IplImage * QueryFrame();
};
#endif

复制代码

蕾米莉亚·斯卡雷特 · 发表于 2011-4-22 20:48:14

回复 yangff 的帖子

GetCurrentBuffer

截图什么的功能打算在 3.1 3.2 的时候添加。不过每帧都截图是不是太那个啊。而且要想真的和 Rm 合体什么的，有点难度。

不过目前最大的问题还是解码链路还是自动连接，对系统的要求比较大就是了。手动连接就好多了。不过要求很高。

对于返回的那个内存图片的内存结构会不会还没研究过。（大概是一样的）

yangff · 发表于 2011-4-22 21:20:11

本帖最后由 yangff 于 2011-4-22 21:22 编辑

蕾米莉亚·斯卡雷特发表于 2011-4-22 20:48
回复 yangff 的帖子

GetCurrentBuffer

这种方法的FPS在30左右时无压力的……不知道60会不会……大不了跳帧= =反正有几个视屏的FPS到60了= =
但是据说CPU各种吃没试过= =这个导的是摄像头的

这段代码本来是用来把DS的那一坨转成Ocv的那一坨……
显然这种玩意返回的东西可以在RM里面直接用
Rm的Bitmap是BGRA的Top-down=int
这个返回的是BGR模式的Top-down
到时候怎么位移一下就好了= =

帐号		自动登录	找回密码
密码			注册会员

[RMVX发布] RM视频播放器 [2011-4-20更新异步模式可以融合进 RM 画面]

点评

点评

点评

烫烫烫

开拓者

[RMVX发布] RM视频播放器 [2011-4-20更新异步模式 可以融合进 RM 画面]

点评

点评

点评

烫烫烫

开拓者

[RMVX发布] RM视频播放器 [2011-4-20更新异步模式可以融合进 RM 画面]