【分享】解决VPSS设计中没有media设备的问题
作者: 付汉杰 hankf@xilinx.com hankf@amd.com
使用hdmi-rx, vpss, frmbuf_write，设计了video输入的pipeline。使用PetaLinux基于XSA做了linux，编译成功，启动也成功。
但是后来查找视频设备，只有video设备，没有media设备。
root@dapd-0330-tpg-peta:~# ls /dev/vid*
/dev/video0 /dev/video1 /dev/video2 /dev/video3 /dev/video4 /dev/video5
root@dapd-0330-tpg-peta:~# ls /dev/medi*
ls: /dev/medi*: No such file or directory
检查启动日志，发现一些异常。比如of_reserved_mem_device_init返回值是负数，表示出错。
[ 3.949086] xlnx,scaler-bridge a4440000.v_proc_ss: xlnx drm scaler experimental driver probed
[ 3.957768] debugfs: File 'xlnx_bridge-v_proc_ss' in directory 'xlnx-bridge' already present!
[ 3.966288] xlnx,scaler-bridge a4480000.v_proc_ss: xlnx drm scaler experimental driver probed
[ 3.974966] debugfs: File 'xlnx_bridge-v_proc_ss' in directory 'xlnx-bridge' already present!
[ 3.983485] xlnx,scaler-bridge a44c0000.v_proc_ss: xlnx drm scaler experimental driver probed
[ 4.307936] xvip_dma_init:1613.
[ 4.311071] xvip_graph_dma_init_one:733.
[ 4.314988] xilinx-video amba_pl@0:vcap_v_proc_ss_12: parsing node ffff0501fdfe7f18
[ 4.314993] xilinx-video amba_pl@0:vcap_v_proc_ss_12: handling endpoint ffff0501fdfe85e0
[ 4.315002] xilinx-video amba_pl@0:vcap_v_proc_ss_12: parsing node ffff0501fdfda748
[ 4.315006] xilinx-video amba_pl@0:vcap_v_proc_ss_12: handling endpoint ffff0501fdfdb648
[ 4.315037] xilinx-video amba_pl@0:vcap_v_proc_ss_12: handling endpoint ffff0501fdfdbac8
[ 4.315046] xilinx-video amba_pl@0:vcap_v_proc_ss_12: parsing node ffff0501fdfe27b8
[ 4.315050] xilinx-video amba_pl@0:vcap_v_proc_ss_12: handling endpoint ffff0501fdfe31c8
[ 4.315057] xilinx-video amba_pl@0:vcap_v_proc_ss_12: xdev->atomic_streamon:0
[ 4.322188] xilinx-video amba_pl@0:vcap_v_proc_ss_12: of_reserved_mem_device_init: -19
[ 4.322192] xilinx-video amba_pl@0:vcap_v_proc_ss_12: device registered
[ 4.328940] xvip_graph_init:798.
[ 4.332163] xvip_graph_dma_init:756.
[ 4.335734] xvip_graph_dma_init:766.
[ 4.339303] xvip_graph_dma_init_one:720.
[ 4.343221] xvip_dma_init:1408.
[ 4.346354] xvip_dma_init:1416.
[ 4.349487] xvip_dma_init:1459.
[ 4.352617] xvip_dma_init:1485.
但是检查下面代码，驱动中虽然报错，但也继续初始化了。看样子，这部分代码不是必须的。
ret = of_reserved_mem_device_init(&pdev->dev);
if (ret) {
dev_dbg(&pdev->dev, "of_reserved_mem_device_init: %d\n", ret);
}
注意到打印中的DRM，意识到这是用于显示的驱动。仔细检查devicetree，PetaLinux自动生成的devicetree如下：
v_proc_ss_12: v_proc_ss@a4380000 {
clock-names = "aclk_axis", "aclk_ctrl";
clocks = <&misc_clk_2>, <&misc_clk_2>;
compatible = "xlnx,v-proc-ss-2.3", "xlnx,vpss-scaler-2.2", "xlnx,v-vpss-scaler-2.2", "xlnx,vpss-scaler";
}
检查Linux代码，发现有两个vpss的驱动。第一个驱动是V4L2的驱动drivers\media\platform\xilinx\xilinx-vpss-scaler.c，它的匹配字符串如下：
static const struct of_device_id xscaler_of_id_table[] = {
{
.compatible = "xlnx,v-vpss-scaler",
.data = &xlnx_scaler
},
{
.compatible = "xlnx,v-vpss-scaler-1.0",
.data = &xlnx_scaler_v1_0
},
{
.compatible = "xlnx,v-vpss-scaler-2.2",
.data = &xlnx_scaler_v2_2
},
{ /* end of table */ }
};
第一个驱动是DRM的驱动drivers\gpu\drm\xlnx\Xlnx_scaler.c，它的匹配字符串如下：
static const struct of_device_id xilinx_scaler_of_match[] = {
{ .compatible = "xlnx,vpss-scaler",
.data = &xlnx_scaler},
{ .compatible = "xlnx,vpss-scaler-2.2",
.data = &xlnx_scaler_v2_2},
{ }
};
PetaLinux自动生成的devicetree的第一个字符串是 "xlnx,v-proc-ss-2.3",都没有匹配。第二个字符串是"xlnx,vpss-scaler-2.2",匹配了DRM的驱动，所以加载了VPSS的DRM驱动。
目前需求是做V4L2的设备，把匹配字符串改为"xlnx,v-vpss-scaler-2.2"。重新编译后，再启动，media设备能够被成功创建。
带调试信息的log如下：
[ 2.880740] xilinx-video amba_pl@0:vcap_v_proc_ss_12: 0 ctrl = 0x98ca21
[ 2.880749] xvip_dma_init:1498.
[ 2.883912] xvip_dma_s_ctrl:1289.
[ 2.887249] xvip_dma_init:1512.
[ 2.890411] xvip_dma_init:1553.
[ 2.893574] xvip_dma_init:1583, dma_request_chan: port0.
[ 2.898928] dma_request_chan:854.
[ 2.902267] dma_request_chan:867.
[ 2.905604] xvip_dma_init:1587: dma_request_chan failed.
[ 2.910963] xilinx-video amba_pl@0:vcap_v_proc_ss_12: /amba_pl@0/vcap_v_proc_ss_12/ports/port@0 initialization failed
[ 2.921656] xvip_graph_dma_init:771 failed.
[ 2.925871] xilinx-video amba_pl@0:vcap_v_proc_ss_12: DMA initialization failed
[ 4.173879] xilinx-video amba_pl@0:vcap_v_proc_ss_12: media_gobj_create id 1: entity 'vcap_v_proc_ss_12 output 0'
[ 4.173883] xilinx-video amba_pl@0:vcap_v_proc_ss_12: media_gobj_create id 2: sink pad 'vcap_v_proc_ss_12 output 0':0
[ 4.173889] xilinx-video amba_pl@0:vcap_v_proc_ss_12: media_gobj_create id 3: intf_devnode v4l-video - major: 81, minor: 0
[ 4.173893] xilinx-video amba_pl@0:vcap_v_proc_ss_12: media_gobj_create id 4: interface link id 3 ==> id 1
[ 4.173896] xvip_dma_init:1613.
[ 4.177026] xvip_graph_dma_init_one:733.
[ 4.180944] xilinx-video amba_pl@0:vcap_v_proc_ss_12: parsing node ffff0501fdfe7f18
[ 4.180949] xilinx-video amba_pl@0:vcap_v_proc_ss_12: handling endpoint ffff0501fdfe85e0
[ 4.180958] xilinx-video amba_pl@0:vcap_v_proc_ss_12: parsing node ffff0501fdfda748
[ 4.180962] xilinx-video amba_pl@0:vcap_v_proc_ss_12: handling endpoint ffff0501fdfdb648
[ 4.180992] xilinx-video amba_pl@0:vcap_v_proc_ss_12: handling endpoint ffff0501fdfdbac8
[ 4.181002] xilinx-video amba_pl@0:vcap_v_proc_ss_12: parsing node ffff0501fdfe27b8
[ 4.181005] xilinx-video amba_pl@0:vcap_v_proc_ss_12: handling endpoint ffff0501fdfe31c8
[ 4.181012] xilinx-video amba_pl@0:vcap_v_proc_ss_12: xdev->atomic_streamon:0
[ 4.188141] xilinx-video amba_pl@0:vcap_v_proc_ss_12: of_reserved_mem_device_init: -19
[ 4.188145] xilinx-video amba_pl@0:vcap_v_proc_ss_12: device registered
[ 4.652349] xilinx-video amba_pl@0:vcap_v_proc_ss_12: Entity type for entity a4570000.v_tpg was not initialized!
[ 4.662530] xilinx-video amba_pl@0:vcap_v_proc_ss_12: media_gobj_create id 5: entity 'a4570000.v_tpg'
[ 4.662535] xilinx-video amba_pl@0:vcap_v_proc_ss_12: media_gobj_create id 6: sink pad 'a4570000.v_tpg':0
[ 4.662538] xilinx-video amba_pl@0:vcap_v_proc_ss_12: media_gobj_create id 7: source pad 'a4570000.v_tpg':1
[ 4.662543] xilinx-video amba_pl@0:vcap_v_proc_ss_12: subdev a4570000.v_tpg bound
[ 4.714757] xilinx-video amba_pl@0:vcap_v_proc_ss_12: Entity type for entity a4380000.v_proc_ss was not initialized!
[ 4.725276] xilinx-video amba_pl@0:vcap_v_proc_ss_12: media_gobj_create id 8: entity 'a4380000.v_proc_ss'
[ 4.725280] xilinx-video amba_pl@0:vcap_v_proc_ss_12: media_gobj_create id 9: sink pad 'a4380000.v_proc_ss':0
[ 4.725284] xilinx-video amba_pl@0:vcap_v_proc_ss_12: media_gobj_create id 10: source pad 'a4380000.v_proc_ss':1
[ 4.725287] xilinx-video amba_pl@0:vcap_v_proc_ss_12: subdev a4380000.v_proc_ss bound
[ 4.725291] xilinx-video amba_pl@0:vcap_v_proc_ss_12: notify complete, all subdevs registered
[ 4.725294] xilinx-video amba_pl@0:vcap_v_proc_ss_12: creating links for entity a4380000.v_proc_ss
[ 4.725299] xilinx-video amba_pl@0:vcap_v_proc_ss_12: processing endpoint ffff0501fdfdb648
[ 4.725308] xilinx-video amba_pl@0:vcap_v_proc_ss_12: skipping DMA port ffff0501fdfda748:1
[ 4.725312] xilinx-video amba_pl@0:vcap_v_proc_ss_12: processing endpoint ffff0501fdfdbac8
[ 4.725319] xilinx-video amba_pl@0:vcap_v_proc_ss_12: skipping sink port ffff0501fdfda748:0
[ 4.725322] xilinx-video amba_pl@0:vcap_v_proc_ss_12: creating links for entity a4570000.v_tpg
[ 4.725326] xilinx-video amba_pl@0:vcap_v_proc_ss_12: processing endpoint ffff0501fdfe31c8
[ 4.725333] xilinx-video amba_pl@0:vcap_v_proc_ss_12: creating a4570000.v_tpg:1 -> a4380000.v_proc_ss:0 link
[ 4.725337] xilinx-video amba_pl@0:vcap_v_proc_ss_12: media_gobj_create id 11: data link id 7 ==> id 9
[ 4.725341] xilinx-video amba_pl@0:vcap_v_proc_ss_12: media_gobj_create id 12: data link id 7 ==> id 9
[ 4.725345] xilinx-video amba_pl@0:vcap_v_proc_ss_12: creating links for DMA engines
[ 4.725354] xilinx-video amba_pl@0:vcap_v_proc_ss_12: processing endpoint /amba_pl@0/vcap_v_proc_ss_12/ports/port@0/endpoint
[ 4.725360] xilinx-video amba_pl@0:vcap_v_proc_ss_12: creating link for DMA engine vcap_v_proc_ss_12 output 0
[ 4.725364] xilinx-video amba_pl@0:vcap_v_proc_ss_12: creating a4380000.v_proc_ss:1 -> vcap_v_proc_ss_12 output 0:0 link
[ 4.725368] xilinx-video amba_pl@0:vcap_v_proc_ss_12: media_gobj_create id 13: data link id 10 ==> id 2
[ 4.725372] xilinx-video amba_pl@0:vcap_v_proc_ss_12: media_gobj_create id 14: data link id 10 ==> id 2
[ 4.725458] xilinx-video amba_pl@0:vcap_v_proc_ss_12: media_gobj_create id 15: intf_devnode v4l-subdev - major: 81, minor: 6
[ 4.725462] xilinx-video amba_pl@0:vcap_v_proc_ss_12: media_gobj_create id 16: interface link id 15 ==> id 5
[ 4.725511] xilinx-video amba_pl@0:vcap_v_proc_ss_12: media_gobj_create id 17: intf_devnode v4l-subdev - major: 81, minor: 7
[ 4.725515] xilinx-video amba_pl@0:vcap_v_proc_ss_12: media_gobj_create id 18: interface link id 17 ==> id 8
[ 4.725561] xilinx-vpss-scaler a4380000.v_proc_ss: Num Hori Taps 6
[ 4.731739] xilinx-vpss-scaler a4380000.v_proc_ss: Num Vert Taps 6
[ 4.737913] xilinx-vpss-scaler a4380000.v_proc_ss: VPSS Scaler Probe Successful
设备信息如下：
root@dapd-0330-tpg-peta:~# ls /dev/video*
/dev/video0 /dev/video1 /dev/video2 /dev/video3 /dev/video4 /dev/video5
root@dapd-0330-tpg-peta:~# ls /dev/med*
/dev/media0 /dev/media1 /dev/media2 /dev/media3 /dev/media4 /dev/media5