Virtual Simulator hung when executing inference test using prebuilt VP Simulator #28
Comments
|
I'm getting a similar issue running the Virtual Platform on local device: I am using the prebuilt Virtual Platform via the Docker container: http://nvdla.org/vp.html#running-the-virtual-simulator-from-docker I have copied the /sw folder to /usr/local/nvdla This is the output: ./nvdla_runtime --loadable sw/regression/flatbufs/kmd/NN/NN_L0_0_fbuf --imagesw/regression/images/digits/one.pgm Info: NV_NVDLA_cdma.cpp: 1265:NV_NVDLA_cdma::DirectConvDataResponseSequencerCommon, invalid configuration cdma_entries_, set value is 0x6, it shall be 0x7FF. ` |
|
Hi! Have you save it? creating new runtime context... |
|
@fisherxue @ccshi please share full steps you are following to check which driver and test was used for it. are you using docker image? |
|
@prasshantg , I, too, am facing the same problem. I used the out of the box drivers: The command I executed was
And, yes, I am using the docker image. Also, @sushilb270 and @ccshi, did you manage to resolve said issue? Do you have any updates? |
|
@killerzula I am also having the same problem. Cant get even a single loadable file to complete inference successfully. |
|
I have Resolve this issue . this issue is due to new release of vp image instead of using insmod opendla_2.ko please use this " insmod opendla_2.ko . below are complete steps to follow for Running inference on VP.
10)) ./nvdla_runtime --loadable ./sw/regression/flatbufs/kmd/NN/NN_L0_0_fbuf --imag |
|
did anyone solve this issue? |
Hi,
I am learning to use fabulous NVDLA architecture.
I am using AWS FPGA AMI to execute the basic tests.
I am using the prebuilt Virtual Simulator on NVIDIA AMI as per http://nvdla.org/vp_fpga.html#using-the-virtual-simulator-on-nvidia-ami
I am trying to run inference test using the following command:
$ ./nvdla_runtime --loadable kmd/NN/NN_L0_0_fbuf --image /mnt/sw/regression/images/digits/one.pgm
The Virtual Simulator seems to work fine but it get hung i.e. does not return to # prompt of the simulator. Also the run does not generate output.dimg
Please let me know, if any steps are missing or I need to recompile the SW.
The detailed steps followed are as follows:
AWS FPGA AMI used has prebuilt NVDLA repository.
Ubuntu 14.04.5 LTS (GNU/Linux 3.13.0-143-generic x86_64)
Following steps are performed:
$ cd /home/ubuntu/nvdla
$ source /usr/local/nvdla/aws-fpga/sdk_setup.sh
$ ./setup_aws.sh
$ ./setup_fpga.sh
I am using NVIDIA Sample AFI, as I want to run inference test on AWS FPGA platform.
$ cd /usr/local/nvdla
$ sudo ./aarch64_toplevel -c aarch64_nvdla.lua --fpga
Login the kernel with account 'root' and password 'nvdla'
$ mount -t 9p -o trans=virtio r /mnt
$ cd /mnt/sw/prebuilt/linux/
$ insmod drm.ko
$ insmod opendla_small.ko
Now run the inference test:
$ ./nvdla_runtime --loadable kmd/NN/NN_L0_0_fbuf --image /mnt/sw/regression/imag
es/digits/one.pgm
creating new runtime context...
Emulator starting
ppgminfo 1 28 28
pgm2dimg 1 28 28 1 32 896 896
submitting tasks...
Work Found!
Work Done
[ 286.175452] Enter:dla_read_network_config
[ 286.177945] Exit:dla_read_network_config status=0
[ 286.178284] Enter: dla_initiate_processors
[ 286.179167] Enter: dla_submit_operation
[ 286.179426] Prepare Convolution operation index 0 ROI 0 dep_count 1
[ 286.179777] Enter: dla_prepare_operation
[ 286.180182] processor:Convolution group:0, rdma_group:0 available
[ 286.180585] Enter: dla_read_config
[ 286.191015] Exit: dla_read_config
[ 286.191313] Exit: dla_prepare_operation status=0
[ 286.191631] Enter: dla_program_operation
[ 286.191886] Program Convolution operation index 0 ROI 0 Group[0]
[ 286.197917] no desc get due to index==-1
[ 286.198930] no desc get due to index==-1
[ 286.199171] no desc get due to index==-1
[ 286.199400] no desc get due to index==-1
[ 286.199643] no desc get due to index==-1
[ 286.199896] Enter: dla_op_programmed
[ 286.200226] Update dependency operation index 3 ROI 0 DEP_COUNT=3
[ 286.200589] Update dependency operation index 1 ROI 0 DEP_COUNT=1
[ 286.202398] enable SDP in dla_update_dependency as depdency are resolved
[ 286.202833] Enter: dla_enable_operation
[ 286.203098] exit dla_enable_operation without actual enable due to processor hasn't been programmed
[ 286.203600] Exit: dla_enable_operation status=0
[ 286.203920] Exit: dla_op_programmed
[ 286.204153] Exit: dla_program_operation status=0
[ 286.204453] Exit: dla_submit_operation
[ 286.206215] Enter: dla_dequeue_operation
[ 286.206544] Dequeue op from Convolution processor, index=3 ROI=0
[ 286.206946] Enter: dla_submit_operation
[ 286.207188] Prepare Convolution operation index 3 ROI 0 dep_count 2
[ 286.207535] Enter: dla_prepare_operation
[ 286.207858] processor:Convolution group:1, rdma_group:0 available
[ 286.208213] Enter: dla_read_config
[ 286.218391] Exit: dla_read_config
[ 286.218660] Exit: dla_prepare_operation status=0
[ 286.218935] Enter: dla_program_operation
[ 286.219198] Program Convolution operation index 3 ROI 0 Group[1]
[ 286.222859] no desc get due to index==-1
[ 286.225318] no desc get due to index==-1
[ 286.225610] no desc get due to index==-1
[ 286.225848] no desc get due to index==-1
[ 286.226120] no desc get due to index==-1
[ 286.226386] Enter: dla_op_programmed
[ 286.226640] Update dependency operation index 6 ROI 0 DEP_COUNT=3
[ 286.227028] Update dependency operation index 4 ROI 0 DEP_COUNT=2
[ 286.227411] Exit: dla_op_programmed
[ 286.227647] Exit: dla_program_operation status=0
[ 286.227953] Exit: dla_submit_operation
[ 286.228237] Exit: dla_dequeue_operation
[ 286.228526] Enter: dla_submit_operation
[ 286.231000] Prepare SDP operation index 1 ROI 0 dep_count 0
[ 286.231355] Enter: dla_prepare_operation
[ 286.231725] processor:SDP group:0, rdma_group:0 available
[ 286.232037] Enter: dla_read_config
[ 286.241702] Exit: dla_read_config
[ 286.242057] Exit: dla_prepare_operation status=0
[ 286.242367] Enter: dla_program_operation
[ 286.242615] Program SDP operation index 1 ROI 0 Group[0]
[ 286.246296] no desc get due to index==-1
[ 286.246583] no desc get due to index==-1
[ 286.247224] no desc get due to index==-1
[ 286.247468] no desc get due to index==-1
[ 286.247727] Enter: dla_op_programmed
[ 286.247957] Update dependency operation index 4 ROI 0 DEP_COUNT=1
[ 286.248295] enable SDP in dla_update_dependency as depdency are resolved
[ 286.250030] Enter: dla_enable_operation
[ 286.250332] exit dla_enable_operation without actual enable due to processor hasn't been programmed
[ 286.250835] Exit: dla_enable_operation status=0
[ 286.251101] Exit: dla_op_programmed
[ 286.251321] Exit: dla_program_operation status=0
[ 286.251600] Enter: dla_enable_operation
[ 286.251880] Enable SDP operation index 1 ROI 0
[ 286.252405] Enter: dla_op_enabled
[ 286.252652] Update dependency operation index 0 ROI 0 DEP_COUNT=1
[ 286.254637] enable Convolution in dla_update_dependency as depdency are resolved
[ 286.255053] Enter: dla_enable_operation
[ 286.255291] Enable Convolution operation index 0 ROI 0
[ 286.256139] Enter: dla_op_enabled
[ 286.256369] Exit: dla_op_enabled
[ 286.256585] Exit: dla_enable_operation status=0
[ 286.258190] Exit: dla_op_enabled
[ 286.258443] Exit: dla_enable_operation status=0
[ 286.258730] Exit: dla_submit_operation
[ 286.258970] Enter: dla_dequeue_operation
[ 286.259213] Dequeue op from SDP processor, index=4 ROI=0
[ 286.259530] Enter: dla_submit_operation
[ 286.259786] Prepare SDP operation index 4 ROI 0 dep_count 0
[ 286.260122] Enter: dla_prepare_operation
[ 286.262535] processor:SDP group:1, rdma_group:1 available
[ 286.262890] Enter: dla_read_config
[ 286.271270] Exit: dla_read_config
[ 286.272520] Exit: dla_prepare_operation status=0
[ 286.273591] Enter: dla_program_operation
[ 286.273894] Program SDP operation index 4 ROI 0 Group[1]
[ 286.275691] no desc get due to index==-1
[ 286.275933] no desc get due to index==-1
[ 286.276962] no desc get due to index==-1
[ 286.278397] no desc get due to index==-1
[ 286.278695] Enter: dla_op_programmed
[ 286.278931] Update dependency operation index 7 ROI 0 DEP_COUNT=2
[ 286.279277] Exit: dla_op_programmed
[ 286.279507] Exit: dla_program_operation status=0
[ 286.279788] Enter: dla_enable_operation
[ 286.280071] Enable SDP operation index 4 ROI 0
[ 286.280524] Enter: dla_op_enabled
[ 286.282219] Update dependency operation index 3 ROI 0 DEP_COUNT=2
[ 286.282598] Exit: dla_op_enabled
[ 286.282808] Exit: dla_enable_operation status=0
[ 286.283080] Exit: dla_submit_operation
[ 286.283311] Exit: dla_dequeue_operation
[ 286.283547] Enter: dla_submit_operation
[ 286.283790] Prepare PDP operation index 2 ROI 0 dep_count 1
[ 286.284104] Enter: dla_prepare_operation
[ 286.284460] processor:PDP group:0, rdma_group:0 available
[ 286.286352] Enter: dla_read_config
At this point, the VP simulator hung.
Please let me know, if any steps are missing or I need to recompile the SW.
Regards,
-Sushil Behere
The text was updated successfully, but these errors were encountered: