failed to install ubuntu_docker.img

[xjzzzxx]

My environment:

0.VMware® Workstation 16 Pro
1.Ubuntu 18.04 Linux ubuntu 5.10.75-051075-generic
2.kvm-nyx-5.10.73-1.2
3.QEMU-Nyx-4.2.0

My steps:

1. booted into the Nyx-enabled kernel， following the command

sudo modprobe -r kvm-intel
sudo modprobe -r kvm
sudo modprobe  kvm enable_vmware_backdoor=y
sudo modprobe  kvm-intel
cat /sys/module/kvm/parameters/enable_vmware_backdoor
sudo chmod 777 /dev/kvm 

2. use the packer

./packer/qemu_tool.sh create_image ubuntu_docker.img 15000

3. error

when i exec the command ./packer/qemu_tool.sh install ubuntu_docker.img ubuntu-18.04.4-server-amd64.iso

I got

20:35:31 › ./ packer/qemu_tool.sh install ubuntu_docker.img ubuntu-18.04.4-server-amd64.iso
INSTALL
[QEMU-NYX] Warning: Nyx block COW layer disabled for ubuntu_docker.img (write operations are not cached!)
[QEMU-NYX] Warning: Nyx block COW layer disabled for ubuntu-18.04.4-server-amd64.iso (write operations are not cached!)
[QEMU-Nyx] Could not access KVM-PT kernel module!
[QEMU-Nyx] Trying vanilla KVM...
[QEMU-Nyx] NYX runs in fallback mode (no Intel-PT tracing or nested hypercall support)!
[QEMU-Nyx] Error: NYX requires support for KVM_CAP_DIRTY_LOG_RING in fallback mode!
qemu-system-x86_64: /home/vul/QEMU-Nyx/accel/kvm/kvm-all.c:2238: kvm_init: Assertion `ret < 0' failed

kernel log

20:35:42 › sudo dmesg | grep kvm                                                          
[   69.996384] kvm: loading out-of-tree module taints kernel.
[   69.996916] kvm: module verification failed: signature and/or required key missing - tainting kernel
[   77.554528]  vmx_pt_destroy+0x17/0x80 [kvm_intel]
[   77.554530]  vmx_free_vcpu+0x52/0xa0 [kvm_intel]
[   77.554547]  kvm_arch_vcpu_destroy+0x4a/0x130 [kvm]
[   77.554554]  kvm_vcpu_destroy+0x13/0x50 [kvm]
[   77.554563]  kvm_arch_destroy_vm+0x10a/0x210 [kvm]
[   77.554570]  kvm_destroy_vm+0x190/0x280 [kvm]
[   77.554577]  kvm_put_kvm+0x26/0x40 [kvm]
[   77.554594]  kvm_vm_release+0x22/0x30 [kvm]

This seems to be an issue caused by Intel PT not being supported in VMware, and I am confident that my host supports Intel PT.

Or could it be for some other reason?

[egueler]

Did I understand correctly that you are trying to run the whole setup inside a VMWare VM? I don't know if Nyx supports this setup (pinging @schumilo). In the meantime, to rule out an Atropos-specific issue, could you try running AFL++ with Nyx to see if that works?