[kata-dev] Regarding, Kata 2.0.0, kata-runtime, qemu OVMF
Gupta, Sandeep
Sandeep.Gupta at amd.com
Wed Jan 6 05:26:43 UTC 2021
[AMD Official Use Only - Internal Distribution Only]
Hi Tao,
Attaching full log for Kata 2.0.0, kata-runtime, qemu OVMF -- including 'qemu-system-x86_64'
# ctr run --runtime io.containerd.run.kata.v2 -t --rm docker.io/library/busybox:latest csh
ctr: failed to launch qemu: exit status 1, error messages from qemu log: qemu: could not load PC BIOS '/usr/local/share/qemu/OVMF_CODE.fd.kata'
: unknown
qemu-system-x86_64 :
=====================
msg="launching /usr/local/bin/qemu-system-x86_64 with: [-name sandbox-csh -uuid a9ecf610-ebb5-42b4-bd8c-d72445f60601 -machine q35,accel=kvm,kernel_irqchip -cpu host,pmu=off -qmp unix:/run/vc/vm/csh/qmp.sock,server,nowait -m 2048M,slots=10,maxmem=129755M -device pci-bridge,bus=pcie.0,id=pci-bridge-0,chassis_nr=1,shpc=on,addr=2,romfile= -device virtio-serial-pci,disable-modern=false,id=serial0,romfile= -device virtconsole,chardev=charconsole0,id=console0 -chardev socket,id=charconsole0,path=/run/vc/vm/csh/console.sock,server,nowait -device virtio-scsi-pci,id=scsi0,disable-modern=false,romfile= -object rng-random,id=rng0,filename=/dev/urandom -device virtio-rng-pci,rng=rng0,romfile= -device vhost-vsock-pci,disable-modern=false,vhostfd=3,id=vsock-3113278101,guest-cid=3113278101,romfile= -device virtio-9p-pci,disable-modern=false,fsdev=extra-9p-kataShared,mount_tag=kataShared,romfile= -fsdev local,id=extra-9p-kataShared,path=/run/kata-containers/shared/sandboxes/csh/shared,security_model=none,multidevs=remap -rtc base=utc,driftfix=slew,clock=host -global kvm-pit.lost_tick_policy=discard -vga none -no-user-config -nodefaults -nographic --no-reboot -daemonize -object memory-backend-ram,id=dimm1,size=2048M -numa node,memdev=dimm1 -kernel /usr/share/kata-containers/vmlinuz-sev-es-5.6-v3.container -initrd /usr/share/kata-containers/kata-containers-initrd.img -append tsc=reliable no_timer_check rcupdate.rcu_expedited=1 i8042.direct=1 i8042.dumbkbd=1 i8042.nopnp=1 i8042.noaux=1 noreplace-smp reboot=k console=hvc0 console=hvc1 cryptomgr.notests net.ifnames=0 pci=lastbus=0 quiet panic=1 nr_cpus=240 scsi_mod.scan=none root=/dev/vda1 rootflags=data=ordered,errors=remount-ro agent.log=debug initcall_debug -bios /usr/local/share/qemu/OVMF_CODE.fd.kata -pidfile /run/vc/vm/csh/pid -smp 1,cores=1,threads=1,sockets=240,maxcpus=240]" pid=361802 sandbox=csh source=virtcontainers subsystem=qmp time="2021-01-06T01:09:08.598025317Z" level=error msg="Unable to launch /usr/local/bin/qemu-system-x86_64: exit status 1" pid=361802 sandbox=csh source=virtcontainers subsystem=qmp time="2021-01-06T01:09:08.598108225Z" level=error msg="qemu: could not load PC BIOS '/usr/local/share/qemu/OVMF_CODE.fd.kata'\n" pid=361802 sandbox=csh source=virtcontainers subsystem=qmp time="2021-01-06T01:09:08.598155344Z" level=error msg="failed to launch qemu: qemu: could not load PC BIOS '/usr/local/share/qemu/OVMF_CODE.fd.kata'\n" error="exit status 1" pid=361802 sandbox=csh source=virtcontainers subsystem=qemu
=====================
More complete Log :
===================================
DEBU[2021-01-06T01:08:29.615317241Z] stat snapshot key="sha256:de168d3b8ec4765250376be559836953e27ff721fff3bc1124dd758bb153ce51"
DEBU[2021-01-06T01:08:29.622956797Z] prepare snapshot key=sh parent="sha256:de168d3b8ec4765250376be559836953e27ff721fff3bc1124dd758bb153ce51"
DEBU[2021-01-06T01:08:56.304661933Z] stat snapshot key="sha256:de168d3b8ec4765250376be559836953e27ff721fff3bc1124dd758bb153ce51"
DEBU[2021-01-06T01:08:56.317821748Z] prepare snapshot key=bash parent="sha256:de168d3b8ec4765250376be559836953e27ff721fff3bc1124dd758bb153ce51"
DEBU[2021-01-06T01:09:08.368128323Z] stat snapshot key="sha256:de168d3b8ec4765250376be559836953e27ff721fff3bc1124dd758bb153ce51"
DEBU[2021-01-06T01:09:08.380135161Z] prepare snapshot key=csh parent="sha256:de168d3b8ec4765250376be559836953e27ff721fff3bc1124dd758bb153ce51"
DEBU[2021-01-06T01:09:08.385519872Z] event published ns=default topic="/snapshot/prepare" type=containerd.events.SnapshotPrepare
DEBU[2021-01-06T01:09:08.390393343Z] get snapshot mounts key=csh
DEBU[2021-01-06T01:09:08.400461926Z] event published ns=default topic="/containers/create" type=containerd.events.ContainerCreate
DEBU[2021-01-06T01:09:08.404528738Z] get snapshot mounts key=csh
time="2021-01-06T01:09:08.503529148Z" level=debug msg="registering ttrpc server"
time="2021-01-06T01:09:08.503667060Z" level=debug msg="serving api on abstract socket" socket="[inherited from parent]"
time="2021-01-06T01:09:08.503701054Z" level=info msg="starting signal loop" namespace=default path=/run/containerd/io.containerd.runtime.v2.task/default/csh pid=361802 time="2021-01-06T01:09:08.504550545Z" level=debug msg="converting /run/containerd/io.containerd.runtime.v2.task/default/csh/config.json" pid=361802 sandbox=csh source=virtcontainers subsystem=compatoci time="2021-01-06T01:09:08.508812677Z" level=info msg="loaded configuration" file=/etc/kata-containers/configuration.toml format=TOML pid=361802 sandbox=csh source=katautils time="2021-01-06T01:09:08.509043996Z" level=info msg="IOMMUPlatform is disabled by default." pid=361802 sandbox=csh source=katautils time="2021-01-06T01:09:08.510648468Z" level=info msg="shm-size detected: 67108864" source=virtcontainers subsystem=oci time="2021-01-06T01:09:08.513613030Z" level=info msg="create netns" netns=/var/run/netns/cnitest-96e33c0e-136c-b90e-a5c3-a7ff1a47067e pid=361802 sandbox=csh source=katautils time="2021-01-06T01:09:08.543947472Z" level=info msg="adding volume" pid=361802 sandbox=csh source=virtcontainers subsystem=qemu volume-type=virtio-9p time="2021-01-06T01:09:08.544942889Z" level=info msg="Endpoints found after scan" endpoints="[]" pid=361802 sandbox=csh source=virtcontainers subsystem=network time="2021-01-06T01:09:08.545072174Z" level=info msg="Starting VM" pid=361802 sandbox=csh source=virtcontainers subsystem=sandbox time="2021-01-06T01:09:08.545428179Z" level=info msg="Adding extra file [0xc000496c70]" pid=361802 sandbox=csh source=virtcontainers subsystem=qmp time="2021-01-06T01:09:08.545532948Z" level=info msg="launching /usr/local/bin/qemu-system-x86_64 with: [-name sandbox-csh -uuid a9ecf610-ebb5-42b4-bd8c-d72445f60601 -machine q35,accel=kvm,kernel_irqchip -cpu host,pmu=off -qmp unix:/run/vc/vm/csh/qmp.sock,server,nowait -m 2048M,slots=10,maxmem=129755M -device pci-bridge,bus=pcie.0,id=pci-bridge-0,chassis_nr=1,shpc=on,addr=2,romfile= -device virtio-serial-pci,disable-modern=false,id=serial0,romfile= -device virtconsole,chardev=charconsole0,id=console0 -chardev socket,id=charconsole0,path=/run/vc/vm/csh/console.sock,server,nowait -device virtio-scsi-pci,id=scsi0,disable-modern=false,romfile= -object rng-random,id=rng0,filename=/dev/urandom -device virtio-rng-pci,rng=rng0,romfile= -device vhost-vsock-pci,disable-modern=false,vhostfd=3,id=vsock-3113278101,guest-cid=3113278101,romfile= -device virtio-9p-pci,disable-modern=false,fsdev=extra-9p-kataShared,mount_tag=kataShared,romfile= -fsdev local,id=extra-9p-kataShared,path=/run/kata-containers/shared/sandboxes/csh/shared,security_model=none,multidevs=remap -rtc base=utc,driftfix=slew,clock=host -global kvm-pit.lost_tick_policy=discard -vga none -no-user-config -nodefaults -nographic --no-reboot -daemonize -object memory-backend-ram,id=dimm1,size=2048M -numa node,memdev=dimm1 -kernel /usr/share/kata-containers/vmlinuz-sev-es-5.6-v3.container -initrd /usr/share/kata-containers/kata-containers-initrd.img -append tsc=reliable no_timer_check rcupdate.rcu_expedited=1 i8042.direct=1 i8042.dumbkbd=1 i8042.nopnp=1 i8042.noaux=1 noreplace-smp reboot=k console=hvc0 console=hvc1 cryptomgr.notests net.ifnames=0 pci=lastbus=0 quiet panic=1 nr_cpus=240 scsi_mod.scan=none root=/dev/vda1 rootflags=data=ordered,errors=remount-ro agent.log=debug initcall_debug -bios /usr/local/share/qemu/OVMF_CODE.fd.kata -pidfile /run/vc/vm/csh/pid -smp 1,cores=1,threads=1,sockets=240,maxcpus=240]" pid=361802 sandbox=csh source=virtcontainers subsystem=qmp time="2021-01-06T01:09:08.598025317Z" level=error msg="Unable to launch /usr/local/bin/qemu-system-x86_64: exit status 1" pid=361802 sandbox=csh source=virtcontainers subsystem=qmp time="2021-01-06T01:09:08.598108225Z" level=error msg="qemu: could not load PC BIOS '/usr/local/share/qemu/OVMF_CODE.fd.kata'\n" pid=361802 sandbox=csh source=virtcontainers subsystem=qmp time="2021-01-06T01:09:08.598155344Z" level=error msg="failed to launch qemu: qemu: could not load PC BIOS '/usr/local/share/qemu/OVMF_CODE.fd.kata'\n" error="exit status 1" pid=361802 sandbox=csh source=virtcontainers subsystem=qemu time="2021-01-06T01:09:08.623018731Z" level=info msg="Network namespace \"/var/run/netns/cnitest-96e33c0e-136c-b90e-a5c3-a7ff1a47067e\" deleted" pid=361802 sandbox=csh source=virtcontainers subsystem=network time="2021-01-06T01:09:08.623889152Z" level=warning msg="sandbox cgroups path is empty" pid=361802 sandbox=csh source=virtcontainers subsystem=sandbox time="2021-01-06T01:09:08.623991075Z" level=info msg="cleanup agent" path=/run/kata-containers/shared/sandboxes/csh/shared pid=361802 sandbox=csh source=virtcontainers subsystem=kata_agent time="2021-01-06T01:09:08.625160482Z" level=warning msg="failed to cleanup netns" error="failed to get netns /var/run/netns/cnitest-96e33c0e-136c-b90e-a5c3-a7ff1a47067e: failed to Statfs \"/var/run/netns/cnitest-96e33c0e-136c-b90e-a5c3-a7ff1a47067e\": no such file or directory" path=/var/run/netns/cnitest-96e33c0e-136c-b90e-a5c3-a7ff1a47067e pid=361802 sandbox=csh source=katautils
DEBU[2021-01-06T01:09:08.636712678Z] remove snapshot key=csh
DEBU[2021-01-06T01:09:08.639720111Z] event published ns=default topic="/snapshot/remove" type=containerd.events.SnapshotRemove
DEBU[2021-01-06T01:09:08.642734608Z] event published ns=default topic="/containers/delete" type=containerd.events.ContainerDelete
DEBU[2021-01-06T01:09:08.765685424Z] schedule snapshotter cleanup snapshotter=overlayfs
DEBU[2021-01-06T01:09:08.768590533Z] removed snapshot key="default/148/csh" snapshotter=overlayfs
DEBU[2021-01-06T01:09:08.769013054Z] snapshot garbage collected d=3.245765ms snapshotter=overlayfs
DEBU[2021-01-06T01:09:08.769056436Z] garbage collected d=4.672521ms
========================================================
--Thanking You
--Best
--Sandeep
-----Original Message-----
From: Peng Tao <tao.peng at linux.alibaba.com>
Sent: Tuesday, January 5, 2021 7:01 PM
To: Gupta, Sandeep <Sandeep.Gupta at amd.com>; Christophe de Dinechin <cdupontd at redhat.com>
Cc: Hollingsworth, Brent <brent.hollingsworth at amd.com>; kata-dev at lists.katacontainers.io
Subject: Re: [kata-dev] Regarding, Kata 2.0.0, kata-runtime, qemu OVMF
[CAUTION: External Email]
On 2021/1/6 04:19, Gupta, Sandeep wrote:
> [AMD Official Use Only - Internal Distribution Only]
>
> Thanks again Christophe,
>
> From my kata-runtime 1.x, setup :
>
> root 2972741 2845780 0 20:13 pts/2 00:00:00 docker run --runtime kata-sev-runtime --cap-add=NET_ADMIN -it apache2-sev
>
>
> root 2018662 2018416 0 15:01 ? 00:00:16 /usr/local/bin/qemu-system-x86_64 -name sandbox-4a28f6d66e95a08be407b10e1fbfd6d0bd41d4048b5823029f02a17b7200adbc -uuid fce8220b-780b-4da6-8f5d-77ace1e06ed6 -machine q35,accel=kvm,kernel_irqchip,nvdimm -cpu host -qmp unix:/run/vc/sbs/4a28f6d66e95a08be407b10e1fbfd6d0bd41d4048b5823029f02a17b7200adbc/qmp.sock,server,nowait -m 512M,slots=2,maxmem=258779M -device pci-bridge,bus=pcie.0,id=pci-bridge-0,chassis_nr=1,shpc=on,addr=2 -device virtio-serial-pci,disable-legacy=on,id=serial0,iommu_platform=true -device virtconsole,chardev=charconsole0,id=console0 -chardev socket,id=charconsole0,path=/run/vc/sbs/4a28f6d66e95a08be407b10e1fbfd6d0bd41d4048b5823029f02a17b7200adbc/console.sock,server,nowait -object sev-guest,id=sev0,cbitpos=51,reduced-phys-bits=5 -machine memory-encryption=sev0 -device virtserialport,chardev=charch0,id=channel0,name=agent.channel.0 -chardev socket,id=charch0,path=/run/vc/sbs/4a28f6d66e95a08be407b10e1fbfd6d0bd41d4048b5823029f02a17b7200adbc/kata.sock,server,nowait -device virtio-9p-pci,disable-legacy=on,iommu_platform=true,fsdev=extra-9p-kataShared,mount_tag=kataShared -fsdev local,id=extra-9p-kataShared,path=/run/kata-containers/shared/sandboxes/4a28f6d66e95a08be407b10e1fbfd6d0bd41d4048b5823029f02a17b7200adbc,security_model=none -netdev tap,id=network-0,vhost=on,vhostfds=3:4:5:6:7:8:9:10,fds=11:12:13:14:15:16:17:18 -device driver=virtio-net-pci,netdev=network-0,mac=02:42:ac:11:00:02,disable-legacy=on,iommu_platform=true,mq=on,vectors=18 -rtc base=utc,driftfix=slew -global kvm-pit.lost_tick_policy=discard -vga none -no-user-config -nodefaults -nographic -daemonize -kernel /usr/share/kata-containers/vmlinuz-sev-es-5.6-v3.container -initrd /usr/share/kata-containers/kata-containers-initrd.img -append tsc=reliable no_timer_check rcupdate.rcu_expedited=1 i8042.direct=1 i8042.dumbkbd=1 i8042.nopnp=1 i8042.noaux=1 noreplace-smp reboot=k console=hvc0 console=hvc1 iommu=off cryptomgr.notests net.ifnames=0 pci=lastbus=0 debug panic=1 initcall_debug nr_cpus=240 ip=::::::4a28f6d66e95a08be407b10e1fbfd6d0bd41d4048b5823029f02a17b7200adbc::off:: root=/dev/vda1 rootflags=data=ordered,errors=remount-ro agent.log=debug initcall_debug -drive if=pflash,format=raw,unit=0,file=/usr/local/share/qemu/OVMF_CODE.fd.kata,readonly -smp 1,cores=1,threads=1,sockets=1,maxcpus=240
>
>
Please also share your kata 2.0 qemu commandline. You can get it by:
1. start containerd with `--log-level debug` 2. look for it in containerd's output
With both 1.x and 2.x qemu commandline, it would be more easier to check that is changed and why 2.0x doesn't boot with custom ovmf.
Cheers,
Tao
--
Into something rich and strange.
More information about the kata-dev
mailing list