Networking between containers in qemu processes
Hi, I'm looking for information on how to set up communication between containers running within virtual machines. On a host, there are multiple VMs with containers and set up networking between the containers in different VMs.
Thanks, Al
I won’t have the answers, but some questions to help clarify…
Q1. Are these all kata-container VMs
Q2. Are you using some standard container networking infra, like CNI, to link them together?
Afaik, kata should ‘just work’ if sat under a CNI setup.
Kata has a number of ways it can discover/config/integrate with the networking passed in from the higher levels – iirc, we default to using ‘tcfilter’ at the moment. Have a look in the config file for some more info. https://github.com/kata-containers/runtime/blob/master/cli/config/configurat...
bottom line is I think, if the higher level orchestration has set up the networking correctly as it would for say ‘runc’, then kata should pick that up and translate/re-configure it into the VM and host side so it works ‘seamlessly’.
Graham
From: Al Lau [mailto:lauatic@gmail.com] Sent: Wednesday, November 20, 2019 3:27 PM To: kata-dev@lists.katacontainers.io Subject: [kata-dev] Networking between containers in qemu processes
Hi, I'm looking for information on how to set up communication between containers running within virtual machines. On a host, there are multiple VMs with containers and set up networking between the containers in different VMs.
Thanks, Al --------------------------------------------------------------------- Intel Corporation (UK) Limited Registered No. 1134945 (England) Registered Office: Pipers Way, Swindon SN3 1RJ VAT No: 860 2173 47
This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies.
Q1. Are these all kata-container VMs
Yes. These are all kata-containers VMs.
Q2. Are you using some standard container networking infra, like CNI, to link them together?
Yes. We use the CNI and set up a new bridge plugin in /etc/cni/net.d/ directory. This is what I have already done. I'm still debugging the issue I'm facing in getting the VMs to communicate.
Thanks,
Al
On Wed, Nov 20, 2019 at 8:18 AM Whaley, Graham graham.whaley@intel.com wrote:
I won’t have the answers, but some questions to help clarify…
Q1. Are these all kata-container VMs
Q2. Are you using some standard container networking infra, like CNI, to link them together?
Afaik, kata should ‘just work’ if sat under a CNI setup.
Kata has a number of ways it can discover/config/integrate with the networking passed in from the higher levels – iirc, we default to using ‘tcfilter’ at the moment. Have a look in the config file for some more info.
https://github.com/kata-containers/runtime/blob/master/cli/config/configurat...
bottom line is I think, if the higher level orchestration has set up the networking correctly as it would for say ‘runc’, then kata should pick that up and translate/re-configure it into the VM and host side so it works ‘seamlessly’.
Graham
*From:* Al Lau [mailto:lauatic@gmail.com] *Sent:* Wednesday, November 20, 2019 3:27 PM *To:* kata-dev@lists.katacontainers.io *Subject:* [kata-dev] Networking between containers in qemu processes
Hi,
I'm looking for information on how to set up communication between containers running within virtual machines. On a host, there are multiple VMs with containers and set up networking between the containers in different VMs.
Thanks,
Al
Intel Corporation (UK) Limited Registered No. 1134945 (England) Registered Office: Pipers Way, Swindon SN3 1RJ VAT No: 860 2173 47
This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies.
Networking should be transparent to you.
If you have standard (runc) containers working but see failures with Kata, then this is an issue.
Can you please verify your setup as a first step?
Eric
On Nov 20, 2019, at 8:41 AM, Al Lau lauatic@gmail.com wrote:
Q1. Are these all kata-container VMs Yes. These are all kata-containers VMs.
Q2. Are you using some standard container networking infra, like CNI, to link them together? Yes. We use the CNI and set up a new bridge plugin in /etc/cni/net.d/ directory. This is what I have already done. I'm still debugging the issue I'm facing in getting the VMs to communicate.
Thanks, Al
On Wed, Nov 20, 2019 at 8:18 AM Whaley, Graham <graham.whaley@intel.commailto:graham.whaley@intel.com> wrote: I won’t have the answers, but some questions to help clarify…
Q1. Are these all kata-container VMs
Q2. Are you using some standard container networking infra, like CNI, to link them together?
Afaik, kata should ‘just work’ if sat under a CNI setup.
Kata has a number of ways it can discover/config/integrate with the networking passed in from the higher levels – iirc, we default to using ‘tcfilter’ at the moment. Have a look in the config file for some more info. https://github.com/kata-containers/runtime/blob/master/cli/config/configurat...
bottom line is I think, if the higher level orchestration has set up the networking correctly as it would for say ‘runc’, then kata should pick that up and translate/re-configure it into the VM and host side so it works ‘seamlessly’.
Graham
From: Al Lau [mailto:lauatic@gmail.commailto:lauatic@gmail.com] Sent: Wednesday, November 20, 2019 3:27 PM To: kata-dev@lists.katacontainers.iomailto:kata-dev@lists.katacontainers.io Subject: [kata-dev] Networking between containers in qemu processes
Hi, I'm looking for information on how to set up communication between containers running within virtual machines. On a host, there are multiple VMs with containers and set up networking between the containers in different VMs.
Thanks, Al
--------------------------------------------------------------------- Intel Corporation (UK) Limited Registered No. 1134945 (England) Registered Office: Pipers Way, Swindon SN3 1RJ VAT No: 860 2173 47
This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies.
_______________________________________________ kata-dev mailing list kata-dev@lists.katacontainers.io http://lists.katacontainers.io/cgi-bin/mailman/listinfo/kata-dev
The standard runc containers are working.
What setup can I post to this email thread for us to verify?
Thanks, Al
On Wed, Nov 20, 2019 at 9:13 AM Ernst, Eric eric.ernst@intel.com wrote:
Networking should be transparent to you.
If you have standard (runc) containers working but see failures with Kata, then this is an issue.
Can you please verify your setup as a first step?
Eric
On Nov 20, 2019, at 8:41 AM, Al Lau lauatic@gmail.com wrote:
Q1. Are these all kata-container VMs
Yes. These are all kata-containers VMs.
Q2. Are you using some standard container networking infra, like CNI, to link them together?
Yes. We use the CNI and set up a new bridge plugin in /etc/cni/net.d/ directory. This is what I have already done. I'm still debugging the issue I'm facing in getting the VMs to communicate.
Thanks,
Al
On Wed, Nov 20, 2019 at 8:18 AM Whaley, Graham graham.whaley@intel.com wrote:
I won’t have the answers, but some questions to help clarify…
Q1. Are these all kata-container VMs
Q2. Are you using some standard container networking infra, like CNI, to link them together?
Afaik, kata should ‘just work’ if sat under a CNI setup.
Kata has a number of ways it can discover/config/integrate with the networking passed in from the higher levels – iirc, we default to using ‘tcfilter’ at the moment. Have a look in the config file for some more info.
https://github.com/kata-containers/runtime/blob/master/cli/config/configurat...
bottom line is I think, if the higher level orchestration has set up the networking correctly as it would for say ‘runc’, then kata should pick that up and translate/re-configure it into the VM and host side so it works ‘seamlessly’.
Graham
*From:* Al Lau [mailto:lauatic@gmail.com] *Sent:* Wednesday, November 20, 2019 3:27 PM *To:* kata-dev@lists.katacontainers.io *Subject:* [kata-dev] Networking between containers in qemu processes
Hi,
I'm looking for information on how to set up communication between containers running within virtual machines. On a host, there are multiple VMs with containers and set up networking between the containers in different VMs.
Thanks,
Al
Intel Corporation (UK) Limited Registered No. 1134945 (England) Registered Office: Pipers Way, Swindon SN3 1RJ VAT No: 860 2173 47
This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies.
kata-dev mailing list kata-dev@lists.katacontainers.io http://lists.katacontainers.io/cgi-bin/mailman/listinfo/kata-dev
participants (3)
-
Al Lau
-
Ernst, Eric
-
Whaley, Graham