Attention
The DEEP platform is sunsetting.
The DEEP-Hybrid-DataCloud project project has ended and its plaftform and software are being decomissioned during 2023, as they have been superseeded by the AI4EOSC platform and the AI4OS software stack.
Please refer to the following links for further information:
OpenStack nova-lxd testing configuration
As the nova-lxd plugin in OpenStack is still experimental, we need to deploy and test its current status to find out the working configuration before implementing new features
Testing of nova-lxd with different software configurations
OpenStack with nova-lxd has been deployed by different methods: OpenStack DevStack, JuJu, and OpenStack Ansible. Various combinations with OpenStack/LXD and base OS version have been tested to find out the working configuration of OpenStack nova-lxd for production.
Since nova-lxd plugin and OpenStack DevStack (deployment of OpenStack Cloud by Python scripts) have extremely shallow documentation, the first step was finding out the best starting configuration for development. We reached the following results (without advanced post-configuration efforts):
Host OS* |
OpenStack ( DevStack)version |
LXD/LXC version |
S torage type |
Nova-lxd recognized |
N o t e s * * |
|---|---|---|---|---|---|
U buntu 16 .04.5 LTS |
Queens |
2.0.11 |
Dir |
Yes |
V M c r e a t i o n s u c c e s s f u l , V o l u m e a t t a c h m e n t e r r o r . |
U buntu 16 .04.5 LTS |
Queens |
2.0.11 |
zfs |
Yes |
V M c r e a t i o n s u c c e s s f u l , V o l u m e a t t a c h m e n t e r r o r . |
U buntu 16 .04.5 LTS |
Queens |
3.0.1 |
zfs |
No |
C o u l d n ’ t f i n d t h e l x d s t o r a g e f r o m i t s z p o o l . |
U buntu 16 .04.5 LTS |
Queens |
3.0.1 |
btrfs |
Yes |
V M c r e a t i o n e r r o r . |
U buntu 16 .04.5 LTS |
Queens |
3.0.1 |
Dir |
Yes |
V M c r e a t i o n e r r o r . |
U buntu 16 .04.5 LTS |
Queens |
3.0.1 |
lvm |
Yes |
V M c r e a t i o n e r r o r . |
U buntu 16 .04.5 LTS |
Rocky |
2.0.11 |
Dir |
Yes |
V M c r e a t i o n s u c c e s s f u l , V o l u m e a t t a c h m e n t e r r o r . |
U buntu 16 .04.5 LTS |
Rocky |
2.0.11 |
zfs |
No |
E r r o r d u r i n g d e p l o y m e n t . |
U buntu 16 .04.5 LTS |
Rocky |
3.0.1 |
zfs |
No |
C o u l d n ’ t f i n d t h e l x d s t o r a g e f r o m i t s z p o o l . |
U buntu 16 .04.5 LTS |
Rocky |
3.0.1 |
btrfs |
Yes |
V M c r e a t i o n e r r o r . |
U buntu 18 .04.1 LTS |
Rocky |
3.0.1 |
zfs |
No |
C o u l d n ’ t f i n d t h e l x d s t o r a g e f r o m i t s z p o o l . |
U buntu 18 .04.1 LTS |
Rocky |
3.0.1 |
btrfs |
Yes |
V M c r e a t i o n e r r o r . |
U buntu LTS (both t ested vers ions) |
OpenStack devstack (both tested versions) |
The last version (from its Snap re pository) |
N/A |
No |
L X D / L X C i s n ’ t r e c o g n i z e d b y O p e n S t a c k d e v s t a c k i n s t a l l a t i o n s c r i p t s t a c k . s h o r n o v a - l x d p l u g i n |
The hosts have the following static parameters:
Tool/Library |
Version |
Notes |
|---|---|---|
Python |
2.7 |
It is possible to use Python 3.X also. |
pip |
9.0.3 |
The tool was installed by OpenStack devstack script stack.sh |
PyLXD |
2.2.7 |
The library has to be pre-installed on a host. |
Nova-lxd plugin | According to an OpenStack version, there are following options:
17.0.1 (stable/queens)
18.0.0 (stable/rocky), 18.0.0.0rc2.dev1 (master)
| The master branch was used for hosts with storage backend zfs running LXD/LXC 3.0.1
There are two other deployment options for OpenStack alongside DevStack which are the following: Juju, and Ansible. The main advantage of these two approaches is automated deployment (with a post-configuration) of an OpenStack Cloud environment. The main differences between the deployment approaches are the configuration of an OpenStack environment, and LXD/LXC support. Juju supports LXD/LXC 2.0.11. It creates inside a Xenial/Bionic host another virtual layer by an LXD daemon from the host, and so Xenial with LXD/LXC 2.0.11 is installed in a container. All in all, it doesn’t support higher versions of LXD/LXC which supports GPUs.
On the other hand, Ansible supports LXD/LXC 3.0.1. However, the situation about a nova-lxd plugin integration is the same, but the configuration of an OpenStack environment is different. According to Alex Kavanagh (one of the maintainers for the nova-lxd plugin) suggestions, the plugin has to be post-configured within a nova-compute configuration that is not documented in any official sources. The configuration file has to contain the following lines:
[DEFAULT]
compute_driver = nova_lxd.nova.virt.lxd.LXDDriver
[lxd]
allow_live_migration = True
pool = {{ storage_pool }}
A problem with the post-configuration is that it has to be performed in a different way within an OpenStack Cloud environment deployed by DevStack. The environment has a dedicated configuration file nova-cpu.conf. The other approaches create the standard deployment of an OpenStack Cloud environment, and so the configuration of the nova-lxd plugin is performed by editing of a nova.conf file.
Working configuration
According to the performed test mentioned above, we chose OpenStack Ansible repository for deployment of an OpenStack Cloud. The main reason is that it deploys a standard OpenStack Cloud with LXD/LXC 3.0.1 which supports GPUs.