Turns out there are unexpected structural changes in this upgrade that
we need to address separately.

It requires to deploy a CR after successful deployment, which means
we'll have to move the helm chart to bootstrape of work around this in
another way.