Error upgrading from 2.11.4 to 3.0.0

[bratao]

First of all, thanks for this great project.

I´m using rancher 2.6 to upgrade a helm installation of version 2.11.4 > 3.0.0. The installation have nothing of special interest. It was using mainly the default values, and I only use the localstorage provider.

The error is the following, and I have no idea or hints on the net. Can you give my any pointers:

helm upgrade --history-max=5 --install=true --namespace=openebs --timeout=10m0s --values=/home/shell/helm/values-openebs-3.0.0.yaml --version=3.0.0 --wait=true openebs /home/shell/helm/openebs-3.0.0.tgz
checking 7 resources for changes
error updating the resource "openebs-ndm":
cannot patch "openebs-ndm" with kind DaemonSet: DaemonSet.apps "openebs-ndm" is invalid: spec.selector: Invalid value: v1.LabelSelector{MatchLabels:map[string]string{"app":"openebs", "component":"ndm", "release":"openebs"}, MatchExpressions:[]v1.LabelSelectorRequirement(nil)}: field is immutable
error updating the resource "openebs-localpv-provisioner":
cannot patch "openebs-localpv-provisioner" with kind Deployment: Deployment.apps "openebs-localpv-provisioner" is invalid: spec.selector: Invalid value: v1.LabelSelector{MatchLabels:map[string]string{"app":"openebs", "release":"openebs"}, MatchExpressions:[]v1.LabelSelectorRequirement(nil)}: field is immutable
error updating the resource "openebs-ndm-operator":
cannot patch "openebs-ndm-operator" with kind Deployment: Deployment.apps "openebs-ndm-operator" is invalid: spec.selector: Invalid value: v1.LabelSelector{MatchLabels:map[string]string{"app":"openebs", "release":"openebs"}, MatchExpressions:[]v1.LabelSelectorRequirement(nil)}: field is immutable
Error: UPGRADE FAILED: cannot patch "openebs-ndm" with kind DaemonSet: DaemonSet.apps "openebs-ndm" is invalid: spec.selector: Invalid value: v1.LabelSelector{MatchLabels:map[string]string{"app":"openebs", "component":"ndm", "release":"openebs"}, MatchExpressions:[]v1.LabelSelectorRequirement(nil)}: field is immutable && cannot patch "openebs-localpv-provisioner" with kind Deployment: Deployment.apps "openebs-localpv-provisioner" is invalid: spec.selector: Invalid value: v1.LabelSelector{MatchLabels:map[string]string{"app":"openebs", "release":"openebs"}, MatchExpressions:[]v1.LabelSelectorRequirement(nil)}: field is immutable && cannot patch "openebs-ndm-operator" with kind Deployment: Deployment.apps "openebs-ndm-operator" is invalid: spec.selector: Invalid value: v1.LabelSelector{MatchLabels:map[string]string{"app":"openebs", "release":"openebs"}, MatchExpressions:[]v1.LabelSelectorRequirement(nil)}: field is immutable 

The yaml config is the following

analytics:
  enabled: true
  pingInterval: 24h
apiserver:
  affinity: {}
  enabled: true
  healthCheck:
    initialDelaySeconds: 30
    periodSeconds: 60
  image: openebs/m-apiserver
  imageTag: 2.12.2
  nodeSelector: {}
  ports:
    externalPort: 5656
    internalPort: 5656
  replicas: 1
  resources: {}
  sparse:
    enabled: 'false'
  tolerations: []
cleanup:
  image:
    imagePullSecrets: []
    registry: null
    repository: bitnami/kubectl
    tag: null
crd:
  enableInstall: true
cstor:
  enabled: false
  openebsNDM:
    enabled: false
  pool:
    image: openebs/cstor-pool
    imageTag: 2.12.2
  poolMgmt:
    image: openebs/cstor-pool-mgmt
    imageTag: 2.12.2
  target:
    image: openebs/cstor-istgt
    imageTag: 2.12.2
  volumeMgmt:
    image: openebs/cstor-volume-mgmt
    imageTag: 2.12.2
defaultStorageConfig:
  enabled: 'true'
featureGates:
  APIService:
    address: 0.0.0.0:9115
    enabled: false
    featureGateFlag: APIService
  ChangeDetection:
    enabled: false
    featureGateFlag: ChangeDetection
  GPTBasedUUID:
    enabled: true
    featureGateFlag: GPTBasedUUID
  UseOSDisk:
    enabled: false
    featureGateFlag: UseOSDisk
  enabled: true
helper:
  image: openebs/linux-utils
  imageTag: 3.0.0
image:
  pullPolicy: IfNotPresent
  repository: ''
imagePullSecrets: []
jiva:
  defaultStoragePath: /var/openebs
  enabled: false
  image: openebs/jiva
  imageTag: 2.12.2
  localpv-provisioner:
    openebsNDM:
      enabled: false
  openebsLocalpv:
    enabled: false
  replicas: 3
legacy:
  enabled: false
localprovisioner:
  affinity: {}
  basePath: /var/openebs/local
  enableDeviceClass: false
  enableHostpathClass: false
  enableLeaderElection: true
  enabled: true
  healthCheck:
    initialDelaySeconds: 30
    periodSeconds: 60
  image: openebs/provisioner-localpv
  imageTag: 3.0.0
  nodeSelector: {}
  replicas: 1
  resources: {}
  tolerations: []
  waitForBDBindTimeoutRetryCount: '12'
localpv-provisioner:
  enabled: false
  openebsNDM:
    enabled: false
lvm-localpv:
  enabled: false
ndm:
  enabled: true
  filters:
    enableOsDiskExcludeFilter: true
    enablePathFilter: true
    enableVendorFilter: true
    excludePaths: /dev/loop,/dev/fd0,/dev/sr0,/dev/ram,/dev/dm-,/dev/md,/dev/rbd,/dev/zd
    excludeVendors: CLOUDBYT,OpenEBS
    includePaths: ''
    osDiskExcludePaths: /,/etc/hosts,/boot
  healthCheck:
    initialDelaySeconds: 30
    periodSeconds: 60
  image: openebs/node-disk-manager
  imageTag: 1.7.0
  nodeSelector: {}
  probes:
    enableSeachest: false
  resources: {}
  sparse:
    count: '0'
    path: /var/openebs/sparse
    size: '10737418240'
    enabled: false
  tolerations: []
ndmExporter:
  clusterExporter:
    metricsPort: 9100
    name: ndm-cluster-exporter
    podLabels:
      name: openebs-ndm-cluster-exporter
  enabled: false
  image:
    pullPolicy: IfNotPresent
    registry: null
    repository: openebs/node-disk-exporter
    tag: 1.7.0
  nodeExporter:
    metricsPort: 9101
    name: ndm-node-exporter
    podLabels:
      name: openebs-ndm-node-exporter
ndmOperator:
  enabled: true
  healthCheck:
    initialDelaySeconds: 15
    periodSeconds: 20
  image: openebs/node-disk-operator
  imageTag: 1.7.0
  nodeSelector: {}
  readinessCheck:
    initialDelaySeconds: 5
    periodSeconds: 10
  replicas: 1
  resources: {}
  tolerations: []
  upgradeStrategy: Recreate
nfs-provisioner:
  enabled: false
openebs-ndm:
  enabled: false
policies:
  monitoring:
    enabled: true
    image: openebs/m-exporter
    imageTag: 2.12.2
provisioner:
  affinity: {}
  enableLeaderElection: true
  enabled: true
  healthCheck:
    initialDelaySeconds: 30
    periodSeconds: 60
  image: openebs/openebs-k8s-provisioner
  imageTag: 2.12.2
  nodeSelector: {}
  patchJivaNodeAffinity: enabled
  replicas: 1
  resources: {}
  tolerations: []
rbac:
  create: true
  kyvernoEnabled: false
  pspEnabled: false
release:
  version: 3.0.0
serviceAccount:
  create: true
  name: null
snapshotOperator:
  affinity: {}
  controller:
    image: openebs/snapshot-controller
    imageTag: 2.12.2
    resources: {}
  enableLeaderElection: true
  enabled: true
  healthCheck:
    initialDelaySeconds: 30
    periodSeconds: 60
  nodeSelector: {}
  provisioner:
    image: openebs/snapshot-provisioner
    imageTag: 2.12.2
    resources: {}
  replicas: 1
  tolerations: []
  upgradeStrategy: Recreate
varDirectoryPath:
  baseDir: /var/openebs
webhook:
  affinity: {}
  enabled: true
  failurePolicy: Fail
  healthCheck:
    initialDelaySeconds: 30
    periodSeconds: 60
  hostNetwork: false
  image: openebs/admission-server
  imageTag: 2.12.2
  nodeSelector: {}
  replicas: 1
  resources: {}
  tolerations: []
zfs-localpv:
  enabled: false
global:
  clusterName: c-dww6p
  projectName: p-mq4jz
defaultImage: true
defaultPorts: true