pvc is pending

[13567436138]

Description

root@storage-b-01:~# kubectl get pvc -n velero 
NAME                              STATUS    VOLUME   CAPACITY   ACCESS MODES   STORAGECLASS    AGE
rook-ceph-backup-pv-pvc-4-27klg   Pending                                      openebs-lvmpv   2m24s
rook-ceph-backup-pv-pvc-4-5kbzv   Pending                                      openebs-lvmpv   117s
rook-ceph-backup-pv-pvc-4-7b5gr   Pending                                      openebs-lvmpv   2m52s
rook-ceph-backup-pv-pvc-4-7lz9x   Pending                                      openebs-lvmpv   2m34s
rook-ceph-backup-pv-pvc-4-87248   Pending                                      openebs-lvmpv   2m29s
rook-ceph-backup-pv-pvc-4-hlfnk   Pending                                      openebs-lvmpv   2m11s
rook-ceph-backup-pv-pvc-4-htlh7   Pending                                      openebs-lvmpv   2m47s
rook-ceph-backup-pv-pvc-4-mc7sz   Pending                                      openebs-lvmpv   2m18s
rook-ceph-backup-pv-pvc-4-zvl7v   Pending                                      openebs-lvmpv   2m
rook-ceph-backup-pv-pvc-4-zzmpn   Pending                                      openebs-lvmpv   2m41s

Warning  ProvisioningFailed    38s               local.csi.openebs.io_openebs-lvm-controller-0_24a6e4e0-6bde-4212-b01f-8cabaf937638  failed to provision volume with StorageClass "openebs-lvmpv": error getting handle for DataSource Type VolumeSnapshot by Name rook-ceph-backup-pv-pvc-4-mc7sz: snapshot rook-ceph-backup-pv-pvc-4-mc7sz is not Ready
  Normal   ExternalProvisioning  6s (x5 over 38s)  persistentvolume-controller                                                         Waiting for a volume to be created either by the external provisioner 'local.csi.openebs.io' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered.
  Normal   Provisioning          4s (x6 over 38s)  local.csi.openebs.io_openebs-lvm-controller-0_24a6e4e0-6bde-4212-b01f-8cabaf937638  External provisioner is provisioning volume for claim "velero/rook-ceph-backup-pv-pvc-4-mc7sz"
  Warning  ProvisioningFailed    4s (x5 over 36s)  local.csi.openebs.io_openebs-lvm-controller-0_24a6e4e0-6bde-4212-b01f-8cabaf937638  failed to provision volume with StorageClass "openebs-lvmpv": rpc error: code = Unimplemented desc =

root@storage-b-01:~# kubectl get sc openebs-lvmpv -o yaml
allowVolumeExpansion: true
allowedTopologies:
- matchLabelExpressions:
  - key: kubernetes.io/hostname
    values:
    - master-01
    - worker-01
    - worker-02
    - worker-03
apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
  annotations:
    kubectl.kubernetes.io/last-applied-configuration: |
      {"allowVolumeExpansion":true,"allowedTopologies":[{"matchLabelExpressions":[{"key":"kubernetes.io/hostname","values":["master-01","worker-01","worker-02","worker-03"]}]}],"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{},"name":"openebs-lvmpv"},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"provisioner":"local.csi.openebs.io"}
  creationTimestamp: "2024-02-10T09:22:16Z"
  name: openebs-lvmpv
  resourceVersion: "345934"
  uid: 21fc542b-cfe6-4fe2-96d4-c46f99c768fe
parameters:
  storage: lvm
  volgroup: openebs-lvm
provisioner: local.csi.openebs.io
reclaimPolicy: Delete
volumeBindingMode: Immediate

kubectl logs -n kube-system openebs-lvm-controller-0 -c csi-provisioner

I0211 02:42:40.794135       1 capacity.go:518] Capacity Controller: enqueuing {segment:0xc000011c38 storageClassName:openebs-lvmpv} for periodic update
I0211 02:42:40.794303       1 capacity.go:518] Capacity Controller: enqueuing {segment:0xc000011c68 storageClassName:openebs-lvmpv} for periodic update
I0211 02:42:40.794323       1 capacity.go:518] Capacity Controller: enqueuing {segment:0xc000011c98 storageClassName:openebs-lvmpv} for periodic update
I0211 02:42:40.794337       1 capacity.go:518] Capacity Controller: enqueuing {segment:0xc000011cc8 storageClassName:openebs-lvmpv} for periodic update
I0211 02:42:40.794378       1 capacity.go:574] Capacity Controller: refreshing {segment:0xc000011c38 storageClassName:openebs-lvmpv}
I0211 02:42:40.794411       1 connection.go:193] GRPC call: /csi.v1.Controller/GetCapacity
I0211 02:42:40.794425       1 connection.go:194] GRPC request: {"accessible_topology":{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":null},"access_mode":{}}]}
I0211 02:42:40.795209       1 connection.go:200] GRPC response: {"available_capacity":433774919680}
I0211 02:42:40.795259       1 connection.go:201] GRPC error: <nil>
I0211 02:42:40.795281       1 capacity.go:656] Capacity Controller: no need to update csisc-fhh8t for {segment:0xc000011c38 storageClassName:openebs-lvmpv}, same capacity 413680Mi, same maximumVolumeSize <nil> and correct owner
I0211 02:42:40.795315       1 capacity.go:574] Capacity Controller: refreshing {segment:0xc000011c68 storageClassName:openebs-lvmpv}
I0211 02:42:40.795335       1 connection.go:193] GRPC call: /csi.v1.Controller/GetCapacity
I0211 02:42:40.795348       1 connection.go:194] GRPC request: {"accessible_topology":{"segments":{"kubernetes.io/hostname":"worker-01","openebs.io/nodename":"worker-01"}},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":null},"access_mode":{}}]}
I0211 02:42:40.795661       1 connection.go:200] GRPC response: {"available_capacity":471355883520}
I0211 02:42:40.795683       1 connection.go:201] GRPC error: <nil>
I0211 02:42:40.795698       1 capacity.go:656] Capacity Controller: no need to update csisc-g2xj9 for {segment:0xc000011c68 storageClassName:openebs-lvmpv}, same capacity 449520Mi, same maximumVolumeSize <nil> and correct owner
I0211 02:42:40.795718       1 capacity.go:574] Capacity Controller: refreshing {segment:0xc000011c98 storageClassName:openebs-lvmpv}
I0211 02:42:40.795735       1 connection.go:193] GRPC call: /csi.v1.Controller/GetCapacity
I0211 02:42:40.795747       1 connection.go:194] GRPC request: {"accessible_topology":{"segments":{"kubernetes.io/hostname":"worker-02","openebs.io/nodename":"worker-02"}},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":null},"access_mode":{}}]}
I0211 02:42:40.795970       1 connection.go:200] GRPC response: {"available_capacity":471355883520}
I0211 02:42:40.795990       1 connection.go:201] GRPC error: <nil>
I0211 02:42:40.796006       1 capacity.go:656] Capacity Controller: no need to update csisc-96j89 for {segment:0xc000011c98 storageClassName:openebs-lvmpv}, same capacity 449520Mi, same maximumVolumeSize <nil> and correct owner
I0211 02:42:40.796024       1 capacity.go:574] Capacity Controller: refreshing {segment:0xc000011cc8 storageClassName:openebs-lvmpv}
I0211 02:42:40.796040       1 connection.go:193] GRPC call: /csi.v1.Controller/GetCapacity
I0211 02:42:40.796052       1 connection.go:194] GRPC request: {"accessible_topology":{"segments":{"kubernetes.io/hostname":"worker-03","openebs.io/nodename":"worker-03"}},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":null},"access_mode":{}}]}
I0211 02:42:40.796279       1 connection.go:200] GRPC response: {"available_capacity":472429625344}
I0211 02:42:40.796299       1 connection.go:201] GRPC error: <nil>
I0211 02:42:40.796314       1 capacity.go:656] Capacity Controller: no need to update csisc-95wnt for {segment:0xc000011cc8 storageClassName:openebs-lvmpv}, same capacity 450544Mi, same maximumVolumeSize <nil> and correct owner```


I0210 09:49:00.543945       1 grpc.go:81] GRPC response: {"available_capacity":472429625344}
I0210 09:49:00.754768       1 grpc.go:72] GRPC call: /csi.v1.Controller/CreateVolume requests {"accessibility_requirements":{"preferred":[{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}}],"requisite":[{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-b3ea61be-e2a4-4d32-a898-6e61695f70b9","parameters":{"csi.storage.k8s.io/pv/name":"pvc-b3ea61be-e2a4-4d32-a898-6e61695f70b9","csi.storage.k8s.io/pvc/name":"rook-ceph-backup-pv-pvc-4-mc7sz","csi.storage.k8s.io/pvc/namespace":"velero","storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Block":{}},"access_mode":{"mode":1}}],"volume_content_source":{"Type":{"Snapshot":{"snapshot_id":"pvc-d13922aa-be6f-4393-b6df-90db88f3d6c4@snapshot-6e89095a-00ea-44ff-b285-d81271e5af02"}}}}
E0210 09:49:00.754945       1 grpc.go:79] GRPC error: rpc error: code = Unimplemented desc = 
I0210 09:49:00.771281       1 grpc.go:72] GRPC call: /csi.v1.Controller/GetCapacity requests {"accessible_topology":{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{}}]}
I0210 09:49:00.771414       1 grpc.go:81] GRPC response: {"available_capacity":395120214016}
I0210 09:49:00.776258       1 grpc.go:72] GRPC call: /csi.v1.Controller/GetCapacity requests {"accessible_topology":{"segments":{"kubernetes.io/hostname":"worker-01","openebs.io/nodename":"worker-01"}},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{}}]}
--
I0210 09:49:00.802516       1 grpc.go:72] GRPC call: /csi.v1.Controller/GetCapacity requests {"accessible_topology":{"segments":{"kubernetes.io/hostname":"worker-03","openebs.io/nodename":"worker-03"}},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{}}]}
I0210 09:49:00.802770       1 grpc.go:81] GRPC response: {"available_capacity":472429625344}
I0210 09:49:01.051397       1 grpc.go:72] GRPC call: /csi.v1.Controller/CreateVolume requests {"accessibility_requirements":{"preferred":[{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}}],"requisite":[{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}}]},"capacity_range":{"required_bytes":1073741824},"name":"pvc-702f30d5-165d-4b67-bc22-169ad58c0737","parameters":{"csi.storage.k8s.io/pv/name":"pvc-702f30d5-165d-4b67-bc22-169ad58c0737","csi.storage.k8s.io/pvc/name":"rook-ceph-backup-pv-pvc-4-htlh7","csi.storage.k8s.io/pvc/namespace":"velero","storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}}],"volume_content_source":{"Type":{"Snapshot":{"snapshot_id":"pvc-fa467e09-dd15-4e94-a0e6-7be9392fc2cb@snapshot-c3558f96-de64-4533-9b17-8f755b829064"}}}}
E0210 09:49:01.063905       1 grpc.go:79] GRPC error: rpc error: code = Unimplemented desc = 
I0210 09:49:01.070750       1 grpc.go:72] GRPC call: /csi.v1.Controller/GetCapacity requests {"accessible_topology":{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{}}]}
I0210 09:49:01.070879       1 grpc.go:81] GRPC response: {"available_capacity":395120214016}
I0210 09:49:01.144397       1 grpc.go:72] GRPC call: /csi.v1.Controller/GetCapacity requests {"accessible_topology":{"segments":{"kubernetes.io/hostname":"worker-01","openebs.io/nodename":"worker-01"}},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{}}]}
--
I0210 11:14:48.806578       1 grpc.go:72] GRPC call: /csi.v1.Controller/ControllerGetCapabilities requests {}
I0210 11:14:48.806632       1 grpc.go:81] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":4}}}]}
I0210 11:14:50.358995       1 grpc.go:72] GRPC call: /csi.v1.Controller/CreateVolume requests {"accessibility_requirements":{"preferred":[{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}}],"requisite":[{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}}]},"capacity_range":{"required_bytes":1073741824},"name":"pvc-38ed4cf5-7c1b-4c31-9e19-b98e8dab89e1","parameters":{"csi.storage.k8s.io/pv/name":"pvc-38ed4cf5-7c1b-4c31-9e19-b98e8dab89e1","csi.storage.k8s.io/pvc/name":"rook-ceph-backup-pv-pvc-4-7b5gr","csi.storage.k8s.io/pvc/namespace":"velero","storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}}],"volume_content_source":{"Type":{"Snapshot":{"snapshot_id":"pvc-de77d60a-d446-4486-8b08-a57af771f677@snapshot-1717e107-f7dd-49eb-80cb-73411577ac80"}}}}
E0210 11:14:50.362528       1 grpc.go:79] GRPC error: rpc error: code = Unimplemented desc = 
I0210 11:14:50.491318       1 grpc.go:72] GRPC call: /csi.v1.Controller/GetCapacity requests {"accessible_topology":{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{}}]}
I0210 11:14:50.491469       1 grpc.go:81] GRPC response: {"available_capacity":395120214016}
I0210 11:14:50.680091       1 grpc.go:72] GRPC call: /csi.v1.Controller/GetCapacity requests {"accessible_topology":{"segments":{"kubernetes.io/hostname":"worker-01","openebs.io/nodename":"worker-01"}},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{}}]}


I0211 03:05:04.030231       1 controller.go:1359] provision "default/www-web-2" class "openebs-lvmpv": started
I0211 03:05:04.030327       1 connection.go:193] GRPC call: /csi.v1.Controller/CreateVolume
I0211 03:05:04.030335       1 connection.go:194] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}}],"requisite":[{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}}]},"capacity_range":{"required_bytes":10485760},"name":"pvc-fc01f1b4-3b46-4809-8fd9-aaf0ff61b874","parameters":{"csi.storage.k8s.io/pv/name":"pvc-fc01f1b4-3b46-4809-8fd9-aaf0ff61b874","csi.storage.k8s.io/pvc/name":"www-web-2","csi.storage.k8s.io/pvc/namespace":"default","storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}}]}
I0211 03:05:04.030849       1 event.go:298] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"www-web-2", UID:"fc01f1b4-3b46-4809-8fd9-aaf0ff61b874", APIVersion:"v1", ResourceVersion:"440906", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/www-web-2"
I0211 03:05:05.816034       1 connection.go:200] GRPC response: {"volume":{"accessible_topology":[{"segments":{"openebs.io/nodename":"master-01"}}],"capacity_bytes":10485760,"volume_context":{"openebs.io/cas-type":"localpv-lvm","openebs.io/volgroup":"openebs-lvm"},"volume_id":"pvc-fc01f1b4-3b46-4809-8fd9-aaf0ff61b874"}}
## Expected Behavior
<!-- Tell us what should happen -->

## Current Behavior
<!-- Tell us what happens instead -->

## Possible Solution
<!-- Suggest a fix or reason for this bug -->

## Steps to Reproduce
<!-- Provide a link to a live example or steps to reproduce this bug -->

## Screenshots
<!-- Add screenshots of this bug -->

## Your Environment
<!-- Include as many relevant details about the environment you experienced the bug in -->
* `kubectl get nodes`:
* `kubectl get pods --all-namespaces`:
* `kubectl get services`:
* `kubectl get sc`:
* `kubectl get pv`:
* `kubectl get pvc`:
* OS (from `/etc/os-release`):
* Kernel (from `uname -a`):
* Install tools:
* Others:

[orville-wright]

moving this issue to LocalPV-LVM repo, which will be picked by my the new Mayastor structure when its activated (soon)... becasue LocalPV-LVM is being unified into Mayastor.

[amasolov]

Experiencing exactly the same problem.

[w3aman]

Experiencing exactly the same problem.

Can you please share any one of the node-agent logs from lvm-node daemonset pods?

[amasolov]

I0501 14:36:22.077234       1 lvm_util.go:522] created snapshot lvmvg/bce4ca07-0b26-42d0-bf61-fed6cb467db6 from pvc-337110de-ed58-4f6b-b484-51370aaec61a
I0501 14:36:22.088215       1 snapshot.go:267] Successfully synced 'openebs-system/snapshot-bce4ca07-0b26-42d0-bf61-fed6cb467db6'
I0501 14:36:35.644706       1 lvmnode.go:110] lvm node controller: node volume groups updated current=[{Name:lvmvg UUID:B76M19-s03N-1vcL-mQA6-0YB7-QVeA-bkYDLF Size:{i:{value:1000203091968 scale:0} d:{Dec:<nil>} s:953868Mi Format:BinarySI} Free:{i:{value:677006802944 scale:0} d:{Dec:<nil>} s:645644Mi Format:BinarySI} LVCount:4 PVCount:1 MaxLV:0 MaxPV:0 SnapCount:0 MissingPVCount:0 MetadataCount:1 MetadataUsedCount:1 MetadataFree:{i:{value:519168 scale:0} d:{Dec:<nil>} s:507Ki Format:BinarySI} MetadataSize:{i:{value:1044480 scale:0} d:{Dec:<nil>} s:1020Ki Format:BinarySI} Permission:0 AllocationPolicy:0}], required=[{Name:lvmvg UUID:B76M19-s03N-1vcL-mQA6-0YB7-QVeA-bkYDLF Size:{i:{value:1000203091968 scale:0} d:{Dec:<nil>} s: Format:BinarySI} Free:{i:{value:569632620544 scale:0} d:{Dec:<nil>} s: Format:BinarySI} LVCount:5 PVCount:1 MaxLV:0 MaxPV:0 SnapCount:1 MissingPVCount:0 MetadataCount:1 MetadataUsedCount:1 MetadataFree:{i:{value:518144 scale:0} d:{Dec:<nil>} s: Format:BinarySI} MetadataSize:{i:{value:1044480 scale:0} d:{Dec:<nil>} s: Format:BinarySI} Permission:0 AllocationPolicy:0}]
I0501 14:36:35.644778       1 lvmnode.go:120] lvm node controller: updating node object with &{TypeMeta:{Kind:LVMNode APIVersion:local.openebs.io/v1alpha1} ObjectMeta:{Name:ktmb1-g-srv-005.iot.home.alexeym.net GenerateName: Namespace:openebs-system SelfLink: UID:2e007c23-88cf-487d-9431-452892030a60 ResourceVersion:1700015 Generation:5 CreationTimestamp:2024-04-29 05:09:33 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[] Annotations:map[] OwnerReferences:[{APIVersion:v1 Kind:Node Name:ktmb1-g-srv-005.iot.home.alexeym.net UID:1bcfbcc3-ad06-4bb2-9679-5f5d2bdda0be Controller:0xc00017a810 BlockOwnerDeletion:<nil>}] Finalizers:[] ManagedFields:[{Manager:lvm-driver Operation:Update APIVersion:local.openebs.io/v1alpha1 Time:2024-05-01 13:30:35 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:ownerReferences":{".":{},"k:{\"uid\":\"1bcfbcc3-ad06-4bb2-9679-5f5d2bdda0be\"}":{}}},"f:volumeGroups":{}} Subresource:}]} VolumeGroups:[{Name:lvmvg UUID:B76M19-s03N-1vcL-mQA6-0YB7-QVeA-bkYDLF Size:{i:{value:1000203091968 scale:0} d:{Dec:<nil>} s: Format:BinarySI} Free:{i:{value:569632620544 scale:0} d:{Dec:<nil>} s: Format:BinarySI} LVCount:5 PVCount:1 MaxLV:0 MaxPV:0 SnapCount:1 MissingPVCount:0 MetadataCount:1 MetadataUsedCount:1 MetadataFree:{i:{value:518144 scale:0} d:{Dec:<nil>} s: Format:BinarySI} MetadataSize:{i:{value:1044480 scale:0} d:{Dec:<nil>} s: Format:BinarySI} Permission:0 AllocationPolicy:0}]}
I0501 14:36:35.656589       1 lvmnode.go:124] lvm node controller: updated node object openebs-system/ktmb1-g-srv-005.iot.home.alexeym.net
I0501 14:36:35.656624       1 lvmnode.go:306] Successfully synced 'openebs-system/ktmb1-g-srv-005.iot.home.alexeym.net'
I0501 14:36:35.656822       1 lvmnode.go:165] Got update event for lvm node openebs-system/ktmb1-g-srv-005.iot.home.alexeym.net
I0501 14:36:35.784698       1 lvmnode.go:306] Successfully synced 'openebs-system/ktmb1-g-srv-005.iot.home.alexeym.net'
I0501 14:37:16.256841       1 lvmnode.go:306] Successfully synced 'openebs-system/ktmb1-g-srv-004.iot.home.alexeym.net'
I0501 14:37:35.632538       1 lvmnode.go:306] Successfully synced 'openebs-system/ktmb1-g-srv-005.iot.home.alexeym.net'
I0501 14:38:16.265125       1 lvmnode.go:306] Successfully synced 'openebs-system/ktmb1-g-srv-004.iot.home.alexeym.net'
I0501 14:38:35.640765       1 lvmnode.go:306] Successfully synced 'openebs-system/ktmb1-g-srv-005.iot.home.alexeym.net'
I0501 14:39:16.294034       1 lvmnode.go:306] Successfully synced 'openebs-system/ktmb1-g-srv-004.iot.home.alexeym.net'
I0501 14:39:33.432159       1 lvmnode.go:165] Got update event for lvm node openebs-system/ktmb1-g-srv-005.iot.home.alexeym.net
I0501 14:39:33.560451       1 lvmnode.go:306] Successfully synced 'openebs-system/ktmb1-g-srv-005.iot.home.alexeym.net'
I0501 14:39:35.608849       1 lvmnode.go:306] Successfully synced 'openebs-system/ktmb1-g-srv-005.iot.home.alexeym.net'
I0501 14:40:14.269000       1 lvmnode.go:165] Got update event for lvm node openebs-system/ktmb1-g-srv-004.iot.home.alexeym.net
I0501 14:40:14.428713       1 lvmnode.go:306] Successfully synced 'openebs-system/ktmb1-g-srv-004.iot.home.alexeym.net'

[w3aman]

@13567436138 From the PVC describe I can see that, cloning out of a snapshot is being performed. This is not supported in lvm-localpv as of today. For more options, you can follow this thread on our slack channel -- https://kubernetes.slack.com/archives/CUAKPFU78/p1714627792264429

[abhilashshetty04]

Hi @amasolov , @13567436138 , As @w3aman mentioned. Pvc had volume snapshot as datasource.

Warning ProvisioningFailed 38s local.csi.openebs.io_openebs-lvm-controller-0_24a6e4e0-6bde-4212-b01f-8cabaf937638 failed to provision volume with StorageClass "openebs-lvmpv": error getting handle for DataSource Type VolumeSnapshot by Name rook-ceph-backup-pv-pvc-4-mc7sz: snapshot rook-ceph-backup-pv-pvc-4-mc7sz is not Ready

Its an unimplemented feature yet. However, i see snapshot was not Ready. Is dm-snapshot module loaded in lvm node machines?

[dsharma-dc]

As mentioned, using a snapshot as volume creation source is not yet supported and will be taken up when #13 and #175 come into the product roadmap scope.
Closing this issue and the enhancement will be tracked against linked ones. Please let us know if any questions around it.