Skip to content

Instantly share code, notes, and snippets.

@stevesloka

stevesloka/mount volumes

Created November 3, 2016 15:17
Show Gist options
  • Save stevesloka/633848635fea4dbbce0eb12b1075de72 to your computer and use it in GitHub Desktop.
Save stevesloka/633848635fea4dbbce0eb12b1075de72 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
mount volumes
Nov 03 15:12:25 ip-10-0-70-22.ec2.internal kubelet-wrapper[26385]: E1103 15:12:25.666697 26385 kubelet.go:1813] Unable to mount volumes for pod "es-master02-4258059340-gsy7q_steve(a59dc63e-a1d7-11e6-80f0-12eeb6a0f22c)": timeout expired waiting for volumes to attach/mount for pod "es-master02-4258059340-gsy7q"/"steve". list of unattached/unmounted volumes=[storage]; skipping pod
Nov 03 15:12:25 ip-10-0-70-22.ec2.internal kubelet-wrapper[26385]: E1103 15:12:25.666736 26385 pod_workers.go:184] Error syncing pod a59dc63e-a1d7-11e6-80f0-12eeb6a0f22c, skipping: timeout expired waiting for volumes to attach/mount for pod "es-master02-4258059340-gsy7q"/"steve". list of unattached/unmounted volumes=[storage]
Nov 03 15:12:32 ip-10-0-70-22.ec2.internal kubelet-wrapper[26385]: I1103 15:12:32.598588 26385 reconciler.go:229] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/aws-ebs/aws://us-east-1b/vol-e433bf30" (spec.Name: "pvc-a494d9f4-a1d7-11e6-80f0-12eeb6a0f22c") pod "a4f236e7-a1d7-11e6-80f0-12eeb6a0f22c" (UID: "a4f236e7-a1d7-11e6-80f0-12eeb6a0f22c")
Nov 03 15:12:32 ip-10-0-70-22.ec2.internal kubelet-wrapper[26385]: E1103 15:12:32.601260 26385 nestedpendingoperations.go:253] Operation for "\"kubernetes.io/aws-ebs/aws://us-east-1b/vol-e433bf30\"" failed. No retries permitted until 2016-11-03 15:14:32.601235488 +0000 UTC (durationBeforeRetry 2m0s). Error: Volume "kubernetes.io/aws-ebs/aws://us-east-1b/vol-e433bf30" (spec.Name: "pvc-a494d9f4-a1d7-11e6-80f0-12eeb6a0f22c") pod "a4f236e7-a1d7-11e6-80f0-12eeb6a0f22c" (UID: "a4f236e7-a1d7-11e6-80f0-12eeb6a0f22c") is not yet attached according to node status.
Nov 03 15:12:32 ip-10-0-70-22.ec2.internal kubelet-wrapper[26385]: I1103 15:12:32.899474 26385 reconciler.go:229] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/aws-ebs/aws://us-east-1b/vol-1132bec5" (spec.Name: "pvc-a512efb1-a1d7-11e6-80f0-12eeb6a0f22c") pod "a539950d-a1d7-11e6-80f0-12eeb6a0f22c" (UID: "a539950d-a1d7-11e6-80f0-12eeb6a0f22c")
Nov 03 15:12:32 ip-10-0-70-22.ec2.internal kubelet-wrapper[26385]: E1103 15:12:32.901908 26385 nestedpendingoperations.go:253] Operation for "\"kubernetes.io/aws-ebs/aws://us-east-1b/vol-1132bec5\"" failed. No retries permitted until 2016-11-03 15:14:32.901890069 +0000 UTC (durationBeforeRetry 2m0s). Error: Volume "kubernetes.io/aws-ebs/aws://us-east-1b/vol-1132bec5" (spec.Name: "pvc-a512efb1-a1d7-11e6-80f0-12eeb6a0f22c") pod "a539950d-a1d7-11e6-80f0-12eeb6a0f22c" (UID: "a539950d-a1d7-11e6-80f0-12eeb6a0f22c") is not yet attached according to node status.
Nov 03 15:12:33 ip-10-0-70-22.ec2.internal kubelet-wrapper[26385]: I1103 15:12:33.601563 26385 reconciler.go:229] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/aws-ebs/aws://us-east-1b/vol-4832be9c" (spec.Name: "pvc-a57fb229-a1d7-11e6-80f0-12eeb6a0f22c") pod "a59dc63e-a1d7-11e6-80f0-12eeb6a0f22c" (UID: "a59dc63e-a1d7-11e6-80f0-12eeb6a0f22c")
Nov 03 15:12:33 ip-10-0-70-22.ec2.internal kubelet-wrapper[26385]: E1103 15:12:33.603703 26385 nestedpendingoperations.go:253] Operation for "\"kubernetes.io/aws-ebs/aws://us-east-1b/vol-4832be9c\"" failed. No retries permitted until 2016-11-03 15:14:33.603684185 +0000 UTC (durationBeforeRetry 2m0s). Error: Volume "kubernetes.io/aws-ebs/aws://us-east-1b/vol-4832be9c" (spec.Name: "pvc-a57fb229-a1d7-11e6-80f0-12eeb6a0f22c") pod "a59dc63e-a1d7-11e6-80f0-12eeb6a0f22c" (UID: "a59dc63e-a1d7-11e6-80f0-12eeb6a0f22c") is not yet attached according to node status.
Nov 03 15:12:37 ip-10-0-70-22.ec2.internal kubelet-wrapper[26385]: I1103 15:12:37.114425 26385 operation_executor.go:803] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/a4f236e7-a1d7-11e6-80f0-12eeb6a0f22c-default-token-wrjyn" (spec.Name: "default-token-wrjyn") pod "a4f236e7-a1d7-11e6-80f0-12eeb6a0f22c" (UID: "a4f236e7-a1d7-11e6-80f0-12eeb6a0f22c").
Nov 03 15:12:38 ip-10-0-70-22.ec2.internal kubelet-wrapper[26385]: I1103 15:12:38.117375 26385 operation_executor.go:803] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/a59dc63e-a1d7-11e6-80f0-12eeb6a0f22c-default-token-wrjyn" (spec.Name: "default-token-wrjyn") pod "a59dc63e-a1d7-11e6-80f0-12eeb6a0f22c" (UID: "a59dc63e-a1d7-11e6-80f0-12eeb6a0f22c").
Nov 03 15:12:39 ip-10-0-70-22.ec2.internal kubelet-wrapper[26385]: I1103 15:12:39.120762 26385 operation_executor.go:803] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/a539950d-a1d7-11e6-80f0-12eeb6a0f22c-default-token-wrjyn" (spec.Name: "default-token-wrjyn") pod "a539950d-a1d7-11e6-80f0-12eeb6a0f22c" (UID: "a539950d-a1d7-11e6-80f0-12eeb6a0f22c").
---
Nov 03 15:16:57 ip-10-0-70-202.ec2.internal kubelet-wrapper[1175]: I1103 15:16:57.211215 1175 reconciler.go:188] UnmountVolume operation started for volume "kubernetes.io/aws-ebs/aws://us-east-1b/vol-1732bec3" (spec.Name: "storage") from pod "16ad1b43-a1d8-11e6-80f0-12eeb6a0f22c" (UID: "16ad1b43-a1d8-11e6-80f0-12eeb6a0f22c").
Nov 03 15:16:57 ip-10-0-70-202.ec2.internal kubelet-wrapper[1175]: E1103 15:16:57.211368 1175 nestedpendingoperations.go:253] Operation for "\"kubernetes.io/aws-ebs/aws://us-east-1b/vol-1732bec3\" (\"16ad1b43-a1d8-11e6-80f0-12eeb6a0f22c\")" failed. No retries permitted until 2016-11-03 15:17:01.211346558 +0000 UTC (durationBeforeRetry 4s). Error: UnmountVolume.TearDown failed for volume "kubernetes.io/aws-ebs/aws://us-east-1b/vol-1732bec3" (volume.spec.Name: "storage") pod "16ad1b43-a1d8-11e6-80f0-12eeb6a0f22c" (UID: "16ad1b43-a1d8-11e6-80f0-12eeb6a0f22c") with: stat /var/lib/kubelet/pods/16ad1b43-a1d8-11e6-80f0-12eeb6a0f22c/volumes/kubernetes.io~aws-ebs/pvc-a43750ce-a1d7-11e6-80f0-12eeb6a0f22c: no such file or directory
Nov 03 15:16:59 ip-10-0-70-202.ec2.internal kubelet-wrapper[1175]: I1103 15:16:59.821987 1175 operation_executor.go:803] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/a4928730-a1d7-11e6-80f0-12eeb6a0f22c-default-token-wrjyn" (spec.Name: "default-token-wrjyn") pod "a4928730-a1d7-11e6-80f0-12eeb6a0f22c" (UID: "a4928730-a1d7-11e6-80f0-12eeb6a0f22c").
Nov 03 15:17:01 ip-10-0-70-202.ec2.internal kubelet-wrapper[1175]: I1103 15:17:01.223465 1175 reconciler.go:188] UnmountVolume operation started for volume "kubernetes.io/aws-ebs/aws://us-east-1b/vol-1732bec3" (spec.Name: "storage") from pod "16ad1b43-a1d8-11e6-80f0-12eeb6a0f22c" (UID: "16ad1b43-a1d8-11e6-80f0-12eeb6a0f22c").
Nov 03 15:17:01 ip-10-0-70-202.ec2.internal kubelet-wrapper[1175]: E1103 15:17:01.223669 1175 nestedpendingoperations.go:253] Operation for "\"kubernetes.io/aws-ebs/aws://us-east-1b/vol-1732bec3\" (\"16ad1b43-a1d8-11e6-80f0-12eeb6a0f22c\")" failed. No retries permitted until 2016-11-03 15:17:09.223650367 +0000 UTC (durationBeforeRetry 8s). Error: UnmountVolume.TearDown failed for volume "kubernetes.io/aws-ebs/aws://us-east-1b/vol-1732bec3" (volume.spec.Name: "storage") pod "16ad1b43-a1d8-11e6-80f0-12eeb6a0f22c" (UID: "16ad1b43-a1d8-11e6-80f0-12eeb6a0f22c") with: stat /var/lib/kubelet/pods/16ad1b43-a1d8-11e6-80f0-12eeb6a0f22c/volumes/kubernetes.io~aws-ebs/pvc-a43750ce-a1d7-11e6-80f0-12eeb6a0f22c: no such file or directory
Nov 03 15:17:09 ip-10-0-70-202.ec2.internal kubelet-wrapper[1175]: I1103 15:17:09.247685 1175 reconciler.go:188] UnmountVolume operation started for volume "kubernetes.io/aws-ebs/aws://us-east-1b/vol-1732bec3" (spec.Name: "storage") from pod "16ad1b43-a1d8-11e6-80f0-12eeb6a0f22c" (UID: "16ad1b43-a1d8-11e6-80f0-12eeb6a0f22c").
Nov 03 15:17:09 ip-10-0-70-202.ec2.internal kubelet-wrapper[1175]: E1103 15:17:09.247854 1175 nestedpendingoperations.go:253] Operation for "\"kubernetes.io/aws-ebs/aws://us-east-1b/vol-1732bec3\" (\"16ad1b43-a1d8-11e6-80f0-12eeb6a0f22c\")" failed. No retries permitted until 2016-11-03 15:17:25.24783355 +0000 UTC (durationBeforeRetry 16s). Error: UnmountVolume.TearDown failed for volume "kubernetes.io/aws-ebs/aws://us-east-1b/vol-1732bec3" (volume.spec.Name: "storage") pod "16ad1b43-a1d8-11e6-80f0-12eeb6a0f22c" (UID: "16ad1b43-a1d8-11e6-80f0-12eeb6a0f22c") with: stat /var/lib/kubelet/pods/16ad1b43-a1d8-11e6-80f0-12eeb6a0f22c/volumes/kubernetes.io~aws-ebs/pvc-a43750ce-a1d7-11e6-80f0-12eeb6a0f22c: no such file or directory
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment