Created
February 9, 2021 18:40
-
-
Save billimek/064f85c0d5f83e85ab2feb7c7bcbf9a7 to your computer and use it in GitHub Desktop.
k3s service log for #2425
This file has been truncated, but you can view the full file.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| -- Logs begin at Sun 2020-11-15 21:10:02 UTC, end at Tue 2021-02-09 18:36:30 UTC. -- | |
| Feb 09 17:00:28 k3s-0 k3s[2906]: I0209 17:00:28.840629 2906 request.go:645] Throttling request took 1.047559041s, request: GET:https://127.0.0.1:6444/apis/notification.toolkit.fluxcd.io/v1beta1?timeout=32s | |
| Feb 09 17:00:56 k3s-0 k3s[2906]: time="2021-02-09T17:00:56.318721786Z" level=info msg="Cluster-Http-Server 2021/02/09 17:00:56 http: TLS handshake error from 10.2.0.34:45035: EOF" | |
| Feb 09 17:00:56 k3s-0 k3s[2906]: time="2021-02-09T17:00:56.333205537Z" level=info msg="Cluster-Http-Server 2021/02/09 17:00:56 http: TLS handshake error from 10.2.0.34:35807: EOF" | |
| Feb 09 17:00:56 k3s-0 k3s[2906]: time="2021-02-09T17:00:56.334394038Z" level=info msg="Cluster-Http-Server 2021/02/09 17:00:56 http: TLS handshake error from 10.2.0.34:12159: EOF" | |
| Feb 09 17:01:00 k3s-0 k3s[2906]: I0209 17:01:00.491998 2906 request.go:645] Throttling request took 1.044775242s, request: GET:https://127.0.0.1:6444/apis/velero.io/v1?timeout=32s | |
| Feb 09 17:01:26 k3s-0 k3s[2906]: I0209 17:01:26.050636 2906 trace.go:205] Trace[1479602766]: "GuaranteedUpdate etcd3" type:*apiextensions.CustomResourceDefinition (09-Feb-2021 17:01:25.535) (total time: 515ms): | |
| Feb 09 17:01:26 k3s-0 k3s[2906]: Trace[1479602766]: [515.20638ms] [515.20638ms] END | |
| Feb 09 17:01:26 k3s-0 k3s[2906]: I0209 17:01:26.082366 2906 trace.go:205] Trace[1983004475]: "Patch" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/issuers.cert-manager.io,user-agent:kubectl/v1.20.2 (linux/amd64) kubernetes/faecb19,client:10.2.0.34 (09-Feb-2021 17:01:25.534) (total time: 548ms): | |
| Feb 09 17:01:26 k3s-0 k3s[2906]: Trace[1983004475]: ---"About to check admission control" 183ms (17:01:00.727) | |
| Feb 09 17:01:26 k3s-0 k3s[2906]: Trace[1983004475]: ---"Object stored in database" 323ms (17:01:00.050) | |
| Feb 09 17:01:26 k3s-0 k3s[2906]: Trace[1983004475]: [548.235956ms] [548.235956ms] END | |
| Feb 09 17:01:32 k3s-0 k3s[2906]: I0209 17:01:32.143836 2906 request.go:645] Throttling request took 1.045406814s, request: GET:https://127.0.0.1:6444/apis/kustomize.toolkit.fluxcd.io/v1beta1?timeout=32s | |
| Feb 09 17:02:03 k3s-0 k3s[2906]: I0209 17:02:03.799395 2906 request.go:645] Throttling request took 1.031470208s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:02:35 k3s-0 k3s[2906]: I0209 17:02:35.451057 2906 request.go:645] Throttling request took 1.042948031s, request: GET:https://127.0.0.1:6444/apis/ricoberger.de/v1alpha1?timeout=32s | |
| Feb 09 17:03:07 k3s-0 k3s[2906]: I0209 17:03:07.106770 2906 request.go:645] Throttling request took 1.044733822s, request: GET:https://127.0.0.1:6444/apis/source.toolkit.fluxcd.io/v1beta1?timeout=32s | |
| Feb 09 17:03:38 k3s-0 k3s[2906]: I0209 17:03:38.010910 2906 trace.go:205] Trace[1845600437]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.157 (09-Feb-2021 17:03:37.248) (total time: 762ms): | |
| Feb 09 17:03:38 k3s-0 k3s[2906]: Trace[1845600437]: ---"Writing http response done" count:10 657ms (17:03:00.010) | |
| Feb 09 17:03:38 k3s-0 k3s[2906]: Trace[1845600437]: [762.175758ms] [762.175758ms] END | |
| Feb 09 17:03:38 k3s-0 k3s[2906]: I0209 17:03:38.760797 2906 request.go:645] Throttling request took 1.04207448s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:04:10 k3s-0 k3s[2906]: I0209 17:04:10.413097 2906 request.go:645] Throttling request took 1.041147944s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:04:36 k3s-0 k3s[2906]: I0209 17:04:36.564042 2906 event.go:291] "Event occurred" object="flux-system/source-controller-65f5b6cb7c" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: source-controller-65f5b6cb7c-k5j46" | |
| Feb 09 17:04:42 k3s-0 k3s[2906]: I0209 17:04:42.067529 2906 request.go:645] Throttling request took 1.043037963s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:04:58 k3s-0 k3s[2906]: I0209 17:04:58.071322 2906 trace.go:205] Trace[667697716]: "List" url:/api/v1/secrets,user-agent:source-controller/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,client:10.2.0.38 (09-Feb-2021 17:04:56.688) (total time: 1382ms): | |
| Feb 09 17:04:58 k3s-0 k3s[2906]: Trace[667697716]: ---"Writing http response done" count:508 1381ms (17:04:00.071) | |
| Feb 09 17:04:58 k3s-0 k3s[2906]: Trace[667697716]: [1.382255579s] [1.382255579s] END | |
| Feb 09 17:05:13 k3s-0 k3s[2906]: I0209 17:05:13.718302 2906 request.go:645] Throttling request took 1.045728632s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:05:45 k3s-0 k3s[2906]: I0209 17:05:45.370477 2906 request.go:645] Throttling request took 1.046343203s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:06:17 k3s-0 k3s[2906]: I0209 17:06:17.023561 2906 request.go:645] Throttling request took 1.042266998s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:06:48 k3s-0 k3s[2906]: I0209 17:06:48.674950 2906 request.go:645] Throttling request took 1.04555492s, request: GET:https://127.0.0.1:6444/apis/snapshot.storage.k8s.io/v1beta1?timeout=32s | |
| Feb 09 17:07:20 k3s-0 k3s[2906]: I0209 17:07:20.327146 2906 request.go:645] Throttling request took 1.045524194s, request: GET:https://127.0.0.1:6444/apis/cert-manager.io/v1beta1?timeout=32s | |
| Feb 09 17:07:51 k3s-0 k3s[2906]: I0209 17:07:51.979276 2906 request.go:645] Throttling request took 1.044969293s, request: GET:https://127.0.0.1:6444/apis/storage.k8s.io/v1?timeout=32s | |
| Feb 09 17:08:23 k3s-0 k3s[2906]: I0209 17:08:23.630769 2906 request.go:645] Throttling request took 1.046163059s, request: GET:https://127.0.0.1:6444/apis/velero.io/v1?timeout=32s | |
| Feb 09 17:08:39 k3s-0 k3s[2906]: I0209 17:08:39.947661 2906 trace.go:205] Trace[552783588]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.157 (09-Feb-2021 17:08:39.194) (total time: 753ms): | |
| Feb 09 17:08:39 k3s-0 k3s[2906]: Trace[552783588]: ---"Writing http response done" count:10 644ms (17:08:00.947) | |
| Feb 09 17:08:39 k3s-0 k3s[2906]: Trace[552783588]: [753.213269ms] [753.213269ms] END | |
| Feb 09 17:08:55 k3s-0 k3s[2906]: I0209 17:08:55.282739 2906 request.go:645] Throttling request took 1.044354163s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:09:26 k3s-0 k3s[2906]: I0209 17:09:26.934593 2906 request.go:645] Throttling request took 1.045482135s, request: GET:https://127.0.0.1:6444/apis/rook.io/v1alpha2?timeout=32s | |
| Feb 09 17:09:27 k3s-0 k3s[2906]: I0209 17:09:27.967137 2906 trace.go:205] Trace[1655532123]: "GuaranteedUpdate etcd3" type:*apiextensions.CustomResourceDefinition (09-Feb-2021 17:09:27.313) (total time: 653ms): | |
| Feb 09 17:09:27 k3s-0 k3s[2906]: Trace[1655532123]: [653.221072ms] [653.221072ms] END | |
| Feb 09 17:09:28 k3s-0 k3s[2906]: I0209 17:09:28.001104 2906 trace.go:205] Trace[1044977760]: "Patch" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/issuers.cert-manager.io,user-agent:kubectl/v1.20.2 (linux/amd64) kubernetes/faecb19,client:10.2.0.34 (09-Feb-2021 17:09:27.311) (total time: 689ms): | |
| Feb 09 17:09:28 k3s-0 k3s[2906]: Trace[1044977760]: ---"About to check admission control" 431ms (17:09:00.759) | |
| Feb 09 17:09:28 k3s-0 k3s[2906]: Trace[1044977760]: ---"Object stored in database" 207ms (17:09:00.967) | |
| Feb 09 17:09:28 k3s-0 k3s[2906]: Trace[1044977760]: [689.297619ms] [689.297619ms] END | |
| Feb 09 17:09:58 k3s-0 k3s[2906]: I0209 17:09:58.628726 2906 request.go:645] Throttling request took 1.046534179s, request: GET:https://127.0.0.1:6444/apis/networking.k8s.io/v1?timeout=32s | |
| Feb 09 17:10:26 k3s-0 k3s[2906]: I0209 17:10:26.109142 2906 trace.go:205] Trace[742294286]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.157 (09-Feb-2021 17:10:25.606) (total time: 502ms): | |
| Feb 09 17:10:26 k3s-0 k3s[2906]: Trace[742294286]: ---"Listing from storage done" 236ms (17:10:00.842) | |
| Feb 09 17:10:26 k3s-0 k3s[2906]: Trace[742294286]: ---"Writing http response done" count:8 266ms (17:10:00.109) | |
| Feb 09 17:10:26 k3s-0 k3s[2906]: Trace[742294286]: [502.806204ms] [502.806204ms] END | |
| Feb 09 17:10:26 k3s-0 k3s[2906]: I0209 17:10:26.167836 2906 trace.go:205] Trace[1590642933]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.157 (09-Feb-2021 17:10:25.649) (total time: 517ms): | |
| Feb 09 17:10:26 k3s-0 k3s[2906]: Trace[1590642933]: ---"Listing from storage done" 477ms (17:10:00.127) | |
| Feb 09 17:10:26 k3s-0 k3s[2906]: Trace[1590642933]: [517.828877ms] [517.828877ms] END | |
| Feb 09 17:10:26 k3s-0 k3s[2906]: I0209 17:10:26.253522 2906 trace.go:205] Trace[1335113149]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.157 (09-Feb-2021 17:10:25.750) (total time: 503ms): | |
| Feb 09 17:10:26 k3s-0 k3s[2906]: Trace[1335113149]: ---"Listing from storage done" 413ms (17:10:00.164) | |
| Feb 09 17:10:26 k3s-0 k3s[2906]: Trace[1335113149]: [503.030588ms] [503.030588ms] END | |
| Feb 09 17:10:30 k3s-0 k3s[2906]: I0209 17:10:30.280714 2906 request.go:645] Throttling request took 1.046548755s, request: GET:https://127.0.0.1:6444/apis/upgrade.cattle.io/v1?timeout=32s | |
| Feb 09 17:11:01 k3s-0 k3s[2906]: I0209 17:11:01.932962 2906 request.go:645] Throttling request took 1.045282537s, request: GET:https://127.0.0.1:6444/apis/notification.toolkit.fluxcd.io/v1beta1?timeout=32s | |
| Feb 09 17:11:33 k3s-0 k3s[2906]: I0209 17:11:33.588127 2906 request.go:645] Throttling request took 1.046557676s, request: GET:https://127.0.0.1:6444/apis/rbac.authorization.k8s.io/v1?timeout=32s | |
| Feb 09 17:12:05 k3s-0 k3s[2906]: I0209 17:12:05.240415 2906 request.go:645] Throttling request took 1.046001458s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:12:36 k3s-0 k3s[2906]: I0209 17:12:36.892358 2906 request.go:645] Throttling request took 1.044853205s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:13:08 k3s-0 k3s[2906]: I0209 17:13:08.544361 2906 request.go:645] Throttling request took 1.045871674s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:13:40 k3s-0 k3s[2906]: I0209 17:13:40.196261 2906 request.go:645] Throttling request took 1.044962014s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:13:41 k3s-0 k3s[2906]: I0209 17:13:41.802059 2906 trace.go:205] Trace[812373173]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.157 (09-Feb-2021 17:13:41.105) (total time: 696ms): | |
| Feb 09 17:13:41 k3s-0 k3s[2906]: Trace[812373173]: ---"Writing http response done" count:10 605ms (17:13:00.801) | |
| Feb 09 17:13:41 k3s-0 k3s[2906]: Trace[812373173]: [696.837859ms] [696.837859ms] END | |
| Feb 09 17:14:11 k3s-0 k3s[2906]: I0209 17:14:11.856570 2906 request.go:645] Throttling request took 1.045420995s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:14:43 k3s-0 k3s[2906]: I0209 17:14:43.508834 2906 request.go:645] Throttling request took 1.046696929s, request: GET:https://127.0.0.1:6444/apis/source.toolkit.fluxcd.io/v1beta1?timeout=32s | |
| Feb 09 17:15:15 k3s-0 k3s[2906]: I0209 17:15:15.160886 2906 request.go:645] Throttling request took 1.04604193s, request: GET:https://127.0.0.1:6444/apis/ops.alexellis.io/v1?timeout=32s | |
| Feb 09 17:15:25 k3s-0 k3s[2906]: I0209 17:15:25.239869 2906 trace.go:205] Trace[472819647]: "List etcd3" key:/secrets/default,resourceVersion:,resourceVersionMatch:,limit:0,continue: (09-Feb-2021 17:15:24.691) (total time: 547ms): | |
| Feb 09 17:15:25 k3s-0 k3s[2906]: Trace[472819647]: [547.956985ms] [547.956985ms] END | |
| Feb 09 17:15:25 k3s-0 k3s[2906]: I0209 17:15:25.242638 2906 trace.go:205] Trace[180250970]: "List etcd3" key:/secrets/default,resourceVersion:,resourceVersionMatch:,limit:0,continue: (09-Feb-2021 17:15:24.727) (total time: 515ms): | |
| Feb 09 17:15:25 k3s-0 k3s[2906]: Trace[180250970]: [515.050723ms] [515.050723ms] END | |
| Feb 09 17:15:25 k3s-0 k3s[2906]: I0209 17:15:25.245292 2906 trace.go:205] Trace[1998641940]: "List" url:/api/v1/namespaces/default/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.157 (09-Feb-2021 17:15:24.727) (total time: 517ms): | |
| Feb 09 17:15:25 k3s-0 k3s[2906]: Trace[1998641940]: ---"Listing from storage done" 515ms (17:15:00.243) | |
| Feb 09 17:15:25 k3s-0 k3s[2906]: Trace[1998641940]: [517.746481ms] [517.746481ms] END | |
| Feb 09 17:15:25 k3s-0 k3s[2906]: I0209 17:15:25.259819 2906 trace.go:205] Trace[467190417]: "List" url:/api/v1/namespaces/default/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.157 (09-Feb-2021 17:15:24.691) (total time: 567ms): | |
| Feb 09 17:15:25 k3s-0 k3s[2906]: Trace[467190417]: ---"Listing from storage done" 548ms (17:15:00.239) | |
| Feb 09 17:15:25 k3s-0 k3s[2906]: Trace[467190417]: [567.951975ms] [567.951975ms] END | |
| Feb 09 17:15:26 k3s-0 k3s[2906]: I0209 17:15:26.996254 2906 trace.go:205] Trace[377465302]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.157 (09-Feb-2021 17:15:26.354) (total time: 641ms): | |
| Feb 09 17:15:26 k3s-0 k3s[2906]: Trace[377465302]: ---"Listing from storage done" 492ms (17:15:00.847) | |
| Feb 09 17:15:26 k3s-0 k3s[2906]: Trace[377465302]: ---"Writing http response done" count:10 148ms (17:15:00.996) | |
| Feb 09 17:15:26 k3s-0 k3s[2906]: Trace[377465302]: [641.707716ms] [641.707716ms] END | |
| Feb 09 17:15:46 k3s-0 k3s[2906]: I0209 17:15:46.813599 2906 request.go:645] Throttling request took 1.045938689s, request: GET:https://127.0.0.1:6444/apis/objectbucket.io/v1alpha1?timeout=32s | |
| Feb 09 17:16:18 k3s-0 k3s[2906]: I0209 17:16:18.465844 2906 request.go:645] Throttling request took 1.042222838s, request: GET:https://127.0.0.1:6444/apis/snapshot.storage.k8s.io/v1?timeout=32s | |
| Feb 09 17:16:50 k3s-0 k3s[2906]: I0209 17:16:50.118441 2906 request.go:645] Throttling request took 1.045456604s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:17:21 k3s-0 k3s[2906]: I0209 17:17:21.770682 2906 request.go:645] Throttling request took 1.042652184s, request: GET:https://127.0.0.1:6444/apis/snapshot.storage.k8s.io/v1beta1?timeout=32s | |
| Feb 09 17:17:53 k3s-0 k3s[2906]: I0209 17:17:53.422540 2906 request.go:645] Throttling request took 1.04441845s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:18:25 k3s-0 k3s[2906]: I0209 17:18:25.074384 2906 request.go:645] Throttling request took 1.045874871s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:18:43 k3s-0 k3s[2906]: I0209 17:18:43.840862 2906 trace.go:205] Trace[1909283551]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.157 (09-Feb-2021 17:18:43.044) (total time: 796ms): | |
| Feb 09 17:18:43 k3s-0 k3s[2906]: Trace[1909283551]: ---"Listing from storage done" 132ms (17:18:00.176) | |
| Feb 09 17:18:43 k3s-0 k3s[2906]: Trace[1909283551]: ---"Writing http response done" count:10 664ms (17:18:00.840) | |
| Feb 09 17:18:43 k3s-0 k3s[2906]: Trace[1909283551]: [796.635277ms] [796.635277ms] END | |
| Feb 09 17:18:56 k3s-0 k3s[2906]: I0209 17:18:56.726512 2906 request.go:645] Throttling request took 1.046563513s, request: GET:https://127.0.0.1:6444/apis/coordination.k8s.io/v1?timeout=32s | |
| Feb 09 17:19:21 k3s-0 k3s[2906]: I0209 17:19:21.560325 2906 trace.go:205] Trace[1105123893]: "Call conversion webhook" custom-resource-definition:certificates.cert-manager.io,desired-api-version:cert-manager.io/v1alpha2,object-count:1,UID:db8680e5-0491-4692-bbf0-10246bf3ab2c (09-Feb-2021 17:19:21.432) (total time: 127ms): | |
| Feb 09 17:19:21 k3s-0 k3s[2906]: Trace[1105123893]: ---"Request completed" 127ms (17:19:00.560) | |
| Feb 09 17:19:21 k3s-0 k3s[2906]: Trace[1105123893]: [127.339331ms] [127.339331ms] END | |
| Feb 09 17:19:26 k3s-0 k3s[2906]: I0209 17:19:26.178308 2906 trace.go:205] Trace[2080262185]: "Patch" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/challenges.acme.cert-manager.io,user-agent:kubectl/v1.20.2 (linux/amd64) kubernetes/faecb19,client:10.2.0.34 (09-Feb-2021 17:19:25.672) (total time: 506ms): | |
| Feb 09 17:19:26 k3s-0 k3s[2906]: Trace[2080262185]: ---"About to apply patch" 83ms (17:19:00.765) | |
| Feb 09 17:19:26 k3s-0 k3s[2906]: Trace[2080262185]: ---"About to check admission control" 302ms (17:19:00.067) | |
| Feb 09 17:19:26 k3s-0 k3s[2906]: Trace[2080262185]: [506.221605ms] [506.221605ms] END | |
| Feb 09 17:19:28 k3s-0 k3s[2906]: I0209 17:19:28.371825 2906 trace.go:205] Trace[1832248433]: "GuaranteedUpdate etcd3" type:*apiextensions.CustomResourceDefinition (09-Feb-2021 17:19:27.841) (total time: 530ms): | |
| Feb 09 17:19:28 k3s-0 k3s[2906]: Trace[1832248433]: ---"Transaction prepared" 440ms (17:19:00.332) | |
| Feb 09 17:19:28 k3s-0 k3s[2906]: Trace[1832248433]: [530.482832ms] [530.482832ms] END | |
| Feb 09 17:19:28 k3s-0 k3s[2906]: I0209 17:19:28.381200 2906 request.go:645] Throttling request took 1.048293078s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:19:28 k3s-0 k3s[2906]: I0209 17:19:28.405719 2906 trace.go:205] Trace[1379049484]: "Patch" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/prometheuses.monitoring.coreos.com,user-agent:kubectl/v1.20.2 (linux/amd64) kubernetes/faecb19,client:10.2.0.34 (09-Feb-2021 17:19:27.838) (total time: 567ms): | |
| Feb 09 17:19:28 k3s-0 k3s[2906]: Trace[1379049484]: ---"About to check admission control" 371ms (17:19:00.263) | |
| Feb 09 17:19:28 k3s-0 k3s[2906]: Trace[1379049484]: ---"Object stored in database" 109ms (17:19:00.373) | |
| Feb 09 17:19:28 k3s-0 k3s[2906]: Trace[1379049484]: [567.266645ms] [567.266645ms] END | |
| Feb 09 17:19:33 k3s-0 k3s[2906]: I0209 17:19:33.903593 2906 event.go:291] "Event occurred" object="default/unifi" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set unifi-5586bd94dd to 0" | |
| Feb 09 17:19:33 k3s-0 k3s[2906]: I0209 17:19:33.932944 2906 event.go:291] "Event occurred" object="default/unifi-5586bd94dd" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: unifi-5586bd94dd-xzk78" | |
| Feb 09 17:19:34 k3s-0 k3s[2906]: I0209 17:19:34.493239 2906 trace.go:205] Trace[1063585657]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:operator/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 17:19:32.889) (total time: 1603ms): | |
| Feb 09 17:19:34 k3s-0 k3s[2906]: Trace[1063585657]: ---"Listing from storage done" 129ms (17:19:00.019) | |
| Feb 09 17:19:34 k3s-0 k3s[2906]: Trace[1063585657]: ---"Writing http response done" count:80 1473ms (17:19:00.493) | |
| Feb 09 17:19:34 k3s-0 k3s[2906]: Trace[1063585657]: [1.603232398s] [1.603232398s] END | |
| Feb 09 17:19:37 k3s-0 k3s[2906]: I0209 17:19:37.023315 2906 trace.go:205] Trace[1519677237]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:operator/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 17:19:35.192) (total time: 1830ms): | |
| Feb 09 17:19:37 k3s-0 k3s[2906]: Trace[1519677237]: ---"Listing from storage done" 269ms (17:19:00.462) | |
| Feb 09 17:19:37 k3s-0 k3s[2906]: Trace[1519677237]: ---"Writing http response done" count:80 1561ms (17:19:00.023) | |
| Feb 09 17:19:37 k3s-0 k3s[2906]: Trace[1519677237]: [1.830849602s] [1.830849602s] END | |
| Feb 09 17:19:38 k3s-0 k3s[2906]: I0209 17:19:38.830649 2906 trace.go:205] Trace[1414354315]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:operator/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 17:19:37.605) (total time: 1224ms): | |
| Feb 09 17:19:38 k3s-0 k3s[2906]: Trace[1414354315]: ---"Listing from storage done" 175ms (17:19:00.781) | |
| Feb 09 17:19:38 k3s-0 k3s[2906]: Trace[1414354315]: ---"Writing http response done" count:80 1048ms (17:19:00.830) | |
| Feb 09 17:19:38 k3s-0 k3s[2906]: Trace[1414354315]: [1.22485857s] [1.22485857s] END | |
| Feb 09 17:19:46 k3s-0 k3s[2906]: I0209 17:19:46.703620 2906 event.go:291] "Event occurred" object="default/unifi" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set unifi-759f745699 to 1" | |
| Feb 09 17:19:46 k3s-0 k3s[2906]: I0209 17:19:46.723426 2906 event.go:291] "Event occurred" object="default/unifi-759f745699" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: unifi-759f745699-2w2x5" | |
| Feb 09 17:19:46 k3s-0 k3s[2906]: W0209 17:19:46.793262 2906 reconciler.go:315] Multi-Attach error for volume "pvc-68df14e9-7fcc-4cca-a591-ad44efddcd7b" (UniqueName: "kubernetes.io/csi/rook-ceph.rbd.csi.ceph.com^0001-0009-rook-ceph-0000000000000002-b2e91df0-27c8-11eb-b4af-b65a84c354e8") from node "k3s-d" Volume is already exclusively attached to node k3s-c and can't be attached to another | |
| Feb 09 17:19:46 k3s-0 k3s[2906]: I0209 17:19:46.793854 2906 event.go:291] "Event occurred" object="default/unifi-759f745699-2w2x5" kind="Pod" apiVersion="v1" type="Warning" reason="FailedAttachVolume" message="Multi-Attach error for volume \"pvc-68df14e9-7fcc-4cca-a591-ad44efddcd7b\" Volume is already exclusively attached to one node and can't be attached to another" | |
| Feb 09 17:19:50 k3s-0 k3s[2906]: I0209 17:19:50.125341 2906 reconciler.go:203] attacherDetacher.DetachVolume started for volume "pvc-68df14e9-7fcc-4cca-a591-ad44efddcd7b" (UniqueName: "kubernetes.io/csi/rook-ceph.rbd.csi.ceph.com^0001-0009-rook-ceph-0000000000000002-b2e91df0-27c8-11eb-b4af-b65a84c354e8") on node "k3s-c" | |
| Feb 09 17:19:50 k3s-0 k3s[2906]: I0209 17:19:50.140909 2906 operation_generator.go:1400] Verified volume is safe to detach for volume "pvc-68df14e9-7fcc-4cca-a591-ad44efddcd7b" (UniqueName: "kubernetes.io/csi/rook-ceph.rbd.csi.ceph.com^0001-0009-rook-ceph-0000000000000002-b2e91df0-27c8-11eb-b4af-b65a84c354e8") on node "k3s-c" | |
| Feb 09 17:19:50 k3s-0 k3s[2906]: I0209 17:19:50.156646 2906 operation_generator.go:472] DetachVolume.Detach succeeded for volume "pvc-68df14e9-7fcc-4cca-a591-ad44efddcd7b" (UniqueName: "kubernetes.io/csi/rook-ceph.rbd.csi.ceph.com^0001-0009-rook-ceph-0000000000000002-b2e91df0-27c8-11eb-b4af-b65a84c354e8") on node "k3s-c" | |
| Feb 09 17:19:50 k3s-0 k3s[2906]: I0209 17:19:50.229985 2906 reconciler.go:275] attacherDetacher.AttachVolume started for volume "pvc-68df14e9-7fcc-4cca-a591-ad44efddcd7b" (UniqueName: "kubernetes.io/csi/rook-ceph.rbd.csi.ceph.com^0001-0009-rook-ceph-0000000000000002-b2e91df0-27c8-11eb-b4af-b65a84c354e8") from node "k3s-d" | |
| Feb 09 17:19:50 k3s-0 k3s[2906]: I0209 17:19:50.264931 2906 operation_generator.go:361] AttachVolume.Attach succeeded for volume "pvc-68df14e9-7fcc-4cca-a591-ad44efddcd7b" (UniqueName: "kubernetes.io/csi/rook-ceph.rbd.csi.ceph.com^0001-0009-rook-ceph-0000000000000002-b2e91df0-27c8-11eb-b4af-b65a84c354e8") from node "k3s-d" | |
| Feb 09 17:19:50 k3s-0 k3s[2906]: I0209 17:19:50.265600 2906 event.go:291] "Event occurred" object="default/unifi-759f745699-2w2x5" kind="Pod" apiVersion="v1" type="Normal" reason="SuccessfulAttachVolume" message="AttachVolume.Attach succeeded for volume \"pvc-68df14e9-7fcc-4cca-a591-ad44efddcd7b\" " | |
| Feb 09 17:20:00 k3s-0 k3s[2906]: I0209 17:20:00.030751 2906 request.go:645] Throttling request took 1.045757975s, request: GET:https://127.0.0.1:6444/apis/velero.io/v1?timeout=32s | |
| Feb 09 17:20:21 k3s-0 k3s[2906]: time="2021-02-09T17:20:21.984655538Z" level=info msg="Cluster-Http-Server 2021/02/09 17:20:21 http: TLS handshake error from 10.2.0.34:21056: EOF" | |
| Feb 09 17:20:21 k3s-0 k3s[2906]: time="2021-02-09T17:20:21.984925730Z" level=info msg="Cluster-Http-Server 2021/02/09 17:20:21 http: TLS handshake error from 10.2.0.34:10024: EOF" | |
| Feb 09 17:20:21 k3s-0 k3s[2906]: time="2021-02-09T17:20:21.984991106Z" level=info msg="Cluster-Http-Server 2021/02/09 17:20:21 http: TLS handshake error from 10.2.0.34:39448: EOF" | |
| Feb 09 17:20:21 k3s-0 k3s[2906]: time="2021-02-09T17:20:21.986214877Z" level=info msg="Cluster-Http-Server 2021/02/09 17:20:21 http: TLS handshake error from 10.2.0.34:40184: EOF" | |
| Feb 09 17:20:31 k3s-0 k3s[2906]: I0209 17:20:31.702760 2906 request.go:645] Throttling request took 1.043245388s, request: GET:https://127.0.0.1:6444/apis/networking.k8s.io/v1beta1?timeout=32s | |
| Feb 09 17:21:03 k3s-0 k3s[2906]: I0209 17:21:03.354590 2906 request.go:645] Throttling request took 1.045707244s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:21:09 k3s-0 k3s[2906]: time="2021-02-09T17:21:09.631473385Z" level=error msg="Compact failed: failed to compact to revision 55454538: database is locked" | |
| Feb 09 17:21:35 k3s-0 k3s[2906]: I0209 17:21:35.005892 2906 request.go:645] Throttling request took 1.044538717s, request: GET:https://127.0.0.1:6444/apis/objectbucket.io/v1alpha1?timeout=32s | |
| Feb 09 17:22:06 k3s-0 k3s[2906]: I0209 17:22:06.657706 2906 request.go:645] Throttling request took 1.046572693s, request: GET:https://127.0.0.1:6444/apis/rbac.authorization.k8s.io/v1?timeout=32s | |
| Feb 09 17:22:38 k3s-0 k3s[2906]: I0209 17:22:38.309650 2906 request.go:645] Throttling request took 1.041928382s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:23:09 k3s-0 k3s[2906]: I0209 17:23:09.961886 2906 request.go:645] Throttling request took 1.04695865s, request: GET:https://127.0.0.1:6444/apis/rook.io/v1alpha2?timeout=32s | |
| Feb 09 17:23:35 k3s-0 k3s[2906]: I0209 17:23:35.078622 2906 trace.go:205] Trace[1687748028]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:operator/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 17:23:33.695) (total time: 1382ms): | |
| Feb 09 17:23:35 k3s-0 k3s[2906]: Trace[1687748028]: ---"Listing from storage done" 146ms (17:23:00.842) | |
| Feb 09 17:23:35 k3s-0 k3s[2906]: Trace[1687748028]: ---"Writing http response done" count:80 1236ms (17:23:00.078) | |
| Feb 09 17:23:35 k3s-0 k3s[2906]: Trace[1687748028]: [1.382806444s] [1.382806444s] END | |
| Feb 09 17:23:36 k3s-0 k3s[2906]: I0209 17:23:36.775458 2906 trace.go:205] Trace[148915160]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:operator/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 17:23:35.504) (total time: 1270ms): | |
| Feb 09 17:23:36 k3s-0 k3s[2906]: Trace[148915160]: ---"Listing from storage done" 129ms (17:23:00.634) | |
| Feb 09 17:23:36 k3s-0 k3s[2906]: Trace[148915160]: ---"Writing http response done" count:80 1140ms (17:23:00.775) | |
| Feb 09 17:23:36 k3s-0 k3s[2906]: Trace[148915160]: [1.270914746s] [1.270914746s] END | |
| Feb 09 17:23:38 k3s-0 k3s[2906]: I0209 17:23:38.187776 2906 trace.go:205] Trace[106948750]: "List" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions,user-agent:kustomize-controller/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,client:10.2.0.34 (09-Feb-2021 17:23:37.667) (total time: 519ms): | |
| Feb 09 17:23:38 k3s-0 k3s[2906]: Trace[106948750]: ---"Listing from storage done" 263ms (17:23:00.931) | |
| Feb 09 17:23:38 k3s-0 k3s[2906]: Trace[106948750]: ---"Writing http response done" count:41 255ms (17:23:00.187) | |
| Feb 09 17:23:38 k3s-0 k3s[2906]: Trace[106948750]: [519.753596ms] [519.753596ms] END | |
| Feb 09 17:23:38 k3s-0 k3s[2906]: I0209 17:23:38.776378 2906 trace.go:205] Trace[208683813]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:operator/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 17:23:37.199) (total time: 1576ms): | |
| Feb 09 17:23:38 k3s-0 k3s[2906]: Trace[208683813]: ---"Listing from storage done" 132ms (17:23:00.332) | |
| Feb 09 17:23:38 k3s-0 k3s[2906]: Trace[208683813]: ---"Writing http response done" count:80 1444ms (17:23:00.776) | |
| Feb 09 17:23:38 k3s-0 k3s[2906]: Trace[208683813]: [1.57651576s] [1.57651576s] END | |
| Feb 09 17:23:41 k3s-0 k3s[2906]: I0209 17:23:41.614055 2906 request.go:645] Throttling request took 1.045547926s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:23:45 k3s-0 k3s[2906]: I0209 17:23:45.870655 2906 trace.go:205] Trace[1653652589]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.157 (09-Feb-2021 17:23:45.106) (total time: 764ms): | |
| Feb 09 17:23:45 k3s-0 k3s[2906]: Trace[1653652589]: ---"Writing http response done" count:10 659ms (17:23:00.870) | |
| Feb 09 17:23:45 k3s-0 k3s[2906]: Trace[1653652589]: [764.257427ms] [764.257427ms] END | |
| Feb 09 17:24:13 k3s-0 k3s[2906]: I0209 17:24:13.266057 2906 request.go:645] Throttling request took 1.046827776s, request: GET:https://127.0.0.1:6444/apis/cert-manager.io/v1alpha2?timeout=32s | |
| Feb 09 17:24:36 k3s-0 k3s[2906]: I0209 17:24:36.523859 2906 trace.go:205] Trace[1399725291]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:operator/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 17:24:35.290) (total time: 1233ms): | |
| Feb 09 17:24:36 k3s-0 k3s[2906]: Trace[1399725291]: ---"Listing from storage done" 175ms (17:24:00.466) | |
| Feb 09 17:24:36 k3s-0 k3s[2906]: Trace[1399725291]: ---"Writing http response done" count:80 1057ms (17:24:00.523) | |
| Feb 09 17:24:36 k3s-0 k3s[2906]: Trace[1399725291]: [1.23365718s] [1.23365718s] END | |
| Feb 09 17:24:36 k3s-0 k3s[2906]: I0209 17:24:36.755363 2906 event.go:291] "Event occurred" object="default/unifi" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set unifi-759f745699 to 0" | |
| Feb 09 17:24:36 k3s-0 k3s[2906]: I0209 17:24:36.802127 2906 event.go:291] "Event occurred" object="default/unifi-759f745699" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: unifi-759f745699-2w2x5" | |
| Feb 09 17:24:38 k3s-0 k3s[2906]: I0209 17:24:38.039665 2906 trace.go:205] Trace[951940459]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:operator/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 17:24:37.052) (total time: 986ms): | |
| Feb 09 17:24:38 k3s-0 k3s[2906]: Trace[951940459]: ---"Listing from storage done" 165ms (17:24:00.218) | |
| Feb 09 17:24:38 k3s-0 k3s[2906]: Trace[951940459]: ---"Writing http response done" count:80 821ms (17:24:00.039) | |
| Feb 09 17:24:38 k3s-0 k3s[2906]: Trace[951940459]: [986.879371ms] [986.879371ms] END | |
| Feb 09 17:24:39 k3s-0 k3s[2906]: I0209 17:24:39.051400 2906 event.go:291] "Event occurred" object="default/unifi" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set unifi-7ff5db5889 to 1" | |
| Feb 09 17:24:39 k3s-0 k3s[2906]: I0209 17:24:39.088857 2906 event.go:291] "Event occurred" object="default/unifi-7ff5db5889" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: unifi-7ff5db5889-vzjqn" | |
| Feb 09 17:24:44 k3s-0 k3s[2906]: I0209 17:24:44.918048 2906 request.go:645] Throttling request took 1.046361686s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1?timeout=32s | |
| Feb 09 17:25:16 k3s-0 k3s[2906]: I0209 17:25:16.570153 2906 request.go:645] Throttling request took 1.043107292s, request: GET:https://127.0.0.1:6444/apis/kustomize.toolkit.fluxcd.io/v1beta1?timeout=32s | |
| Feb 09 17:25:44 k3s-0 k3s[2906]: I0209 17:25:44.204380 2906 trace.go:205] Trace[440218000]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:operator/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 17:25:43.361) (total time: 842ms): | |
| Feb 09 17:25:44 k3s-0 k3s[2906]: Trace[440218000]: ---"Writing http response done" count:80 718ms (17:25:00.204) | |
| Feb 09 17:25:44 k3s-0 k3s[2906]: Trace[440218000]: [842.555892ms] [842.555892ms] END | |
| Feb 09 17:25:45 k3s-0 k3s[2906]: I0209 17:25:45.703897 2906 trace.go:205] Trace[1554491322]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:operator/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 17:25:44.832) (total time: 870ms): | |
| Feb 09 17:25:45 k3s-0 k3s[2906]: Trace[1554491322]: ---"Writing http response done" count:80 750ms (17:25:00.703) | |
| Feb 09 17:25:45 k3s-0 k3s[2906]: Trace[1554491322]: [870.991038ms] [870.991038ms] END | |
| Feb 09 17:25:48 k3s-0 k3s[2906]: I0209 17:25:48.226129 2906 request.go:645] Throttling request took 1.046091547s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:26:06 k3s-0 k3s[2906]: I0209 17:26:06.648771 2906 trace.go:205] Trace[503978113]: "List" url:/api/v1/namespaces/cert-manager/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.157 (09-Feb-2021 17:26:06.065) (total time: 583ms): | |
| Feb 09 17:26:06 k3s-0 k3s[2906]: Trace[503978113]: ---"Writing http response done" count:4 489ms (17:26:00.648) | |
| Feb 09 17:26:06 k3s-0 k3s[2906]: Trace[503978113]: [583.205131ms] [583.205131ms] END | |
| Feb 09 17:26:19 k3s-0 k3s[2906]: I0209 17:26:19.878494 2906 request.go:645] Throttling request took 1.04574945s, request: GET:https://127.0.0.1:6444/apis/ops.alexellis.io/v1?timeout=32s | |
| Feb 09 17:26:51 k3s-0 k3s[2906]: I0209 17:26:51.531824 2906 request.go:645] Throttling request took 1.04730176s, request: GET:https://127.0.0.1:6444/apis/networking.k8s.io/v1beta1?timeout=32s | |
| Feb 09 17:27:23 k3s-0 k3s[2906]: I0209 17:27:23.182763 2906 request.go:645] Throttling request took 1.04498665s, request: GET:https://127.0.0.1:6444/apis/discovery.k8s.io/v1beta1?timeout=32s | |
| Feb 09 17:27:54 k3s-0 k3s[2906]: I0209 17:27:54.835472 2906 request.go:645] Throttling request took 1.046261638s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:28:15 k3s-0 k3s[2906]: I0209 17:28:15.873663 2906 trace.go:205] Trace[116382073]: "Get" url:/api/v1/namespaces/default/pods/unifi-7ff5db5889-vzjqn/log,user-agent:kubectl/v1.20.2 (linux/amd64) kubernetes/faecb19,client:10.0.7.12 (09-Feb-2021 17:25:20.869) (total time: 175004ms): | |
| Feb 09 17:28:15 k3s-0 k3s[2906]: Trace[116382073]: ---"Transformed response object" 174986ms (17:28:00.873) | |
| Feb 09 17:28:15 k3s-0 k3s[2906]: Trace[116382073]: [2m55.004365393s] [2m55.004365393s] END | |
| Feb 09 17:28:26 k3s-0 k3s[2906]: I0209 17:28:26.488704 2906 request.go:645] Throttling request took 1.045117874s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:28:47 k3s-0 k3s[2906]: I0209 17:28:47.759785 2906 trace.go:205] Trace[331837502]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.157 (09-Feb-2021 17:28:47.114) (total time: 645ms): | |
| Feb 09 17:28:47 k3s-0 k3s[2906]: Trace[331837502]: ---"Writing http response done" count:10 548ms (17:28:00.759) | |
| Feb 09 17:28:47 k3s-0 k3s[2906]: Trace[331837502]: [645.217679ms] [645.217679ms] END | |
| Feb 09 17:28:58 k3s-0 k3s[2906]: I0209 17:28:58.141386 2906 request.go:645] Throttling request took 1.045712879s, request: GET:https://127.0.0.1:6444/apis/snapshot.storage.k8s.io/v1?timeout=32s | |
| Feb 09 17:29:29 k3s-0 k3s[2906]: I0209 17:29:29.793886 2906 request.go:645] Throttling request took 1.045916372s, request: GET:https://127.0.0.1:6444/apis/snapshot.storage.k8s.io/v1beta1?timeout=32s | |
| Feb 09 17:30:01 k3s-0 k3s[2906]: I0209 17:30:01.445476 2906 request.go:645] Throttling request took 1.040674591s, request: GET:https://127.0.0.1:6444/apis/snapshot.storage.k8s.io/v1beta1?timeout=32s | |
| Feb 09 17:30:33 k3s-0 k3s[2906]: I0209 17:30:33.099576 2906 request.go:645] Throttling request took 1.043265598s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:31:04 k3s-0 k3s[2906]: I0209 17:31:04.759893 2906 request.go:645] Throttling request took 1.034707586s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:31:10 k3s-0 k3s[2906]: time="2021-02-09T17:31:10.002112075Z" level=error msg="Compact failed: failed to compact to revision 55459751: database is locked" | |
| Feb 09 17:31:36 k3s-0 k3s[2906]: I0209 17:31:36.417013 2906 request.go:645] Throttling request took 1.041441091s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:32:08 k3s-0 k3s[2906]: I0209 17:32:08.069509 2906 request.go:645] Throttling request took 1.037880643s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1?timeout=32s | |
| Feb 09 17:32:39 k3s-0 k3s[2906]: I0209 17:32:39.721539 2906 request.go:645] Throttling request took 1.044149976s, request: GET:https://127.0.0.1:6444/apis/networking.k8s.io/v1beta1?timeout=32s | |
| Feb 09 17:33:11 k3s-0 k3s[2906]: I0209 17:33:11.375404 2906 request.go:645] Throttling request took 1.043358648s, request: GET:https://127.0.0.1:6444/apis/snapshot.storage.k8s.io/v1beta1?timeout=32s | |
| Feb 09 17:33:43 k3s-0 k3s[2906]: I0209 17:33:43.027611 2906 request.go:645] Throttling request took 1.046503727s, request: GET:https://127.0.0.1:6444/apis/helm.toolkit.fluxcd.io/v2beta1?timeout=32s | |
| Feb 09 17:33:49 k3s-0 k3s[2906]: I0209 17:33:49.880584 2906 trace.go:205] Trace[2048948857]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.157 (09-Feb-2021 17:33:48.904) (total time: 976ms): | |
| Feb 09 17:33:49 k3s-0 k3s[2906]: Trace[2048948857]: ---"Listing from storage done" 165ms (17:33:00.070) | |
| Feb 09 17:33:49 k3s-0 k3s[2906]: Trace[2048948857]: ---"Writing http response done" count:10 810ms (17:33:00.880) | |
| Feb 09 17:33:49 k3s-0 k3s[2906]: Trace[2048948857]: [976.060336ms] [976.060336ms] END | |
| Feb 09 17:34:14 k3s-0 k3s[2906]: I0209 17:34:14.679850 2906 request.go:645] Throttling request took 1.046438778s, request: GET:https://127.0.0.1:6444/apis/ricoberger.de/v1alpha1?timeout=32s | |
| Feb 09 17:34:46 k3s-0 k3s[2906]: I0209 17:34:46.331767 2906 request.go:645] Throttling request took 1.045525924s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:35:17 k3s-0 k3s[2906]: I0209 17:35:17.983600 2906 request.go:645] Throttling request took 1.045469045s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:35:49 k3s-0 k3s[2906]: I0209 17:35:49.635303 2906 request.go:645] Throttling request took 1.046360315s, request: GET:https://127.0.0.1:6444/apis/admissionregistration.k8s.io/v1?timeout=32s | |
| Feb 09 17:36:21 k3s-0 k3s[2906]: I0209 17:36:21.289445 2906 request.go:645] Throttling request took 1.047250276s, request: GET:https://127.0.0.1:6444/apis/acme.cert-manager.io/v1alpha3?timeout=32s | |
| Feb 09 17:36:52 k3s-0 k3s[2906]: I0209 17:36:52.939806 2906 request.go:645] Throttling request took 1.04668813s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:37:24 k3s-0 k3s[2906]: I0209 17:37:24.591806 2906 request.go:645] Throttling request took 1.044907357s, request: GET:https://127.0.0.1:6444/apis/notification.toolkit.fluxcd.io/v1beta1?timeout=32s | |
| Feb 09 17:37:56 k3s-0 k3s[2906]: I0209 17:37:56.244827 2906 request.go:645] Throttling request took 1.044015978s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:38:27 k3s-0 k3s[2906]: I0209 17:38:27.896603 2906 request.go:645] Throttling request took 1.042529163s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:38:52 k3s-0 k3s[2906]: I0209 17:38:52.104880 2906 trace.go:205] Trace[1713370435]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.157 (09-Feb-2021 17:38:51.312) (total time: 791ms): | |
| Feb 09 17:38:52 k3s-0 k3s[2906]: Trace[1713370435]: ---"Writing http response done" count:10 676ms (17:38:00.104) | |
| Feb 09 17:38:52 k3s-0 k3s[2906]: Trace[1713370435]: [791.929466ms] [791.929466ms] END | |
| Feb 09 17:38:59 k3s-0 k3s[2906]: I0209 17:38:59.549090 2906 request.go:645] Throttling request took 1.046180826s, request: GET:https://127.0.0.1:6444/apis/kustomize.toolkit.fluxcd.io/v1beta1?timeout=32s | |
| Feb 09 17:39:31 k3s-0 k3s[2906]: I0209 17:39:31.201707 2906 request.go:645] Throttling request took 1.044990703s, request: GET:https://127.0.0.1:6444/apis/rbac.authorization.k8s.io/v1beta1?timeout=32s | |
| Feb 09 17:40:02 k3s-0 k3s[2906]: I0209 17:40:02.854533 2906 request.go:645] Throttling request took 1.045496472s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:40:34 k3s-0 k3s[2906]: I0209 17:40:34.506570 2906 request.go:645] Throttling request took 1.043980416s, request: GET:https://127.0.0.1:6444/apis/rbac.authorization.k8s.io/v1beta1?timeout=32s | |
| Feb 09 17:41:06 k3s-0 k3s[2906]: I0209 17:41:06.169462 2906 request.go:645] Throttling request took 1.045129541s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1?timeout=32s | |
| Feb 09 17:41:37 k3s-0 k3s[2906]: I0209 17:41:37.821900 2906 request.go:645] Throttling request took 1.047269165s, request: GET:https://127.0.0.1:6444/apis/scheduling.k8s.io/v1?timeout=32s | |
| Feb 09 17:42:09 k3s-0 k3s[2906]: I0209 17:42:09.473645 2906 request.go:645] Throttling request took 1.046805135s, request: GET:https://127.0.0.1:6444/apis/apiextensions.k8s.io/v1?timeout=32s | |
| Feb 09 17:42:41 k3s-0 k3s[2906]: I0209 17:42:41.125846 2906 request.go:645] Throttling request took 1.042801982s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:43:12 k3s-0 k3s[2906]: I0209 17:43:12.777659 2906 request.go:645] Throttling request took 1.046475584s, request: GET:https://127.0.0.1:6444/apis/cert-manager.io/v1alpha3?timeout=32s | |
| Feb 09 17:43:44 k3s-0 k3s[2906]: I0209 17:43:44.429195 2906 request.go:645] Throttling request took 1.045664124s, request: GET:https://127.0.0.1:6444/apis/upgrade.cattle.io/v1?timeout=32s | |
| Feb 09 17:43:54 k3s-0 k3s[2906]: I0209 17:43:54.185281 2906 trace.go:205] Trace[2127294299]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.157 (09-Feb-2021 17:43:53.328) (total time: 857ms): | |
| Feb 09 17:43:54 k3s-0 k3s[2906]: Trace[2127294299]: ---"Writing http response done" count:10 752ms (17:43:00.185) | |
| Feb 09 17:43:54 k3s-0 k3s[2906]: Trace[2127294299]: [857.069525ms] [857.069525ms] END | |
| Feb 09 17:44:16 k3s-0 k3s[2906]: I0209 17:44:16.081346 2906 request.go:645] Throttling request took 1.046747646s, request: GET:https://127.0.0.1:6444/apis/cert-manager.io/v1?timeout=32s | |
| Feb 09 17:44:47 k3s-0 k3s[2906]: I0209 17:44:47.733838 2906 request.go:645] Throttling request took 1.04663279s, request: GET:https://127.0.0.1:6444/apis/ops.alexellis.io/v1?timeout=32s | |
| Feb 09 17:45:19 k3s-0 k3s[2906]: I0209 17:45:19.385309 2906 request.go:645] Throttling request took 1.047074094s, request: GET:https://127.0.0.1:6444/apis/certificates.k8s.io/v1beta1?timeout=32s | |
| Feb 09 17:45:51 k3s-0 k3s[2906]: I0209 17:45:51.037101 2906 request.go:645] Throttling request took 1.015120034s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1?timeout=32s | |
| Feb 09 17:46:22 k3s-0 k3s[2906]: I0209 17:46:22.689360 2906 request.go:645] Throttling request took 1.040532459s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:46:54 k3s-0 k3s[2906]: I0209 17:46:54.341163 2906 request.go:645] Throttling request took 1.046575364s, request: GET:https://127.0.0.1:6444/apis/storage.k8s.io/v1?timeout=32s | |
| Feb 09 17:47:25 k3s-0 k3s[2906]: I0209 17:47:25.992812 2906 request.go:645] Throttling request took 1.04352769s, request: GET:https://127.0.0.1:6444/apis/acme.cert-manager.io/v1alpha3?timeout=32s | |
| Feb 09 17:47:57 k3s-0 k3s[2906]: I0209 17:47:57.644463 2906 request.go:645] Throttling request took 1.044175015s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:48:29 k3s-0 k3s[2906]: I0209 17:48:29.296311 2906 request.go:645] Throttling request took 1.045532211s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:48:56 k3s-0 k3s[2906]: I0209 17:48:56.070507 2906 trace.go:205] Trace[1601050721]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.157 (09-Feb-2021 17:48:55.403) (total time: 666ms): | |
| Feb 09 17:48:56 k3s-0 k3s[2906]: Trace[1601050721]: ---"Writing http response done" count:10 575ms (17:48:00.070) | |
| Feb 09 17:48:56 k3s-0 k3s[2906]: Trace[1601050721]: [666.823649ms] [666.823649ms] END | |
| Feb 09 17:49:00 k3s-0 k3s[2906]: I0209 17:49:00.954772 2906 request.go:645] Throttling request took 1.051308486s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:49:32 k3s-0 k3s[2906]: I0209 17:49:32.600149 2906 request.go:645] Throttling request took 1.040111031s, request: GET:https://127.0.0.1:6444/apis/objectbucket.io/v1alpha1?timeout=32s | |
| Feb 09 17:50:04 k3s-0 k3s[2906]: I0209 17:50:04.256696 2906 request.go:645] Throttling request took 1.034705725s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1?timeout=32s | |
| Feb 09 17:50:35 k3s-0 k3s[2906]: I0209 17:50:35.910673 2906 request.go:645] Throttling request took 1.041374451s, request: GET:https://127.0.0.1:6444/apis/velero.io/v1?timeout=32s | |
| Feb 09 17:51:07 k3s-0 k3s[2906]: I0209 17:51:07.563573 2906 request.go:645] Throttling request took 1.04710068s, request: GET:https://127.0.0.1:6444/apis/admissionregistration.k8s.io/v1beta1?timeout=32s | |
| Feb 09 17:51:10 k3s-0 k3s[2906]: I0209 17:51:10.194753 2906 trace.go:205] Trace[360825242]: "List" url:/api/v1/namespaces/cert-manager/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.157 (09-Feb-2021 17:51:09.690) (total time: 503ms): | |
| Feb 09 17:51:10 k3s-0 k3s[2906]: Trace[360825242]: ---"Listing from storage done" 136ms (17:51:00.827) | |
| Feb 09 17:51:10 k3s-0 k3s[2906]: Trace[360825242]: ---"Writing http response done" count:4 367ms (17:51:00.194) | |
| Feb 09 17:51:10 k3s-0 k3s[2906]: Trace[360825242]: [503.866849ms] [503.866849ms] END | |
| Feb 09 17:51:39 k3s-0 k3s[2906]: I0209 17:51:39.215589 2906 request.go:645] Throttling request took 1.046675025s, request: GET:https://127.0.0.1:6444/apis/k3s.cattle.io/v1?timeout=32s | |
| Feb 09 17:52:10 k3s-0 k3s[2906]: I0209 17:52:10.867849 2906 request.go:645] Throttling request took 1.046758255s, request: GET:https://127.0.0.1:6444/apis/coordination.k8s.io/v1?timeout=32s | |
| Feb 09 17:52:42 k3s-0 k3s[2906]: I0209 17:52:42.520471 2906 request.go:645] Throttling request took 1.045604457s, request: GET:https://127.0.0.1:6444/apis/notification.toolkit.fluxcd.io/v1beta1?timeout=32s | |
| Feb 09 17:53:14 k3s-0 k3s[2906]: I0209 17:53:14.172406 2906 request.go:645] Throttling request took 1.042229255s, request: GET:https://127.0.0.1:6444/apis/objectbucket.io/v1alpha1?timeout=32s | |
| Feb 09 17:53:45 k3s-0 k3s[2906]: I0209 17:53:45.824507 2906 request.go:645] Throttling request took 1.047301374s, request: GET:https://127.0.0.1:6444/apis/autoscaling/v1?timeout=32s | |
| Feb 09 17:53:57 k3s-0 k3s[2906]: I0209 17:53:57.974471 2906 trace.go:205] Trace[707504388]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.157 (09-Feb-2021 17:53:57.267) (total time: 707ms): | |
| Feb 09 17:53:57 k3s-0 k3s[2906]: Trace[707504388]: ---"Writing http response done" count:10 610ms (17:53:00.974) | |
| Feb 09 17:53:57 k3s-0 k3s[2906]: Trace[707504388]: [707.222357ms] [707.222357ms] END | |
| Feb 09 17:54:17 k3s-0 k3s[2906]: I0209 17:54:17.476735 2906 request.go:645] Throttling request took 1.045043117s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:54:49 k3s-0 k3s[2906]: I0209 17:54:49.129413 2906 request.go:645] Throttling request took 1.044269359s, request: GET:https://127.0.0.1:6444/apis/upgrade.cattle.io/v1?timeout=32s | |
| Feb 09 17:55:20 k3s-0 k3s[2906]: I0209 17:55:20.781318 2906 request.go:645] Throttling request took 1.046167777s, request: GET:https://127.0.0.1:6444/apis/apiextensions.k8s.io/v1?timeout=32s | |
| Feb 09 17:55:52 k3s-0 k3s[2906]: I0209 17:55:52.545389 2906 request.go:645] Throttling request took 1.043594664s, request: GET:https://127.0.0.1:6444/apis/acme.cert-manager.io/v1?timeout=32s | |
| Feb 09 17:56:24 k3s-0 k3s[2906]: I0209 17:56:24.201648 2906 request.go:645] Throttling request took 1.046014018s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:56:55 k3s-0 k3s[2906]: I0209 17:56:55.853566 2906 request.go:645] Throttling request took 1.047043643s, request: GET:https://127.0.0.1:6444/apis/source.toolkit.fluxcd.io/v1beta1?timeout=32s | |
| Feb 09 17:57:27 k3s-0 k3s[2906]: I0209 17:57:27.505285 2906 request.go:645] Throttling request took 1.045118413s, request: GET:https://127.0.0.1:6444/apis/objectbucket.io/v1alpha1?timeout=32s | |
| Feb 09 17:57:59 k3s-0 k3s[2906]: I0209 17:57:59.158863 2906 request.go:645] Throttling request took 1.047356225s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 17:58:30 k3s-0 k3s[2906]: I0209 17:58:30.809011 2906 request.go:645] Throttling request took 1.045852078s, request: GET:https://127.0.0.1:6444/apis/scheduling.k8s.io/v1?timeout=32s | |
| Feb 09 17:58:59 k3s-0 k3s[2906]: I0209 17:58:59.881479 2906 trace.go:205] Trace[50664731]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.157 (09-Feb-2021 17:58:59.181) (total time: 699ms): | |
| Feb 09 17:58:59 k3s-0 k3s[2906]: Trace[50664731]: ---"Writing http response done" count:10 604ms (17:58:00.881) | |
| Feb 09 17:58:59 k3s-0 k3s[2906]: Trace[50664731]: [699.812531ms] [699.812531ms] END | |
| Feb 09 17:59:02 k3s-0 k3s[2906]: I0209 17:59:02.460895 2906 request.go:645] Throttling request took 1.046225958s, request: GET:https://127.0.0.1:6444/apis/coordination.k8s.io/v1?timeout=32s | |
| Feb 09 17:59:34 k3s-0 k3s[2906]: I0209 17:59:34.113118 2906 request.go:645] Throttling request took 1.045422004s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 18:00:05 k3s-0 k3s[2906]: I0209 18:00:05.764770 2906 request.go:645] Throttling request took 1.046577956s, request: GET:https://127.0.0.1:6444/apis/authorization.k8s.io/v1beta1?timeout=32s | |
| Feb 09 18:00:29 k3s-0 k3s[2906]: I0209 18:00:29.402674 2906 trace.go:205] Trace[454052391]: "List etcd3" key:/secrets/monitoring,resourceVersion:,resourceVersionMatch:,limit:0,continue: (09-Feb-2021 18:00:28.872) (total time: 529ms): | |
| Feb 09 18:00:29 k3s-0 k3s[2906]: Trace[454052391]: [529.744434ms] [529.744434ms] END | |
| Feb 09 18:00:29 k3s-0 k3s[2906]: I0209 18:00:29.461755 2906 trace.go:205] Trace[206011449]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.157 (09-Feb-2021 18:00:28.872) (total time: 588ms): | |
| Feb 09 18:00:29 k3s-0 k3s[2906]: Trace[206011449]: ---"Listing from storage done" 529ms (18:00:00.402) | |
| Feb 09 18:00:29 k3s-0 k3s[2906]: Trace[206011449]: [588.8339ms] [588.8339ms] END | |
| Feb 09 18:00:29 k3s-0 k3s[2906]: I0209 18:00:29.502639 2906 trace.go:205] Trace[539980921]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.157 (09-Feb-2021 18:00:28.989) (total time: 512ms): | |
| Feb 09 18:00:29 k3s-0 k3s[2906]: Trace[539980921]: ---"Listing from storage done" 489ms (18:00:00.479) | |
| Feb 09 18:00:29 k3s-0 k3s[2906]: Trace[539980921]: [512.912921ms] [512.912921ms] END | |
| Feb 09 18:00:37 k3s-0 k3s[2906]: I0209 18:00:37.417994 2906 request.go:645] Throttling request took 1.045826569s, request: GET:https://127.0.0.1:6444/apis/networking.k8s.io/v1?timeout=32s | |
| Feb 09 18:00:48 k3s-0 k3s[2906]: time="2021-02-09T18:00:48.264209795Z" level=info msg="Cluster-Http-Server 2021/02/09 18:00:48 http: TLS handshake error from 10.2.0.34:65056: EOF" | |
| Feb 09 18:00:48 k3s-0 k3s[2906]: time="2021-02-09T18:00:48.265501570Z" level=info msg="Cluster-Http-Server 2021/02/09 18:00:48 http: TLS handshake error from 10.2.0.34:7230: EOF" | |
| Feb 09 18:00:48 k3s-0 k3s[2906]: time="2021-02-09T18:00:48.265610849Z" level=info msg="Cluster-Http-Server 2021/02/09 18:00:48 http: TLS handshake error from 10.2.0.34:35954: EOF" | |
| Feb 09 18:00:48 k3s-0 k3s[2906]: time="2021-02-09T18:00:48.294449515Z" level=info msg="Cluster-Http-Server 2021/02/09 18:00:48 http: TLS handshake error from 10.2.0.34:17920: EOF" | |
| Feb 09 18:00:48 k3s-0 k3s[2906]: time="2021-02-09T18:00:48.294994084Z" level=info msg="Cluster-Http-Server 2021/02/09 18:00:48 http: TLS handshake error from 10.2.0.34:4198: EOF" | |
| Feb 09 18:00:48 k3s-0 k3s[2906]: time="2021-02-09T18:00:48.295090701Z" level=info msg="Cluster-Http-Server 2021/02/09 18:00:48 http: TLS handshake error from 10.2.0.34:10648: EOF" | |
| Feb 09 18:00:48 k3s-0 k3s[2906]: time="2021-02-09T18:00:48.295248589Z" level=info msg="Cluster-Http-Server 2021/02/09 18:00:48 http: TLS handshake error from 10.2.0.34:52360: EOF" | |
| Feb 09 18:01:09 k3s-0 k3s[2906]: I0209 18:01:09.070392 2906 request.go:645] Throttling request took 1.045383379s, request: GET:https://127.0.0.1:6444/apis/k3s.cattle.io/v1?timeout=32s | |
| Feb 09 18:01:40 k3s-0 k3s[2906]: I0209 18:01:40.724061 2906 request.go:645] Throttling request took 1.047094392s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 18:02:12 k3s-0 k3s[2906]: I0209 18:02:12.377556 2906 request.go:645] Throttling request took 1.04392997s, request: GET:https://127.0.0.1:6444/apis/discovery.k8s.io/v1beta1?timeout=32s | |
| Feb 09 18:02:44 k3s-0 k3s[2906]: I0209 18:02:44.030875 2906 request.go:645] Throttling request took 1.045535218s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 18:03:15 k3s-0 k3s[2906]: I0209 18:03:15.683181 2906 request.go:645] Throttling request took 1.042667669s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 18:03:47 k3s-0 k3s[2906]: I0209 18:03:47.334949 2906 request.go:645] Throttling request took 1.043148802s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 18:04:01 k3s-0 k3s[2906]: I0209 18:04:01.919438 2906 trace.go:205] Trace[363152816]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.42.0.157 (09-Feb-2021 18:04:01.163) (total time: 755ms): | |
| Feb 09 18:04:01 k3s-0 k3s[2906]: Trace[363152816]: ---"Writing http response done" count:10 639ms (18:04:00.919) | |
| Feb 09 18:04:01 k3s-0 k3s[2906]: Trace[363152816]: [755.93448ms] [755.93448ms] END | |
| Feb 09 18:04:18 k3s-0 k3s[2906]: I0209 18:04:18.987514 2906 request.go:645] Throttling request took 1.042654385s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 18:04:50 k3s-0 k3s[2906]: I0209 18:04:50.639058 2906 request.go:645] Throttling request took 1.046609458s, request: GET:https://127.0.0.1:6444/apis/rbac.authorization.k8s.io/v1?timeout=32s | |
| Feb 09 18:05:22 k3s-0 k3s[2906]: I0209 18:05:22.446672 2906 request.go:645] Throttling request took 1.033437987s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 18:05:54 k3s-0 k3s[2906]: I0209 18:05:54.098722 2906 request.go:645] Throttling request took 1.043552999s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 18:06:25 k3s-0 k3s[2906]: I0209 18:06:25.750742 2906 request.go:645] Throttling request took 1.037278869s, request: GET:https://127.0.0.1:6444/apis/ricoberger.de/v1alpha1?timeout=32s | |
| Feb 09 18:06:57 k3s-0 k3s[2906]: I0209 18:06:57.402849 2906 request.go:645] Throttling request took 1.047054502s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 18:07:29 k3s-0 k3s[2906]: I0209 18:07:29.055587 2906 request.go:645] Throttling request took 1.045175809s, request: GET:https://127.0.0.1:6444/apis/velero.io/v1?timeout=32s | |
| Feb 09 18:08:00 k3s-0 k3s[2906]: I0209 18:08:00.707429 2906 request.go:645] Throttling request took 1.045196558s, request: GET:https://127.0.0.1:6444/apis/kustomize.toolkit.fluxcd.io/v1beta1?timeout=32s | |
| Feb 09 18:08:23 k3s-0 k3s[2906]: I0209 18:08:23.867919 2906 event.go:291] "Event occurred" object="kube-system/coredns-coredns-5b9fbc465" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-coredns-5b9fbc465-bx59h" | |
| Feb 09 18:08:23 k3s-0 k3s[2906]: I0209 18:08:23.870930 2906 event.go:291] "Event occurred" object="kube-system/coredns-66c464876b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-66c464876b-87786" | |
| Feb 09 18:08:23 k3s-0 k3s[2906]: E0209 18:08:23.914479 2906 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"} | |
| Feb 09 18:08:23 k3s-0 k3s[2906]: time="2021-02-09T18:08:23.947641244Z" level=error msg="error while range on /registry/deployments/rook-ceph/rook-ceph-crashcollector-k3s-0 : context canceled" | |
| Feb 09 18:08:23 k3s-0 k3s[2906]: I0209 18:08:23.969812 2906 event.go:291] "Event occurred" object="kube-system/ingress-nginx-defaultbackend-78694c6c78" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: ingress-nginx-defaultbackend-78694c6c78-w9h9c" | |
| Feb 09 18:08:24 k3s-0 k3s[2906]: I0209 18:08:24.218587 2906 event.go:291] "Event occurred" object="flux-system/helm-controller-c858b9c65" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: helm-controller-c858b9c65-h9lrr" | |
| Feb 09 18:08:24 k3s-0 k3s[2906]: I0209 18:08:24.232743 2906 event.go:291] "Event occurred" object="rook-ceph/rook-ceph-operator-5c7f74cb49" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: rook-ceph-operator-5c7f74cb49-rr59m" | |
| Feb 09 18:08:24 k3s-0 k3s[2906]: I0209 18:08:24.285429 2906 trace.go:205] Trace[1944885493]: "Create" url:/api/v1/namespaces/rook-ceph/pods,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38/system:serviceaccount:kube-system:replicaset-controller,client:127.0.0.1 (09-Feb-2021 18:08:23.601) (total time: 684ms): | |
| Feb 09 18:08:24 k3s-0 k3s[2906]: Trace[1944885493]: ---"Object stored in database" 679ms (18:08:00.285) | |
| Feb 09 18:08:24 k3s-0 k3s[2906]: Trace[1944885493]: [684.296818ms] [684.296818ms] END | |
| Feb 09 18:08:24 k3s-0 k3s[2906]: I0209 18:08:24.313757 2906 event.go:291] "Event occurred" object="rook-ceph/rook-ceph-tools-7bf6744b9c" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: rook-ceph-tools-7bf6744b9c-5w2lz" | |
| Feb 09 18:08:24 k3s-0 k3s[2906]: I0209 18:08:24.351122 2906 event.go:291] "Event occurred" object="kube-system/ingress-nginx-defaultbackend" kind="Endpoints" apiVersion="v1" type="Warning" reason="FailedToUpdateEndpoint" message="Failed to update endpoint kube-system/ingress-nginx-defaultbackend: Operation cannot be fulfilled on endpoints \"ingress-nginx-defaultbackend\": the object has been modified; please apply your changes to the latest version and try again" | |
| Feb 09 18:08:24 k3s-0 k3s[2906]: I0209 18:08:24.404838 2906 trace.go:205] Trace[710486726]: "Create" url:/api/v1/namespaces/system-upgrade/pods/system-upgrade-controller-b64b5bcb7-l9pcf/eviction,user-agent:kubectl/v1.20.2 (linux/amd64) kubernetes/faecb19,client:10.0.7.12 (09-Feb-2021 18:08:23.636) (total time: 768ms): | |
| Feb 09 18:08:24 k3s-0 k3s[2906]: Trace[710486726]: ---"Object stored in database" 768ms (18:08:00.404) | |
| Feb 09 18:08:24 k3s-0 k3s[2906]: Trace[710486726]: [768.736392ms] [768.736392ms] END | |
| Feb 09 18:08:24 k3s-0 k3s[2906]: I0209 18:08:24.543180 2906 event.go:291] "Event occurred" object="rook-ceph/rook-ceph-mon-d-845667b8fb" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: rook-ceph-mon-d-845667b8fb-5wxds" | |
| Feb 09 18:08:24 k3s-0 k3s[2906]: I0209 18:08:24.609550 2906 trace.go:205] Trace[1214524575]: "Create" url:/api/v1/namespaces/rook-ceph/pods/rook-ceph-crashcollector-k3s-0-544c5f5f45-5rttv/eviction,user-agent:kubectl/v1.20.2 (linux/amd64) kubernetes/faecb19,client:10.0.7.12 (09-Feb-2021 18:08:24.057) (total time: 551ms): | |
| Feb 09 18:08:24 k3s-0 k3s[2906]: Trace[1214524575]: ---"Object stored in database" 551ms (18:08:00.609) | |
| Feb 09 18:08:24 k3s-0 k3s[2906]: Trace[1214524575]: [551.903151ms] [551.903151ms] END | |
| Feb 09 18:08:24 k3s-0 k3s[2906]: I0209 18:08:24.610279 2906 trace.go:205] Trace[406422147]: "Create" url:/api/v1/namespaces/rook-ceph/pods/snapshot-controller-0/eviction,user-agent:kubectl/v1.20.2 (linux/amd64) kubernetes/faecb19,client:10.0.7.12 (09-Feb-2021 18:08:23.853) (total time: 756ms): | |
| Feb 09 18:08:24 k3s-0 k3s[2906]: Trace[406422147]: ---"Object stored in database" 756ms (18:08:00.610) | |
| Feb 09 18:08:24 k3s-0 k3s[2906]: Trace[406422147]: [756.511745ms] [756.511745ms] END | |
| Feb 09 18:08:24 k3s-0 k3s[2906]: I0209 18:08:24.920094 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 193edc73709b03fa644919cb18d984f2823cc68c3b79bfc9a823b916c1f262fc | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: I0209 18:08:25.045300 2906 trace.go:205] Trace[564248151]: "Create" url:/api/v1/namespaces/cert-manager/pods,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38/system:serviceaccount:kube-system:replicaset-controller,client:127.0.0.1 (09-Feb-2021 18:08:24.149) (total time: 895ms): | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: Trace[564248151]: ---"Object stored in database" 887ms (18:08:00.045) | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: Trace[564248151]: [895.701527ms] [895.701527ms] END | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: I0209 18:08:25.071795 2906 event.go:291] "Event occurred" object="cert-manager/cert-manager-cainjector-84546bcf59" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: cert-manager-cainjector-84546bcf59-t6z69" | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: I0209 18:08:25.119107 2906 trace.go:205] Trace[1273958236]: "GuaranteedUpdate etcd3" type:*v1.Endpoints (09-Feb-2021 18:08:24.354) (total time: 764ms): | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: Trace[1273958236]: ---"initial value restored" 249ms (18:08:00.604) | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: Trace[1273958236]: ---"Transaction prepared" 289ms (18:08:00.893) | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: Trace[1273958236]: ---"Transaction committed" 225ms (18:08:00.119) | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: Trace[1273958236]: [764.050164ms] [764.050164ms] END | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: I0209 18:08:25.135953 2906 trace.go:205] Trace[2096222006]: "Create" url:/api/v1/namespaces/logs/pods/loki-0/eviction,user-agent:kubectl/v1.20.2 (linux/amd64) kubernetes/faecb19,client:10.0.7.12 (09-Feb-2021 18:08:24.219) (total time: 916ms): | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: Trace[2096222006]: ---"Object stored in database" 916ms (18:08:00.135) | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: Trace[2096222006]: [916.545508ms] [916.545508ms] END | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: I0209 18:08:25.143824 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 58bad71836a9756ccacb2236746bdb58e62a404685c22fd681b838d465aaf357 | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: I0209 18:08:25.329978 2906 trace.go:205] Trace[570866261]: "Create" url:/api/v1/namespaces/default/pods/minio-787b78d7c4-vm7br/eviction,user-agent:kubectl/v1.20.2 (linux/amd64) kubernetes/faecb19,client:10.0.7.12 (09-Feb-2021 18:08:24.441) (total time: 888ms): | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: Trace[570866261]: ---"Object stored in database" 888ms (18:08:00.329) | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: Trace[570866261]: [888.62476ms] [888.62476ms] END | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: I0209 18:08:25.330305 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 1d55a9d42259d527237e88a92b848b2389942d0d3691a8e12ff0bf0c1c9f28be | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: I0209 18:08:25.435793 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 32f39f534ae4d9f4d2fd72a1116b5e403dafdefdc5fb648eaf7d98ec821744d5 | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: I0209 18:08:25.439921 2906 trace.go:205] Trace[154999689]: "Create" url:/api/v1/namespaces/default/pods,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38/system:serviceaccount:kube-system:replicaset-controller,client:127.0.0.1 (09-Feb-2021 18:08:24.585) (total time: 854ms): | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: Trace[154999689]: ---"Object stored in database" 853ms (18:08:00.439) | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: Trace[154999689]: [854.40996ms] [854.40996ms] END | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: I0209 18:08:25.512184 2906 event.go:291] "Event occurred" object="default/blocky-76bcc874f4" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: blocky-76bcc874f4-d7g5d" | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: I0209 18:08:25.632763 2906 event.go:291] "Event occurred" object="rook-ceph/rook-ceph-crashcollector-k3s-0-544c5f5f45" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: rook-ceph-crashcollector-k3s-0-544c5f5f45-8ptzf" | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: I0209 18:08:25.634462 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 87a91244dd2a9d9dfedce1f26c40e9e07fea9073e6a662d3b6cb40d5ef64d807 | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: I0209 18:08:25.770887 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: abb948b10ab269a28a383054547ded26391d2d4573a32f2552da5c1ecd7fef87 | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: I0209 18:08:25.773005 2906 trace.go:205] Trace[1929999925]: "Create" url:/api/v1/namespaces/system-upgrade/pods,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38/system:serviceaccount:kube-system:replicaset-controller,client:127.0.0.1 (09-Feb-2021 18:08:25.256) (total time: 516ms): | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: Trace[1929999925]: ---"Object stored in database" 515ms (18:08:00.772) | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: Trace[1929999925]: [516.096856ms] [516.096856ms] END | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: I0209 18:08:25.828230 2906 event.go:291] "Event occurred" object="system-upgrade/system-upgrade-controller-b64b5bcb7" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: system-upgrade-controller-b64b5bcb7-mvbv8" | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: I0209 18:08:25.863145 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: c7756b187f69265f13ba31b4c2e14936bb6549ac892c201bb01a18364e8ebf34 | |
| Feb 09 18:08:25 k3s-0 k3s[2906]: I0209 18:08:25.969956 2906 event.go:291] "Event occurred" object="default/minio-787b78d7c4" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: minio-787b78d7c4-tcw98" | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.648302 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 7955fa9392bb6e33c0f9cc329900c556283ab2e95dc6bc2d90283589ac763a87 | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.666571 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 621479c935207addaa616d1b95aa99d082736b3af1d48c2ebfabb877576d7f71 | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.684375 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 4711537284e83706508a3e1f75e2546e275cad52b0a7b8f4ba5e910dea91bdbe | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.700153 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 204377173c94ddda90362459382bc20e995e8430611e8cfa43083b2cf53c3f22 | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.728918 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 1cb39851d326950ddecaaaa307e703eaf82509d83f7d401a66ff2c76529c05dd | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.779967 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 9c4f1b293c346904aa6577830844464c8561e18c80238c470e127941a10d8ad0 | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.807138 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 28648215e54709ee310bffde6a75b0330cdef5be6ba43c9487b00aaba7028db9 | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.827243 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "ceph-config" (UniqueName: "kubernetes.io/empty-dir/7f9c961f-4a50-4014-9f40-cd7c429ea582-ceph-config") pod "7f9c961f-4a50-4014-9f40-cd7c429ea582" (UID: "7f9c961f-4a50-4014-9f40-cd7c429ea582") | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.827413 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "config-volume" (UniqueName: "kubernetes.io/configmap/76f39ed7-94ea-4db9-b277-323e7bcd073e-config-volume") pod "76f39ed7-94ea-4db9-b277-323e7bcd073e" (UID: "76f39ed7-94ea-4db9-b277-323e7bcd073e") | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.827503 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "mon-endpoint-volume" (UniqueName: "kubernetes.io/configmap/7f9c961f-4a50-4014-9f40-cd7c429ea582-mon-endpoint-volume") pod "7f9c961f-4a50-4014-9f40-cd7c429ea582" (UID: "7f9c961f-4a50-4014-9f40-cd7c429ea582") | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.827665 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "coredns-token-cxb65" (UniqueName: "kubernetes.io/secret/76f39ed7-94ea-4db9-b277-323e7bcd073e-coredns-token-cxb65") pod "76f39ed7-94ea-4db9-b277-323e7bcd073e" (UID: "76f39ed7-94ea-4db9-b277-323e7bcd073e") | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.827735 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "default-token-j7f5c" (UniqueName: "kubernetes.io/secret/7f9c961f-4a50-4014-9f40-cd7c429ea582-default-token-j7f5c") pod "7f9c961f-4a50-4014-9f40-cd7c429ea582" (UID: "7f9c961f-4a50-4014-9f40-cd7c429ea582") | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: W0209 18:08:26.828911 2906 empty_dir.go:469] Warning: Failed to clear quota on /var/lib/kubelet/pods/7f9c961f-4a50-4014-9f40-cd7c429ea582/volumes/kubernetes.io~empty-dir/ceph-config: ClearQuota called, but quotas disabled | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: W0209 18:08:26.830185 2906 empty_dir.go:469] Warning: Failed to clear quota on /var/lib/kubelet/pods/76f39ed7-94ea-4db9-b277-323e7bcd073e/volumes/kubernetes.io~configmap/config-volume: ClearQuota called, but quotas disabled | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.830740 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76f39ed7-94ea-4db9-b277-323e7bcd073e-config-volume" (OuterVolumeSpecName: "config-volume") pod "76f39ed7-94ea-4db9-b277-323e7bcd073e" (UID: "76f39ed7-94ea-4db9-b277-323e7bcd073e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.830677 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f9c961f-4a50-4014-9f40-cd7c429ea582-ceph-config" (OuterVolumeSpecName: "ceph-config") pod "7f9c961f-4a50-4014-9f40-cd7c429ea582" (UID: "7f9c961f-4a50-4014-9f40-cd7c429ea582"). InnerVolumeSpecName "ceph-config". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: W0209 18:08:26.831111 2906 empty_dir.go:469] Warning: Failed to clear quota on /var/lib/kubelet/pods/7f9c961f-4a50-4014-9f40-cd7c429ea582/volumes/kubernetes.io~configmap/mon-endpoint-volume: ClearQuota called, but quotas disabled | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.831723 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f9c961f-4a50-4014-9f40-cd7c429ea582-mon-endpoint-volume" (OuterVolumeSpecName: "mon-endpoint-volume") pod "7f9c961f-4a50-4014-9f40-cd7c429ea582" (UID: "7f9c961f-4a50-4014-9f40-cd7c429ea582"). InnerVolumeSpecName "mon-endpoint-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.883218 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f9c961f-4a50-4014-9f40-cd7c429ea582-default-token-j7f5c" (OuterVolumeSpecName: "default-token-j7f5c") pod "7f9c961f-4a50-4014-9f40-cd7c429ea582" (UID: "7f9c961f-4a50-4014-9f40-cd7c429ea582"). InnerVolumeSpecName "default-token-j7f5c". PluginName "kubernetes.io/secret", VolumeGidValue "" | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.884818 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 9ae341c914f6a9fc8653585217a5974c3813241f3e909a8497db31df71a731c5 | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.913325 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76f39ed7-94ea-4db9-b277-323e7bcd073e-coredns-token-cxb65" (OuterVolumeSpecName: "coredns-token-cxb65") pod "76f39ed7-94ea-4db9-b277-323e7bcd073e" (UID: "76f39ed7-94ea-4db9-b277-323e7bcd073e"). InnerVolumeSpecName "coredns-token-cxb65". PluginName "kubernetes.io/secret", VolumeGidValue "" | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.922712 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 28648215e54709ee310bffde6a75b0330cdef5be6ba43c9487b00aaba7028db9 | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: E0209 18:08:26.932533 2906 remote_runtime.go:329] ContainerStatus "28648215e54709ee310bffde6a75b0330cdef5be6ba43c9487b00aaba7028db9" from runtime service failed: rpc error: code = NotFound desc = an error occurred when try to find container "28648215e54709ee310bffde6a75b0330cdef5be6ba43c9487b00aaba7028db9": not found | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: W0209 18:08:26.932731 2906 pod_container_deletor.go:52] [pod_container_deletor] DeleteContainer returned error for (id={containerd 28648215e54709ee310bffde6a75b0330cdef5be6ba43c9487b00aaba7028db9}): failed to get container status "28648215e54709ee310bffde6a75b0330cdef5be6ba43c9487b00aaba7028db9": rpc error: code = NotFound desc = an error occurred when try to find container "28648215e54709ee310bffde6a75b0330cdef5be6ba43c9487b00aaba7028db9": not found | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.932790 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 9ae341c914f6a9fc8653585217a5974c3813241f3e909a8497db31df71a731c5 | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.934091 2906 reconciler.go:319] Volume detached for volume "default-token-j7f5c" (UniqueName: "kubernetes.io/secret/7f9c961f-4a50-4014-9f40-cd7c429ea582-default-token-j7f5c") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.934129 2906 reconciler.go:319] Volume detached for volume "ceph-config" (UniqueName: "kubernetes.io/empty-dir/7f9c961f-4a50-4014-9f40-cd7c429ea582-ceph-config") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.934147 2906 reconciler.go:319] Volume detached for volume "config-volume" (UniqueName: "kubernetes.io/configmap/76f39ed7-94ea-4db9-b277-323e7bcd073e-config-volume") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.934169 2906 reconciler.go:319] Volume detached for volume "mon-endpoint-volume" (UniqueName: "kubernetes.io/configmap/7f9c961f-4a50-4014-9f40-cd7c429ea582-mon-endpoint-volume") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.934195 2906 reconciler.go:319] Volume detached for volume "coredns-token-cxb65" (UniqueName: "kubernetes.io/secret/76f39ed7-94ea-4db9-b277-323e7bcd073e-coredns-token-cxb65") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: E0209 18:08:26.944985 2906 remote_runtime.go:329] ContainerStatus "9ae341c914f6a9fc8653585217a5974c3813241f3e909a8497db31df71a731c5" from runtime service failed: rpc error: code = NotFound desc = an error occurred when try to find container "9ae341c914f6a9fc8653585217a5974c3813241f3e909a8497db31df71a731c5": not found | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: W0209 18:08:26.945482 2906 pod_container_deletor.go:52] [pod_container_deletor] DeleteContainer returned error for (id={containerd 9ae341c914f6a9fc8653585217a5974c3813241f3e909a8497db31df71a731c5}): failed to get container status "9ae341c914f6a9fc8653585217a5974c3813241f3e909a8497db31df71a731c5": rpc error: code = NotFound desc = an error occurred when try to find container "9ae341c914f6a9fc8653585217a5974c3813241f3e909a8497db31df71a731c5": not found | |
| Feb 09 18:08:26 k3s-0 k3s[2906]: I0209 18:08:26.945909 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: f97e4f2b7b5c8e19ab6cacba14ffe43da7c966f3d97d39f5b5caa08887cc4cba | |
| Feb 09 18:08:27 k3s-0 k3s[2906]: I0209 18:08:27.008929 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: ae578654e0b8bbb929cec387223bcd998b696811618e3adb4c050a16bd478643 | |
| Feb 09 18:08:27 k3s-0 k3s[2906]: I0209 18:08:27.054157 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: f97e4f2b7b5c8e19ab6cacba14ffe43da7c966f3d97d39f5b5caa08887cc4cba | |
| Feb 09 18:08:27 k3s-0 k3s[2906]: E0209 18:08:27.054917 2906 remote_runtime.go:329] ContainerStatus "f97e4f2b7b5c8e19ab6cacba14ffe43da7c966f3d97d39f5b5caa08887cc4cba" from runtime service failed: rpc error: code = NotFound desc = an error occurred when try to find container "f97e4f2b7b5c8e19ab6cacba14ffe43da7c966f3d97d39f5b5caa08887cc4cba": not found | |
| Feb 09 18:08:27 k3s-0 k3s[2906]: W0209 18:08:27.055000 2906 pod_container_deletor.go:52] [pod_container_deletor] DeleteContainer returned error for (id={containerd f97e4f2b7b5c8e19ab6cacba14ffe43da7c966f3d97d39f5b5caa08887cc4cba}): failed to get container status "f97e4f2b7b5c8e19ab6cacba14ffe43da7c966f3d97d39f5b5caa08887cc4cba": rpc error: code = NotFound desc = an error occurred when try to find container "f97e4f2b7b5c8e19ab6cacba14ffe43da7c966f3d97d39f5b5caa08887cc4cba": not found | |
| Feb 09 18:08:27 k3s-0 k3s[2906]: I0209 18:08:27.055036 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: ae578654e0b8bbb929cec387223bcd998b696811618e3adb4c050a16bd478643 | |
| Feb 09 18:08:27 k3s-0 k3s[2906]: E0209 18:08:27.056094 2906 remote_runtime.go:329] ContainerStatus "ae578654e0b8bbb929cec387223bcd998b696811618e3adb4c050a16bd478643" from runtime service failed: rpc error: code = NotFound desc = an error occurred when try to find container "ae578654e0b8bbb929cec387223bcd998b696811618e3adb4c050a16bd478643": not found | |
| Feb 09 18:08:27 k3s-0 k3s[2906]: W0209 18:08:27.056143 2906 pod_container_deletor.go:52] [pod_container_deletor] DeleteContainer returned error for (id={containerd ae578654e0b8bbb929cec387223bcd998b696811618e3adb4c050a16bd478643}): failed to get container status "ae578654e0b8bbb929cec387223bcd998b696811618e3adb4c050a16bd478643": rpc error: code = NotFound desc = an error occurred when try to find container "ae578654e0b8bbb929cec387223bcd998b696811618e3adb4c050a16bd478643": not found | |
| Feb 09 18:08:27 k3s-0 k3s[2906]: I0209 18:08:27.056171 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 4ffc912ab9cbbbf71e1b2ee5651b6c7174d65e8410a23a5cb186d7c77201138f | |
| Feb 09 18:08:27 k3s-0 k3s[2906]: I0209 18:08:27.074951 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 50c5b86ea122aa76ea40fd3d37ffba1db4738c0334b83d9da637c7d385e2750c | |
| Feb 09 18:08:27 k3s-0 k3s[2906]: I0209 18:08:27.104267 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 5bf8095940a7eed177f3479125fa2a370a44673749d55f7864051abc72ad6239 | |
| Feb 09 18:08:27 k3s-0 k3s[2906]: I0209 18:08:27.176198 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: f52b935c4747a9b154f678aba5255dd447a9aef19c4278fd8f03ce2acddd1901 | |
| Feb 09 18:08:27 k3s-0 k3s[2906]: I0209 18:08:27.229299 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: c8e920e33e22e8b3936b1efe6ec82eb556bc4c5a55e2420933289ab023908df2 | |
| Feb 09 18:08:27 k3s-0 k3s[2906]: I0209 18:08:27.254050 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: cf5fba88d4e2d14fbf4cfdfe846b64739c628735b364bff1fd6f02eeb962ee5f | |
| Feb 09 18:08:27 k3s-0 k3s[2906]: I0209 18:08:27.330489 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: bcfff47ac08c1151ee4febc4542bfbeefdaba1fe944d445c746855cef7ef2765 | |
| Feb 09 18:08:27 k3s-0 k3s[2906]: I0209 18:08:27.430084 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 49e1465e62f81505bdb445ae20c6c4b8e3b3dc793b87b183c8dfd3c7923d4ee4 | |
| Feb 09 18:08:27 k3s-0 k3s[2906]: I0209 18:08:27.454999 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: bcfff47ac08c1151ee4febc4542bfbeefdaba1fe944d445c746855cef7ef2765 | |
| Feb 09 18:08:27 k3s-0 k3s[2906]: E0209 18:08:27.457282 2906 remote_runtime.go:329] ContainerStatus "bcfff47ac08c1151ee4febc4542bfbeefdaba1fe944d445c746855cef7ef2765" from runtime service failed: rpc error: code = NotFound desc = an error occurred when try to find container "bcfff47ac08c1151ee4febc4542bfbeefdaba1fe944d445c746855cef7ef2765": not found | |
| Feb 09 18:08:27 k3s-0 k3s[2906]: W0209 18:08:27.457351 2906 pod_container_deletor.go:52] [pod_container_deletor] DeleteContainer returned error for (id={containerd bcfff47ac08c1151ee4febc4542bfbeefdaba1fe944d445c746855cef7ef2765}): failed to get container status "bcfff47ac08c1151ee4febc4542bfbeefdaba1fe944d445c746855cef7ef2765": rpc error: code = NotFound desc = an error occurred when try to find container "bcfff47ac08c1151ee4febc4542bfbeefdaba1fe944d445c746855cef7ef2765": not found | |
| Feb 09 18:08:27 k3s-0 k3s[2906]: I0209 18:08:27.457423 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 49e1465e62f81505bdb445ae20c6c4b8e3b3dc793b87b183c8dfd3c7923d4ee4 | |
| Feb 09 18:08:27 k3s-0 k3s[2906]: E0209 18:08:27.458120 2906 remote_runtime.go:329] ContainerStatus "49e1465e62f81505bdb445ae20c6c4b8e3b3dc793b87b183c8dfd3c7923d4ee4" from runtime service failed: rpc error: code = NotFound desc = an error occurred when try to find container "49e1465e62f81505bdb445ae20c6c4b8e3b3dc793b87b183c8dfd3c7923d4ee4": not found | |
| Feb 09 18:08:27 k3s-0 k3s[2906]: W0209 18:08:27.458151 2906 pod_container_deletor.go:52] [pod_container_deletor] DeleteContainer returned error for (id={containerd 49e1465e62f81505bdb445ae20c6c4b8e3b3dc793b87b183c8dfd3c7923d4ee4}): failed to get container status "49e1465e62f81505bdb445ae20c6c4b8e3b3dc793b87b183c8dfd3c7923d4ee4": rpc error: code = NotFound desc = an error occurred when try to find container "49e1465e62f81505bdb445ae20c6c4b8e3b3dc793b87b183c8dfd3c7923d4ee4": not found | |
| Feb 09 18:08:27 k3s-0 k3s[2906]: I0209 18:08:27.804482 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: cd50bfc3be16a77f9b2d21cd85dc9dc10c0f274b2a2e9d2cf010430d78503d59 | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.281912 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: bde7027f511d932c9f2f90a589529f38edf9e443e36bba15afb3791ca96a6541 | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.310100 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: cd50bfc3be16a77f9b2d21cd85dc9dc10c0f274b2a2e9d2cf010430d78503d59 | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: E0209 18:08:28.311049 2906 remote_runtime.go:329] ContainerStatus "cd50bfc3be16a77f9b2d21cd85dc9dc10c0f274b2a2e9d2cf010430d78503d59" from runtime service failed: rpc error: code = NotFound desc = an error occurred when try to find container "cd50bfc3be16a77f9b2d21cd85dc9dc10c0f274b2a2e9d2cf010430d78503d59": not found | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: W0209 18:08:28.311112 2906 pod_container_deletor.go:52] [pod_container_deletor] DeleteContainer returned error for (id={containerd cd50bfc3be16a77f9b2d21cd85dc9dc10c0f274b2a2e9d2cf010430d78503d59}): failed to get container status "cd50bfc3be16a77f9b2d21cd85dc9dc10c0f274b2a2e9d2cf010430d78503d59": rpc error: code = NotFound desc = an error occurred when try to find container "cd50bfc3be16a77f9b2d21cd85dc9dc10c0f274b2a2e9d2cf010430d78503d59": not found | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.311148 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: bde7027f511d932c9f2f90a589529f38edf9e443e36bba15afb3791ca96a6541 | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: E0209 18:08:28.312463 2906 remote_runtime.go:329] ContainerStatus "bde7027f511d932c9f2f90a589529f38edf9e443e36bba15afb3791ca96a6541" from runtime service failed: rpc error: code = NotFound desc = an error occurred when try to find container "bde7027f511d932c9f2f90a589529f38edf9e443e36bba15afb3791ca96a6541": not found | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: W0209 18:08:28.312790 2906 pod_container_deletor.go:52] [pod_container_deletor] DeleteContainer returned error for (id={containerd bde7027f511d932c9f2f90a589529f38edf9e443e36bba15afb3791ca96a6541}): failed to get container status "bde7027f511d932c9f2f90a589529f38edf9e443e36bba15afb3791ca96a6541": rpc error: code = NotFound desc = an error occurred when try to find container "bde7027f511d932c9f2f90a589529f38edf9e443e36bba15afb3791ca96a6541": not found | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.877294 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "ingress-nginx-backend-token-db2cf" (UniqueName: "kubernetes.io/secret/04535203-ec24-4256-8165-bed878c5c63a-ingress-nginx-backend-token-db2cf") pod "04535203-ec24-4256-8165-bed878c5c63a" (UID: "04535203-ec24-4256-8165-bed878c5c63a") | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.877387 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "tmp" (UniqueName: "kubernetes.io/empty-dir/ba0942af-41ca-4e18-959f-a07c57dda674-tmp") pod "ba0942af-41ca-4e18-959f-a07c57dda674" (UID: "ba0942af-41ca-4e18-959f-a07c57dda674") | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.877434 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "rook-ceph-system-token-d95ww" (UniqueName: "kubernetes.io/secret/0b36964d-a75e-47c6-86cf-a4ace1cc7f91-rook-ceph-system-token-d95ww") pod "0b36964d-a75e-47c6-86cf-a4ace1cc7f91" (UID: "0b36964d-a75e-47c6-86cf-a4ace1cc7f91") | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.877526 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "etc-ssl" (UniqueName: "kubernetes.io/host-path/ba0942af-41ca-4e18-959f-a07c57dda674-etc-ssl") pod "ba0942af-41ca-4e18-959f-a07c57dda674" (UID: "ba0942af-41ca-4e18-959f-a07c57dda674") | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.877576 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "temp" (UniqueName: "kubernetes.io/empty-dir/487a72ce-4f05-408c-8e67-7e9fc4068078-temp") pod "487a72ce-4f05-408c-8e67-7e9fc4068078" (UID: "487a72ce-4f05-408c-8e67-7e9fc4068078") | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.877627 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "helm-controller-token-hnchb" (UniqueName: "kubernetes.io/secret/487a72ce-4f05-408c-8e67-7e9fc4068078-helm-controller-token-hnchb") pod "487a72ce-4f05-408c-8e67-7e9fc4068078" (UID: "487a72ce-4f05-408c-8e67-7e9fc4068078") | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.877669 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "system-upgrade-token-gnb62" (UniqueName: "kubernetes.io/secret/ba0942af-41ca-4e18-959f-a07c57dda674-system-upgrade-token-gnb62") pod "ba0942af-41ca-4e18-959f-a07c57dda674" (UID: "ba0942af-41ca-4e18-959f-a07c57dda674") | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: W0209 18:08:28.879848 2906 empty_dir.go:469] Warning: Failed to clear quota on /var/lib/kubelet/pods/ba0942af-41ca-4e18-959f-a07c57dda674/volumes/kubernetes.io~empty-dir/tmp: ClearQuota called, but quotas disabled | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.879924 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba0942af-41ca-4e18-959f-a07c57dda674-tmp" (OuterVolumeSpecName: "tmp") pod "ba0942af-41ca-4e18-959f-a07c57dda674" (UID: "ba0942af-41ca-4e18-959f-a07c57dda674"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.880259 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/ba0942af-41ca-4e18-959f-a07c57dda674-etc-ssl" (OuterVolumeSpecName: "etc-ssl") pod "ba0942af-41ca-4e18-959f-a07c57dda674" (UID: "ba0942af-41ca-4e18-959f-a07c57dda674"). InnerVolumeSpecName "etc-ssl". PluginName "kubernetes.io/host-path", VolumeGidValue "" | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: W0209 18:08:28.882148 2906 empty_dir.go:469] Warning: Failed to clear quota on /var/lib/kubelet/pods/487a72ce-4f05-408c-8e67-7e9fc4068078/volumes/kubernetes.io~empty-dir/temp: ClearQuota called, but quotas disabled | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.882578 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/487a72ce-4f05-408c-8e67-7e9fc4068078-temp" (OuterVolumeSpecName: "temp") pod "487a72ce-4f05-408c-8e67-7e9fc4068078" (UID: "487a72ce-4f05-408c-8e67-7e9fc4068078"). InnerVolumeSpecName "temp". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.917635 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba0942af-41ca-4e18-959f-a07c57dda674-system-upgrade-token-gnb62" (OuterVolumeSpecName: "system-upgrade-token-gnb62") pod "ba0942af-41ca-4e18-959f-a07c57dda674" (UID: "ba0942af-41ca-4e18-959f-a07c57dda674"). InnerVolumeSpecName "system-upgrade-token-gnb62". PluginName "kubernetes.io/secret", VolumeGidValue "" | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.921189 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04535203-ec24-4256-8165-bed878c5c63a-ingress-nginx-backend-token-db2cf" (OuterVolumeSpecName: "ingress-nginx-backend-token-db2cf") pod "04535203-ec24-4256-8165-bed878c5c63a" (UID: "04535203-ec24-4256-8165-bed878c5c63a"). InnerVolumeSpecName "ingress-nginx-backend-token-db2cf". PluginName "kubernetes.io/secret", VolumeGidValue "" | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.950894 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b36964d-a75e-47c6-86cf-a4ace1cc7f91-rook-ceph-system-token-d95ww" (OuterVolumeSpecName: "rook-ceph-system-token-d95ww") pod "0b36964d-a75e-47c6-86cf-a4ace1cc7f91" (UID: "0b36964d-a75e-47c6-86cf-a4ace1cc7f91"). InnerVolumeSpecName "rook-ceph-system-token-d95ww". PluginName "kubernetes.io/secret", VolumeGidValue "" | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.968564 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/487a72ce-4f05-408c-8e67-7e9fc4068078-helm-controller-token-hnchb" (OuterVolumeSpecName: "helm-controller-token-hnchb") pod "487a72ce-4f05-408c-8e67-7e9fc4068078" (UID: "487a72ce-4f05-408c-8e67-7e9fc4068078"). InnerVolumeSpecName "helm-controller-token-hnchb". PluginName "kubernetes.io/secret", VolumeGidValue "" | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.979214 2906 reconciler.go:319] Volume detached for volume "ingress-nginx-backend-token-db2cf" (UniqueName: "kubernetes.io/secret/04535203-ec24-4256-8165-bed878c5c63a-ingress-nginx-backend-token-db2cf") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.979272 2906 reconciler.go:319] Volume detached for volume "tmp" (UniqueName: "kubernetes.io/empty-dir/ba0942af-41ca-4e18-959f-a07c57dda674-tmp") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.979292 2906 reconciler.go:319] Volume detached for volume "rook-ceph-system-token-d95ww" (UniqueName: "kubernetes.io/secret/0b36964d-a75e-47c6-86cf-a4ace1cc7f91-rook-ceph-system-token-d95ww") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.979308 2906 reconciler.go:319] Volume detached for volume "temp" (UniqueName: "kubernetes.io/empty-dir/487a72ce-4f05-408c-8e67-7e9fc4068078-temp") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.979326 2906 reconciler.go:319] Volume detached for volume "etc-ssl" (UniqueName: "kubernetes.io/host-path/ba0942af-41ca-4e18-959f-a07c57dda674-etc-ssl") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.979342 2906 reconciler.go:319] Volume detached for volume "system-upgrade-token-gnb62" (UniqueName: "kubernetes.io/secret/ba0942af-41ca-4e18-959f-a07c57dda674-system-upgrade-token-gnb62") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:28 k3s-0 k3s[2906]: I0209 18:08:28.979358 2906 reconciler.go:319] Volume detached for volume "helm-controller-token-hnchb" (UniqueName: "kubernetes.io/secret/487a72ce-4f05-408c-8e67-7e9fc4068078-helm-controller-token-hnchb") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:29 k3s-0 k3s[2906]: I0209 18:08:29.865755 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: e22818bb4e6e874fef622e49117a5d589cb6e6c83c14d48f3eb2ec5ce4f26373 | |
| Feb 09 18:08:29 k3s-0 k3s[2906]: I0209 18:08:29.889544 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: e22818bb4e6e874fef622e49117a5d589cb6e6c83c14d48f3eb2ec5ce4f26373 | |
| Feb 09 18:08:29 k3s-0 k3s[2906]: E0209 18:08:29.890909 2906 remote_runtime.go:329] ContainerStatus "e22818bb4e6e874fef622e49117a5d589cb6e6c83c14d48f3eb2ec5ce4f26373" from runtime service failed: rpc error: code = NotFound desc = an error occurred when try to find container "e22818bb4e6e874fef622e49117a5d589cb6e6c83c14d48f3eb2ec5ce4f26373": not found | |
| Feb 09 18:08:29 k3s-0 k3s[2906]: W0209 18:08:29.891318 2906 pod_container_deletor.go:52] [pod_container_deletor] DeleteContainer returned error for (id={containerd e22818bb4e6e874fef622e49117a5d589cb6e6c83c14d48f3eb2ec5ce4f26373}): failed to get container status "e22818bb4e6e874fef622e49117a5d589cb6e6c83c14d48f3eb2ec5ce4f26373": rpc error: code = NotFound desc = an error occurred when try to find container "e22818bb4e6e874fef622e49117a5d589cb6e6c83c14d48f3eb2ec5ce4f26373": not found | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.930725 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "rook-ceph-crash" (UniqueName: "kubernetes.io/host-path/4d3dbc6c-2b78-40ba-9705-731933096179-rook-ceph-crash") pod "4d3dbc6c-2b78-40ba-9705-731933096179" (UID: "4d3dbc6c-2b78-40ba-9705-731933096179") | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.930801 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "ceph-daemon-data" (UniqueName: "kubernetes.io/host-path/4d3dbc6c-2b78-40ba-9705-731933096179-ceph-daemon-data") pod "4d3dbc6c-2b78-40ba-9705-731933096179" (UID: "4d3dbc6c-2b78-40ba-9705-731933096179") | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.930848 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "default-token-j7f5c" (UniqueName: "kubernetes.io/secret/b87fc8b6-bb83-473e-8071-30e492d87bbb-default-token-j7f5c") pod "b87fc8b6-bb83-473e-8071-30e492d87bbb" (UID: "b87fc8b6-bb83-473e-8071-30e492d87bbb") | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.930889 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "config" (UniqueName: "kubernetes.io/projected/6e6a7cb4-e952-4e6e-803e-f1c828ec1ce4-config") pod "6e6a7cb4-e952-4e6e-803e-f1c828ec1ce4" (UID: "6e6a7cb4-e952-4e6e-803e-f1c828ec1ce4") | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.930928 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "default-token-j7f5c" (UniqueName: "kubernetes.io/secret/4d3dbc6c-2b78-40ba-9705-731933096179-default-token-j7f5c") pod "4d3dbc6c-2b78-40ba-9705-731933096179" (UID: "4d3dbc6c-2b78-40ba-9705-731933096179") | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.930994 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "config-volume" (UniqueName: "kubernetes.io/configmap/95e186e6-2383-4a8e-bb6f-7bf5f6eeef76-config-volume") pod "95e186e6-2383-4a8e-bb6f-7bf5f6eeef76" (UID: "95e186e6-2383-4a8e-bb6f-7bf5f6eeef76") | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.931042 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "cert-manager-cainjector-token-wlptn" (UniqueName: "kubernetes.io/secret/d01b3ca1-c68d-44aa-8582-381b5c845fee-cert-manager-cainjector-token-wlptn") pod "d01b3ca1-c68d-44aa-8582-381b5c845fee" (UID: "d01b3ca1-c68d-44aa-8582-381b5c845fee") | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.933605 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "minio-token-c6scv" (UniqueName: "kubernetes.io/secret/553ea4f6-761f-4a0d-909c-afe04ba741d2-minio-token-c6scv") pod "553ea4f6-761f-4a0d-909c-afe04ba741d2" (UID: "553ea4f6-761f-4a0d-909c-afe04ba741d2") | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.933967 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "rook-ceph-log" (UniqueName: "kubernetes.io/host-path/4d3dbc6c-2b78-40ba-9705-731933096179-rook-ceph-log") pod "4d3dbc6c-2b78-40ba-9705-731933096179" (UID: "4d3dbc6c-2b78-40ba-9705-731933096179") | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.934381 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "rook-config-override" (UniqueName: "kubernetes.io/projected/b87fc8b6-bb83-473e-8071-30e492d87bbb-rook-config-override") pod "b87fc8b6-bb83-473e-8071-30e492d87bbb" (UID: "b87fc8b6-bb83-473e-8071-30e492d87bbb") | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.934884 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "rook-ceph-crash-collector-keyring" (UniqueName: "kubernetes.io/secret/b87fc8b6-bb83-473e-8071-30e492d87bbb-rook-ceph-crash-collector-keyring") pod "b87fc8b6-bb83-473e-8071-30e492d87bbb" (UID: "b87fc8b6-bb83-473e-8071-30e492d87bbb") | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.934127 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/4d3dbc6c-2b78-40ba-9705-731933096179-rook-ceph-log" (OuterVolumeSpecName: "rook-ceph-log") pod "4d3dbc6c-2b78-40ba-9705-731933096179" (UID: "4d3dbc6c-2b78-40ba-9705-731933096179"). InnerVolumeSpecName "rook-ceph-log". PluginName "kubernetes.io/host-path", VolumeGidValue "" | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.936214 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "default-token-8hf5p" (UniqueName: "kubernetes.io/secret/6e6a7cb4-e952-4e6e-803e-f1c828ec1ce4-default-token-8hf5p") pod "6e6a7cb4-e952-4e6e-803e-f1c828ec1ce4" (UID: "6e6a7cb4-e952-4e6e-803e-f1c828ec1ce4") | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.936274 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "snapshot-controller-token-kf6cn" (UniqueName: "kubernetes.io/secret/ac443c2b-2513-4e71-b2a0-73e9bf27c5f9-snapshot-controller-token-kf6cn") pod "ac443c2b-2513-4e71-b2a0-73e9bf27c5f9" (UID: "ac443c2b-2513-4e71-b2a0-73e9bf27c5f9") | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.936306 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "rook-ceph-crash" (UniqueName: "kubernetes.io/host-path/b87fc8b6-bb83-473e-8071-30e492d87bbb-rook-ceph-crash") pod "b87fc8b6-bb83-473e-8071-30e492d87bbb" (UID: "b87fc8b6-bb83-473e-8071-30e492d87bbb") | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.936391 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "export" (UniqueName: "kubernetes.io/nfs/553ea4f6-761f-4a0d-909c-afe04ba741d2-nfs-data-pv") pod "553ea4f6-761f-4a0d-909c-afe04ba741d2" (UID: "553ea4f6-761f-4a0d-909c-afe04ba741d2") | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.936428 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "rook-ceph-log" (UniqueName: "kubernetes.io/host-path/b87fc8b6-bb83-473e-8071-30e492d87bbb-rook-ceph-log") pod "b87fc8b6-bb83-473e-8071-30e492d87bbb" (UID: "b87fc8b6-bb83-473e-8071-30e492d87bbb") | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.936470 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "rook-config-override" (UniqueName: "kubernetes.io/projected/4d3dbc6c-2b78-40ba-9705-731933096179-rook-config-override") pod "4d3dbc6c-2b78-40ba-9705-731933096179" (UID: "4d3dbc6c-2b78-40ba-9705-731933096179") | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.936522 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "default-token-sxqcl" (UniqueName: "kubernetes.io/secret/95e186e6-2383-4a8e-bb6f-7bf5f6eeef76-default-token-sxqcl") pod "95e186e6-2383-4a8e-bb6f-7bf5f6eeef76" (UID: "95e186e6-2383-4a8e-bb6f-7bf5f6eeef76") | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.936562 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "rook-ceph-mons-keyring" (UniqueName: "kubernetes.io/secret/4d3dbc6c-2b78-40ba-9705-731933096179-rook-ceph-mons-keyring") pod "4d3dbc6c-2b78-40ba-9705-731933096179" (UID: "4d3dbc6c-2b78-40ba-9705-731933096179") | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.937015 2906 reconciler.go:319] Volume detached for volume "rook-ceph-log" (UniqueName: "kubernetes.io/host-path/4d3dbc6c-2b78-40ba-9705-731933096179-rook-ceph-log") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.938200 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b87fc8b6-bb83-473e-8071-30e492d87bbb-rook-ceph-crash" (OuterVolumeSpecName: "rook-ceph-crash") pod "b87fc8b6-bb83-473e-8071-30e492d87bbb" (UID: "b87fc8b6-bb83-473e-8071-30e492d87bbb"). InnerVolumeSpecName "rook-ceph-crash". PluginName "kubernetes.io/host-path", VolumeGidValue "" | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.939056 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b87fc8b6-bb83-473e-8071-30e492d87bbb-rook-ceph-log" (OuterVolumeSpecName: "rook-ceph-log") pod "b87fc8b6-bb83-473e-8071-30e492d87bbb" (UID: "b87fc8b6-bb83-473e-8071-30e492d87bbb"). InnerVolumeSpecName "rook-ceph-log". PluginName "kubernetes.io/host-path", VolumeGidValue "" | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.947929 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/4d3dbc6c-2b78-40ba-9705-731933096179-rook-ceph-crash" (OuterVolumeSpecName: "rook-ceph-crash") pod "4d3dbc6c-2b78-40ba-9705-731933096179" (UID: "4d3dbc6c-2b78-40ba-9705-731933096179"). InnerVolumeSpecName "rook-ceph-crash". PluginName "kubernetes.io/host-path", VolumeGidValue "" | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.948043 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/4d3dbc6c-2b78-40ba-9705-731933096179-ceph-daemon-data" (OuterVolumeSpecName: "ceph-daemon-data") pod "4d3dbc6c-2b78-40ba-9705-731933096179" (UID: "4d3dbc6c-2b78-40ba-9705-731933096179"). InnerVolumeSpecName "ceph-daemon-data". PluginName "kubernetes.io/host-path", VolumeGidValue "" | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: W0209 18:08:30.950676 2906 empty_dir.go:469] Warning: Failed to clear quota on /var/lib/kubelet/pods/95e186e6-2383-4a8e-bb6f-7bf5f6eeef76/volumes/kubernetes.io~configmap/config-volume: ClearQuota called, but quotas disabled | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.951064 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95e186e6-2383-4a8e-bb6f-7bf5f6eeef76-config-volume" (OuterVolumeSpecName: "config-volume") pod "95e186e6-2383-4a8e-bb6f-7bf5f6eeef76" (UID: "95e186e6-2383-4a8e-bb6f-7bf5f6eeef76"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue "" | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.976410 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d01b3ca1-c68d-44aa-8582-381b5c845fee-cert-manager-cainjector-token-wlptn" (OuterVolumeSpecName: "cert-manager-cainjector-token-wlptn") pod "d01b3ca1-c68d-44aa-8582-381b5c845fee" (UID: "d01b3ca1-c68d-44aa-8582-381b5c845fee"). InnerVolumeSpecName "cert-manager-cainjector-token-wlptn". PluginName "kubernetes.io/secret", VolumeGidValue "" | |
| Feb 09 18:08:30 k3s-0 k3s[2906]: I0209 18:08:30.991276 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/553ea4f6-761f-4a0d-909c-afe04ba741d2-minio-token-c6scv" (OuterVolumeSpecName: "minio-token-c6scv") pod "553ea4f6-761f-4a0d-909c-afe04ba741d2" (UID: "553ea4f6-761f-4a0d-909c-afe04ba741d2"). InnerVolumeSpecName "minio-token-c6scv". PluginName "kubernetes.io/secret", VolumeGidValue "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.007628 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b87fc8b6-bb83-473e-8071-30e492d87bbb-rook-ceph-crash-collector-keyring" (OuterVolumeSpecName: "rook-ceph-crash-collector-keyring") pod "b87fc8b6-bb83-473e-8071-30e492d87bbb" (UID: "b87fc8b6-bb83-473e-8071-30e492d87bbb"). InnerVolumeSpecName "rook-ceph-crash-collector-keyring". PluginName "kubernetes.io/secret", VolumeGidValue "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.009510 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b87fc8b6-bb83-473e-8071-30e492d87bbb-rook-config-override" (OuterVolumeSpecName: "rook-config-override") pod "b87fc8b6-bb83-473e-8071-30e492d87bbb" (UID: "b87fc8b6-bb83-473e-8071-30e492d87bbb"). InnerVolumeSpecName "rook-config-override". PluginName "kubernetes.io/projected", VolumeGidValue "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.011305 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d3dbc6c-2b78-40ba-9705-731933096179-rook-ceph-mons-keyring" (OuterVolumeSpecName: "rook-ceph-mons-keyring") pod "4d3dbc6c-2b78-40ba-9705-731933096179" (UID: "4d3dbc6c-2b78-40ba-9705-731933096179"). InnerVolumeSpecName "rook-ceph-mons-keyring". PluginName "kubernetes.io/secret", VolumeGidValue "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.020368 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e6a7cb4-e952-4e6e-803e-f1c828ec1ce4-default-token-8hf5p" (OuterVolumeSpecName: "default-token-8hf5p") pod "6e6a7cb4-e952-4e6e-803e-f1c828ec1ce4" (UID: "6e6a7cb4-e952-4e6e-803e-f1c828ec1ce4"). InnerVolumeSpecName "default-token-8hf5p". PluginName "kubernetes.io/secret", VolumeGidValue "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.038539 2906 reconciler.go:319] Volume detached for volume "rook-ceph-mons-keyring" (UniqueName: "kubernetes.io/secret/4d3dbc6c-2b78-40ba-9705-731933096179-rook-ceph-mons-keyring") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.038905 2906 reconciler.go:319] Volume detached for volume "rook-ceph-crash" (UniqueName: "kubernetes.io/host-path/4d3dbc6c-2b78-40ba-9705-731933096179-rook-ceph-crash") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.039139 2906 reconciler.go:319] Volume detached for volume "ceph-daemon-data" (UniqueName: "kubernetes.io/host-path/4d3dbc6c-2b78-40ba-9705-731933096179-ceph-daemon-data") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.039525 2906 reconciler.go:319] Volume detached for volume "config-volume" (UniqueName: "kubernetes.io/configmap/95e186e6-2383-4a8e-bb6f-7bf5f6eeef76-config-volume") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.039731 2906 reconciler.go:319] Volume detached for volume "cert-manager-cainjector-token-wlptn" (UniqueName: "kubernetes.io/secret/d01b3ca1-c68d-44aa-8582-381b5c845fee-cert-manager-cainjector-token-wlptn") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.039928 2906 reconciler.go:319] Volume detached for volume "minio-token-c6scv" (UniqueName: "kubernetes.io/secret/553ea4f6-761f-4a0d-909c-afe04ba741d2-minio-token-c6scv") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.040112 2906 reconciler.go:319] Volume detached for volume "rook-config-override" (UniqueName: "kubernetes.io/projected/b87fc8b6-bb83-473e-8071-30e492d87bbb-rook-config-override") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.040296 2906 reconciler.go:319] Volume detached for volume "rook-ceph-crash-collector-keyring" (UniqueName: "kubernetes.io/secret/b87fc8b6-bb83-473e-8071-30e492d87bbb-rook-ceph-crash-collector-keyring") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.040343 2906 reconciler.go:319] Volume detached for volume "default-token-8hf5p" (UniqueName: "kubernetes.io/secret/6e6a7cb4-e952-4e6e-803e-f1c828ec1ce4-default-token-8hf5p") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.040361 2906 reconciler.go:319] Volume detached for volume "rook-ceph-crash" (UniqueName: "kubernetes.io/host-path/b87fc8b6-bb83-473e-8071-30e492d87bbb-rook-ceph-crash") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.040378 2906 reconciler.go:319] Volume detached for volume "rook-ceph-log" (UniqueName: "kubernetes.io/host-path/b87fc8b6-bb83-473e-8071-30e492d87bbb-rook-ceph-log") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.049461 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac443c2b-2513-4e71-b2a0-73e9bf27c5f9-snapshot-controller-token-kf6cn" (OuterVolumeSpecName: "snapshot-controller-token-kf6cn") pod "ac443c2b-2513-4e71-b2a0-73e9bf27c5f9" (UID: "ac443c2b-2513-4e71-b2a0-73e9bf27c5f9"). InnerVolumeSpecName "snapshot-controller-token-kf6cn". PluginName "kubernetes.io/secret", VolumeGidValue "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.073326 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b87fc8b6-bb83-473e-8071-30e492d87bbb-default-token-j7f5c" (OuterVolumeSpecName: "default-token-j7f5c") pod "b87fc8b6-bb83-473e-8071-30e492d87bbb" (UID: "b87fc8b6-bb83-473e-8071-30e492d87bbb"). InnerVolumeSpecName "default-token-j7f5c". PluginName "kubernetes.io/secret", VolumeGidValue "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.073521 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95e186e6-2383-4a8e-bb6f-7bf5f6eeef76-default-token-sxqcl" (OuterVolumeSpecName: "default-token-sxqcl") pod "95e186e6-2383-4a8e-bb6f-7bf5f6eeef76" (UID: "95e186e6-2383-4a8e-bb6f-7bf5f6eeef76"). InnerVolumeSpecName "default-token-sxqcl". PluginName "kubernetes.io/secret", VolumeGidValue "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.075923 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d3dbc6c-2b78-40ba-9705-731933096179-rook-config-override" (OuterVolumeSpecName: "rook-config-override") pod "4d3dbc6c-2b78-40ba-9705-731933096179" (UID: "4d3dbc6c-2b78-40ba-9705-731933096179"). InnerVolumeSpecName "rook-config-override". PluginName "kubernetes.io/projected", VolumeGidValue "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.079928 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d3dbc6c-2b78-40ba-9705-731933096179-default-token-j7f5c" (OuterVolumeSpecName: "default-token-j7f5c") pod "4d3dbc6c-2b78-40ba-9705-731933096179" (UID: "4d3dbc6c-2b78-40ba-9705-731933096179"). InnerVolumeSpecName "default-token-j7f5c". PluginName "kubernetes.io/secret", VolumeGidValue "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.133848 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e6a7cb4-e952-4e6e-803e-f1c828ec1ce4-config" (OuterVolumeSpecName: "config") pod "6e6a7cb4-e952-4e6e-803e-f1c828ec1ce4" (UID: "6e6a7cb4-e952-4e6e-803e-f1c828ec1ce4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/projected", VolumeGidValue "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.143760 2906 reconciler.go:319] Volume detached for volume "default-token-j7f5c" (UniqueName: "kubernetes.io/secret/4d3dbc6c-2b78-40ba-9705-731933096179-default-token-j7f5c") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.143828 2906 reconciler.go:319] Volume detached for volume "snapshot-controller-token-kf6cn" (UniqueName: "kubernetes.io/secret/ac443c2b-2513-4e71-b2a0-73e9bf27c5f9-snapshot-controller-token-kf6cn") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.143849 2906 reconciler.go:319] Volume detached for volume "rook-config-override" (UniqueName: "kubernetes.io/projected/4d3dbc6c-2b78-40ba-9705-731933096179-rook-config-override") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.143865 2906 reconciler.go:319] Volume detached for volume "default-token-sxqcl" (UniqueName: "kubernetes.io/secret/95e186e6-2383-4a8e-bb6f-7bf5f6eeef76-default-token-sxqcl") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.143880 2906 reconciler.go:319] Volume detached for volume "default-token-j7f5c" (UniqueName: "kubernetes.io/secret/b87fc8b6-bb83-473e-8071-30e492d87bbb-default-token-j7f5c") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.143896 2906 reconciler.go:319] Volume detached for volume "config" (UniqueName: "kubernetes.io/projected/6e6a7cb4-e952-4e6e-803e-f1c828ec1ce4-config") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.302994 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/nfs/553ea4f6-761f-4a0d-909c-afe04ba741d2-nfs-data-pv" (OuterVolumeSpecName: "export") pod "553ea4f6-761f-4a0d-909c-afe04ba741d2" (UID: "553ea4f6-761f-4a0d-909c-afe04ba741d2"). InnerVolumeSpecName "nfs-data-pv". PluginName "kubernetes.io/nfs", VolumeGidValue "" | |
| Feb 09 18:08:31 k3s-0 k3s[2906]: I0209 18:08:31.344410 2906 reconciler.go:319] Volume detached for volume "nfs-data-pv" (UniqueName: "kubernetes.io/nfs/553ea4f6-761f-4a0d-909c-afe04ba741d2-nfs-data-pv") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:32 k3s-0 k3s[2906]: I0209 18:08:32.360190 2906 request.go:645] Throttling request took 1.044084358s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 18:08:32 k3s-0 k3s[2906]: I0209 18:08:32.363942 2906 trace.go:205] Trace[725070989]: "List" url:/api/v1/secrets,user-agent:rook/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.36 (09-Feb-2021 18:08:29.220) (total time: 3143ms): | |
| Feb 09 18:08:32 k3s-0 k3s[2906]: Trace[725070989]: ---"Writing http response done" count:508 3143ms (18:08:00.363) | |
| Feb 09 18:08:32 k3s-0 k3s[2906]: Trace[725070989]: [3.143764987s] [3.143764987s] END | |
| Feb 09 18:08:35 k3s-0 k3s[2906]: I0209 18:08:35.292669 2906 event.go:291] "Event occurred" object="rook-ceph/rook-ceph-csi-detect-version" kind="Job" apiVersion="batch/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: rook-ceph-csi-detect-version-6zj7s" | |
| Feb 09 18:08:36 k3s-0 k3s[2906]: I0209 18:08:36.069865 2906 event.go:291] "Event occurred" object="rook-ceph/rook-ceph-detect-version" kind="Job" apiVersion="batch/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: rook-ceph-detect-version-8psjb" | |
| Feb 09 18:08:37 k3s-0 k3s[2906]: I0209 18:08:37.924093 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 115b4af182dc00801de29ffc320bacf58feec23154e9a9462ab4e1dfce607649 | |
| Feb 09 18:08:37 k3s-0 k3s[2906]: I0209 18:08:37.939771 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 434ddd37296432e3f117316598e1900e567d2030e9c535c9f543c37418d03011 | |
| Feb 09 18:08:38 k3s-0 k3s[2906]: I0209 18:08:38.982092 2906 event.go:291] "Event occurred" object="rook-ceph/rook-ceph-detect-version" kind="Job" apiVersion="batch/v1" type="Normal" reason="Completed" message="Job completed" | |
| Feb 09 18:08:39 k3s-0 k3s[2906]: I0209 18:08:39.037192 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "config" (UniqueName: "kubernetes.io/secret/7d87b99c-67f9-401e-bbf4-224b84b49aaa-config") pod "7d87b99c-67f9-401e-bbf4-224b84b49aaa" (UID: "7d87b99c-67f9-401e-bbf4-224b84b49aaa") | |
| Feb 09 18:08:39 k3s-0 k3s[2906]: I0209 18:08:39.037284 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "storage" (UniqueName: "kubernetes.io/empty-dir/7d87b99c-67f9-401e-bbf4-224b84b49aaa-storage") pod "7d87b99c-67f9-401e-bbf4-224b84b49aaa" (UID: "7d87b99c-67f9-401e-bbf4-224b84b49aaa") | |
| Feb 09 18:08:39 k3s-0 k3s[2906]: I0209 18:08:39.037336 2906 reconciler.go:196] operationExecutor.UnmountVolume started for volume "loki-token-xhkxh" (UniqueName: "kubernetes.io/secret/7d87b99c-67f9-401e-bbf4-224b84b49aaa-loki-token-xhkxh") pod "7d87b99c-67f9-401e-bbf4-224b84b49aaa" (UID: "7d87b99c-67f9-401e-bbf4-224b84b49aaa") | |
| Feb 09 18:08:39 k3s-0 k3s[2906]: W0209 18:08:39.040043 2906 empty_dir.go:469] Warning: Failed to clear quota on /var/lib/kubelet/pods/7d87b99c-67f9-401e-bbf4-224b84b49aaa/volumes/kubernetes.io~empty-dir/storage: ClearQuota called, but quotas disabled | |
| Feb 09 18:08:39 k3s-0 k3s[2906]: I0209 18:08:39.049184 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d87b99c-67f9-401e-bbf4-224b84b49aaa-loki-token-xhkxh" (OuterVolumeSpecName: "loki-token-xhkxh") pod "7d87b99c-67f9-401e-bbf4-224b84b49aaa" (UID: "7d87b99c-67f9-401e-bbf4-224b84b49aaa"). InnerVolumeSpecName "loki-token-xhkxh". PluginName "kubernetes.io/secret", VolumeGidValue "" | |
| Feb 09 18:08:39 k3s-0 k3s[2906]: I0209 18:08:39.071069 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d87b99c-67f9-401e-bbf4-224b84b49aaa-config" (OuterVolumeSpecName: "config") pod "7d87b99c-67f9-401e-bbf4-224b84b49aaa" (UID: "7d87b99c-67f9-401e-bbf4-224b84b49aaa"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" | |
| Feb 09 18:08:39 k3s-0 k3s[2906]: I0209 18:08:39.097446 2906 event.go:291] "Event occurred" object="rook-ceph/snapshot-controller" kind="StatefulSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="create Pod snapshot-controller-0 in StatefulSet snapshot-controller successful" | |
| Feb 09 18:08:39 k3s-0 k3s[2906]: I0209 18:08:39.098472 2906 operation_generator.go:788] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d87b99c-67f9-401e-bbf4-224b84b49aaa-storage" (OuterVolumeSpecName: "storage") pod "7d87b99c-67f9-401e-bbf4-224b84b49aaa" (UID: "7d87b99c-67f9-401e-bbf4-224b84b49aaa"). InnerVolumeSpecName "storage". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" | |
| Feb 09 18:08:39 k3s-0 k3s[2906]: I0209 18:08:39.140870 2906 reconciler.go:319] Volume detached for volume "loki-token-xhkxh" (UniqueName: "kubernetes.io/secret/7d87b99c-67f9-401e-bbf4-224b84b49aaa-loki-token-xhkxh") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:39 k3s-0 k3s[2906]: I0209 18:08:39.140933 2906 reconciler.go:319] Volume detached for volume "config" (UniqueName: "kubernetes.io/secret/7d87b99c-67f9-401e-bbf4-224b84b49aaa-config") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:39 k3s-0 k3s[2906]: I0209 18:08:39.140952 2906 reconciler.go:319] Volume detached for volume "storage" (UniqueName: "kubernetes.io/empty-dir/7d87b99c-67f9-401e-bbf4-224b84b49aaa-storage") on node "k3s-0" DevicePath "" | |
| Feb 09 18:08:41 k3s-0 k3s[2906]: I0209 18:08:41.201272 2906 trace.go:205] Trace[1939184189]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:operator/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 18:08:39.917) (total time: 1283ms): | |
| Feb 09 18:08:41 k3s-0 k3s[2906]: Trace[1939184189]: ---"Writing http response done" count:80 1158ms (18:08:00.201) | |
| Feb 09 18:08:41 k3s-0 k3s[2906]: Trace[1939184189]: [1.283543865s] [1.283543865s] END | |
| Feb 09 18:08:43 k3s-0 k3s[2906]: I0209 18:08:43.601362 2906 event.go:291] "Event occurred" object="rook-ceph/rook-ceph-csi-detect-version" kind="Job" apiVersion="batch/v1" type="Normal" reason="Completed" message="Job completed" | |
| Feb 09 18:08:46 k3s-0 k3s[2906]: I0209 18:08:46.945314 2906 trace.go:205] Trace[652095565]: "List" url:/api/v1/secrets,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,client:10.2.0.38 (09-Feb-2021 18:08:45.198) (total time: 1747ms): | |
| Feb 09 18:08:46 k3s-0 k3s[2906]: Trace[652095565]: ---"Writing http response done" count:508 1746ms (18:08:00.945) | |
| Feb 09 18:08:46 k3s-0 k3s[2906]: Trace[652095565]: [1.747018669s] [1.747018669s] END | |
| Feb 09 18:08:47 k3s-0 k3s[2906]: I0209 18:08:47.055365 2906 trace.go:205] Trace[1182571997]: "List" url:/api/v1/secrets,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,client:10.2.0.38 (09-Feb-2021 18:08:45.303) (total time: 1751ms): | |
| Feb 09 18:08:47 k3s-0 k3s[2906]: Trace[1182571997]: ---"Writing http response done" count:508 1750ms (18:08:00.055) | |
| Feb 09 18:08:47 k3s-0 k3s[2906]: Trace[1182571997]: [1.75141978s] [1.75141978s] END | |
| Feb 09 18:08:48 k3s-0 k3s[2906]: I0209 18:08:48.182711 2906 trace.go:205] Trace[1064384129]: "Update" url:/apis/apiextensions.k8s.io/v1beta1/customresourcedefinitions/clusterissuers.cert-manager.io,user-agent:cainjector/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,client:10.2.0.38 (09-Feb-2021 18:08:47.669) (total time: 512ms): | |
| Feb 09 18:08:48 k3s-0 k3s[2906]: Trace[1064384129]: ---"Object stored in database" 458ms (18:08:00.148) | |
| Feb 09 18:08:48 k3s-0 k3s[2906]: Trace[1064384129]: [512.778421ms] [512.778421ms] END | |
| Feb 09 18:08:49 k3s-0 k3s[2906]: I0209 18:08:49.004396 2906 event.go:291] "Event occurred" object="logs/loki" kind="StatefulSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="create Pod loki-0 in StatefulSet loki successful" | |
| Feb 09 18:08:52 k3s-0 k3s[2906]: I0209 18:08:52.240323 2906 trace.go:205] Trace[692515787]: "List" url:/api/v1/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,client:10.2.0.34 (09-Feb-2021 18:08:50.858) (total time: 1381ms): | |
| Feb 09 18:08:52 k3s-0 k3s[2906]: Trace[692515787]: ---"Writing http response done" count:508 1381ms (18:08:00.240) | |
| Feb 09 18:08:52 k3s-0 k3s[2906]: Trace[692515787]: [1.381663711s] [1.381663711s] END | |
| Feb 09 18:08:53 k3s-0 k3s[2906]: I0209 18:08:53.257025 2906 trace.go:205] Trace[423124042]: "List etcd3" key:/secrets/monitoring,resourceVersion:,resourceVersionMatch:,limit:0,continue: (09-Feb-2021 18:08:52.716) (total time: 540ms): | |
| Feb 09 18:08:53 k3s-0 k3s[2906]: Trace[423124042]: [540.736525ms] [540.736525ms] END | |
| Feb 09 18:08:53 k3s-0 k3s[2906]: I0209 18:08:53.297761 2906 trace.go:205] Trace[977688161]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.34 (09-Feb-2021 18:08:52.716) (total time: 581ms): | |
| Feb 09 18:08:53 k3s-0 k3s[2906]: Trace[977688161]: ---"Listing from storage done" 540ms (18:08:00.257) | |
| Feb 09 18:08:53 k3s-0 k3s[2906]: Trace[977688161]: [581.523936ms] [581.523936ms] END | |
| Feb 09 18:08:55 k3s-0 k3s[2906]: I0209 18:08:55.183324 2906 trace.go:205] Trace[2052345387]: "List" url:/api/v1/namespaces/monitoring/secrets,user-agent:helm-controller/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.34 (09-Feb-2021 18:08:54.065) (total time: 1117ms): | |
| Feb 09 18:08:55 k3s-0 k3s[2906]: Trace[2052345387]: ---"Listing from storage done" 219ms (18:08:00.284) | |
| Feb 09 18:08:55 k3s-0 k3s[2906]: Trace[2052345387]: ---"Writing http response done" count:10 898ms (18:08:00.183) | |
| Feb 09 18:08:55 k3s-0 k3s[2906]: Trace[2052345387]: [1.117864216s] [1.117864216s] END | |
| Feb 09 18:09:04 k3s-0 k3s[2906]: I0209 18:09:04.016787 2906 request.go:645] Throttling request took 1.045710847s, request: GET:https://127.0.0.1:6444/apis/ops.alexellis.io/v1?timeout=32s | |
| Feb 09 18:09:23 k3s-0 k3s[2906]: I0209 18:09:23.519808 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 01ab7b027f18132aa93ca17f706a379bfccdb1aa989366a2db0de12de3184888 | |
| Feb 09 18:09:23 k3s-0 k3s[2906]: I0209 18:09:23.535922 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: d2815d98e2adaa83cd3732ed23b9cd2820fe945d525784879f30870abbfef31e | |
| Feb 09 18:09:23 k3s-0 k3s[2906]: I0209 18:09:23.550724 2906 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: fab20c4bd5a3946e27047f792455b3d87e79e6ab7bfbc46cf5b3869aca826f2d | |
| Feb 09 18:09:35 k3s-0 k3s[2906]: I0209 18:09:35.668826 2906 request.go:645] Throttling request took 1.04569731s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 18:10:07 k3s-0 k3s[2906]: I0209 18:10:07.321575 2906 request.go:645] Throttling request took 1.041898942s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 18:10:38 k3s-0 k3s[2906]: I0209 18:10:38.979594 2906 request.go:645] Throttling request took 1.044584941s, request: GET:https://127.0.0.1:6444/apis/monitoring.coreos.com/v1alpha1?timeout=32s | |
| Feb 09 18:11:09 k3s-0 k3s[2906]: time="2021-02-09T18:11:09.534605667Z" level=error msg="Compact failed: failed to compact to revision 55481356: database is locked" | |
| Feb 09 18:11:10 k3s-0 k3s[2906]: I0209 18:11:10.643451 2906 request.go:645] Throttling request took 1.058062839s, request: GET:https://127.0.0.1:6444/apis/ricoberger.de/v1alpha1?timeout=32s | |
| Feb 09 18:11:42 k3s-0 k3s[2906]: I0209 18:11:42.282528 2906 request.go:645] Throttling request took 1.046816368s, request: GET:https://127.0.0.1:6444/apis/upgrade.cattle.io/v1?timeout=32s | |
| Feb 09 18:12:13 k3s-0 k3s[2906]: I0209 18:12:13.934744 2906 request.go:645] Throttling request took 1.04705195s, request: GET:https://127.0.0.1:6444/apis/snapshot.storage.k8s.io/v1beta1?timeout=32s | |
| Feb 09 18:12:23 k3s-0 systemd[1]: Stopping Lightweight Kubernetes... | |
| Feb 09 18:12:23 k3s-0 k3s[2906]: I0209 18:12:23.996991 2906 network_policy_controller.go:173] Shutting down network policies controller | |
| Feb 09 18:12:23 k3s-0 k3s[2906]: time="2021-02-09T18:12:23.996262241Z" level=info msg="Shutting down /v1, Kind=Secret workers" | |
| Feb 09 18:12:23 k3s-0 k3s[2906]: time="2021-02-09T18:12:23.998262802Z" level=info msg="Shutting down k3s.cattle.io/v1, Kind=Addon workers" | |
| Feb 09 18:12:23 k3s-0 k3s[2906]: time="2021-02-09T18:12:23.998517700Z" level=fatal msg="context canceled" | |
| Feb 09 18:12:24 k3s-0 systemd[1]: k3s.service: Main process exited, code=exited, status=1/FAILURE | |
| Feb 09 18:12:24 k3s-0 systemd[1]: k3s.service: Failed with result 'exit-code'. | |
| Feb 09 18:12:24 k3s-0 systemd[1]: Stopped Lightweight Kubernetes. | |
| -- Reboot -- | |
| Feb 09 18:15:25 k3s-0 systemd[1]: Starting Lightweight Kubernetes... | |
| Feb 09 18:15:27 k3s-0 k3s[698]: time="2021-02-09T18:15:27.256704753Z" level=info msg="Starting k3s v1.19.7+k3s1 (5a00e38d)" | |
| Feb 09 18:15:27 k3s-0 k3s[698]: time="2021-02-09T18:15:27.260471302Z" level=info msg="Cluster bootstrap already complete" | |
| Feb 09 18:15:27 k3s-0 k3s[698]: time="2021-02-09T18:15:27.311665436Z" level=info msg="Cluster-Http-Server 2021/02/09 18:15:27 http: TLS handshake error from 10.2.0.38:49006: EOF" | |
| Feb 09 18:15:27 k3s-0 k3s[698]: time="2021-02-09T18:15:27.313349518Z" level=info msg="Cluster-Http-Server 2021/02/09 18:15:27 http: TLS handshake error from 10.2.0.38:49000: EOF" | |
| Feb 09 18:15:27 k3s-0 k3s[698]: time="2021-02-09T18:15:27.321364607Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s" | |
| Feb 09 18:15:27 k3s-0 k3s[698]: time="2021-02-09T18:15:27.321445196Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." | |
| Feb 09 18:15:27 k3s-0 k3s[698]: time="2021-02-09T18:15:27.321639336Z" level=info msg="Database tables and indexes are up to date" | |
| Feb 09 18:15:27 k3s-0 k3s[698]: time="2021-02-09T18:15:27.371843721Z" level=info msg="Kine listening on unix://kine.sock" | |
| Feb 09 18:15:27 k3s-0 k3s[698]: time="2021-02-09T18:15:27.372554807Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=unknown --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --enable-admission-plugins=NodeRestriction --etcd-servers=unix://kine.sock --insecure-port=0 --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=k3s --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-cluster-ip-range=10.43.0.0/16 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" | |
| Feb 09 18:15:27 k3s-0 k3s[698]: I0209 18:15:27.387574 698 server.go:652] external host was not specified, using 10.2.0.30 | |
| Feb 09 18:15:27 k3s-0 k3s[698]: I0209 18:15:27.389504 698 server.go:177] Version: v1.19.7+k3s1 | |
| Feb 09 18:15:27 k3s-0 k3s[698]: I0209 18:15:27.440722 698 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. | |
| Feb 09 18:15:27 k3s-0 k3s[698]: I0209 18:15:27.440828 698 plugins.go:161] Loaded 10 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota. | |
| Feb 09 18:15:27 k3s-0 k3s[698]: I0209 18:15:27.467348 698 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. | |
| Feb 09 18:15:27 k3s-0 k3s[698]: I0209 18:15:27.468603 698 plugins.go:161] Loaded 10 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota. | |
| Feb 09 18:15:27 k3s-0 k3s[698]: time="2021-02-09T18:15:27.480150512Z" level=info msg="Cluster-Http-Server 2021/02/09 18:15:27 http: TLS handshake error from 10.2.0.35:54282: EOF" | |
| Feb 09 18:15:27 k3s-0 k3s[698]: time="2021-02-09T18:15:27.485010864Z" level=info msg="Cluster-Http-Server 2021/02/09 18:15:27 http: TLS handshake error from 10.2.0.35:54260: EOF" | |
| Feb 09 18:15:27 k3s-0 k3s[698]: time="2021-02-09T18:15:27.485173446Z" level=info msg="Cluster-Http-Server 2021/02/09 18:15:27 http: TLS handshake error from 10.2.0.35:54304: EOF" | |
| Feb 09 18:15:27 k3s-0 k3s[698]: time="2021-02-09T18:15:27.485254635Z" level=info msg="Cluster-Http-Server 2021/02/09 18:15:27 http: TLS handshake error from 10.2.0.35:54300: EOF" | |
| Feb 09 18:15:27 k3s-0 k3s[698]: time="2021-02-09T18:15:27.485377048Z" level=info msg="Cluster-Http-Server 2021/02/09 18:15:27 http: TLS handshake error from 10.2.0.35:54254: EOF" | |
| Feb 09 18:15:27 k3s-0 k3s[698]: time="2021-02-09T18:15:27.491679295Z" level=info msg="Cluster-Http-Server 2021/02/09 18:15:27 http: TLS handshake error from 10.2.0.35:54256: EOF" | |
| Feb 09 18:15:27 k3s-0 k3s[698]: time="2021-02-09T18:15:27.563299647Z" level=info msg="Cluster-Http-Server 2021/02/09 18:15:27 http: TLS handshake error from 10.2.0.38:49012: EOF" | |
| Feb 09 18:15:27 k3s-0 k3s[698]: I0209 18:15:27.601121 698 master.go:271] Using reconciler: lease | |
| Feb 09 18:15:27 k3s-0 k3s[698]: time="2021-02-09T18:15:27.826591344Z" level=info msg="Cluster-Http-Server 2021/02/09 18:15:27 http: TLS handshake error from 10.2.0.38:49020: EOF" | |
| Feb 09 18:15:28 k3s-0 k3s[698]: time="2021-02-09T18:15:28.072630093Z" level=info msg="Cluster-Http-Server 2021/02/09 18:15:28 http: TLS handshake error from 10.2.0.38:49036: EOF" | |
| Feb 09 18:15:28 k3s-0 k3s[698]: time="2021-02-09T18:15:28.075668647Z" level=info msg="Cluster-Http-Server 2021/02/09 18:15:28 http: TLS handshake error from 10.2.0.38:49044: EOF" | |
| Feb 09 18:15:28 k3s-0 k3s[698]: time="2021-02-09T18:15:28.356816185Z" level=info msg="Cluster-Http-Server 2021/02/09 18:15:28 http: TLS handshake error from 10.2.0.38:49048: EOF" | |
| Feb 09 18:15:28 k3s-0 k3s[698]: I0209 18:15:28.447917 698 trace.go:205] Trace[43592539]: "List etcd3" key:/services/endpoints,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (09-Feb-2021 18:15:27.937) (total time: 510ms): | |
| Feb 09 18:15:28 k3s-0 k3s[698]: Trace[43592539]: [510.46867ms] [510.46867ms] END | |
| Feb 09 18:15:28 k3s-0 k3s[698]: time="2021-02-09T18:15:28.607018629Z" level=info msg="Cluster-Http-Server 2021/02/09 18:15:28 http: TLS handshake error from 10.2.0.38:49060: EOF" | |
| Feb 09 18:15:28 k3s-0 k3s[698]: I0209 18:15:28.684213 698 trace.go:205] Trace[133159850]: "List etcd3" key:/pods,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (09-Feb-2021 18:15:27.985) (total time: 698ms): | |
| Feb 09 18:15:28 k3s-0 k3s[698]: Trace[133159850]: [698.203834ms] [698.203834ms] END | |
| Feb 09 18:15:28 k3s-0 k3s[698]: I0209 18:15:28.890358 698 trace.go:205] Trace[1341795084]: "List etcd3" key:/configmaps,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (09-Feb-2021 18:15:27.910) (total time: 980ms): | |
| Feb 09 18:15:28 k3s-0 k3s[698]: Trace[1341795084]: [980.15522ms] [980.15522ms] END | |
| Feb 09 18:15:29 k3s-0 k3s[698]: I0209 18:15:29.132789 698 trace.go:205] Trace[1855474442]: "List etcd3" key:/apiextensions.k8s.io/customresourcedefinitions,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (09-Feb-2021 18:15:27.501) (total time: 1631ms): | |
| Feb 09 18:15:29 k3s-0 k3s[698]: Trace[1855474442]: [1.631080933s] [1.631080933s] END | |
| Feb 09 18:15:29 k3s-0 k3s[698]: I0209 18:15:29.421025 698 trace.go:205] Trace[285593264]: "List etcd3" key:/apiextensions.k8s.io/customresourcedefinitions,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (09-Feb-2021 18:15:27.501) (total time: 1919ms): | |
| Feb 09 18:15:29 k3s-0 k3s[698]: Trace[285593264]: [1.919358396s] [1.919358396s] END | |
| Feb 09 18:15:29 k3s-0 k3s[698]: W0209 18:15:29.989928 698 genericapiserver.go:412] Skipping API batch/v2alpha1 because it has no resources. | |
| Feb 09 18:15:30 k3s-0 k3s[698]: W0209 18:15:30.021791 698 genericapiserver.go:412] Skipping API discovery.k8s.io/v1alpha1 because it has no resources. | |
| Feb 09 18:15:30 k3s-0 k3s[698]: W0209 18:15:30.058087 698 genericapiserver.go:412] Skipping API node.k8s.io/v1alpha1 because it has no resources. | |
| Feb 09 18:15:30 k3s-0 k3s[698]: W0209 18:15:30.136404 698 genericapiserver.go:412] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. | |
| Feb 09 18:15:30 k3s-0 k3s[698]: W0209 18:15:30.148774 698 genericapiserver.go:412] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. | |
| Feb 09 18:15:30 k3s-0 k3s[698]: I0209 18:15:30.183983 698 trace.go:205] Trace[1220179354]: "List etcd3" key:/replicasets,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (09-Feb-2021 18:15:29.507) (total time: 676ms): | |
| Feb 09 18:15:30 k3s-0 k3s[698]: Trace[1220179354]: [676.656233ms] [676.656233ms] END | |
| Feb 09 18:15:30 k3s-0 k3s[698]: W0209 18:15:30.229135 698 genericapiserver.go:412] Skipping API storage.k8s.io/v1alpha1 because it has no resources. | |
| Feb 09 18:15:30 k3s-0 k3s[698]: W0209 18:15:30.325281 698 genericapiserver.go:412] Skipping API apps/v1beta2 because it has no resources. | |
| Feb 09 18:15:30 k3s-0 k3s[698]: W0209 18:15:30.325332 698 genericapiserver.go:412] Skipping API apps/v1beta1 because it has no resources. | |
| Feb 09 18:15:30 k3s-0 k3s[698]: I0209 18:15:30.345801 698 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. | |
| Feb 09 18:15:30 k3s-0 k3s[698]: I0209 18:15:30.345856 698 plugins.go:161] Loaded 10 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota. | |
| Feb 09 18:15:30 k3s-0 k3s[698]: time="2021-02-09T18:15:30.380618254Z" level=info msg="Waiting for API server to become available" | |
| Feb 09 18:15:30 k3s-0 k3s[698]: time="2021-02-09T18:15:30.381030214Z" level=info msg="Running kube-scheduler --address=127.0.0.1 --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --port=10251 --profiling=false --secure-port=0" | |
| Feb 09 18:15:30 k3s-0 k3s[698]: I0209 18:15:30.387099 698 registry.go:173] Registering SelectorSpread plugin | |
| Feb 09 18:15:30 k3s-0 k3s[698]: I0209 18:15:30.387183 698 registry.go:173] Registering SelectorSpread plugin | |
| Feb 09 18:15:30 k3s-0 k3s[698]: time="2021-02-09T18:15:30.387792893Z" level=info msg="Running kube-controller-manager --address=127.0.0.1 --allocate-node-cidrs=true --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --cluster-signing-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --port=10252 --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=0 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.key --use-service-account-credentials=true" | |
| Feb 09 18:15:30 k3s-0 k3s[698]: time="2021-02-09T18:15:30.393679781Z" level=info msg="Node token is available at /var/lib/rancher/k3s/server/token" | |
| Feb 09 18:15:30 k3s-0 k3s[698]: time="2021-02-09T18:15:30.394724771Z" level=info msg="To join node to cluster: k3s agent -s https://10.2.0.30:6443 -t ${NODE_TOKEN}" | |
| Feb 09 18:15:30 k3s-0 k3s[698]: time="2021-02-09T18:15:30.396435546Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" | |
| Feb 09 18:15:30 k3s-0 k3s[698]: time="2021-02-09T18:15:30.396496268Z" level=info msg="Run: k3s kubectl" | |
| Feb 09 18:15:30 k3s-0 k3s[698]: time="2021-02-09T18:15:30.396693211Z" level=info msg="Module overlay was already loaded" | |
| Feb 09 18:15:30 k3s-0 k3s[698]: time="2021-02-09T18:15:30.396727875Z" level=info msg="Module nf_conntrack was already loaded" | |
| Feb 09 18:15:30 k3s-0 k3s[698]: time="2021-02-09T18:15:30.396754179Z" level=info msg="Module br_netfilter was already loaded" | |
| Feb 09 18:15:30 k3s-0 k3s[698]: time="2021-02-09T18:15:30.396777131Z" level=info msg="Module iptable_nat was already loaded" | |
| Feb 09 18:15:30 k3s-0 k3s[698]: time="2021-02-09T18:15:30.472354978Z" level=info msg="Cluster-Http-Server 2021/02/09 18:15:30 http: TLS handshake error from 127.0.0.1:51936: remote error: tls: bad certificate" | |
| Feb 09 18:15:30 k3s-0 k3s[698]: time="2021-02-09T18:15:30.482220867Z" level=info msg="Cluster-Http-Server 2021/02/09 18:15:30 http: TLS handshake error from 127.0.0.1:51946: remote error: tls: bad certificate" | |
| Feb 09 18:15:30 k3s-0 k3s[698]: time="2021-02-09T18:15:30.508018760Z" level=info msg="certificate CN=k3s-0 signed by CN=k3s-server-ca@1605473546: notBefore=2020-11-15 20:52:26 +0000 UTC notAfter=2022-02-09 18:15:30 +0000 UTC" | |
| Feb 09 18:15:30 k3s-0 k3s[698]: time="2021-02-09T18:15:30.514774433Z" level=info msg="certificate CN=system:node:k3s-0,O=system:nodes signed by CN=k3s-client-ca@1605473546: notBefore=2020-11-15 20:52:26 +0000 UTC notAfter=2022-02-09 18:15:30 +0000 UTC" | |
| Feb 09 18:15:30 k3s-0 k3s[698]: time="2021-02-09T18:15:30.532593221Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" | |
| Feb 09 18:15:30 k3s-0 k3s[698]: time="2021-02-09T18:15:30.533061803Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml -a /run/k3s/containerd/containerd.sock --state /run/k3s/containerd --root /var/lib/rancher/k3s/agent/containerd" | |
| Feb 09 18:15:31 k3s-0 k3s[698]: I0209 18:15:31.510278 698 trace.go:205] Trace[647411046]: "List etcd3" key:/secrets,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (09-Feb-2021 18:15:27.855) (total time: 3654ms): | |
| Feb 09 18:15:31 k3s-0 k3s[698]: Trace[647411046]: [3.654913824s] [3.654913824s] END | |
| Feb 09 18:15:31 k3s-0 k3s[698]: time="2021-02-09T18:15:31.537595165Z" level=info msg="Waiting for containerd startup: rpc error: code = Unknown desc = server is not initialized yet" | |
| Feb 09 18:15:32 k3s-0 k3s[698]: time="2021-02-09T18:15:32.096592502Z" level=info msg="Handling backend connection request [k3s-pi4-b]" | |
| Feb 09 18:15:32 k3s-0 k3s[698]: time="2021-02-09T18:15:32.540099218Z" level=info msg="Waiting for containerd startup: rpc error: code = Unknown desc = server is not initialized yet" | |
| Feb 09 18:15:33 k3s-0 k3s[698]: time="2021-02-09T18:15:33.541250732Z" level=info msg="Containerd is now running" | |
| Feb 09 18:15:33 k3s-0 k3s[698]: time="2021-02-09T18:15:33.551518430Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" | |
| Feb 09 18:15:33 k3s-0 k3s[698]: time="2021-02-09T18:15:33.554906635Z" level=info msg="Handling backend connection request [k3s-0]" | |
| Feb 09 18:15:33 k3s-0 k3s[698]: time="2021-02-09T18:15:33.555827923Z" level=info msg="Running kubelet --address=0.0.0.0 --anonymous-auth=false --authentication-token-webhook=true --authorization-mode=Webhook --cgroup-driver=cgroupfs --client-ca-file=/var/lib/rancher/k3s/agent/client-ca.crt --cloud-provider=external --cluster-dns=10.43.0.10 --cluster-domain=cluster.local --cni-bin-dir=/var/lib/rancher/k3s/data/30740d1d67da51fe92b10367ecce4d580e552c634ad4a6c4dd13297ffd1f3edd/bin --cni-conf-dir=/var/lib/rancher/k3s/agent/etc/cni/net.d --container-runtime-endpoint=/run/k3s/containerd/containerd.sock --container-runtime=remote --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=imagefs.available<5%,nodefs.available<5% --eviction-minimum-reclaim=imagefs.available=10%,nodefs.available=10% --fail-swap-on=false --healthz-bind-address=127.0.0.1 --hostname-override=k3s-0 --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-labels= --pod-manifest-path=/var/lib/rancher/k3s/agent/pod-manifests --read-only-port=0 --resolv-conf=/etc/resolv.conf --serialize-image-pulls=false --tls-cert-file=/var/lib/rancher/k3s/agent/serving-kubelet.crt --tls-private-key-file=/var/lib/rancher/k3s/agent/serving-kubelet.key" | |
| Feb 09 18:15:33 k3s-0 k3s[698]: time="2021-02-09T18:15:33.557825085Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --healthz-bind-address=127.0.0.1 --hostname-override=k3s-0 --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" | |
| Feb 09 18:15:33 k3s-0 k3s[698]: Flag --cloud-provider has been deprecated, will be removed in 1.23, in favor of removing cloud provider code from Kubelet. | |
| Feb 09 18:15:33 k3s-0 k3s[698]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. | |
| Feb 09 18:15:33 k3s-0 k3s[698]: W0209 18:15:33.561845 698 server.go:226] WARNING: all flags other than --config, --write-config-to, and --cleanup are deprecated. Please begin using a config file ASAP. | |
| Feb 09 18:15:33 k3s-0 k3s[698]: time="2021-02-09T18:15:33.581014761Z" level=info msg="Node CIDR assigned for: k3s-0" | |
| Feb 09 18:15:33 k3s-0 k3s[698]: I0209 18:15:33.582466 698 flannel.go:92] Determining IP address of default interface | |
| Feb 09 18:15:33 k3s-0 k3s[698]: I0209 18:15:33.586117 698 flannel.go:105] Using interface with name ens18 and address 10.2.0.30 | |
| Feb 09 18:15:33 k3s-0 k3s[698]: I0209 18:15:33.595014 698 kube.go:117] Waiting 10m0s for node controller to sync | |
| Feb 09 18:15:33 k3s-0 k3s[698]: I0209 18:15:33.595616 698 kube.go:300] Starting kube subnet manager | |
| Feb 09 18:15:33 k3s-0 k3s[698]: I0209 18:15:33.602260 698 server.go:407] Version: v1.19.7+k3s1 | |
| Feb 09 18:15:33 k3s-0 k3s[698]: time="2021-02-09T18:15:33.602787746Z" level=info msg="labels have already set on node: k3s-0" | |
| Feb 09 18:15:33 k3s-0 k3s[698]: I0209 18:15:33.702322 698 dynamic_cafile_content.go:167] Starting client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt | |
| Feb 09 18:15:33 k3s-0 k3s[698]: E0209 18:15:33.735750 698 node.go:125] Failed to retrieve node info: nodes "k3s-0" is forbidden: User "system:kube-proxy" cannot get resource "nodes" in API group "" at the cluster scope | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.473376 698 dynamic_serving_content.go:130] Starting serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.473434 698 secure_serving.go:197] Serving securely on 127.0.0.1:6444 | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.473494 698 controller.go:83] Starting OpenAPI AggregationController | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.473503 698 dynamic_cafile_content.go:167] Starting request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.473533 698 tlsconfig.go:240] Starting DynamicServingCertificateController | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.473907 698 dynamic_cafile_content.go:167] Starting client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.476816 698 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.476865 698 shared_informer.go:240] Waiting for caches to sync for cluster_authentication_trust_controller | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.477548 698 customresource_discovery_controller.go:209] Starting DiscoveryController | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.482051 698 dynamic_serving_content.go:130] Starting aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.482126 698 apiservice_controller.go:97] Starting APIServiceRegistrationController | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.482137 698 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.482173 698 autoregister_controller.go:141] Starting autoregister controller | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.482182 698 cache.go:32] Waiting for caches to sync for autoregister controller | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.482364 698 available_controller.go:457] Starting AvailableConditionController | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.482375 698 cache.go:32] Waiting for caches to sync for AvailableConditionController controller | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.492983 698 dynamic_cafile_content.go:167] Starting client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.493058 698 dynamic_cafile_content.go:167] Starting request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.493383 698 controller.go:86] Starting OpenAPI controller | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.493426 698 naming_controller.go:291] Starting NamingConditionController | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.493442 698 establishing_controller.go:76] Starting EstablishingController | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.493459 698 nonstructuralschema_controller.go:186] Starting NonStructuralSchemaConditionController | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.493474 698 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.493511 698 crd_finalizer.go:266] Starting CRDFinalizer | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.494135 698 crdregistration_controller.go:111] Starting crd-autoregister controller | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.494164 698 shared_informer.go:240] Waiting for caches to sync for crd-autoregister | |
| Feb 09 18:15:34 k3s-0 k3s[698]: time="2021-02-09T18:15:34.553055817Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --allow-untagged-cloud=true --bind-address=127.0.0.1 --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --node-status-update-frequency=1m --profiling=false --secure-port=0" | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Flag --allow-untagged-cloud has been deprecated, This flag is deprecated and will be removed in a future release. A cluster-id will be required on cloud instances. | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.560646 698 controllermanager.go:127] Version: v1.19.7+k3s1 | |
| Feb 09 18:15:34 k3s-0 k3s[698]: W0209 18:15:34.560692 698 controllermanager.go:139] detected a cluster without a ClusterID. A ClusterID will be required in the future. Please tag your cluster to avoid any future issues | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.564203 698 node_controller.go:108] Sending events to api server. | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.564316 698 controllermanager.go:254] Started "cloud-node" | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.575827 698 node_lifecycle_controller.go:77] Sending events to api server | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.575906 698 controllermanager.go:254] Started "cloud-node-lifecycle" | |
| Feb 09 18:15:34 k3s-0 k3s[698]: E0209 18:15:34.577663 698 core.go:97] Failed to start service controller: the cloud provider does not support external load balancers | |
| Feb 09 18:15:34 k3s-0 k3s[698]: W0209 18:15:34.577705 698 controllermanager.go:251] Skipping "service" | |
| Feb 09 18:15:34 k3s-0 k3s[698]: W0209 18:15:34.577715 698 core.go:115] configure-cloud-routes is set, but cloud provider does not support routes. Will not configure cloud provider routes. | |
| Feb 09 18:15:34 k3s-0 k3s[698]: W0209 18:15:34.577721 698 controllermanager.go:251] Skipping "route" | |
| Feb 09 18:15:34 k3s-0 k3s[698]: E0209 18:15:34.585149 698 node_controller.go:153] Error monitoring node status: nodes is forbidden: User "cloud-controller-manager" cannot list resource "nodes" in API group "" at the cluster scope | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.585367 698 cache.go:39] Caches are synced for APIServiceRegistrationController controller | |
| Feb 09 18:15:34 k3s-0 k3s[698]: E0209 18:15:34.590465 698 reflector.go:127] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "cloud-controller-manager" cannot list resource "nodes" in API group "" at the cluster scope | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.622567 698 cache.go:39] Caches are synced for autoregister controller | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.639267 698 controller.go:609] quota admission added evaluator for: leases.coordination.k8s.io | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.641858 698 trace.go:205] Trace[724999989]: "Create" url:/apis/authentication.k8s.io/v1/tokenreviews,user-agent:k3s/v1.19.7+k3s1 (linux/arm64) kubernetes/5a00e38,client:10.2.0.32 (09-Feb-2021 18:15:32.917) (total time: 1724ms): | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[724999989]: ---"Object stored in database" 1724ms (18:15:00.641) | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[724999989]: [1.724649668s] [1.724649668s] END | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.674557 698 trace.go:205] Trace[1501319380]: "Create" url:/apis/authentication.k8s.io/v1/tokenreviews,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.36 (09-Feb-2021 18:15:32.324) (total time: 2350ms): | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[1501319380]: ---"Object stored in database" 2350ms (18:15:00.674) | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[1501319380]: [2.350428925s] [2.350428925s] END | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.753290 698 kube.go:124] Node controller sync successful | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.753840 698 shared_informer.go:247] Caches are synced for cluster_authentication_trust_controller | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.753975 698 cache.go:39] Caches are synced for AvailableConditionController controller | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.796850 698 shared_informer.go:247] Caches are synced for crd-autoregister | |
| Feb 09 18:15:34 k3s-0 k3s[698]: time="2021-02-09T18:15:34.809768383Z" level=error msg="error while range on /registry/persistentvolumeclaims/ /registry/persistentvolumeclaims/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:34 k3s-0 k3s[698]: time="2021-02-09T18:15:34.816485202Z" level=error msg="error while range on /registry/namespaces/ /registry/namespaces/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:34 k3s-0 k3s[698]: time="2021-02-09T18:15:34.832901579Z" level=error msg="error while range on /registry/roles/ /registry/roles/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.843051 698 trace.go:205] Trace[1014680396]: "Create" url:/apis/authentication.k8s.io/v1/tokenreviews,user-agent:k3s/v1.19.7+k3s1 (linux/arm64) kubernetes/5a00e38,client:10.2.0.31 (09-Feb-2021 18:15:33.046) (total time: 1796ms): | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[1014680396]: ---"Object stored in database" 1796ms (18:15:00.842) | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[1014680396]: [1.796459947s] [1.796459947s] END | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.846175 698 trace.go:205] Trace[735039192]: "GuaranteedUpdate etcd3" type:*core.Node (09-Feb-2021 18:15:32.462) (total time: 2383ms): | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[735039192]: ---"Transaction prepared" 2203ms (18:15:00.666) | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[735039192]: ---"Transaction committed" 179ms (18:15:00.845) | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[735039192]: [2.383626928s] [2.383626928s] END | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.847412 698 trace.go:205] Trace[2121777912]: "Patch" url:/api/v1/nodes/k3s-c/status,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.35 (09-Feb-2021 18:15:32.462) (total time: 2385ms): | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[2121777912]: ---"Object stored in database" 2345ms (18:15:00.847) | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[2121777912]: [2.385140643s] [2.385140643s] END | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.857101 698 trace.go:205] Trace[1889762060]: "GuaranteedUpdate etcd3" type:*core.Pod (09-Feb-2021 18:15:33.433) (total time: 1423ms): | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[1889762060]: ---"Transaction prepared" 1223ms (18:15:00.657) | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[1889762060]: ---"Transaction committed" 199ms (18:15:00.856) | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[1889762060]: [1.423534632s] [1.423534632s] END | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.857520 698 trace.go:205] Trace[1320444257]: "Patch" url:/api/v1/namespaces/kube-system/pods/node-feature-discovery-worker-5vjvs/status,user-agent:k3s/v1.19.7+k3s1 (linux/arm64) kubernetes/5a00e38,client:10.2.0.31 (09-Feb-2021 18:15:33.433) (total time: 1424ms): | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[1320444257]: ---"Object stored in database" 1421ms (18:15:00.857) | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[1320444257]: [1.424095697s] [1.424095697s] END | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.857871 698 trace.go:205] Trace[261691647]: "GuaranteedUpdate etcd3" type:*core.Pod (09-Feb-2021 18:15:32.437) (total time: 2420ms): | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[261691647]: ---"Transaction prepared" 2199ms (18:15:00.637) | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[261691647]: ---"Transaction committed" 220ms (18:15:00.857) | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[261691647]: [2.42048096s] [2.42048096s] END | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.858228 698 trace.go:205] Trace[505788541]: "Patch" url:/api/v1/namespaces/kube-system/pods/node-feature-discovery-worker-5v6nb/status,user-agent:k3s/v1.19.7+k3s1 (linux/arm64) kubernetes/5a00e38,client:10.2.0.32 (09-Feb-2021 18:15:32.434) (total time: 2423ms): | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[505788541]: ---"Object stored in database" 2362ms (18:15:00.857) | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[505788541]: [2.423421223s] [2.423421223s] END | |
| Feb 09 18:15:34 k3s-0 k3s[698]: time="2021-02-09T18:15:34.921845607Z" level=error msg="error while range on /registry/limitranges/ /registry/limitranges/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:34 k3s-0 k3s[698]: time="2021-02-09T18:15:34.944593091Z" level=error msg="error while range on /registry/clusterroles/ /registry/clusterroles/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:34 k3s-0 k3s[698]: time="2021-02-09T18:15:34.958564556Z" level=error msg="error while range on /registry/services/specs/ /registry/services/specs/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.959162 698 trace.go:205] Trace[86503516]: "GuaranteedUpdate etcd3" type:*coordination.Lease (09-Feb-2021 18:15:34.414) (total time: 544ms): | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[86503516]: ---"Transaction prepared" 301ms (18:15:00.716) | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[86503516]: ---"Transaction committed" 242ms (18:15:00.959) | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[86503516]: [544.614663ms] [544.614663ms] END | |
| Feb 09 18:15:34 k3s-0 k3s[698]: I0209 18:15:34.959341 698 trace.go:205] Trace[1257256828]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/k3s-d,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.36 (09-Feb-2021 18:15:34.414) (total time: 544ms): | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[1257256828]: ---"Object stored in database" 544ms (18:15:00.959) | |
| Feb 09 18:15:34 k3s-0 k3s[698]: Trace[1257256828]: [544.924135ms] [544.924135ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.006046480Z" level=error msg="error while range on /registry/persistentvolumes/ /registry/persistentvolumes/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.068964670Z" level=info msg="Handling backend connection request [k3s-pi4-c]" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.077465234Z" level=error msg="error while range on /registry/clusterrolebindings/ /registry/clusterrolebindings/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.082767 698 flannel.go:78] Wrote subnet file to /run/flannel/subnet.env | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.083075 698 flannel.go:82] Running backend. | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.083636 698 route_network.go:53] Watching for new subnet leases | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.113173 698 route_network.go:85] Subnet added: 10.42.1.0/24 via 10.2.0.38 | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.114514 698 route_network.go:85] Subnet added: 10.42.5.0/24 via 10.2.0.33 | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.114809 698 route_network.go:85] Subnet added: 10.42.6.0/24 via 10.2.0.32 | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.115030 698 route_network.go:85] Subnet added: 10.42.2.0/24 via 10.2.0.34 | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.115273 698 route_network.go:85] Subnet added: 10.42.3.0/24 via 10.2.0.35 | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.115471 698 route_network.go:85] Subnet added: 10.42.7.0/24 via 10.2.0.36 | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.115699 698 route_network.go:85] Subnet added: 10.42.8.0/24 via 10.2.0.37 | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.115918 698 route_network.go:85] Subnet added: 10.42.4.0/24 via 10.2.0.31 | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.118759 698 iptables.go:145] Some iptables rules are missing; deleting and recreating rules | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.118801 698 iptables.go:167] Deleting iptables rule: -s 10.42.0.0/16 -j ACCEPT | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.131110320Z" level=error msg="error while range on /registry/daemonsets/ /registry/daemonsets/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.132002061Z" level=error msg="error while range on /registry/mutatingwebhookconfigurations/ /registry/mutatingwebhookconfigurations/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.151298069Z" level=error msg="error while range on /registry/ingress/ /registry/ingress/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.151862941Z" level=error msg="error while range on /registry/rolebindings/ /registry/rolebindings/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.158413804Z" level=error msg="error while range on /registry/namespaces/ /registry/namespaces/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.159986247Z" level=error msg="error while range on /registry/services/specs/ /registry/services/specs/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.213161060Z" level=error msg="error while range on /registry/resourcequotas/ /registry/resourcequotas/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.216531 698 trace.go:205] Trace[1627071840]: "List etcd3" key:/rolebindings,resourceVersion:55459032,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:34.712) (total time: 503ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1627071840]: [503.602575ms] [503.602575ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.285042 698 trace.go:205] Trace[1505367724]: "List" url:/apis/rbac.authorization.k8s.io/v1/rolebindings,user-agent:botkube/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:34.712) (total time: 572ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1505367724]: [572.155911ms] [572.155911ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.229059297Z" level=error msg="error while range on /registry/volumeattachments/ /registry/volumeattachments/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.275740 698 iptables.go:167] Deleting iptables rule: -d 10.42.0.0/16 -j ACCEPT | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.295543 698 iptables.go:155] Adding iptables rule: -s 10.42.0.0/16 -j ACCEPT | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.228842 698 trace.go:205] Trace[942655040]: "List etcd3" key:/clusterrolebindings,resourceVersion:55459040,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:34.711) (total time: 517ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[942655040]: [517.612318ms] [517.612318ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.354317 698 trace.go:205] Trace[206188397]: "List" url:/apis/rbac.authorization.k8s.io/v1/clusterrolebindings,user-agent:botkube/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:34.711) (total time: 643ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[206188397]: [643.112211ms] [643.112211ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.362625 698 trace.go:205] Trace[617564744]: "GuaranteedUpdate etcd3" type:*coordination.Lease (09-Feb-2021 18:15:34.853) (total time: 508ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[617564744]: ---"Transaction committed" 507ms (18:15:00.362) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[617564744]: [508.70661ms] [508.70661ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.362814 698 trace.go:205] Trace[1883727481]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/rook-ceph/leases/external-snapshotter-leader-rook-ceph-cephfs-csi-ceph-com,user-agent:csi-snapshotter/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:34.853) (total time: 509ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1883727481]: ---"Object stored in database" 508ms (18:15:00.362) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1883727481]: [509.097908ms] [509.097908ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.363227 698 trace.go:205] Trace[2056340253]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/rook-ceph/leases/external-attacher-leader-rook-ceph-rbd-csi-ceph-com,user-agent:csi-attacher/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 18:15:34.858) (total time: 504ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[2056340253]: ---"Object stored in database" 504ms (18:15:00.363) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[2056340253]: [504.789258ms] [504.789258ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.364947 698 trace.go:205] Trace[1333426833]: "List etcd3" key:/statefulsets,resourceVersion:55485770,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:34.837) (total time: 527ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1333426833]: [527.307901ms] [527.307901ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.365769 698 trace.go:205] Trace[1502171817]: "List" url:/apis/apps/v1/statefulsets,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:34.837) (total time: 528ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1502171817]: ---"Listing from storage done" 527ms (18:15:00.364) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1502171817]: [528.150991ms] [528.150991ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.229241037Z" level=error msg="error while range on /registry/storageclasses/ /registry/storageclasses/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.361571143Z" level=info msg="Handling backend connection request [k3s-e]" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.257237 698 trace.go:205] Trace[1221110248]: "List etcd3" key:/daemonsets,resourceVersion:55459112,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:34.713) (total time: 543ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1221110248]: [543.950478ms] [543.950478ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.366148 698 trace.go:205] Trace[1960744552]: "List" url:/apis/apps/v1/daemonsets,user-agent:botkube/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:34.713) (total time: 652ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1960744552]: [652.894419ms] [652.894419ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.316391 698 iptables.go:145] Some iptables rules are missing; deleting and recreating rules | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.366289 698 iptables.go:167] Deleting iptables rule: -s 10.42.0.0/16 -d 10.42.0.0/16 -j RETURN | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.374014 698 trace.go:205] Trace[2018028914]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:34.683) (total time: 690ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[2018028914]: ---"initial value restored" 160ms (18:15:00.843) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[2018028914]: ---"Transaction committed" 528ms (18:15:00.373) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[2018028914]: [690.235115ms] [690.235115ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.374518 698 trace.go:205] Trace[1372945246]: "Patch" url:/api/v1/namespaces/default/events/unifi-controller.166200765735b7a2,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:34.683) (total time: 690ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1372945246]: ---"About to apply patch" 160ms (18:15:00.843) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1372945246]: ---"Object stored in database" 529ms (18:15:00.374) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1372945246]: [690.925235ms] [690.925235ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.376459 698 trace.go:205] Trace[876638773]: "List etcd3" key:/volumeattachments,resourceVersion:55456883,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:34.837) (total time: 538ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[876638773]: [538.476273ms] [538.476273ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.376565 698 trace.go:205] Trace[1056590998]: "List" url:/apis/storage.k8s.io/v1/volumeattachments,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:34.837) (total time: 538ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1056590998]: [538.626693ms] [538.626693ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.376900 698 trace.go:205] Trace[968908147]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:34.660) (total time: 716ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[968908147]: ---"initial value restored" 184ms (18:15:00.844) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[968908147]: ---"Transaction committed" 531ms (18:15:00.376) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[968908147]: [716.278625ms] [716.278625ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.377117 698 trace.go:205] Trace[1077174255]: "Patch" url:/api/v1/namespaces/default/events/blocky-udp.1661ffd6626301d2,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 18:15:34.660) (total time: 716ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1077174255]: ---"About to apply patch" 184ms (18:15:00.844) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1077174255]: ---"Object stored in database" 531ms (18:15:00.376) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1077174255]: [716.611519ms] [716.611519ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.377509 698 trace.go:205] Trace[25284784]: "Create" url:/api/v1/namespaces/kube-system/events,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.38 (09-Feb-2021 18:15:33.715) (total time: 1661ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[25284784]: ---"Object stored in database" 1661ms (18:15:00.377) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[25284784]: [1.661645801s] [1.661645801s] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.381248 698 trace.go:205] Trace[1249424965]: "Create" url:/api/v1/namespaces/kube-system/events,user-agent:k3s/v1.19.7+k3s1 (linux/arm64) kubernetes/5a00e38,client:10.2.0.31 (09-Feb-2021 18:15:32.498) (total time: 2883ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1249424965]: ---"Object stored in database" 2882ms (18:15:00.381) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1249424965]: [2.883066457s] [2.883066457s] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.381612 698 trace.go:205] Trace[118786489]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:34.764) (total time: 617ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[118786489]: ---"initial value restored" 617ms (18:15:00.381) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[118786489]: [617.515334ms] [617.515334ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.381727 698 trace.go:205] Trace[1057886784]: "Patch" url:/api/v1/namespaces/rook-ceph/events/csi-rbdplugin-provisioner-6dd559f8b4-tcq67.1661fed009cad509,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.35 (09-Feb-2021 18:15:34.763) (total time: 617ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1057886784]: ---"About to apply patch" 617ms (18:15:00.381) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1057886784]: [617.755829ms] [617.755829ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.240007231Z" level=error msg="error while range on /registry/networkpolicies/ /registry/networkpolicies/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.248206832Z" level=error msg="error while range on /registry/cronjobs/ /registry/cronjobs/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.268807 698 node.go:136] Successfully retrieved node IP: 10.2.0.30 | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.438598 698 server_others.go:143] kube-proxy node IP is an IPv4 address (10.2.0.30), assume IPv4 operation | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.444145 698 trace.go:205] Trace[1306193515]: "List etcd3" key:/services/endpoints,resourceVersion:55487161,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:34.833) (total time: 610ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1306193515]: [610.411929ms] [610.411929ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.436333 698 iptables.go:167] Deleting iptables rule: -s 10.42.0.0/16 ! -d 224.0.0.0/4 -j MASQUERADE --random-fully | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.530406 698 trace.go:205] Trace[2029765082]: "List etcd3" key:/deployments,resourceVersion:55485181,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:34.839) (total time: 691ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[2029765082]: [691.179143ms] [691.179143ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.252129592Z" level=error msg="error while range on /registry/ingress/ /registry/ingress/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.336814740Z" level=error msg="error while range on /registry/persistentvolumeclaims/ /registry/persistentvolumeclaims/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.313798 698 trace.go:205] Trace[1313984930]: "GuaranteedUpdate etcd3" type:*coordination.Lease (09-Feb-2021 18:15:34.496) (total time: 817ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1313984930]: ---"Transaction prepared" 348ms (18:15:00.844) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1313984930]: ---"Transaction committed" 468ms (18:15:00.313) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1313984930]: [817.486522ms] [817.486522ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.534346 698 trace.go:205] Trace[1629793767]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/k3s-e,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.37 (09-Feb-2021 18:15:34.496) (total time: 1038ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1629793767]: ---"Object stored in database" 1037ms (18:15:00.534) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1629793767]: [1.038191755s] [1.038191755s] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.514714 698 iptables.go:155] Adding iptables rule: -d 10.42.0.0/16 -j ACCEPT | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.546084 698 trace.go:205] Trace[682975272]: "List" url:/api/v1/nodes,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:34.842) (total time: 703ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[682975272]: ---"Listing from storage done" 492ms (18:15:00.334) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[682975272]: ---"Writing http response done" count:9 211ms (18:15:00.545) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[682975272]: [703.638803ms] [703.638803ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.255003170Z" level=error msg="error while range on /registry/persistentvolumes/ /registry/persistentvolumes/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.255174776Z" level=error msg="error while range on /registry/validatingwebhookconfigurations/ /registry/validatingwebhookconfigurations/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.258003374Z" level=error msg="error while range on /registry/poddisruptionbudgets/ /registry/poddisruptionbudgets/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.270002509Z" level=error msg="error while range on /registry/daemonsets/ /registry/daemonsets/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.270810603Z" level=error msg="error while range on /registry/controllers/ /registry/controllers/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.331006270Z" level=error msg="error while range on /registry/horizontalpodautoscalers/ /registry/horizontalpodautoscalers/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: time="2021-02-09T18:15:35.331911767Z" level=error msg="error while range on /registry/certificatesigningrequests/ /registry/certificatesigningrequests/: rpc error: code = OutOfRange desc = etcdserver: mvcc: required revision has been compacted" | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.339978 698 trace.go:205] Trace[1462525495]: "List" url:/api/v1/configmaps,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 18:15:34.682) (total time: 657ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1462525495]: ---"Writing http response done" count:64 657ms (18:15:00.339) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1462525495]: [657.647906ms] [657.647906ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.556561 698 trace.go:205] Trace[220926962]: "List" url:/api/v1/namespaces,user-agent:botkube/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:34.981) (total time: 574ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[220926962]: ---"Listing from storage done" 460ms (18:15:00.442) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[220926962]: [574.807678ms] [574.807678ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.351159 698 trace.go:205] Trace[523749734]: "List" url:/apis/apps/v1/deployments,user-agent:botkube/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:34.691) (total time: 660ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[523749734]: ---"Listing from storage done" 404ms (18:15:00.095) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[523749734]: ---"Writing http response done" count:75 255ms (18:15:00.351) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[523749734]: [660.070908ms] [660.070908ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.405769 698 trace.go:205] Trace[1624101689]: "GuaranteedUpdate etcd3" type:*coordination.Lease (09-Feb-2021 18:15:34.855) (total time: 550ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1624101689]: ---"Transaction committed" 549ms (18:15:00.405) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1624101689]: [550.147847ms] [550.147847ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.563461 698 trace.go:205] Trace[1517524765]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/rook-ceph/leases/external-resizer-rook-ceph-cephfs-csi-ceph-com,user-agent:csi-resizer/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:34.855) (total time: 708ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1517524765]: ---"Object stored in database" 707ms (18:15:00.563) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1517524765]: [708.058ms] [708.058ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.566735 698 trace.go:205] Trace[465401590]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:32.333) (total time: 3233ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[465401590]: ---"Transaction prepared" 2496ms (18:15:00.844) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[465401590]: ---"Transaction committed" 721ms (18:15:00.566) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[465401590]: [3.233025268s] [3.233025268s] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.566922 698 trace.go:205] Trace[234498603]: "Patch" url:/api/v1/namespaces/flux-system/events/helm-controller-c858b9c65-h9lrr.166226a60790bc78,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.34 (09-Feb-2021 18:15:32.333) (total time: 3233ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[234498603]: ---"Object stored in database" 3205ms (18:15:00.566) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[234498603]: [3.233412257s] [3.233412257s] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.567250 698 trace.go:205] Trace[1642501357]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:34.748) (total time: 818ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1642501357]: ---"initial value restored" 336ms (18:15:00.085) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1642501357]: ---"Transaction committed" 480ms (18:15:00.567) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1642501357]: [818.347008ms] [818.347008ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.567467 698 trace.go:205] Trace[285320449]: "Patch" url:/api/v1/namespaces/monitoring/events/influxdb.166200d4550f1287,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.34 (09-Feb-2021 18:15:34.748) (total time: 818ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[285320449]: ---"About to apply patch" 336ms (18:15:00.085) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[285320449]: ---"Object stored in database" 481ms (18:15:00.567) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[285320449]: [818.6458ms] [818.6458ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.567772 698 trace.go:205] Trace[2100119253]: "GuaranteedUpdate etcd3" type:*v1.Endpoints (09-Feb-2021 18:15:34.597) (total time: 969ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[2100119253]: ---"initial value restored" 174ms (18:15:00.772) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[2100119253]: ---"Transaction prepared" 250ms (18:15:00.022) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[2100119253]: ---"Transaction committed" 545ms (18:15:00.567) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[2100119253]: [969.946456ms] [969.946456ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.568028 698 trace.go:205] Trace[1644453600]: "List etcd3" key:/networkpolicies,resourceVersion:55459197,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:34.838) (total time: 729ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1644453600]: [729.13295ms] [729.13295ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.568110 698 trace.go:205] Trace[541276186]: "List" url:/apis/networking.k8s.io/v1/networkpolicies,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:34.838) (total time: 729ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[541276186]: [729.24837ms] [729.24837ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.409716 698 trace.go:205] Trace[1458072013]: "Get" url:/api/v1/namespaces/kube-system/pods/node-feature-discovery-worker-5vjvs,user-agent:k3s/v1.19.7+k3s1 (linux/arm64) kubernetes/5a00e38,client:10.2.0.31 (09-Feb-2021 18:15:34.900) (total time: 508ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1458072013]: ---"About to write a response" 508ms (18:15:00.409) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1458072013]: [508.724065ms] [508.724065ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.415795 698 trace.go:205] Trace[950688984]: "List" url:/api/v1/secrets,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:127.0.0.1 (09-Feb-2021 18:15:34.532) (total time: 883ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[950688984]: ---"Writing http response done" count:508 882ms (18:15:00.415) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[950688984]: [883.708539ms] [883.708539ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.447252 698 trace.go:205] Trace[574809531]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:34.815) (total time: 631ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[574809531]: ---"initial value restored" 631ms (18:15:00.447) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[574809531]: [631.811013ms] [631.811013ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.568709 698 trace.go:205] Trace[1029186936]: "Patch" url:/api/v1/namespaces/kube-system/events/node-feature-discovery-worker-r6tzg.166200c805643c78,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.36 (09-Feb-2021 18:15:34.815) (total time: 753ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1029186936]: ---"About to apply patch" 631ms (18:15:00.447) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1029186936]: [753.364253ms] [753.364253ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.447947 698 trace.go:205] Trace[1039378167]: "List etcd3" key:/storageclasses,resourceVersion:55458931,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:34.838) (total time: 609ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1039378167]: [609.321875ms] [609.321875ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.569011 698 trace.go:205] Trace[1947655702]: "List" url:/apis/storage.k8s.io/v1/storageclasses,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:34.838) (total time: 730ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1947655702]: [730.414057ms] [730.414057ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.278686 698 trace.go:205] Trace[2076085364]: "List etcd3" key:/ingress,resourceVersion:55459215,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:34.711) (total time: 566ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[2076085364]: [566.774064ms] [566.774064ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.569511 698 trace.go:205] Trace[1550981773]: "List" url:/apis/networking.k8s.io/v1beta1/ingresses,user-agent:botkube/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:34.711) (total time: 857ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1550981773]: [857.645045ms] [857.645045ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.581042 698 trace.go:205] Trace[1247876664]: "List etcd3" key:/cronjobs,resourceVersion:55121545,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:34.839) (total time: 741ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1247876664]: [741.528463ms] [741.528463ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.581214 698 trace.go:205] Trace[661035283]: "List" url:/apis/batch/v1beta1/cronjobs,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:34.839) (total time: 741ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[661035283]: [741.738984ms] [741.738984ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.628893 698 server_others.go:186] Using iptables Proxier. | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.629927 698 server.go:650] Version: v1.19.7+k3s1 | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.637990 698 iptables.go:167] Deleting iptables rule: ! -s 10.42.0.0/16 -d 10.42.0.0/24 -j RETURN | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.646722 698 trace.go:205] Trace[838790274]: "List" url:/api/v1/endpoints,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:34.833) (total time: 813ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[838790274]: ---"Listing from storage done" 632ms (18:15:00.466) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[838790274]: ---"Writing http response done" count:103 180ms (18:15:00.646) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[838790274]: [813.072791ms] [813.072791ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.648099 698 trace.go:205] Trace[1641386158]: "GuaranteedUpdate etcd3" type:*coordination.Lease (09-Feb-2021 18:15:34.851) (total time: 796ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1641386158]: ---"Transaction committed" 796ms (18:15:00.647) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1641386158]: [796.652539ms] [796.652539ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.778286 698 trace.go:205] Trace[1901838041]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/rook-ceph/leases/external-snapshotter-leader-rook-ceph-rbd-csi-ceph-com,user-agent:csi-snapshotter/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 18:15:34.850) (total time: 927ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1901838041]: ---"Object stored in database" 926ms (18:15:00.778) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1901838041]: [927.61909ms] [927.61909ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.778057 698 iptables.go:167] Deleting iptables rule: ! -s 10.42.0.0/16 -d 10.42.0.0/16 -j MASQUERADE --random-fully | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.648539 698 trace.go:205] Trace[794008842]: "GuaranteedUpdate etcd3" type:*coordination.Lease (09-Feb-2021 18:15:34.860) (total time: 787ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[794008842]: ---"Transaction committed" 780ms (18:15:00.648) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[794008842]: [787.725063ms] [787.725063ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.836825 698 trace.go:205] Trace[929547170]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:34.804) (total time: 1032ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[929547170]: ---"initial value restored" 577ms (18:15:00.381) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[929547170]: ---"Transaction committed" 453ms (18:15:00.836) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[929547170]: [1.032252957s] [1.032252957s] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.837952 698 trace.go:205] Trace[718734377]: "Patch" url:/api/v1/namespaces/default/events/flood-bt.1661febf99d1b7b2,user-agent:speaker/v0.0.0 (linux/arm64) kubernetes/$Format,client:10.2.0.31 (09-Feb-2021 18:15:34.804) (total time: 1033ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[718734377]: ---"About to apply patch" 577ms (18:15:00.381) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[718734377]: ---"Object stored in database" 455ms (18:15:00.837) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[718734377]: [1.033505045s] [1.033505045s] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.772414 698 trace.go:205] Trace[88910505]: "List etcd3" key:/certificatesigningrequests,resourceVersion:55121548,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:34.837) (total time: 935ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[88910505]: [935.130868ms] [935.130868ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.850535 698 trace.go:205] Trace[491218924]: "List" url:/apis/certificates.k8s.io/v1beta1/certificatesigningrequests,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:34.837) (total time: 1013ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[491218924]: [1.013314233s] [1.013314233s] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.682991 698 trace.go:205] Trace[943658157]: "List etcd3" key:/limitranges,resourceVersion:,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:35.121) (total time: 561ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[943658157]: [561.613764ms] [561.613764ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.850989 698 trace.go:205] Trace[936577066]: "List" url:/api/v1/limitranges,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:35.121) (total time: 729ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[936577066]: ---"Listing from storage done" 729ms (18:15:00.850) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[936577066]: [729.754999ms] [729.754999ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.686590 698 trace.go:205] Trace[1748939443]: "List etcd3" key:/validatingwebhookconfigurations,resourceVersion:55121544,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:34.839) (total time: 846ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1748939443]: [846.813702ms] [846.813702ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.851222 698 trace.go:205] Trace[595315549]: "List" url:/apis/admissionregistration.k8s.io/v1/validatingwebhookconfigurations,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:34.839) (total time: 1011ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[595315549]: [1.01152592s] [1.01152592s] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.690759 698 trace.go:205] Trace[1661504039]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:34.771) (total time: 919ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1661504039]: ---"initial value restored" 455ms (18:15:00.227) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1661504039]: ---"Transaction committed" 394ms (18:15:00.690) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1661504039]: [919.459002ms] [919.459002ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.726401 698 trace.go:205] Trace[723725926]: "List etcd3" key:/services/specs,resourceVersion:,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:35.153) (total time: 572ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[723725926]: [572.631147ms] [572.631147ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.739184 698 trace.go:205] Trace[773246744]: "List etcd3" key:/persistentvolumes,resourceVersion:55459082,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:34.842) (total time: 897ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[773246744]: [897.041325ms] [897.041325ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.851868 698 trace.go:205] Trace[208720571]: "List" url:/api/v1/persistentvolumes,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:34.842) (total time: 1009ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[208720571]: [1.009738964s] [1.009738964s] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.739307 698 trace.go:205] Trace[1035300435]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:34.833) (total time: 906ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1035300435]: ---"initial value restored" 545ms (18:15:00.378) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1035300435]: ---"Transaction committed" 359ms (18:15:00.739) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1035300435]: [906.058176ms] [906.058176ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.739380 698 trace.go:205] Trace[608179167]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:34.761) (total time: 977ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[608179167]: ---"initial value restored" 618ms (18:15:00.379) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[608179167]: ---"Transaction committed" 358ms (18:15:00.739) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[608179167]: [977.612342ms] [977.612342ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.739594 698 trace.go:205] Trace[189625900]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:34.765) (total time: 974ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[189625900]: ---"initial value restored" 612ms (18:15:00.377) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[189625900]: ---"Transaction committed" 360ms (18:15:00.739) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[189625900]: [974.463033ms] [974.463033ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.757550 698 trace.go:205] Trace[233598266]: "List etcd3" key:/persistentvolumeclaims,resourceVersion:55459086,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:34.840) (total time: 916ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[233598266]: [916.8917ms] [916.8917ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.852180 698 trace.go:205] Trace[792446946]: "List" url:/api/v1/persistentvolumeclaims,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:34.840) (total time: 1011ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[792446946]: [1.011556728s] [1.011556728s] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.772507 698 trace.go:205] Trace[854089661]: "List etcd3" key:/horizontalpodautoscalers,resourceVersion:55121545,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:34.834) (total time: 938ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[854089661]: [938.45632ms] [938.45632ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.852436 698 trace.go:205] Trace[149279182]: "List" url:/apis/autoscaling/v2beta1/horizontalpodautoscalers,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:34.833) (total time: 1018ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[149279182]: [1.018409874s] [1.018409874s] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.772665 698 trace.go:205] Trace[1460648113]: "List etcd3" key:/controllers,resourceVersion:55121544,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:34.840) (total time: 932ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1460648113]: [932.285554ms] [932.285554ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.852821 698 trace.go:205] Trace[756989901]: "List" url:/api/v1/replicationcontrollers,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:34.840) (total time: 1012ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[756989901]: [1.012427565s] [1.012427565s] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.842324 698 trace.go:205] Trace[1191973076]: "List etcd3" key:/daemonsets,resourceVersion:55459112,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:34.836) (total time: 1005ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1191973076]: [1.00598804s] [1.00598804s] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.853182 698 trace.go:205] Trace[1390201163]: "List" url:/apis/apps/v1/daemonsets,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:34.836) (total time: 1016ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1390201163]: [1.016902456s] [1.016902456s] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.858508 698 trace.go:205] Trace[1992719198]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/rook-ceph/leases/external-resizer-rook-ceph-rbd-csi-ceph-com,user-agent:csi-resizer/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:34.860) (total time: 998ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1992719198]: ---"Object stored in database" 947ms (18:15:00.808) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1992719198]: [998.243941ms] [998.243941ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.649258 698 conntrack.go:103] Set sysctl 'net/netfilter/nf_conntrack_max' to 131072 | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.861275 698 conntrack.go:52] Setting nf_conntrack_max to 131072 | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.861433 698 conntrack.go:103] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400 | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.861514 698 conntrack.go:103] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600 | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.860122 698 iptables.go:155] Adding iptables rule: -s 10.42.0.0/16 -d 10.42.0.0/16 -j RETURN | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.862447 698 trace.go:205] Trace[1307031334]: "List" url:/apis/apps/v1/deployments,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:34.839) (total time: 1023ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1307031334]: ---"Listing from storage done" 691ms (18:15:00.530) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1307031334]: ---"Writing http response done" count:75 331ms (18:15:00.862) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1307031334]: [1.023209279s] [1.023209279s] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.898700 698 trace.go:205] Trace[2007487470]: "List" url:/api/v1/pods,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:127.0.0.1 (09-Feb-2021 18:15:35.367) (total time: 531ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[2007487470]: ---"Writing http response done" count:181 531ms (18:15:00.898) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[2007487470]: [531.40732ms] [531.40732ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.899048 698 iptables.go:155] Adding iptables rule: -s 10.42.0.0/16 ! -d 224.0.0.0/4 -j MASQUERADE --random-fully | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.934726 698 trace.go:205] Trace[1701907776]: "Get" url:/apis/coordination.k8s.io/v1/namespaces/rook-ceph/leases/external-attacher-leader-rook-ceph-cephfs-csi-ceph-com,user-agent:csi-attacher/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 18:15:35.312) (total time: 622ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1701907776]: ---"About to write a response" 622ms (18:15:00.934) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1701907776]: [622.458779ms] [622.458779ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.935165 698 trace.go:205] Trace[807312297]: "Get" url:/apis/coordination.k8s.io/v1/namespaces/rook-ceph/leases/external-snapshotter-leader-rook-ceph-cephfs-csi-ceph-com,user-agent:csi-snapshotter/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:35.398) (total time: 536ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[807312297]: ---"About to write a response" 536ms (18:15:00.935) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[807312297]: [536.225271ms] [536.225271ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.935425 698 trace.go:205] Trace[1718565739]: "List etcd3" key:/ingress,resourceVersion:55459215,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:34.836) (total time: 1098ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1718565739]: [1.098720683s] [1.098720683s] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.935721 698 trace.go:205] Trace[1349152853]: "List" url:/apis/extensions/v1beta1/ingresses,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:34.836) (total time: 1098ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1349152853]: [1.098945824s] [1.098945824s] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.936530 698 trace.go:205] Trace[548167334]: "List etcd3" key:/volumeattachments,resourceVersion:,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:35.408) (total time: 527ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[548167334]: [527.704476ms] [527.704476ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.936979 698 trace.go:205] Trace[1084404914]: "List" url:/apis/storage.k8s.io/v1/volumeattachments,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:35.408) (total time: 528ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1084404914]: ---"Listing from storage done" 527ms (18:15:00.936) | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1084404914]: [528.16426ms] [528.16426ms] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.946380 698 trace.go:205] Trace[96984464]: "List etcd3" key:/pods,resourceVersion:55485765,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:34.834) (total time: 1111ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[96984464]: [1.111381307s] [1.111381307s] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.954303 698 trace.go:205] Trace[1995345612]: "List etcd3" key:/poddisruptionbudgets,resourceVersion:55435753,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:34.838) (total time: 1116ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[1995345612]: [1.116000294s] [1.116000294s] END | |
| Feb 09 18:15:35 k3s-0 k3s[698]: I0209 18:15:35.974409 698 trace.go:205] Trace[560862134]: "List etcd3" key:/clusterrolebindings,resourceVersion:,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:35.389) (total time: 584ms): | |
| Feb 09 18:15:35 k3s-0 k3s[698]: Trace[560862134]: [584.979249ms] [584.979249ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:35.977321 698 trace.go:205] Trace[720827641]: "Patch" url:/api/v1/namespaces/monitoring/events/influxdb.1661feac9987743f,user-agent:speaker/v0.0.0 (linux/arm64) kubernetes/$Format,client:10.2.0.33 (09-Feb-2021 18:15:34.766) (total time: 1210ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[720827641]: ---"About to apply patch" 460ms (18:15:00.227) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[720827641]: ---"Object stored in database" 621ms (18:15:00.851) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[720827641]: ---"Self-link added" 125ms (18:15:00.977) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[720827641]: [1.210475114s] [1.210475114s] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.003616 698 trace.go:205] Trace[1168969201]: "List" url:/apis/policy/v1beta1/poddisruptionbudgets,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:34.838) (total time: 1165ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1168969201]: [1.165346606s] [1.165346606s] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.005480 698 trace.go:205] Trace[779453420]: "GuaranteedUpdate etcd3" type:*core.Pod (09-Feb-2021 18:15:35.311) (total time: 693ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[779453420]: ---"Transaction committed" 654ms (18:15:00.005) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[779453420]: [693.783676ms] [693.783676ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.006019 698 trace.go:205] Trace[1755955880]: "Patch" url:/api/v1/namespaces/kube-system/pods/node-feature-discovery-worker-5v6nb/status,user-agent:k3s/v1.19.7+k3s1 (linux/arm64) kubernetes/5a00e38,client:10.2.0.32 (09-Feb-2021 18:15:35.310) (total time: 695ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1755955880]: ---"Object stored in database" 689ms (18:15:00.005) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1755955880]: [695.071124ms] [695.071124ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.006599 698 trace.go:205] Trace[1035273507]: "List etcd3" key:/namespaces,resourceVersion:,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:35.312) (total time: 693ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1035273507]: [693.625209ms] [693.625209ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.007187 698 trace.go:205] Trace[744685116]: "List" url:/api/v1/namespaces,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:35.312) (total time: 694ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[744685116]: ---"Listing from storage done" 693ms (18:15:00.006) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[744685116]: [694.211521ms] [694.211521ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.010375 698 trace.go:205] Trace[1901658070]: "Delete" url:/apis/apiregistration.k8s.io/v1/apiservices/v1alpha1.monitoring.coreos.com,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:127.0.0.1 (09-Feb-2021 18:15:34.703) (total time: 1307ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1901658070]: ---"Object deleted from database" 1289ms (18:15:00.010) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1901658070]: [1.307250864s] [1.307250864s] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.011488 698 trace.go:205] Trace[47195055]: "Delete" url:/apis/apiregistration.k8s.io/v1/apiservices/v1.k3s.cattle.io,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:127.0.0.1 (09-Feb-2021 18:15:34.702) (total time: 1309ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[47195055]: ---"Object deleted from database" 1309ms (18:15:00.011) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[47195055]: [1.309139909s] [1.309139909s] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:35.985242 698 iptables.go:155] Adding iptables rule: ! -s 10.42.0.0/16 -d 10.42.0.0/24 -j RETURN | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:35.986562 698 trace.go:205] Trace[771460205]: "List" url:/api/v1/services,user-agent:botkube/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:35.153) (total time: 832ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[771460205]: ---"Listing from storage done" 697ms (18:15:00.851) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[771460205]: ---"Writing http response done" count:103 135ms (18:15:00.986) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[771460205]: [832.796322ms] [832.796322ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:35.987692 698 trace.go:205] Trace[1204976407]: "Patch" url:/api/v1/namespaces/default/events/nzbget.1661feaaa6bcbff3,user-agent:speaker/v0.0.0 (linux/arm64) kubernetes/$Format,client:10.2.0.32 (09-Feb-2021 18:15:34.833) (total time: 1154ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1204976407]: ---"About to apply patch" 545ms (18:15:00.378) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1204976407]: ---"Object stored in database" 472ms (18:15:00.852) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1204976407]: ---"Self-link added" 135ms (18:15:00.987) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1204976407]: [1.15450889s] [1.15450889s] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:35.987801 698 trace.go:205] Trace[1376035780]: "Patch" url:/api/v1/namespaces/default/events/unifi-stun.166200cf0c5048a7,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.36 (09-Feb-2021 18:15:34.761) (total time: 1226ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1376035780]: ---"About to apply patch" 618ms (18:15:00.379) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1376035780]: ---"Object stored in database" 471ms (18:15:00.852) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1376035780]: ---"Self-link added" 135ms (18:15:00.987) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1376035780]: [1.226168683s] [1.226168683s] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:35.987916 698 trace.go:205] Trace[1520993691]: "Patch" url:/api/v1/namespaces/default/events/vernemq.1661feb7c2b1d26e,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.37 (09-Feb-2021 18:15:34.764) (total time: 1222ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1520993691]: ---"About to apply patch" 612ms (18:15:00.377) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1520993691]: ---"Object stored in database" 473ms (18:15:00.852) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1520993691]: ---"Self-link added" 135ms (18:15:00.987) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1520993691]: [1.222931753s] [1.222931753s] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.034082 698 trace.go:205] Trace[88166402]: "List etcd3" key:/events,resourceVersion:55487058,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:34.713) (total time: 1320ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[88166402]: [1.320416253s] [1.320416253s] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.038819 698 trace.go:205] Trace[639497408]: "List" url:/apis/rbac.authorization.k8s.io/v1/clusterrolebindings,user-agent:botkube/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:35.389) (total time: 649ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[639497408]: ---"Listing from storage done" 608ms (18:15:00.997) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[639497408]: [649.462581ms] [649.462581ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.046238 698 trace.go:205] Trace[1445321490]: "Get" url:/api/v1/namespaces/logs/secrets/loki-promtail-token-svcch,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:127.0.0.1 (09-Feb-2021 18:15:35.313) (total time: 732ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1445321490]: ---"About to write a response" 732ms (18:15:00.046) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1445321490]: [732.695944ms] [732.695944ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.052302 698 trace.go:205] Trace[162963227]: "Create" url:/api/v1/namespaces/rook-ceph/events,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.35 (09-Feb-2021 18:15:35.407) (total time: 644ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[162963227]: ---"Object stored in database" 644ms (18:15:00.051) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[162963227]: [644.371761ms] [644.371761ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.060463 698 trace.go:205] Trace[1813861951]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:35.411) (total time: 648ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1813861951]: ---"initial value restored" 648ms (18:15:00.060) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1813861951]: [648.759802ms] [648.759802ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.060596 698 trace.go:205] Trace[916853521]: "Patch" url:/api/v1/namespaces/kube-system/events/node-feature-discovery-worker-smfx8.1661ffe131b2564f,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.38 (09-Feb-2021 18:15:35.411) (total time: 649ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[916853521]: ---"About to apply patch" 648ms (18:15:00.060) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[916853521]: [649.079956ms] [649.079956ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.066592 698 trace.go:205] Trace[435599836]: "Create" url:/api/v1/namespaces/rook-ceph/events,user-agent:csi-attacher/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 18:15:35.493) (total time: 573ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[435599836]: ---"Object stored in database" 367ms (18:15:00.860) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[435599836]: [573.185257ms] [573.185257ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.066956 698 trace.go:205] Trace[1885633614]: "Create" url:/api/v1/namespaces/rook-ceph/events,user-agent:csi-snapshotter/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:35.481) (total time: 585ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1885633614]: ---"Object stored in database" 379ms (18:15:00.860) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1885633614]: [585.405312ms] [585.405312ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.067246 698 trace.go:205] Trace[756447486]: "GuaranteedUpdate etcd3" type:*coordination.Lease (09-Feb-2021 18:15:35.450) (total time: 616ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[756447486]: ---"Transaction committed" 615ms (18:15:00.067) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[756447486]: [616.260997ms] [616.260997ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.067567 698 trace.go:205] Trace[367767557]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/k3s-pi4-c,user-agent:k3s/v1.19.7+k3s1 (linux/arm64) kubernetes/5a00e38,client:10.2.0.33 (09-Feb-2021 18:15:35.450) (total time: 616ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[367767557]: ---"Object stored in database" 616ms (18:15:00.067) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[367767557]: [616.775668ms] [616.775668ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.077725 698 trace.go:205] Trace[1527440270]: "List etcd3" key:/services/specs,resourceVersion:,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:35.299) (total time: 778ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1527440270]: [778.027136ms] [778.027136ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.088191 698 trace.go:205] Trace[1956491507]: "List" url:/api/v1/services,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:35.299) (total time: 788ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1956491507]: ---"Listing from storage done" 778ms (18:15:00.077) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1956491507]: [788.497818ms] [788.497818ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.088823 698 config.go:315] Starting service config controller | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.088852 698 shared_informer.go:240] Waiting for caches to sync for service config | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.088893 698 config.go:224] Starting endpoint slice config controller | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.088900 698 shared_informer.go:240] Waiting for caches to sync for endpoint slice config | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.096189 698 trace.go:205] Trace[1843269352]: "List" url:/api/v1/events,user-agent:botkube/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:34.713) (total time: 1382ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1843269352]: ---"Listing from storage done" 1320ms (18:15:00.034) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1843269352]: [1.382521892s] [1.382521892s] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.108975 698 trace.go:205] Trace[1119725743]: "List etcd3" key:/resourcequotas,resourceVersion:,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:35.386) (total time: 722ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1119725743]: [722.283906ms] [722.283906ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.109335 698 trace.go:205] Trace[19380376]: "List" url:/api/v1/resourcequotas,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:35.386) (total time: 722ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[19380376]: ---"Listing from storage done" 722ms (18:15:00.109) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[19380376]: [722.504833ms] [722.504833ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.118484 698 trace.go:205] Trace[618864154]: "Delete" url:/apis/apiregistration.k8s.io/v1/apiservices/v1.snapshot.storage.k8s.io,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:127.0.0.1 (09-Feb-2021 18:15:34.702) (total time: 1415ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[618864154]: ---"Object deleted from database" 1398ms (18:15:00.118) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[618864154]: [1.415730185s] [1.415730185s] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.141190 698 trace.go:205] Trace[2095841261]: "List" url:/apis/rbac.authorization.k8s.io/v1/clusterroles,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:127.0.0.1 (09-Feb-2021 18:15:35.565) (total time: 575ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[2095841261]: ---"Listing from storage done" 493ms (18:15:00.059) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[2095841261]: [575.825402ms] [575.825402ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.141608 698 trace.go:205] Trace[1509202447]: "Delete" url:/apis/apiregistration.k8s.io/v1/apiservices/v1.upgrade.cattle.io,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:127.0.0.1 (09-Feb-2021 18:15:34.702) (total time: 1438ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1509202447]: ---"Object deleted from database" 1420ms (18:15:00.141) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1509202447]: [1.43865844s] [1.43865844s] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.142030 698 trace.go:205] Trace[1460492357]: "Delete" url:/apis/apiregistration.k8s.io/v1/apiservices/v1beta1.cert-manager.io,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:127.0.0.1 (09-Feb-2021 18:15:34.703) (total time: 1438ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1460492357]: ---"Object deleted from database" 1426ms (18:15:00.141) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1460492357]: [1.438691338s] [1.438691338s] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.152118 698 iptables.go:155] Adding iptables rule: ! -s 10.42.0.0/16 -d 10.42.0.0/16 -j MASQUERADE --random-fully | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.181995 698 trace.go:205] Trace[953397073]: "Create" url:/api/v1/namespaces/kube-system/events,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.36 (09-Feb-2021 18:15:35.667) (total time: 514ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[953397073]: ---"Object stored in database" 514ms (18:15:00.181) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[953397073]: [514.763067ms] [514.763067ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.216230 698 trace.go:205] Trace[787424481]: "List etcd3" key:/storageclasses,resourceVersion:,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:35.662) (total time: 553ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[787424481]: [553.367963ms] [553.367963ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.216529 698 trace.go:205] Trace[904529852]: "List" url:/apis/storage.k8s.io/v1/storageclasses,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:35.662) (total time: 553ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[904529852]: ---"Listing from storage done" 553ms (18:15:00.216) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[904529852]: [553.719993ms] [553.719993ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.233341 698 trace.go:205] Trace[484071202]: "GuaranteedUpdate etcd3" type:*core.Pod (09-Feb-2021 18:15:35.652) (total time: 580ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[484071202]: ---"Transaction prepared" 298ms (18:15:00.951) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[484071202]: ---"Transaction committed" 281ms (18:15:00.233) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[484071202]: [580.683677ms] [580.683677ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.234136 698 trace.go:205] Trace[1747197213]: "Patch" url:/api/v1/namespaces/kube-system/pods/node-feature-discovery-worker-5vjvs/status,user-agent:k3s/v1.19.7+k3s1 (linux/arm64) kubernetes/5a00e38,client:10.2.0.31 (09-Feb-2021 18:15:35.652) (total time: 581ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1747197213]: ---"About to check admission control" 193ms (18:15:00.846) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1747197213]: ---"Object stored in database" 387ms (18:15:00.233) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1747197213]: [581.745717ms] [581.745717ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.237540 698 trace.go:205] Trace[465437570]: "List" url:/api/v1/pods,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:34.834) (total time: 1402ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[465437570]: ---"Listing from storage done" 1121ms (18:15:00.956) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[465437570]: ---"Writing http response done" count:181 280ms (18:15:00.237) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[465437570]: [1.402578842s] [1.402578842s] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.263522 698 trace.go:205] Trace[616835811]: "List etcd3" key:/networkpolicies,resourceVersion:,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:35.661) (total time: 601ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[616835811]: [601.923067ms] [601.923067ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.263793 698 trace.go:205] Trace[559392325]: "List" url:/apis/networking.k8s.io/v1/networkpolicies,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:35.661) (total time: 602ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[559392325]: ---"Listing from storage done" 602ms (18:15:00.263) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[559392325]: [602.252602ms] [602.252602ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.267030 698 trace.go:205] Trace[2131905103]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:35.645) (total time: 621ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[2131905103]: ---"initial value restored" 621ms (18:15:00.266) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[2131905103]: [621.150913ms] [621.150913ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.267166 698 trace.go:205] Trace[1361803077]: "Patch" url:/api/v1/namespaces/flux-system/events/kustomize-controller-f674fdd7b-vjvpf.1661fecabdbfe753,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.34 (09-Feb-2021 18:15:35.645) (total time: 621ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1361803077]: ---"About to apply patch" 621ms (18:15:00.266) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1361803077]: [621.438613ms] [621.438613ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.268441 698 trace.go:205] Trace[1834601107]: "GuaranteedUpdate etcd3" type:*coordination.Lease (09-Feb-2021 18:15:35.397) (total time: 870ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1834601107]: ---"Transaction committed" 870ms (18:15:00.268) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1834601107]: [870.770458ms] [870.770458ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.268954 698 trace.go:205] Trace[989067568]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/k3s-pi4-b,user-agent:k3s/v1.19.7+k3s1 (linux/arm64) kubernetes/5a00e38,client:10.2.0.32 (09-Feb-2021 18:15:35.397) (total time: 871ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[989067568]: ---"Object stored in database" 871ms (18:15:00.268) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[989067568]: [871.411189ms] [871.411189ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.269514 698 trace.go:205] Trace[90850363]: "Get" url:/apis/coordination.k8s.io/v1/namespaces/rook-ceph/leases/external-resizer-rook-ceph-cephfs-csi-ceph-com,user-agent:csi-resizer/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:35.653) (total time: 615ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[90850363]: ---"About to write a response" 615ms (18:15:00.269) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[90850363]: [615.801079ms] [615.801079ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.290121 698 shared_informer.go:247] Caches are synced for endpoint slice config | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.324580 698 trace.go:205] Trace[1040075105]: "GuaranteedUpdate etcd3" type:*core.Pod (09-Feb-2021 18:15:35.650) (total time: 673ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1040075105]: ---"Transaction committed" 667ms (18:15:00.324) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1040075105]: [673.983397ms] [673.983397ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.325039 698 trace.go:205] Trace[480825582]: "Patch" url:/api/v1/namespaces/kube-system/pods/node-feature-discovery-worker-t6qz2/status,user-agent:k3s/v1.19.7+k3s1 (linux/arm64) kubernetes/5a00e38,client:10.2.0.33 (09-Feb-2021 18:15:35.650) (total time: 674ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[480825582]: ---"Object stored in database" 668ms (18:15:00.324) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[480825582]: [674.674315ms] [674.674315ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.325945 698 trace.go:205] Trace[1521670986]: "List etcd3" key:/cronjobs,resourceVersion:,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:35.718) (total time: 607ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1521670986]: [607.507487ms] [607.507487ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.326145 698 trace.go:205] Trace[1128374213]: "List" url:/apis/batch/v1beta1/cronjobs,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:35.718) (total time: 607ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1128374213]: ---"Listing from storage done" 607ms (18:15:00.325) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1128374213]: [607.738624ms] [607.738624ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.326795 698 trace.go:205] Trace[1841145075]: "GuaranteedUpdate etcd3" type:*core.Pod (09-Feb-2021 18:15:35.628) (total time: 698ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1841145075]: ---"Transaction committed" 614ms (18:15:00.326) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1841145075]: [698.683296ms] [698.683296ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.327282 698 trace.go:205] Trace[284219399]: "Patch" url:/api/v1/namespaces/kube-system/pods/node-feature-discovery-worker-r6tzg/status,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.36 (09-Feb-2021 18:15:35.627) (total time: 699ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[284219399]: ---"Object stored in database" 615ms (18:15:00.326) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[284219399]: [699.48157ms] [699.48157ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.339874 698 trace.go:205] Trace[1209995337]: "Get" url:/apis/scheduling.k8s.io/v1/priorityclasses/system-node-critical,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:127.0.0.1 (09-Feb-2021 18:15:35.565) (total time: 774ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1209995337]: ---"About to write a response" 774ms (18:15:00.339) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1209995337]: [774.106086ms] [774.106086ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.396535 698 trace.go:205] Trace[1159713668]: "GuaranteedUpdate etcd3" type:*coordination.Lease (09-Feb-2021 18:15:35.769) (total time: 627ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1159713668]: ---"Transaction committed" 551ms (18:15:00.396) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1159713668]: [627.361742ms] [627.361742ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.396739 698 trace.go:205] Trace[1276228224]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/k3s-a,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.38 (09-Feb-2021 18:15:35.768) (total time: 628ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1276228224]: ---"Object stored in database" 627ms (18:15:00.396) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1276228224]: [628.417932ms] [628.417932ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.416309 698 shared_informer.go:247] Caches are synced for service config | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.420275 698 trace.go:205] Trace[597215048]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:35.686) (total time: 733ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[597215048]: ---"initial value restored" 522ms (18:15:00.209) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[597215048]: ---"Transaction committed" 210ms (18:15:00.420) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[597215048]: [733.641634ms] [733.641634ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.420524 698 trace.go:205] Trace[401785294]: "Patch" url:/api/v1/namespaces/default/events/mcsv-minecraft.1662000cb90b14f9,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.34 (09-Feb-2021 18:15:35.686) (total time: 734ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[401785294]: ---"About to apply patch" 522ms (18:15:00.209) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[401785294]: ---"Object stored in database" 210ms (18:15:00.420) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[401785294]: [734.084883ms] [734.084883ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.454456 698 trace.go:205] Trace[1062096327]: "Get" url:/api/v1/namespaces/default/endpoints/kubernetes,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:127.0.0.1 (09-Feb-2021 18:15:35.668) (total time: 785ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1062096327]: ---"About to write a response" 785ms (18:15:00.454) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1062096327]: [785.690653ms] [785.690653ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.457458 698 trace.go:205] Trace[1150299101]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:35.409) (total time: 1048ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1150299101]: ---"initial value restored" 654ms (18:15:00.064) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1150299101]: ---"Transaction committed" 391ms (18:15:00.457) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1150299101]: [1.048119346s] [1.048119346s] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.457645 698 trace.go:205] Trace[237924700]: "Patch" url:/api/v1/namespaces/kube-system/events/ingress-nginx-controller.1661fed906320d82,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 18:15:35.409) (total time: 1048ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[237924700]: ---"About to apply patch" 654ms (18:15:00.064) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[237924700]: ---"Object stored in database" 392ms (18:15:00.457) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[237924700]: [1.048375388s] [1.048375388s] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.458687 698 trace.go:205] Trace[1811265451]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:35.412) (total time: 1046ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1811265451]: ---"initial value restored" 653ms (18:15:00.065) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1811265451]: ---"Transaction committed" 392ms (18:15:00.458) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1811265451]: [1.046047281s] [1.046047281s] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.458913 698 trace.go:205] Trace[345667572]: "Patch" url:/api/v1/namespaces/monitoring/events/influxdb.166200d454c17917,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:35.412) (total time: 1046ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[345667572]: ---"About to apply patch" 653ms (18:15:00.065) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[345667572]: ---"Object stored in database" 392ms (18:15:00.458) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[345667572]: [1.046352925s] [1.046352925s] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.598741 698 trace.go:205] Trace[778506160]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:36.095) (total time: 503ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[778506160]: ---"initial value restored" 361ms (18:15:00.456) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[778506160]: ---"Transaction committed" 141ms (18:15:00.598) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[778506160]: [503.469165ms] [503.469165ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.620701 698 trace.go:205] Trace[1894448835]: "Patch" url:/api/v1/namespaces/default/events/mc-minecraft.16621effe9d5ac1c,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.36 (09-Feb-2021 18:15:36.095) (total time: 525ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1894448835]: ---"About to apply patch" 361ms (18:15:00.456) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1894448835]: ---"Object stored in database" 163ms (18:15:00.620) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[1894448835]: [525.5039ms] [525.5039ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.622307 698 trace.go:205] Trace[340270694]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:36.094) (total time: 527ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[340270694]: ---"initial value restored" 280ms (18:15:00.374) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[340270694]: ---"Transaction committed" 246ms (18:15:00.622) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[340270694]: [527.578768ms] [527.578768ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.623130 698 trace.go:205] Trace[812262232]: "Patch" url:/api/v1/namespaces/default/events/unifi-stun.1661feb7c29c69a6,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.37 (09-Feb-2021 18:15:36.094) (total time: 528ms): | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[812262232]: ---"About to apply patch" 280ms (18:15:00.374) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[812262232]: ---"Object stored in database" 247ms (18:15:00.622) | |
| Feb 09 18:15:36 k3s-0 k3s[698]: Trace[812262232]: [528.48733ms] [528.48733ms] END | |
| Feb 09 18:15:36 k3s-0 k3s[698]: I0209 18:15:36.740290 698 storage_scheduling.go:143] all system priority classes are created successfully or already exist. | |
| Feb 09 18:15:37 k3s-0 k3s[698]: I0209 18:15:37.028188 698 network_policy_controller.go:149] Starting network policy controller | |
| Feb 09 18:15:37 k3s-0 k3s[698]: E0209 18:15:37.062898 698 proxier.go:1571] Failed to execute iptables-restore: exit status 2 (iptables-restore v1.8.4 (legacy): Couldn't load target `KUBE-MARK-DROP':No such file or directory | |
| Feb 09 18:15:37 k3s-0 k3s[698]: Error occurred at line: 397 | |
| Feb 09 18:15:37 k3s-0 k3s[698]: Try `iptables-restore -h' or 'iptables-restore --help' for more information. | |
| Feb 09 18:15:37 k3s-0 k3s[698]: ) | |
| Feb 09 18:15:37 k3s-0 k3s[698]: I0209 18:15:37.063625 698 proxier.go:850] Sync failed; retrying in 30s | |
| Feb 09 18:15:37 k3s-0 k3s[698]: I0209 18:15:37.097662 698 trace.go:205] Trace[675281277]: "List etcd3" key:/pods,resourceVersion:,resourceVersionMatch:,limit:0,continue: (09-Feb-2021 18:15:36.559) (total time: 537ms): | |
| Feb 09 18:15:37 k3s-0 k3s[698]: Trace[675281277]: [537.918162ms] [537.918162ms] END | |
| Feb 09 18:15:37 k3s-0 k3s[698]: I0209 18:15:37.114337 698 trace.go:205] Trace[1668266174]: "List etcd3" key:/configmaps,resourceVersion:55487173,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:35.738) (total time: 1375ms): | |
| Feb 09 18:15:37 k3s-0 k3s[698]: Trace[1668266174]: [1.37538687s] [1.37538687s] END | |
| Feb 09 18:15:37 k3s-0 k3s[698]: I0209 18:15:37.138311 698 trace.go:205] Trace[1655570946]: "List" url:/api/v1/pods,user-agent:descheduler/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:36.559) (total time: 578ms): | |
| Feb 09 18:15:37 k3s-0 k3s[698]: Trace[1655570946]: ---"Listing from storage done" 538ms (18:15:00.097) | |
| Feb 09 18:15:37 k3s-0 k3s[698]: Trace[1655570946]: [578.595134ms] [578.595134ms] END | |
| Feb 09 18:15:37 k3s-0 k3s[698]: I0209 18:15:37.144536 698 trace.go:205] Trace[2080411307]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:36.494) (total time: 649ms): | |
| Feb 09 18:15:37 k3s-0 k3s[698]: Trace[2080411307]: ---"initial value restored" 463ms (18:15:00.958) | |
| Feb 09 18:15:37 k3s-0 k3s[698]: Trace[2080411307]: ---"Transaction committed" 185ms (18:15:00.144) | |
| Feb 09 18:15:37 k3s-0 k3s[698]: Trace[2080411307]: [649.689912ms] [649.689912ms] END | |
| Feb 09 18:15:37 k3s-0 k3s[698]: I0209 18:15:37.144745 698 trace.go:205] Trace[1087487268]: "Patch" url:/api/v1/namespaces/default/events/mcsv-minecraft.1661feac99db6f68,user-agent:speaker/v0.0.0 (linux/arm64) kubernetes/$Format,client:10.2.0.33 (09-Feb-2021 18:15:36.494) (total time: 650ms): | |
| Feb 09 18:15:37 k3s-0 k3s[698]: Trace[1087487268]: ---"About to apply patch" 463ms (18:15:00.958) | |
| Feb 09 18:15:37 k3s-0 k3s[698]: Trace[1087487268]: ---"Object stored in database" 185ms (18:15:00.144) | |
| Feb 09 18:15:37 k3s-0 k3s[698]: Trace[1087487268]: [650.015302ms] [650.015302ms] END | |
| Feb 09 18:15:37 k3s-0 k3s[698]: I0209 18:15:37.178924 698 trace.go:205] Trace[1949098538]: "List etcd3" key:/replicasets,resourceVersion:55485176,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:34.834) (total time: 2344ms): | |
| Feb 09 18:15:37 k3s-0 k3s[698]: Trace[1949098538]: [2.344454173s] [2.344454173s] END | |
| Feb 09 18:15:37 k3s-0 k3s[698]: I0209 18:15:37.246122 698 trace.go:205] Trace[1284162171]: "List" url:/api/v1/configmaps,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:35.738) (total time: 1507ms): | |
| Feb 09 18:15:37 k3s-0 k3s[698]: Trace[1284162171]: ---"Listing from storage done" 1375ms (18:15:00.114) | |
| Feb 09 18:15:37 k3s-0 k3s[698]: Trace[1284162171]: ---"Writing http response done" count:64 131ms (18:15:00.246) | |
| Feb 09 18:15:37 k3s-0 k3s[698]: Trace[1284162171]: [1.507182983s] [1.507182983s] END | |
| Feb 09 18:15:37 k3s-0 k3s[698]: I0209 18:15:37.401731 698 trace.go:205] Trace[232833163]: "List" url:/apis/apps/v1/replicasets,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:34.834) (total time: 2567ms): | |
| Feb 09 18:15:37 k3s-0 k3s[698]: Trace[232833163]: ---"Listing from storage done" 2344ms (18:15:00.178) | |
| Feb 09 18:15:37 k3s-0 k3s[698]: Trace[232833163]: ---"Writing http response done" count:395 222ms (18:15:00.401) | |
| Feb 09 18:15:37 k3s-0 k3s[698]: Trace[232833163]: [2.56726823s] [2.56726823s] END | |
| Feb 09 18:15:37 k3s-0 k3s[698]: E0209 18:15:37.564590 698 controller.go:156] Unable to remove old endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service | |
| Feb 09 18:15:37 k3s-0 k3s[698]: I0209 18:15:37.954000 698 trace.go:205] Trace[1105279813]: "List etcd3" key:/pods,resourceVersion:,resourceVersionMatch:,limit:0,continue: (09-Feb-2021 18:15:37.201) (total time: 752ms): | |
| Feb 09 18:15:37 k3s-0 k3s[698]: Trace[1105279813]: [752.10959ms] [752.10959ms] END | |
| Feb 09 18:15:38 k3s-0 k3s[698]: I0209 18:15:38.013228 698 trace.go:205] Trace[328666898]: "List" url:/api/v1/pods,user-agent:descheduler/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:37.201) (total time: 811ms): | |
| Feb 09 18:15:38 k3s-0 k3s[698]: Trace[328666898]: ---"Listing from storage done" 752ms (18:15:00.954) | |
| Feb 09 18:15:38 k3s-0 k3s[698]: Trace[328666898]: [811.338513ms] [811.338513ms] END | |
| Feb 09 18:15:38 k3s-0 k3s[698]: I0209 18:15:38.192188 698 trace.go:205] Trace[904137131]: "List etcd3" key:/pods,resourceVersion:,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:37.380) (total time: 811ms): | |
| Feb 09 18:15:38 k3s-0 k3s[698]: Trace[904137131]: [811.823327ms] [811.823327ms] END | |
| Feb 09 18:15:38 k3s-0 k3s[698]: I0209 18:15:38.272949 698 trace.go:205] Trace[2133889149]: "List" url:/api/v1/pods,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:37.380) (total time: 892ms): | |
| Feb 09 18:15:38 k3s-0 k3s[698]: Trace[2133889149]: ---"Listing from storage done" 811ms (18:15:00.192) | |
| Feb 09 18:15:38 k3s-0 k3s[698]: Trace[2133889149]: [892.614929ms] [892.614929ms] END | |
| Feb 09 18:15:38 k3s-0 k3s[698]: I0209 18:15:38.517487 698 trace.go:205] Trace[1557474776]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:38.015) (total time: 502ms): | |
| Feb 09 18:15:38 k3s-0 k3s[698]: Trace[1557474776]: ---"initial value restored" 199ms (18:15:00.214) | |
| Feb 09 18:15:38 k3s-0 k3s[698]: Trace[1557474776]: ---"Transaction committed" 302ms (18:15:00.517) | |
| Feb 09 18:15:38 k3s-0 k3s[698]: Trace[1557474776]: [502.42776ms] [502.42776ms] END | |
| Feb 09 18:15:38 k3s-0 k3s[698]: I0209 18:15:38.517719 698 trace.go:205] Trace[869453512]: "Patch" url:/api/v1/namespaces/kube-system/events/node-feature-discovery-worker-r6tzg.166200c82665ce08,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.36 (09-Feb-2021 18:15:38.014) (total time: 502ms): | |
| Feb 09 18:15:38 k3s-0 k3s[698]: Trace[869453512]: ---"About to apply patch" 199ms (18:15:00.214) | |
| Feb 09 18:15:38 k3s-0 k3s[698]: Trace[869453512]: ---"Object stored in database" 302ms (18:15:00.517) | |
| Feb 09 18:15:38 k3s-0 k3s[698]: Trace[869453512]: [502.830097ms] [502.830097ms] END | |
| Feb 09 18:15:38 k3s-0 k3s[698]: time="2021-02-09T18:15:38.583557204Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" | |
| Feb 09 18:15:38 k3s-0 k3s[698]: time="2021-02-09T18:15:38.583635764Z" level=info msg="Connecting to proxy" url="wss://10.2.0.30:6443/v1-k3s/connect" | |
| Feb 09 18:15:38 k3s-0 k3s[698]: time="2021-02-09T18:15:38.585227890Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" | |
| Feb 09 18:15:38 k3s-0 k3s[698]: time="2021-02-09T18:15:38.607499532Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" | |
| Feb 09 18:15:38 k3s-0 k3s[698]: I0209 18:15:38.723662 698 server.go:640] --cgroups-per-qos enabled, but --cgroup-root was not specified. defaulting to / | |
| Feb 09 18:15:38 k3s-0 k3s[698]: I0209 18:15:38.724248 698 container_manager_linux.go:289] container manager verified user specified cgroup-root exists: [] | |
| Feb 09 18:15:38 k3s-0 k3s[698]: I0209 18:15:38.724291 698 container_manager_linux.go:294] Creating Container Manager object based on Node Config: {RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:remote CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: ReservedSystemCPUs: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[{Signal:imagefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.05} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.05} GracePeriod:0s MinReclaim:<nil>}]} QOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalCPUManagerReconcilePeriod:10s ExperimentalPodPidsLimit:-1 EnforceCPULimits:true CPUCFSQuotaPeriod:100ms ExperimentalTopologyManagerPolicy:none Rootless:false} | |
| Feb 09 18:15:38 k3s-0 k3s[698]: I0209 18:15:38.724569 698 topology_manager.go:126] [topologymanager] Creating topology manager with none policy | |
| Feb 09 18:15:38 k3s-0 k3s[698]: I0209 18:15:38.724585 698 container_manager_linux.go:324] [topologymanager] Initializing Topology Manager with none policy | |
| Feb 09 18:15:38 k3s-0 k3s[698]: I0209 18:15:38.724591 698 container_manager_linux.go:329] Creating device plugin manager: true | |
| Feb 09 18:15:38 k3s-0 k3s[698]: W0209 18:15:38.725079 698 util_unix.go:103] Using "/run/k3s/containerd/containerd.sock" as endpoint is deprecated, please consider using full url format "unix:///run/k3s/containerd/containerd.sock". | |
| Feb 09 18:15:38 k3s-0 k3s[698]: W0209 18:15:38.725202 698 util_unix.go:103] Using "/run/k3s/containerd/containerd.sock" as endpoint is deprecated, please consider using full url format "unix:///run/k3s/containerd/containerd.sock". | |
| Feb 09 18:15:38 k3s-0 k3s[698]: I0209 18:15:38.729703 698 kubelet.go:261] Adding pod path: /var/lib/rancher/k3s/agent/pod-manifests | |
| Feb 09 18:15:38 k3s-0 k3s[698]: I0209 18:15:38.729795 698 kubelet.go:273] Watching apiserver | |
| Feb 09 18:15:38 k3s-0 k3s[698]: time="2021-02-09T18:15:38.748818366Z" level=info msg="Handling backend connection request [k3s-0]" | |
| Feb 09 18:15:38 k3s-0 k3s[698]: I0209 18:15:38.892049 698 kuberuntime_manager.go:214] Container runtime containerd initialized, version: v1.4.3-k3s1, apiVersion: v1alpha2 | |
| Feb 09 18:15:38 k3s-0 k3s[698]: I0209 18:15:38.900106 698 server.go:1148] Started kubelet | |
| Feb 09 18:15:38 k3s-0 k3s[698]: I0209 18:15:38.934123 698 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue). | |
| Feb 09 18:15:38 k3s-0 k3s[698]: I0209 18:15:38.934186 698 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue). | |
| Feb 09 18:15:38 k3s-0 k3s[698]: I0209 18:15:38.936626 698 fs_resource_analyzer.go:64] Starting FS ResourceAnalyzer | |
| Feb 09 18:15:38 k3s-0 k3s[698]: I0209 18:15:38.938796 698 server.go:152] Starting to listen on 0.0.0.0:10250 | |
| Feb 09 18:15:38 k3s-0 k3s[698]: I0209 18:15:38.940037 698 server.go:425] Adding debug handlers to kubelet server. | |
| Feb 09 18:15:38 k3s-0 k3s[698]: I0209 18:15:38.946025 698 volume_manager.go:265] Starting Kubelet Volume Manager | |
| Feb 09 18:15:38 k3s-0 k3s[698]: E0209 18:15:38.948835 698 customresource_handler.go:668] error building openapi models for alertmanagers.monitoring.coreos.com: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.containers.items.<array>.properties.env.items.<array>.properties.valueFrom.properties.resourceFieldRef.properties.divisor has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.containers.items.<array>.properties.lifecycle.properties.postStart.properties.httpGet.properties.port has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.containers.items.<array>.properties.lifecycle.properties.postStart.properties.tcpSocket.properties.port has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.containers.items.<array>.properties.lifecycle.properties.preStop.properties.httpGet.properties.port has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.containers.items.<array>.properties.lifecycle.properties.preStop.properties.tcpSocket.properties.port has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.containers.items.<array>.properties.livenessProbe.properties.httpGet.properties.port has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.containers.items.<array>.properties.livenessProbe.properties.tcpSocket.properties.port has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.containers.items.<array>.properties.readinessProbe.properties.httpGet.properties.port has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.containers.items.<array>.properties.readinessProbe.properties.tcpSocket.properties.port has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.containers.items.<array>.properties.resources.properties.limits.additionalProperties.schema has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.containers.items.<array>.properties.resources.properties.requests.additionalProperties.schema has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.containers.items.<array>.properties.startupProbe.properties.httpGet.properties.port has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.containers.items.<array>.properties.startupProbe.properties.tcpSocket.properties.port has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.initContainers.items.<array>.properties.env.items.<array>.properties.valueFrom.properties.resourceFieldRef.properties.divisor has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.initContainers.items.<array>.properties.lifecycle.properties.postStart.properties.httpGet.properties.port has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.initContainers.items.<array>.properties.lifecycle.properties.postStart.properties.tcpSocket.properties.port has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.initContainers.items.<array>.properties.lifecycle.properties.preStop.properties.httpGet.properties.port has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.initContainers.items.<array>.properties.lifecycle.properties.preStop.properties.tcpSocket.properties.port has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.initContainers.items.<array>.properties.livenessProbe.properties.httpGet.properties.port has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.initContainers.items.<array>.properties.livenessProbe.properties.tcpSocket.properties.port has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.initContainers.items.<array>.properties.readinessProbe.properties.httpGet.properties.port has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.initContainers.items.<array>.properties.readinessProbe.properties.tcpSocket.properties.port has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.initContainers.items.<array>.properties.resources.properties.limits.additionalProperties.schema has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.initContainers.items.<array>.properties.resources.properties.requests.additionalProperties.schema has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.initContainers.items.<array>.properties.startupProbe.properties.httpGet.properties.port has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.initContainers.items.<array>.properties.startupProbe.properties.tcpSocket.properties.port has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.resources.properties.limits.additionalProperties.schema has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.resources.properties.requests.additionalProperties.schema has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.storage.properties.emptyDir.properties.sizeLimit has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.storage.properties.volumeClaimTemplate.properties.spec.properties.resources.properties.limits.additionalProperties.schema has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.storage.properties.volumeClaimTemplate.properties.spec.properties.resources.properties.requests.additionalProperties.schema has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.storage.properties.volumeClaimTemplate.properties.status.properties.capacity.additionalProperties.schema has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.volumes.items.<array>.properties.downwardAPI.properties.items.items.<array>.properties.resourceFieldRef.properties.divisor has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.volumes.items.<array>.properties.emptyDir.properties.sizeLimit has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.Alertmanager.properties.spec.properties.volumes.items.<array>.properties.projected.properties.sources.items.<array>.properties.downwardAPI.properties.items.items.<array>.properties.resourceFieldRef.properties.divisor has invalid property: anyOf | |
| Feb 09 18:15:38 k3s-0 k3s[698]: I0209 18:15:38.954005 698 desired_state_of_world_populator.go:139] Desired state populator starts to run | |
| Feb 09 18:15:38 k3s-0 k3s[698]: E0209 18:15:38.990354 698 cri_stats_provider.go:376] Failed to get the info of the filesystem with mountpoint "/var/lib/rancher/k3s/agent/containerd/io.containerd.snapshotter.v1.overlayfs": unable to find data in memory cache. | |
| Feb 09 18:15:38 k3s-0 k3s[698]: E0209 18:15:38.990413 698 kubelet.go:1221] Image garbage collection failed once. Stats initialization may not have completed yet: invalid capacity 0 on image filesystem | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.043035 698 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 641b9304f8c19acbb9e9caba4896ff09d26779518e5a93553e1831de917d5917 | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.072328 698 kuberuntime_manager.go:992] updating runtime config through cri with podcidr 10.42.0.0/24 | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.081207 698 trace.go:205] Trace[653043736]: "List etcd3" key:/velero.io/podvolumebackups,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (09-Feb-2021 18:15:37.238) (total time: 1842ms): | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[653043736]: [1.842735145s] [1.842735145s] END | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.114626 698 trace.go:205] Trace[722854542]: "List etcd3" key:/pods,resourceVersion:,resourceVersionMatch:,limit:0,continue: (09-Feb-2021 18:15:38.537) (total time: 576ms): | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[722854542]: [576.823317ms] [576.823317ms] END | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.116009 698 trace.go:205] Trace[474715411]: "List" url:/api/v1/pods,user-agent:descheduler/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:38.537) (total time: 578ms): | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[474715411]: ---"Listing from storage done" 576ms (18:15:00.114) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[474715411]: [578.261937ms] [578.261937ms] END | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.125139 698 trace.go:205] Trace[432179852]: "cacher list" type:*unstructured.Unstructured (09-Feb-2021 18:15:37.223) (total time: 1901ms): | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[432179852]: ---"Ready" 1900ms (18:15:00.124) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[432179852]: [1.901164651s] [1.901164651s] END | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.165666 698 kubelet_network.go:77] Setting Pod CIDR: -> 10.42.0.0/24 | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.185733 698 kubelet_node_status.go:71] Attempting to register node k3s-0 | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.306644 698 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 47357c492d0d1d3a958237b44aaddc24fe6a34e91455d8498bb748a47d6ac209 | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.345877 698 trace.go:205] Trace[1890939327]: "List etcd3" key:/configmaps,resourceVersion:,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:38.340) (total time: 1005ms): | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1890939327]: [1.005645156s] [1.005645156s] END | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.452186 698 status_manager.go:158] Starting to sync pod status with apiserver | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.452689 698 kubelet.go:1744] Starting kubelet main sync loop. | |
| Feb 09 18:15:39 k3s-0 k3s[698]: E0209 18:15:39.452964 698 kubelet.go:1768] skipping pod synchronization - [container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful] | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.465233 698 cpu_manager.go:184] [cpumanager] starting with none policy | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.465315 698 cpu_manager.go:185] [cpumanager] reconciling every 10s | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.465343 698 state_mem.go:36] [cpumanager] initializing new in-memory state store | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.466193 698 state_mem.go:88] [cpumanager] updated default cpuset: "" | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.466225 698 state_mem.go:96] [cpumanager] updated cpuset assignments: "map[]" | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.466241 698 policy_none.go:43] [cpumanager] none policy: Start | |
| Feb 09 18:15:39 k3s-0 k3s[698]: E0209 18:15:39.553740 698 kubelet.go:1768] skipping pod synchronization - PLEG is not healthy: pleg has yet to be successful | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.568233 698 trace.go:205] Trace[495563828]: "List" url:/api/v1/configmaps,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:38.340) (total time: 1228ms): | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[495563828]: ---"Listing from storage done" 1005ms (18:15:00.346) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[495563828]: ---"Writing http response done" count:64 222ms (18:15:00.568) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[495563828]: [1.228069233s] [1.228069233s] END | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.639477 698 plugin_manager.go:114] Starting Kubelet Plugin Manager | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.664229 698 trace.go:205] Trace[1579582568]: "List etcd3" key:/replicasets,resourceVersion:,resourceVersionMatch:,limit:500,continue: (09-Feb-2021 18:15:38.547) (total time: 1116ms): | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1579582568]: [1.116822192s] [1.116822192s] END | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.725098 698 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 9caa9b27014efcb19aa840a7160f58f9fc58d6c9923207adab850564f1501a16 | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.755685 698 trace.go:205] Trace[624665878]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:39.245) (total time: 510ms): | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[624665878]: ---"initial value restored" 285ms (18:15:00.530) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[624665878]: ---"Transaction committed" 224ms (18:15:00.755) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[624665878]: [510.52863ms] [510.52863ms] END | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.755836 698 trace.go:205] Trace[973020504]: "Patch" url:/api/v1/namespaces/kube-system/events/registry-creds-registry-creds-controller-5b84f897f6-xbbn2.166226df625916cc,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.37 (09-Feb-2021 18:15:39.244) (total time: 510ms): | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[973020504]: ---"About to apply patch" 285ms (18:15:00.530) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[973020504]: ---"Object stored in database" 224ms (18:15:00.755) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[973020504]: [510.809822ms] [510.809822ms] END | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.756685 698 trace.go:205] Trace[770817669]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:39.255) (total time: 501ms): | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[770817669]: ---"initial value restored" 274ms (18:15:00.530) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[770817669]: ---"Transaction committed" 225ms (18:15:00.756) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[770817669]: [501.375957ms] [501.375957ms] END | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.756821 698 trace.go:205] Trace[1139697361]: "Patch" url:/api/v1/namespaces/kube-system/events/coredns-coredns.1661fed9c31748aa,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 18:15:39.255) (total time: 501ms): | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1139697361]: ---"About to apply patch" 275ms (18:15:00.530) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1139697361]: ---"Object stored in database" 226ms (18:15:00.756) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1139697361]: [501.680398ms] [501.680398ms] END | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.780935 698 topology_manager.go:233] [topologymanager] Topology Admit Handler | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.783353 698 trace.go:205] Trace[1995725534]: "List" url:/apis/velero.io/v1/namespaces/velero/podvolumebackups,user-agent:restic-server/v1.5.3 (linux/arm64) 123109a3bcac11dbb6783d2758207bac0d0817cb,client:10.2.0.31 (09-Feb-2021 18:15:37.223) (total time: 2559ms): | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1995725534]: ---"Listing from storage done" 1903ms (18:15:00.127) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1995725534]: ---"Writing http response done" count:344 656ms (18:15:00.783) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1995725534]: [2.559462199s] [2.559462199s] END | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.786902 698 trace.go:205] Trace[1256982342]: "List" url:/apis/velero.io/v1/namespaces/velero/podvolumebackups,user-agent:restic-server/v1.5.3 (linux/amd64) 123109a3bcac11dbb6783d2758207bac0d0817cb,client:10.2.0.34 (09-Feb-2021 18:15:38.967) (total time: 819ms): | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1256982342]: ---"Listing from storage done" 176ms (18:15:00.143) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1256982342]: ---"Writing http response done" count:344 643ms (18:15:00.786) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1256982342]: [819.603011ms] [819.603011ms] END | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.787574 698 topology_manager.go:233] [topologymanager] Topology Admit Handler | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.809223 698 trace.go:205] Trace[1008224077]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:39.252) (total time: 556ms): | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1008224077]: ---"initial value restored" 276ms (18:15:00.529) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1008224077]: ---"Transaction committed" 279ms (18:15:00.809) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1008224077]: [556.309306ms] [556.309306ms] END | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.809369 698 trace.go:205] Trace[1355534139]: "Patch" url:/api/v1/namespaces/default/events/vernemq.1661fed25acabc33,user-agent:speaker/v0.0.0 (linux/arm64) kubernetes/$Format,client:10.2.0.31 (09-Feb-2021 18:15:39.252) (total time: 556ms): | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1355534139]: ---"About to apply patch" 276ms (18:15:00.529) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1355534139]: ---"Object stored in database" 279ms (18:15:00.809) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1355534139]: [556.607616ms] [556.607616ms] END | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.810413 698 trace.go:205] Trace[1694140399]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:39.256) (total time: 554ms): | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1694140399]: ---"initial value restored" 268ms (18:15:00.524) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1694140399]: ---"Transaction committed" 283ms (18:15:00.810) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1694140399]: [554.072023ms] [554.072023ms] END | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.810667 698 trace.go:205] Trace[1298497091]: "Patch" url:/api/v1/namespaces/default/events/unifi-gui.1661feaaa5db2a3c,user-agent:speaker/v0.0.0 (linux/arm64) kubernetes/$Format,client:10.2.0.32 (09-Feb-2021 18:15:39.256) (total time: 554ms): | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1298497091]: ---"About to apply patch" 268ms (18:15:00.524) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1298497091]: ---"Object stored in database" 283ms (18:15:00.810) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1298497091]: [554.419761ms] [554.419761ms] END | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.831058 698 topology_manager.go:233] [topologymanager] Topology Admit Handler | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.856619 698 kubelet_node_status.go:109] Node k3s-0 was previously registered | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.862824 698 trace.go:205] Trace[1927612504]: "List etcd3" key:/pods,resourceVersion:,resourceVersionMatch:,limit:0,continue: (09-Feb-2021 18:15:39.160) (total time: 702ms): | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1927612504]: [702.66262ms] [702.66262ms] END | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.875253 698 trace.go:205] Trace[253784767]: "List" url:/api/v1/pods,user-agent:descheduler/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:39.160) (total time: 715ms): | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[253784767]: ---"Listing from storage done" 713ms (18:15:00.873) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[253784767]: [715.143191ms] [715.143191ms] END | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.888029 698 topology_manager.go:233] [topologymanager] Topology Admit Handler | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.924939 698 kubelet_node_status.go:74] Successfully registered node k3s-0 | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.925766 698 topology_manager.go:233] [topologymanager] Topology Admit Handler | |
| Feb 09 18:15:39 k3s-0 k3s[698]: E0209 18:15:39.928062 698 available_controller.go:490] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.43.136.146:443/apis/metrics.k8s.io/v1beta1: Get "https://10.43.136.146:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.43.136.146:443: i/o timeout | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.938340 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "host-sys" (UniqueName: "kubernetes.io/host-path/d43f42c2-46dd-4de3-a871-6fb0ffea7184-host-sys") pod "csi-rbdplugin-7qgcb" (UID: "d43f42c2-46dd-4de3-a871-6fb0ffea7184") | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.938478 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "ceph-csi-config" (UniqueName: "kubernetes.io/configmap/d43f42c2-46dd-4de3-a871-6fb0ffea7184-ceph-csi-config") pod "csi-rbdplugin-7qgcb" (UID: "d43f42c2-46dd-4de3-a871-6fb0ffea7184") | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.938747 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "host-dev" (UniqueName: "kubernetes.io/host-path/0284ac6e-bf40-4f74-98eb-17cc7de85cdb-host-dev") pod "csi-cephfsplugin-thvr5" (UID: "0284ac6e-bf40-4f74-98eb-17cc7de85cdb") | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.938834 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "host-run-mount" (UniqueName: "kubernetes.io/host-path/0284ac6e-bf40-4f74-98eb-17cc7de85cdb-host-run-mount") pod "csi-cephfsplugin-thvr5" (UID: "0284ac6e-bf40-4f74-98eb-17cc7de85cdb") | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.938867 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "metallb-speaker-token-rkkkx" (UniqueName: "kubernetes.io/secret/9b4f5b6d-0eb8-4c9b-b846-100981d3732c-metallb-speaker-token-rkkkx") pod "metallb-speaker-hdtf2" (UID: "9b4f5b6d-0eb8-4c9b-b846-100981d3732c") | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.938998 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "host-dev" (UniqueName: "kubernetes.io/host-path/d43f42c2-46dd-4de3-a871-6fb0ffea7184-host-dev") pod "csi-rbdplugin-7qgcb" (UID: "d43f42c2-46dd-4de3-a871-6fb0ffea7184") | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.939077 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "lib-modules" (UniqueName: "kubernetes.io/host-path/d43f42c2-46dd-4de3-a871-6fb0ffea7184-lib-modules") pod "csi-rbdplugin-7qgcb" (UID: "d43f42c2-46dd-4de3-a871-6fb0ffea7184") | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.939167 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "registration-dir" (UniqueName: "kubernetes.io/host-path/0284ac6e-bf40-4f74-98eb-17cc7de85cdb-registration-dir") pod "csi-cephfsplugin-thvr5" (UID: "0284ac6e-bf40-4f74-98eb-17cc7de85cdb") | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.939198 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "host-sys" (UniqueName: "kubernetes.io/host-path/0284ac6e-bf40-4f74-98eb-17cc7de85cdb-host-sys") pod "csi-cephfsplugin-thvr5" (UID: "0284ac6e-bf40-4f74-98eb-17cc7de85cdb") | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.939286 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "ceph-csi-config" (UniqueName: "kubernetes.io/configmap/0284ac6e-bf40-4f74-98eb-17cc7de85cdb-ceph-csi-config") pod "csi-cephfsplugin-thvr5" (UID: "0284ac6e-bf40-4f74-98eb-17cc7de85cdb") | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.939317 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "plugin-dir" (UniqueName: "kubernetes.io/host-path/d43f42c2-46dd-4de3-a871-6fb0ffea7184-plugin-dir") pod "csi-rbdplugin-7qgcb" (UID: "d43f42c2-46dd-4de3-a871-6fb0ffea7184") | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.939402 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "pods-mount-dir" (UniqueName: "kubernetes.io/host-path/d43f42c2-46dd-4de3-a871-6fb0ffea7184-pods-mount-dir") pod "csi-rbdplugin-7qgcb" (UID: "d43f42c2-46dd-4de3-a871-6fb0ffea7184") | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.939487 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "registration-dir" (UniqueName: "kubernetes.io/host-path/d43f42c2-46dd-4de3-a871-6fb0ffea7184-registration-dir") pod "csi-rbdplugin-7qgcb" (UID: "d43f42c2-46dd-4de3-a871-6fb0ffea7184") | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.939547 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "keys-tmp-dir" (UniqueName: "kubernetes.io/empty-dir/0284ac6e-bf40-4f74-98eb-17cc7de85cdb-keys-tmp-dir") pod "csi-cephfsplugin-thvr5" (UID: "0284ac6e-bf40-4f74-98eb-17cc7de85cdb") | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.939640 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "host-run-mount" (UniqueName: "kubernetes.io/host-path/d43f42c2-46dd-4de3-a871-6fb0ffea7184-host-run-mount") pod "csi-rbdplugin-7qgcb" (UID: "d43f42c2-46dd-4de3-a871-6fb0ffea7184") | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.939904 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "rook-csi-rbd-plugin-sa-token-v5rvv" (UniqueName: "kubernetes.io/secret/d43f42c2-46dd-4de3-a871-6fb0ffea7184-rook-csi-rbd-plugin-sa-token-v5rvv") pod "csi-rbdplugin-7qgcb" (UID: "d43f42c2-46dd-4de3-a871-6fb0ffea7184") | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.940028 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "plugin-dir" (UniqueName: "kubernetes.io/host-path/0284ac6e-bf40-4f74-98eb-17cc7de85cdb-plugin-dir") pod "csi-cephfsplugin-thvr5" (UID: "0284ac6e-bf40-4f74-98eb-17cc7de85cdb") | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.940171 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "csi-plugins-dir" (UniqueName: "kubernetes.io/host-path/0284ac6e-bf40-4f74-98eb-17cc7de85cdb-csi-plugins-dir") pod "csi-cephfsplugin-thvr5" (UID: "0284ac6e-bf40-4f74-98eb-17cc7de85cdb") | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.940271 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "pods-mount-dir" (UniqueName: "kubernetes.io/host-path/0284ac6e-bf40-4f74-98eb-17cc7de85cdb-pods-mount-dir") pod "csi-cephfsplugin-thvr5" (UID: "0284ac6e-bf40-4f74-98eb-17cc7de85cdb") | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.940402 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "lib-modules" (UniqueName: "kubernetes.io/host-path/0284ac6e-bf40-4f74-98eb-17cc7de85cdb-lib-modules") pod "csi-cephfsplugin-thvr5" (UID: "0284ac6e-bf40-4f74-98eb-17cc7de85cdb") | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.940487 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "plugin-mount-dir" (UniqueName: "kubernetes.io/host-path/d43f42c2-46dd-4de3-a871-6fb0ffea7184-plugin-mount-dir") pod "csi-rbdplugin-7qgcb" (UID: "d43f42c2-46dd-4de3-a871-6fb0ffea7184") | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.940561 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "keys-tmp-dir" (UniqueName: "kubernetes.io/empty-dir/d43f42c2-46dd-4de3-a871-6fb0ffea7184-keys-tmp-dir") pod "csi-rbdplugin-7qgcb" (UID: "d43f42c2-46dd-4de3-a871-6fb0ffea7184") | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.940657 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "rook-csi-cephfs-plugin-sa-token-9pkvf" (UniqueName: "kubernetes.io/secret/0284ac6e-bf40-4f74-98eb-17cc7de85cdb-rook-csi-cephfs-plugin-sa-token-9pkvf") pod "csi-cephfsplugin-thvr5" (UID: "0284ac6e-bf40-4f74-98eb-17cc7de85cdb") | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.943357 698 trace.go:205] Trace[1694457593]: "List" url:/apis/apps/v1/replicasets,user-agent:kube-state-metrics/v1.9.7 (linux/amd64) kube-state-metrics/b3fa5852,client:10.2.0.35 (09-Feb-2021 18:15:38.547) (total time: 1395ms): | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1694457593]: ---"Listing from storage done" 1116ms (18:15:00.664) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1694457593]: ---"Writing http response done" count:395 278ms (18:15:00.943) | |
| Feb 09 18:15:39 k3s-0 k3s[698]: Trace[1694457593]: [1.395982184s] [1.395982184s] END | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.956516 698 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 0d6833c0f95ad8c6a763bc30ba99cb99d74a027093258d07a59c0c3cdf005723 | |
| Feb 09 18:15:39 k3s-0 k3s[698]: I0209 18:15:39.969642 698 topology_manager.go:233] [topologymanager] Topology Admit Handler | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.001969 698 topology_manager.go:233] [topologymanager] Topology Admit Handler | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.010992 698 topology_manager.go:233] [topologymanager] Topology Admit Handler | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.036189 698 pod_container_deletor.go:79] Container "df52a5de49d16fba15eedf502d1c1b12537147bb65fbd34978050a47bf395a9b" not found in pod's containers | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.036272 698 pod_container_deletor.go:79] Container "0f4d555fdba1fbeb8af92f28f15dc564ff390d81f8aab5200a6629e3f20907d3" not found in pod's containers | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.036324 698 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: bf88d4105742b16df00dff31eafa407aeacf390208f8cd65acdbf0f295bd7947 | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.059885 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "sys" (UniqueName: "kubernetes.io/host-path/4ded1cb3-0f72-45c3-8ca4-3cedda4deb54-sys") pod "kube-prometheus-stack-prometheus-node-exporter-fkf6t" (UID: "4ded1cb3-0f72-45c3-8ca4-3cedda4deb54") | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.059964 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "nfd-worker-config" (UniqueName: "kubernetes.io/configmap/891b66f0-d916-4b8a-bee9-f74dac9f8d88-nfd-worker-config") pod "node-feature-discovery-worker-h55fq" (UID: "891b66f0-d916-4b8a-bee9-f74dac9f8d88") | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.060684 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "docker" (UniqueName: "kubernetes.io/host-path/768f647f-6808-464b-959f-e7995f03a975-docker") pod "loki-promtail-ndjd5" (UID: "768f647f-6808-464b-959f-e7995f03a975") | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.060741 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "pods" (UniqueName: "kubernetes.io/host-path/768f647f-6808-464b-959f-e7995f03a975-pods") pod "loki-promtail-ndjd5" (UID: "768f647f-6808-464b-959f-e7995f03a975") | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.061339 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "run" (UniqueName: "kubernetes.io/host-path/768f647f-6808-464b-959f-e7995f03a975-run") pod "loki-promtail-ndjd5" (UID: "768f647f-6808-464b-959f-e7995f03a975") | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.061427 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "root" (UniqueName: "kubernetes.io/host-path/4ded1cb3-0f72-45c3-8ca4-3cedda4deb54-root") pod "kube-prometheus-stack-prometheus-node-exporter-fkf6t" (UID: "4ded1cb3-0f72-45c3-8ca4-3cedda4deb54") | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.066061 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "config" (UniqueName: "kubernetes.io/configmap/768f647f-6808-464b-959f-e7995f03a975-config") pod "loki-promtail-ndjd5" (UID: "768f647f-6808-464b-959f-e7995f03a975") | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.066134 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "proc" (UniqueName: "kubernetes.io/host-path/4ded1cb3-0f72-45c3-8ca4-3cedda4deb54-proc") pod "kube-prometheus-stack-prometheus-node-exporter-fkf6t" (UID: "4ded1cb3-0f72-45c3-8ca4-3cedda4deb54") | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.066169 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "kured-token-5bnnx" (UniqueName: "kubernetes.io/secret/96210cc1-e623-4b15-b913-0d17273e4dc9-kured-token-5bnnx") pod "kured-ffx5c" (UID: "96210cc1-e623-4b15-b913-0d17273e4dc9") | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.066557 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "scratch" (UniqueName: "kubernetes.io/empty-dir/33f138b6-612e-4181-8917-a67951bf282d-scratch") pod "restic-pjqbk" (UID: "33f138b6-612e-4181-8917-a67951bf282d") | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.066716 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "loki-promtail-token-svcch" (UniqueName: "kubernetes.io/secret/768f647f-6808-464b-959f-e7995f03a975-loki-promtail-token-svcch") pod "loki-promtail-ndjd5" (UID: "768f647f-6808-464b-959f-e7995f03a975") | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.068535 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "host-boot" (UniqueName: "kubernetes.io/host-path/891b66f0-d916-4b8a-bee9-f74dac9f8d88-host-boot") pod "node-feature-discovery-worker-h55fq" (UID: "891b66f0-d916-4b8a-bee9-f74dac9f8d88") | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.103100 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "host-os-release" (UniqueName: "kubernetes.io/host-path/891b66f0-d916-4b8a-bee9-f74dac9f8d88-host-os-release") pod "node-feature-discovery-worker-h55fq" (UID: "891b66f0-d916-4b8a-bee9-f74dac9f8d88") | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.103922 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "source-d" (UniqueName: "kubernetes.io/host-path/891b66f0-d916-4b8a-bee9-f74dac9f8d88-source-d") pod "node-feature-discovery-worker-h55fq" (UID: "891b66f0-d916-4b8a-bee9-f74dac9f8d88") | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.143221 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "velero-server-token-l85j2" (UniqueName: "kubernetes.io/secret/33f138b6-612e-4181-8917-a67951bf282d-velero-server-token-l85j2") pod "restic-pjqbk" (UID: "33f138b6-612e-4181-8917-a67951bf282d") | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.143293 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "host-sys" (UniqueName: "kubernetes.io/host-path/891b66f0-d916-4b8a-bee9-f74dac9f8d88-host-sys") pod "node-feature-discovery-worker-h55fq" (UID: "891b66f0-d916-4b8a-bee9-f74dac9f8d88") | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.143335 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "node-feature-discovery-token-6lxfd" (UniqueName: "kubernetes.io/secret/891b66f0-d916-4b8a-bee9-f74dac9f8d88-node-feature-discovery-token-6lxfd") pod "node-feature-discovery-worker-h55fq" (UID: "891b66f0-d916-4b8a-bee9-f74dac9f8d88") | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.143378 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "kube-prometheus-stack-prometheus-node-exporter-token-nl8mv" (UniqueName: "kubernetes.io/secret/4ded1cb3-0f72-45c3-8ca4-3cedda4deb54-kube-prometheus-stack-prometheus-node-exporter-token-nl8mv") pod "kube-prometheus-stack-prometheus-node-exporter-fkf6t" (UID: "4ded1cb3-0f72-45c3-8ca4-3cedda4deb54") | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.143411 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "features-d" (UniqueName: "kubernetes.io/host-path/891b66f0-d916-4b8a-bee9-f74dac9f8d88-features-d") pod "node-feature-discovery-worker-h55fq" (UID: "891b66f0-d916-4b8a-bee9-f74dac9f8d88") | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.143532 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "cloud-credentials" (UniqueName: "kubernetes.io/secret/33f138b6-612e-4181-8917-a67951bf282d-cloud-credentials") pod "restic-pjqbk" (UID: "33f138b6-612e-4181-8917-a67951bf282d") | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.143569 698 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "host-pods" (UniqueName: "kubernetes.io/host-path/33f138b6-612e-4181-8917-a67951bf282d-host-pods") pod "restic-pjqbk" (UID: "33f138b6-612e-4181-8917-a67951bf282d") | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.143605 698 reconciler.go:157] Reconciler: start to sync state | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.168631 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/blkio/system.slice/run-rf4c8f562fe78468a96f116527c7921d9.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/blkio/system.slice/run-rf4c8f562fe78468a96f116527c7921d9.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.104075 698 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: c6ab1f65fc7d0cf81de6c9526bdde47f498b0d7757e4269c796d5c1b0a4abefb | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.221101 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/memory/system.slice/run-rf4c8f562fe78468a96f116527c7921d9.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/memory/system.slice/run-rf4c8f562fe78468a96f116527c7921d9.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.221207 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/devices/system.slice/run-rf4c8f562fe78468a96f116527c7921d9.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/devices/system.slice/run-rf4c8f562fe78468a96f116527c7921d9.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.221256 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/pids/system.slice/run-rf4c8f562fe78468a96f116527c7921d9.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/pids/system.slice/run-rf4c8f562fe78468a96f116527c7921d9.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.224952 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/cpu,cpuacct/system.slice/run-r157528e0298340eb95afac331c15f395.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/cpu,cpuacct/system.slice/run-r157528e0298340eb95afac331c15f395.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.227322 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/blkio/system.slice/run-r157528e0298340eb95afac331c15f395.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/blkio/system.slice/run-r157528e0298340eb95afac331c15f395.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.231594 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/memory/system.slice/run-r157528e0298340eb95afac331c15f395.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/memory/system.slice/run-r157528e0298340eb95afac331c15f395.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.231996 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/devices/system.slice/run-r157528e0298340eb95afac331c15f395.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/devices/system.slice/run-r157528e0298340eb95afac331c15f395.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.233574 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/pids/system.slice/run-r157528e0298340eb95afac331c15f395.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/pids/system.slice/run-r157528e0298340eb95afac331c15f395.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.233673 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/cpu,cpuacct/system.slice/run-rd3b25d9f6a71471f9cb08cbda950551c.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/cpu,cpuacct/system.slice/run-rd3b25d9f6a71471f9cb08cbda950551c.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.233710 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/blkio/system.slice/run-rd3b25d9f6a71471f9cb08cbda950551c.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/blkio/system.slice/run-rd3b25d9f6a71471f9cb08cbda950551c.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.233749 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/memory/system.slice/run-rd3b25d9f6a71471f9cb08cbda950551c.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/memory/system.slice/run-rd3b25d9f6a71471f9cb08cbda950551c.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.233780 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/devices/system.slice/run-rd3b25d9f6a71471f9cb08cbda950551c.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/devices/system.slice/run-rd3b25d9f6a71471f9cb08cbda950551c.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.233817 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/pids/system.slice/run-rd3b25d9f6a71471f9cb08cbda950551c.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/pids/system.slice/run-rd3b25d9f6a71471f9cb08cbda950551c.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.233867 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/cpu,cpuacct/system.slice/run-r5f11c73b6cf543ecb454014cd7cdefc0.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/cpu,cpuacct/system.slice/run-r5f11c73b6cf543ecb454014cd7cdefc0.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.245964 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/blkio/system.slice/run-r5f11c73b6cf543ecb454014cd7cdefc0.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/blkio/system.slice/run-r5f11c73b6cf543ecb454014cd7cdefc0.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.267639 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/memory/system.slice/run-r5f11c73b6cf543ecb454014cd7cdefc0.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/memory/system.slice/run-r5f11c73b6cf543ecb454014cd7cdefc0.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.267728 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/devices/system.slice/run-r5f11c73b6cf543ecb454014cd7cdefc0.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/devices/system.slice/run-r5f11c73b6cf543ecb454014cd7cdefc0.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.267777 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/pids/system.slice/run-r5f11c73b6cf543ecb454014cd7cdefc0.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/pids/system.slice/run-r5f11c73b6cf543ecb454014cd7cdefc0.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.267845 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/cpu,cpuacct/system.slice/run-rdac5c33fa22f4fcfa2c50e6f57150cf1.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/cpu,cpuacct/system.slice/run-rdac5c33fa22f4fcfa2c50e6f57150cf1.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.267885 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/blkio/system.slice/run-rdac5c33fa22f4fcfa2c50e6f57150cf1.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/blkio/system.slice/run-rdac5c33fa22f4fcfa2c50e6f57150cf1.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.267919 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/memory/system.slice/run-rdac5c33fa22f4fcfa2c50e6f57150cf1.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/memory/system.slice/run-rdac5c33fa22f4fcfa2c50e6f57150cf1.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.267953 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/devices/system.slice/run-rdac5c33fa22f4fcfa2c50e6f57150cf1.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/devices/system.slice/run-rdac5c33fa22f4fcfa2c50e6f57150cf1.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.267981 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/pids/system.slice/run-rdac5c33fa22f4fcfa2c50e6f57150cf1.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/pids/system.slice/run-rdac5c33fa22f4fcfa2c50e6f57150cf1.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.307070 698 pod_container_deletor.go:79] Container "1ae9350948f9bdb8201b9fc04d7cdf18bb74a051d791689a14068604c428e561" not found in pod's containers | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.330005 698 pod_container_deletor.go:79] Container "e1cbb9cf4d7674200c3dbaf92281742603fc0b2ed9551968622be9b1ca83b7cf" not found in pod's containers | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.370518 698 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 3684c9588b642e8465e79710abde7693a2650b4d7a42f5b6b77babbff3d37832 | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.382113 698 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: bf88d4105742b16df00dff31eafa407aeacf390208f8cd65acdbf0f295bd7947 | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.384503 698 trace.go:205] Trace[1468143700]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:39.840) (total time: 543ms): | |
| Feb 09 18:15:40 k3s-0 k3s[698]: Trace[1468143700]: ---"initial value restored" 417ms (18:15:00.257) | |
| Feb 09 18:15:40 k3s-0 k3s[698]: Trace[1468143700]: ---"Transaction committed" 125ms (18:15:00.384) | |
| Feb 09 18:15:40 k3s-0 k3s[698]: Trace[1468143700]: [543.900314ms] [543.900314ms] END | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.384724 698 trace.go:205] Trace[108612907]: "Patch" url:/api/v1/namespaces/default/events/mc-minecraft.1661fec0294f6efc,user-agent:speaker/v0.0.0 (linux/arm64) kubernetes/$Format,client:10.2.0.31 (09-Feb-2021 18:15:39.840) (total time: 544ms): | |
| Feb 09 18:15:40 k3s-0 k3s[698]: Trace[108612907]: ---"About to apply patch" 417ms (18:15:00.257) | |
| Feb 09 18:15:40 k3s-0 k3s[698]: Trace[108612907]: ---"Object stored in database" 126ms (18:15:00.384) | |
| Feb 09 18:15:40 k3s-0 k3s[698]: Trace[108612907]: [544.189392ms] [544.189392ms] END | |
| Feb 09 18:15:40 k3s-0 k3s[698]: E0209 18:15:40.427019 698 remote_runtime.go:329] ContainerStatus "bf88d4105742b16df00dff31eafa407aeacf390208f8cd65acdbf0f295bd7947" from runtime service failed: rpc error: code = NotFound desc = an error occurred when try to find container "bf88d4105742b16df00dff31eafa407aeacf390208f8cd65acdbf0f295bd7947": not found | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.427093 698 pod_container_deletor.go:52] [pod_container_deletor] DeleteContainer returned error for (id={containerd bf88d4105742b16df00dff31eafa407aeacf390208f8cd65acdbf0f295bd7947}): failed to get container status "bf88d4105742b16df00dff31eafa407aeacf390208f8cd65acdbf0f295bd7947": rpc error: code = NotFound desc = an error occurred when try to find container "bf88d4105742b16df00dff31eafa407aeacf390208f8cd65acdbf0f295bd7947": not found | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.427121 698 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 2fdd604908f30732a57c6bd3aa59d869d0d22c7ee428e540f434345f76c47bb8 | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.442497 698 trace.go:205] Trace[1468767046]: "List etcd3" key:/pods,resourceVersion:,resourceVersionMatch:,limit:0,continue: (09-Feb-2021 18:15:39.900) (total time: 542ms): | |
| Feb 09 18:15:40 k3s-0 k3s[698]: Trace[1468767046]: [542.348723ms] [542.348723ms] END | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.475436 698 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 2fdd604908f30732a57c6bd3aa59d869d0d22c7ee428e540f434345f76c47bb8 | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.482701 698 trace.go:205] Trace[1205134537]: "List" url:/api/v1/pods,user-agent:descheduler/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:39.900) (total time: 582ms): | |
| Feb 09 18:15:40 k3s-0 k3s[698]: Trace[1205134537]: ---"Listing from storage done" 542ms (18:15:00.442) | |
| Feb 09 18:15:40 k3s-0 k3s[698]: Trace[1205134537]: [582.582335ms] [582.582335ms] END | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.576048 698 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 2fdd604908f30732a57c6bd3aa59d869d0d22c7ee428e540f434345f76c47bb8 | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.617236 698 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: bf88d4105742b16df00dff31eafa407aeacf390208f8cd65acdbf0f295bd7947 | |
| Feb 09 18:15:40 k3s-0 k3s[698]: E0209 18:15:40.619416 698 remote_runtime.go:329] ContainerStatus "2fdd604908f30732a57c6bd3aa59d869d0d22c7ee428e540f434345f76c47bb8" from runtime service failed: rpc error: code = NotFound desc = an error occurred when try to find container "2fdd604908f30732a57c6bd3aa59d869d0d22c7ee428e540f434345f76c47bb8": not found | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.619482 698 pod_container_deletor.go:52] [pod_container_deletor] DeleteContainer returned error for (id={containerd 2fdd604908f30732a57c6bd3aa59d869d0d22c7ee428e540f434345f76c47bb8}): failed to get container status "2fdd604908f30732a57c6bd3aa59d869d0d22c7ee428e540f434345f76c47bb8": rpc error: code = NotFound desc = an error occurred when try to find container "2fdd604908f30732a57c6bd3aa59d869d0d22c7ee428e540f434345f76c47bb8": not found | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.634598 698 pod_container_deletor.go:79] Container "47357c492d0d1d3a958237b44aaddc24fe6a34e91455d8498bb748a47d6ac209" not found in pod's containers | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.634676 698 pod_container_deletor.go:79] Container "0d6833c0f95ad8c6a763bc30ba99cb99d74a027093258d07a59c0c3cdf005723" not found in pod's containers | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.634753 698 pod_container_deletor.go:79] Container "c6ab1f65fc7d0cf81de6c9526bdde47f498b0d7757e4269c796d5c1b0a4abefb" not found in pod's containers | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.634851 698 pod_container_deletor.go:79] Container "e8ce9a8e3adcf69ed68b2b4f82d2d516a176435329421b73e8299f35a3fa6549" not found in pod's containers | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.634909 698 pod_container_deletor.go:79] Container "4de1eab3ab7a9a94cb6a35319226bd02fff79d44aae964454bf47ce933cbbc8b" not found in pod's containers | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.666285 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/cpu,cpuacct/system.slice/run-r948e5de049f442609841f19bf1d86ba7.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/cpu,cpuacct/system.slice/run-r948e5de049f442609841f19bf1d86ba7.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.673109 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/blkio/system.slice/run-r948e5de049f442609841f19bf1d86ba7.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/blkio/system.slice/run-r948e5de049f442609841f19bf1d86ba7.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.673196 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/memory/system.slice/run-r948e5de049f442609841f19bf1d86ba7.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/memory/system.slice/run-r948e5de049f442609841f19bf1d86ba7.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.673234 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/devices/system.slice/run-r948e5de049f442609841f19bf1d86ba7.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/devices/system.slice/run-r948e5de049f442609841f19bf1d86ba7.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.673264 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/pids/system.slice/run-r948e5de049f442609841f19bf1d86ba7.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/pids/system.slice/run-r948e5de049f442609841f19bf1d86ba7.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: E0209 18:15:40.684058 698 kuberuntime_gc.go:146] Failed to remove container "bf88d4105742b16df00dff31eafa407aeacf390208f8cd65acdbf0f295bd7947": failed to get container status "bf88d4105742b16df00dff31eafa407aeacf390208f8cd65acdbf0f295bd7947": rpc error: code = NotFound desc = an error occurred when try to find container "bf88d4105742b16df00dff31eafa407aeacf390208f8cd65acdbf0f295bd7947": not found | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.684130 698 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: ef677b916ee0fd243515061a98dd2f680b7b5fdc944a9e566db5fa1491c3a167 | |
| Feb 09 18:15:40 k3s-0 k3s[698]: W0209 18:15:40.872874 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/pids/system.slice/run-r8a7625f7ecde4eaeb61ea874e6bda516.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/pids/system.slice/run-r8a7625f7ecde4eaeb61ea874e6bda516.scope: no such file or directory | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.955095 698 request.go:645] Throttling request took 1.028253541s, request: GET:https://127.0.0.1:6443/api/v1/namespaces/velero/secrets?fieldSelector=metadata.name%3Dvelero&limit=500&resourceVersion=0 | |
| Feb 09 18:15:40 k3s-0 k3s[698]: I0209 18:15:40.966872 698 controller.go:609] quota admission added evaluator for: statefulsets.apps | |
| Feb 09 18:15:41 k3s-0 k3s[698]: I0209 18:15:41.007985 698 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 6fe282776d84988e05cfcd05512ea9ca41d06459b2f0e6d134ff27a5ff0e3090 | |
| Feb 09 18:15:41 k3s-0 k3s[698]: I0209 18:15:41.228068 698 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: ae76e6f011a7b838df096c4ae9dc43b2c486640b737edaaca713c1668f62394f | |
| Feb 09 18:15:41 k3s-0 k3s[698]: W0209 18:15:41.269144 698 pod_container_deletor.go:79] Container "f9d2accd43629b464031057d432aa6e9340f01d294d63df0ff4c22c7a3019667" not found in pod's containers | |
| Feb 09 18:15:41 k3s-0 k3s[698]: W0209 18:15:41.269211 698 pod_container_deletor.go:79] Container "86379dac750f1157bb1090b83d29ff99d6ecf1ddc4debb53444ecbb6660c73eb" not found in pod's containers | |
| Feb 09 18:15:41 k3s-0 k3s[698]: I0209 18:15:41.269228 698 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 6fe282776d84988e05cfcd05512ea9ca41d06459b2f0e6d134ff27a5ff0e3090 | |
| Feb 09 18:15:41 k3s-0 k3s[698]: E0209 18:15:41.277975 698 secret.go:195] Couldn't get secret monitoring/kube-prometheus-stack-prometheus-node-exporter-token-nl8mv: failed to sync secret cache: timed out waiting for the condition | |
| Feb 09 18:15:41 k3s-0 k3s[698]: E0209 18:15:41.278193 698 nestedpendingoperations.go:301] Operation for "{volumeName:kubernetes.io/secret/4ded1cb3-0f72-45c3-8ca4-3cedda4deb54-kube-prometheus-stack-prometheus-node-exporter-token-nl8mv podName:4ded1cb3-0f72-45c3-8ca4-3cedda4deb54 nodeName:}" failed. No retries permitted until 2021-02-09 18:15:41.778099805 +0000 UTC m=+15.578464346 (durationBeforeRetry 500ms). Error: "MountVolume.SetUp failed for volume \"kube-prometheus-stack-prometheus-node-exporter-token-nl8mv\" (UniqueName: \"kubernetes.io/secret/4ded1cb3-0f72-45c3-8ca4-3cedda4deb54-kube-prometheus-stack-prometheus-node-exporter-token-nl8mv\") pod \"kube-prometheus-stack-prometheus-node-exporter-fkf6t\" (UID: \"4ded1cb3-0f72-45c3-8ca4-3cedda4deb54\") : failed to sync secret cache: timed out waiting for the condition" | |
| Feb 09 18:15:41 k3s-0 k3s[698]: E0209 18:15:41.278531 698 secret.go:195] Couldn't get secret kube-system/node-feature-discovery-token-6lxfd: failed to sync secret cache: timed out waiting for the condition | |
| Feb 09 18:15:41 k3s-0 k3s[698]: E0209 18:15:41.278641 698 nestedpendingoperations.go:301] Operation for "{volumeName:kubernetes.io/secret/891b66f0-d916-4b8a-bee9-f74dac9f8d88-node-feature-discovery-token-6lxfd podName:891b66f0-d916-4b8a-bee9-f74dac9f8d88 nodeName:}" failed. No retries permitted until 2021-02-09 18:15:41.778605527 +0000 UTC m=+15.578970076 (durationBeforeRetry 500ms). Error: "MountVolume.SetUp failed for volume \"node-feature-discovery-token-6lxfd\" (UniqueName: \"kubernetes.io/secret/891b66f0-d916-4b8a-bee9-f74dac9f8d88-node-feature-discovery-token-6lxfd\") pod \"node-feature-discovery-worker-h55fq\" (UID: \"891b66f0-d916-4b8a-bee9-f74dac9f8d88\") : failed to sync secret cache: timed out waiting for the condition" | |
| Feb 09 18:15:41 k3s-0 k3s[698]: E0209 18:15:41.319627 698 secret.go:195] Couldn't get secret kube-system/kured-token-5bnnx: failed to sync secret cache: timed out waiting for the condition | |
| Feb 09 18:15:41 k3s-0 k3s[698]: E0209 18:15:41.319750 698 nestedpendingoperations.go:301] Operation for "{volumeName:kubernetes.io/secret/96210cc1-e623-4b15-b913-0d17273e4dc9-kured-token-5bnnx podName:96210cc1-e623-4b15-b913-0d17273e4dc9 nodeName:}" failed. No retries permitted until 2021-02-09 18:15:41.81971824 +0000 UTC m=+15.620082778 (durationBeforeRetry 500ms). Error: "MountVolume.SetUp failed for volume \"kured-token-5bnnx\" (UniqueName: \"kubernetes.io/secret/96210cc1-e623-4b15-b913-0d17273e4dc9-kured-token-5bnnx\") pod \"kured-ffx5c\" (UID: \"96210cc1-e623-4b15-b913-0d17273e4dc9\") : failed to sync secret cache: timed out waiting for the condition" | |
| Feb 09 18:15:41 k3s-0 k3s[698]: E0209 18:15:41.352380 698 configmap.go:200] Couldn't get configMap kube-system/node-feature-discovery: failed to sync configmap cache: timed out waiting for the condition | |
| Feb 09 18:15:41 k3s-0 k3s[698]: E0209 18:15:41.352545 698 nestedpendingoperations.go:301] Operation for "{volumeName:kubernetes.io/configmap/891b66f0-d916-4b8a-bee9-f74dac9f8d88-nfd-worker-config podName:891b66f0-d916-4b8a-bee9-f74dac9f8d88 nodeName:}" failed. No retries permitted until 2021-02-09 18:15:41.852487502 +0000 UTC m=+15.652852040 (durationBeforeRetry 500ms). Error: "MountVolume.SetUp failed for volume \"nfd-worker-config\" (UniqueName: \"kubernetes.io/configmap/891b66f0-d916-4b8a-bee9-f74dac9f8d88-nfd-worker-config\") pod \"node-feature-discovery-worker-h55fq\" (UID: \"891b66f0-d916-4b8a-bee9-f74dac9f8d88\") : failed to sync configmap cache: timed out waiting for the condition" | |
| Feb 09 18:15:41 k3s-0 k3s[698]: E0209 18:15:41.409615 698 remote_runtime.go:329] ContainerStatus "6fe282776d84988e05cfcd05512ea9ca41d06459b2f0e6d134ff27a5ff0e3090" from runtime service failed: rpc error: code = NotFound desc = an error occurred when try to find container "6fe282776d84988e05cfcd05512ea9ca41d06459b2f0e6d134ff27a5ff0e3090": not found | |
| Feb 09 18:15:41 k3s-0 k3s[698]: W0209 18:15:41.409673 698 pod_container_deletor.go:52] [pod_container_deletor] DeleteContainer returned error for (id={containerd 6fe282776d84988e05cfcd05512ea9ca41d06459b2f0e6d134ff27a5ff0e3090}): failed to get container status "6fe282776d84988e05cfcd05512ea9ca41d06459b2f0e6d134ff27a5ff0e3090": rpc error: code = NotFound desc = an error occurred when try to find container "6fe282776d84988e05cfcd05512ea9ca41d06459b2f0e6d134ff27a5ff0e3090": not found | |
| Feb 09 18:15:41 k3s-0 k3s[698]: I0209 18:15:41.409693 698 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: 6fe282776d84988e05cfcd05512ea9ca41d06459b2f0e6d134ff27a5ff0e3090 | |
| Feb 09 18:15:41 k3s-0 k3s[698]: W0209 18:15:41.436156 698 pod_container_deletor.go:52] [pod_container_deletor] DeleteContainer returned error for (id={containerd 6fe282776d84988e05cfcd05512ea9ca41d06459b2f0e6d134ff27a5ff0e3090}): failed to get container status "6fe282776d84988e05cfcd05512ea9ca41d06459b2f0e6d134ff27a5ff0e3090": rpc error: code = NotFound desc = an error occurred when try to find container "6fe282776d84988e05cfcd05512ea9ca41d06459b2f0e6d134ff27a5ff0e3090": not found | |
| Feb 09 18:15:41 k3s-0 k3s[698]: I0209 18:15:41.453637 698 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: fdbdf3be7c33e4ae59bee79631030408da3c290f510313fa78e4e38b2a5920f7 | |
| Feb 09 18:15:41 k3s-0 k3s[698]: I0209 18:15:41.502259 698 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: fdbdf3be7c33e4ae59bee79631030408da3c290f510313fa78e4e38b2a5920f7 | |
| Feb 09 18:15:41 k3s-0 k3s[698]: I0209 18:15:41.707785 698 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: ae76e6f011a7b838df096c4ae9dc43b2c486640b737edaaca713c1668f62394f | |
| Feb 09 18:15:41 k3s-0 k3s[698]: I0209 18:15:41.768310 698 trace.go:205] Trace[2006895890]: "List etcd3" key:/pods,resourceVersion:,resourceVersionMatch:,limit:0,continue: (09-Feb-2021 18:15:41.030) (total time: 737ms): | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[2006895890]: [737.500531ms] [737.500531ms] END | |
| Feb 09 18:15:41 k3s-0 k3s[698]: E0209 18:15:41.783241 698 remote_runtime.go:329] ContainerStatus "ae76e6f011a7b838df096c4ae9dc43b2c486640b737edaaca713c1668f62394f" from runtime service failed: rpc error: code = NotFound desc = an error occurred when try to find container "ae76e6f011a7b838df096c4ae9dc43b2c486640b737edaaca713c1668f62394f": not found | |
| Feb 09 18:15:41 k3s-0 k3s[698]: W0209 18:15:41.783287 698 pod_container_deletor.go:52] [pod_container_deletor] DeleteContainer returned error for (id={containerd ae76e6f011a7b838df096c4ae9dc43b2c486640b737edaaca713c1668f62394f}): failed to get container status "ae76e6f011a7b838df096c4ae9dc43b2c486640b737edaaca713c1668f62394f": rpc error: code = NotFound desc = an error occurred when try to find container "ae76e6f011a7b838df096c4ae9dc43b2c486640b737edaaca713c1668f62394f": not found | |
| Feb 09 18:15:41 k3s-0 k3s[698]: I0209 18:15:41.783308 698 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: ae76e6f011a7b838df096c4ae9dc43b2c486640b737edaaca713c1668f62394f | |
| Feb 09 18:15:41 k3s-0 k3s[698]: W0209 18:15:41.783541 698 pod_container_deletor.go:79] Container "3684c9588b642e8465e79710abde7693a2650b4d7a42f5b6b77babbff3d37832" not found in pod's containers | |
| Feb 09 18:15:41 k3s-0 k3s[698]: W0209 18:15:41.783581 698 pod_container_deletor.go:79] Container "bf52fb96700a53e994442eb564e56baf7e9574158930575f8b55d1a8ed413b89" not found in pod's containers | |
| Feb 09 18:15:41 k3s-0 k3s[698]: W0209 18:15:41.783606 698 pod_container_deletor.go:79] Container "174762feb753473a5baaa985c5c563f95225d00e51e80ffc78a359819c4c5787" not found in pod's containers | |
| Feb 09 18:15:41 k3s-0 k3s[698]: I0209 18:15:41.828217 698 trace.go:205] Trace[752912267]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:41.220) (total time: 608ms): | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[752912267]: ---"initial value restored" 240ms (18:15:00.460) | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[752912267]: ---"Transaction committed" 366ms (18:15:00.828) | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[752912267]: [608.05057ms] [608.05057ms] END | |
| Feb 09 18:15:41 k3s-0 k3s[698]: I0209 18:15:41.828601 698 trace.go:205] Trace[635392262]: "Patch" url:/api/v1/namespaces/kube-system/events/node-feature-discovery-worker-5v6nb.166226e64288df8e,user-agent:k3s/v1.19.7+k3s1 (linux/arm64) kubernetes/5a00e38,client:10.2.0.32 (09-Feb-2021 18:15:41.219) (total time: 608ms): | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[635392262]: ---"About to apply patch" 240ms (18:15:00.460) | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[635392262]: ---"Object stored in database" 367ms (18:15:00.828) | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[635392262]: [608.603318ms] [608.603318ms] END | |
| Feb 09 18:15:41 k3s-0 k3s[698]: I0209 18:15:41.856086 698 trace.go:205] Trace[1978659703]: "List" url:/api/v1/pods,user-agent:descheduler/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:41.030) (total time: 825ms): | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[1978659703]: ---"Listing from storage done" 737ms (18:15:00.768) | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[1978659703]: [825.316177ms] [825.316177ms] END | |
| Feb 09 18:15:41 k3s-0 k3s[698]: I0209 18:15:41.968086 698 trace.go:205] Trace[2110477114]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:41.463) (total time: 504ms): | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[2110477114]: ---"Transaction committed" 381ms (18:15:00.968) | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[2110477114]: [504.731195ms] [504.731195ms] END | |
| Feb 09 18:15:41 k3s-0 k3s[698]: I0209 18:15:41.968243 698 trace.go:205] Trace[1283900529]: "Patch" url:/api/v1/namespaces/logs/events/loki-promtail-syslog.166200cf0b9de8eb,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.36 (09-Feb-2021 18:15:41.463) (total time: 504ms): | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[1283900529]: ---"About to apply patch" 123ms (18:15:00.586) | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[1283900529]: ---"Object stored in database" 381ms (18:15:00.968) | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[1283900529]: [504.991912ms] [504.991912ms] END | |
| Feb 09 18:15:41 k3s-0 k3s[698]: W0209 18:15:41.856794 698 pod_container_deletor.go:79] Container "966e0d571fa3113c99d91ecaf0780311f5c44bac4570c10ed9c18c0cfd864e50" not found in pod's containers | |
| Feb 09 18:15:41 k3s-0 k3s[698]: W0209 18:15:41.971478 698 pod_container_deletor.go:79] Container "381169a985e205a1af500e603a169631a120c296d33515e6ba676984be1c6b10" not found in pod's containers | |
| Feb 09 18:15:41 k3s-0 k3s[698]: W0209 18:15:41.868660 698 pod_container_deletor.go:52] [pod_container_deletor] DeleteContainer returned error for (id={containerd ae76e6f011a7b838df096c4ae9dc43b2c486640b737edaaca713c1668f62394f}): failed to get container status "ae76e6f011a7b838df096c4ae9dc43b2c486640b737edaaca713c1668f62394f": rpc error: code = NotFound desc = an error occurred when try to find container "ae76e6f011a7b838df096c4ae9dc43b2c486640b737edaaca713c1668f62394f": not found | |
| Feb 09 18:15:41 k3s-0 k3s[698]: I0209 18:15:41.972095 698 topology_manager.go:219] [topologymanager] RemoveContainer - Container ID: fdbdf3be7c33e4ae59bee79631030408da3c290f510313fa78e4e38b2a5920f7 | |
| Feb 09 18:15:41 k3s-0 k3s[698]: I0209 18:15:41.976549 698 trace.go:205] Trace[58561859]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:41.463) (total time: 504ms): | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[58561859]: ---"initial value restored" 213ms (18:15:00.677) | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[58561859]: ---"Transaction committed" 255ms (18:15:00.968) | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[58561859]: [504.62143ms] [504.62143ms] END | |
| Feb 09 18:15:41 k3s-0 k3s[698]: I0209 18:15:41.977638 698 trace.go:205] Trace[1376662214]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:41.470) (total time: 507ms): | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[1376662214]: ---"initial value restored" 203ms (18:15:00.673) | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[1376662214]: ---"Transaction committed" 301ms (18:15:00.977) | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[1376662214]: [507.491782ms] [507.491782ms] END | |
| Feb 09 18:15:41 k3s-0 k3s[698]: I0209 18:15:41.978614 698 trace.go:205] Trace[1574391421]: "Patch" url:/api/v1/namespaces/flux-system/events/helm-controller-c858b9c65-h9lrr.166226df2d781d4a,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.34 (09-Feb-2021 18:15:41.452) (total time: 525ms): | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[1574391421]: ---"About to apply patch" 220ms (18:15:00.673) | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[1574391421]: ---"Object stored in database" 304ms (18:15:00.977) | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[1574391421]: [525.378569ms] [525.378569ms] END | |
| Feb 09 18:15:41 k3s-0 k3s[698]: I0209 18:15:41.984679 698 trace.go:205] Trace[1147521786]: "Patch" url:/api/v1/namespaces/default/events/mcsv-minecraft.1661feaaa6a3463c,user-agent:speaker/v0.0.0 (linux/arm64) kubernetes/$Format,client:10.2.0.32 (09-Feb-2021 18:15:41.463) (total time: 520ms): | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[1147521786]: ---"About to apply patch" 213ms (18:15:00.677) | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[1147521786]: ---"Object stored in database" 272ms (18:15:00.984) | |
| Feb 09 18:15:41 k3s-0 k3s[698]: Trace[1147521786]: [520.827808ms] [520.827808ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: E0209 18:15:42.063911 698 remote_runtime.go:329] ContainerStatus "fdbdf3be7c33e4ae59bee79631030408da3c290f510313fa78e4e38b2a5920f7" from runtime service failed: rpc error: code = NotFound desc = an error occurred when try to find container "fdbdf3be7c33e4ae59bee79631030408da3c290f510313fa78e4e38b2a5920f7": not found | |
| Feb 09 18:15:42 k3s-0 k3s[698]: W0209 18:15:42.063963 698 pod_container_deletor.go:52] [pod_container_deletor] DeleteContainer returned error for (id={containerd fdbdf3be7c33e4ae59bee79631030408da3c290f510313fa78e4e38b2a5920f7}): failed to get container status "fdbdf3be7c33e4ae59bee79631030408da3c290f510313fa78e4e38b2a5920f7": rpc error: code = NotFound desc = an error occurred when try to find container "fdbdf3be7c33e4ae59bee79631030408da3c290f510313fa78e4e38b2a5920f7": not found | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.070100 698 trace.go:205] Trace[1933923848]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:41.532) (total time: 537ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1933923848]: ---"initial value restored" 171ms (18:15:00.704) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1933923848]: ---"Transaction committed" 360ms (18:15:00.067) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1933923848]: [537.15978ms] [537.15978ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.070471 698 trace.go:205] Trace[1134187226]: "Patch" url:/api/v1/namespaces/kube-system/events/node-feature-discovery-worker-t6qz2.166203856fc9ead0,user-agent:k3s/v1.19.7+k3s1 (linux/arm64) kubernetes/5a00e38,client:10.2.0.33 (09-Feb-2021 18:15:41.532) (total time: 537ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1134187226]: ---"About to apply patch" 171ms (18:15:00.704) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1134187226]: ---"Object stored in database" 363ms (18:15:00.070) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1134187226]: [537.578578ms] [537.578578ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.071050 698 trace.go:205] Trace[1518717619]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:41.505) (total time: 565ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1518717619]: ---"initial value restored" 198ms (18:15:00.703) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1518717619]: ---"Transaction committed" 366ms (18:15:00.070) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1518717619]: [565.428072ms] [565.428072ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.071585 698 trace.go:205] Trace[74030090]: "Patch" url:/api/v1/namespaces/default/events/home-assistant.1662000b5ab6d4d0,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 18:15:41.505) (total time: 566ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[74030090]: ---"About to apply patch" 198ms (18:15:00.703) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[74030090]: ---"Object stored in database" 366ms (18:15:00.071) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[74030090]: [566.040518ms] [566.040518ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: W0209 18:15:42.080116 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/cpu,cpuacct/system.slice/run-r3b14771794624972af2d0669ecaca183.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/cpu,cpuacct/system.slice/run-r3b14771794624972af2d0669ecaca183.scope: no such file or directory | |
| Feb 09 18:15:42 k3s-0 k3s[698]: W0209 18:15:42.080180 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/blkio/system.slice/run-r3b14771794624972af2d0669ecaca183.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/blkio/system.slice/run-r3b14771794624972af2d0669ecaca183.scope: no such file or directory | |
| Feb 09 18:15:42 k3s-0 k3s[698]: W0209 18:15:42.080207 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/memory/system.slice/run-r3b14771794624972af2d0669ecaca183.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/memory/system.slice/run-r3b14771794624972af2d0669ecaca183.scope: no such file or directory | |
| Feb 09 18:15:42 k3s-0 k3s[698]: W0209 18:15:42.080227 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/devices/system.slice/run-r3b14771794624972af2d0669ecaca183.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/devices/system.slice/run-r3b14771794624972af2d0669ecaca183.scope: no such file or directory | |
| Feb 09 18:15:42 k3s-0 k3s[698]: W0209 18:15:42.080248 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/pids/system.slice/run-r3b14771794624972af2d0669ecaca183.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/pids/system.slice/run-r3b14771794624972af2d0669ecaca183.scope: no such file or directory | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.168513 698 trace.go:205] Trace[236187953]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:41.659) (total time: 508ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[236187953]: ---"initial value restored" 283ms (18:15:00.942) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[236187953]: ---"Transaction committed" 213ms (18:15:00.168) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[236187953]: [508.989433ms] [508.989433ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.170897 698 trace.go:205] Trace[1926256826]: "Patch" url:/api/v1/namespaces/default/events/unifi-gui.166200765125ec68,user-agent:speaker/v0.0.0 (linux/arm64) kubernetes/$Format,client:10.2.0.31 (09-Feb-2021 18:15:41.659) (total time: 511ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1926256826]: ---"About to apply patch" 283ms (18:15:00.942) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1926256826]: ---"Object stored in database" 214ms (18:15:00.168) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1926256826]: [511.271657ms] [511.271657ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: W0209 18:15:42.191070 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/cpu,cpuacct/system.slice/run-r0111c40061324c11aabca9b83a1e0520.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/cpu,cpuacct/system.slice/run-r0111c40061324c11aabca9b83a1e0520.scope: no such file or directory | |
| Feb 09 18:15:42 k3s-0 k3s[698]: W0209 18:15:42.203806 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/blkio/system.slice/run-r0111c40061324c11aabca9b83a1e0520.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/blkio/system.slice/run-r0111c40061324c11aabca9b83a1e0520.scope: no such file or directory | |
| Feb 09 18:15:42 k3s-0 k3s[698]: W0209 18:15:42.203904 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/memory/system.slice/run-r0111c40061324c11aabca9b83a1e0520.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/memory/system.slice/run-r0111c40061324c11aabca9b83a1e0520.scope: no such file or directory | |
| Feb 09 18:15:42 k3s-0 k3s[698]: W0209 18:15:42.203979 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/devices/system.slice/run-r0111c40061324c11aabca9b83a1e0520.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/devices/system.slice/run-r0111c40061324c11aabca9b83a1e0520.scope: no such file or directory | |
| Feb 09 18:15:42 k3s-0 k3s[698]: W0209 18:15:42.204047 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/pids/system.slice/run-r0111c40061324c11aabca9b83a1e0520.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/pids/system.slice/run-r0111c40061324c11aabca9b83a1e0520.scope: no such file or directory | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.206555 698 trace.go:205] Trace[1785268575]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:41.652) (total time: 554ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1785268575]: ---"initial value restored" 313ms (18:15:00.965) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1785268575]: ---"Transaction committed" 238ms (18:15:00.206) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1785268575]: [554.174779ms] [554.174779ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.207051 698 trace.go:205] Trace[895376014]: "Patch" url:/api/v1/namespaces/default/events/home-assistant.1662000b5a7daf04,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:41.652) (total time: 554ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[895376014]: ---"About to apply patch" 313ms (18:15:00.965) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[895376014]: ---"Object stored in database" 238ms (18:15:00.206) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[895376014]: [554.909811ms] [554.909811ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.258174 698 trace.go:205] Trace[1042611449]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:41.658) (total time: 600ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1042611449]: ---"initial value restored" 301ms (18:15:00.959) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1042611449]: ---"Transaction committed" 292ms (18:15:00.258) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1042611449]: [600.000287ms] [600.000287ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.258410 698 trace.go:205] Trace[1363784815]: "Patch" url:/api/v1/namespaces/kube-system/events/node-feature-discovery-worker-r6tzg.166200c805643c78,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.36 (09-Feb-2021 18:15:41.653) (total time: 604ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1363784815]: ---"About to apply patch" 306ms (18:15:00.959) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1363784815]: ---"Object stored in database" 297ms (18:15:00.258) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1363784815]: [604.525982ms] [604.525982ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: W0209 18:15:42.299310 698 pod_container_deletor.go:79] Container "9caa9b27014efcb19aa840a7160f58f9fc58d6c9923207adab850564f1501a16" not found in pod's containers | |
| Feb 09 18:15:42 k3s-0 k3s[698]: W0209 18:15:42.299486 698 pod_container_deletor.go:79] Container "df6554d9fee767f2a2087a3fafb20debfb637009b898cabd4ec0de08bd9a5895" not found in pod's containers | |
| Feb 09 18:15:42 k3s-0 k3s[698]: W0209 18:15:42.299540 698 pod_container_deletor.go:79] Container "4377c82d9e468214d25e4cfb85d22a78d08da3faba8d053848f913d496916097" not found in pod's containers | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.413563 698 trace.go:205] Trace[1802069770]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:41.875) (total time: 537ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1802069770]: ---"initial value restored" 318ms (18:15:00.194) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1802069770]: ---"Transaction committed" 218ms (18:15:00.413) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1802069770]: [537.948913ms] [537.948913ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.413680 698 trace.go:205] Trace[1348474386]: "Patch" url:/api/v1/namespaces/kube-system/events/node-feature-discovery-worker-5v6nb.16620383d52d00b3,user-agent:k3s/v1.19.7+k3s1 (linux/arm64) kubernetes/5a00e38,client:10.2.0.32 (09-Feb-2021 18:15:41.874) (total time: 539ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1348474386]: ---"About to apply patch" 318ms (18:15:00.194) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1348474386]: ---"Object stored in database" 218ms (18:15:00.413) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1348474386]: [539.245088ms] [539.245088ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.451133 698 trace.go:205] Trace[2047045893]: "GuaranteedUpdate etcd3" type:*coordination.Lease (09-Feb-2021 18:15:41.880) (total time: 571ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[2047045893]: ---"Transaction committed" 570ms (18:15:00.451) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[2047045893]: [571.037134ms] [571.037134ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.451394 698 trace.go:205] Trace[1438638748]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/rook-ceph/leases/external-resizer-rook-ceph-rbd-csi-ceph-com,user-agent:csi-resizer/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:41.879) (total time: 571ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1438638748]: ---"Object stored in database" 571ms (18:15:00.451) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1438638748]: [571.639867ms] [571.639867ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.602280 698 trace.go:205] Trace[1070561870]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:42.063) (total time: 538ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1070561870]: ---"initial value restored" 339ms (18:15:00.402) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1070561870]: ---"Transaction committed" 198ms (18:15:00.602) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1070561870]: [538.396315ms] [538.396315ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.602673 698 trace.go:205] Trace[268442699]: "Patch" url:/api/v1/namespaces/default/events/unifi-gui.1661feaaa5db2a3c,user-agent:speaker/v0.0.0 (linux/arm64) kubernetes/$Format,client:10.2.0.32 (09-Feb-2021 18:15:42.063) (total time: 538ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[268442699]: ---"About to apply patch" 339ms (18:15:00.402) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[268442699]: ---"Object stored in database" 199ms (18:15:00.602) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[268442699]: [538.847675ms] [538.847675ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.603221 698 trace.go:205] Trace[783777069]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:42.003) (total time: 599ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[783777069]: ---"initial value restored" 413ms (18:15:00.416) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[783777069]: ---"Transaction committed" 185ms (18:15:00.603) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[783777069]: [599.981367ms] [599.981367ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.603472 698 trace.go:205] Trace[1378691099]: "Patch" url:/api/v1/namespaces/default/events/unifi-stun.166200cf0c5048a7,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.36 (09-Feb-2021 18:15:42.003) (total time: 600ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1378691099]: ---"About to apply patch" 413ms (18:15:00.416) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1378691099]: ---"Object stored in database" 185ms (18:15:00.603) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1378691099]: [600.352337ms] [600.352337ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.642769 698 trace.go:205] Trace[1788733230]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:42.103) (total time: 539ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1788733230]: ---"initial value restored" 312ms (18:15:00.416) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1788733230]: ---"Transaction committed" 225ms (18:15:00.642) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1788733230]: [539.094148ms] [539.094148ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.650253 698 trace.go:205] Trace[1033270784]: "Patch" url:/api/v1/namespaces/default/events/mcsv-minecraft.1662000cb8daa10b,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 18:15:42.103) (total time: 546ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1033270784]: ---"About to apply patch" 312ms (18:15:00.416) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1033270784]: ---"Object stored in database" 233ms (18:15:00.650) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1033270784]: [546.699391ms] [546.699391ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: W0209 18:15:42.730372 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/cpu,cpuacct/system.slice/run-r72c5b90935064bf2bd006cfa5ffca5e1.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/cpu,cpuacct/system.slice/run-r72c5b90935064bf2bd006cfa5ffca5e1.scope: no such file or directory | |
| Feb 09 18:15:42 k3s-0 k3s[698]: W0209 18:15:42.738491 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/blkio/system.slice/run-r72c5b90935064bf2bd006cfa5ffca5e1.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/blkio/system.slice/run-r72c5b90935064bf2bd006cfa5ffca5e1.scope: no such file or directory | |
| Feb 09 18:15:42 k3s-0 k3s[698]: W0209 18:15:42.740007 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/memory/system.slice/run-r72c5b90935064bf2bd006cfa5ffca5e1.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/memory/system.slice/run-r72c5b90935064bf2bd006cfa5ffca5e1.scope: no such file or directory | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.735324 698 trace.go:205] Trace[2127848195]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:42.232) (total time: 502ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[2127848195]: ---"initial value restored" 284ms (18:15:00.516) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[2127848195]: ---"Transaction committed" 217ms (18:15:00.735) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[2127848195]: [502.815341ms] [502.815341ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.737692 698 trace.go:205] Trace[1723063557]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:42.008) (total time: 728ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1723063557]: ---"initial value restored" 406ms (18:15:00.415) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1723063557]: ---"Transaction committed" 321ms (18:15:00.737) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1723063557]: [728.832337ms] [728.832337ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: W0209 18:15:42.745881 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/devices/system.slice/run-r72c5b90935064bf2bd006cfa5ffca5e1.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/devices/system.slice/run-r72c5b90935064bf2bd006cfa5ffca5e1.scope: no such file or directory | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.749522 698 trace.go:205] Trace[1406879670]: "Patch" url:/api/v1/namespaces/default/events/home-assistant.1662000b5aca944f,user-agent:speaker/v0.0.0 (linux/arm64) kubernetes/$Format,client:10.2.0.31 (09-Feb-2021 18:15:42.232) (total time: 517ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1406879670]: ---"About to apply patch" 284ms (18:15:00.516) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1406879670]: ---"Object stored in database" 232ms (18:15:00.749) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1406879670]: [517.102454ms] [517.102454ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: W0209 18:15:42.763356 698 pod_container_deletor.go:79] Container "ef677b916ee0fd243515061a98dd2f680b7b5fdc944a9e566db5fa1491c3a167" not found in pod's containers | |
| Feb 09 18:15:42 k3s-0 k3s[698]: W0209 18:15:42.763485 698 pod_container_deletor.go:79] Container "3b9b7862e8116c9639edfb1785621a7a804b5f6f7ebbb0f462c646c6e2a1be5f" not found in pod's containers | |
| Feb 09 18:15:42 k3s-0 k3s[698]: W0209 18:15:42.763531 698 pod_container_deletor.go:79] Container "248503a971142c9d74ca5e211ce264bbf4bbe2dc2f42330e58cc698985b9c7a5" not found in pod's containers | |
| Feb 09 18:15:42 k3s-0 k3s[698]: W0209 18:15:42.773957 698 watcher.go:87] Error while processing event ("/sys/fs/cgroup/pids/system.slice/run-r72c5b90935064bf2bd006cfa5ffca5e1.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/pids/system.slice/run-r72c5b90935064bf2bd006cfa5ffca5e1.scope: no such file or directory | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.786701 698 trace.go:205] Trace[2049022867]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:42.077) (total time: 708ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[2049022867]: ---"initial value restored" 324ms (18:15:00.402) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[2049022867]: ---"Transaction committed" 383ms (18:15:00.786) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[2049022867]: [708.874434ms] [708.874434ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.814421 698 trace.go:205] Trace[1930105958]: "Patch" url:/api/v1/namespaces/kube-system/events/ingress-nginx-controller.1661fed636411b18,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.34 (09-Feb-2021 18:15:42.077) (total time: 737ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1930105958]: ---"About to apply patch" 324ms (18:15:00.402) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1930105958]: ---"Object stored in database" 411ms (18:15:00.814) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1930105958]: [737.229377ms] [737.229377ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.813793 698 trace.go:205] Trace[2085329954]: "List etcd3" key:/pods,resourceVersion:,resourceVersionMatch:,limit:0,continue: (09-Feb-2021 18:15:42.004) (total time: 808ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[2085329954]: [808.808012ms] [808.808012ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.824292 698 trace.go:205] Trace[900698089]: "List" url:/api/v1/pods,user-agent:descheduler/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:42.004) (total time: 819ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[900698089]: ---"Listing from storage done" 816ms (18:15:00.821) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[900698089]: [819.340023ms] [819.340023ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.818502 698 trace.go:205] Trace[440763086]: "Patch" url:/api/v1/namespaces/flux-system/events/kustomize-controller-f674fdd7b-vjvpf.166202d2b92ba339,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.34 (09-Feb-2021 18:15:42.008) (total time: 809ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[440763086]: ---"About to apply patch" 406ms (18:15:00.415) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[440763086]: ---"Object stored in database" 358ms (18:15:00.773) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[440763086]: [809.763558ms] [809.763558ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.932857 698 trace.go:205] Trace[241728273]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:42.230) (total time: 702ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[241728273]: ---"initial value restored" 285ms (18:15:00.515) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[241728273]: ---"Transaction committed" 416ms (18:15:00.932) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[241728273]: [702.473291ms] [702.473291ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.933165 698 trace.go:205] Trace[1391981032]: "Patch" url:/api/v1/namespaces/default/events/mcbr-minecraft-bedrock.1662000513cf128f,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:42.230) (total time: 702ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1391981032]: ---"About to apply patch" 285ms (18:15:00.515) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1391981032]: ---"Object stored in database" 416ms (18:15:00.932) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1391981032]: [702.918445ms] [702.918445ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.988077 698 trace.go:205] Trace[1645159981]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:42.450) (total time: 538ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1645159981]: ---"initial value restored" 285ms (18:15:00.735) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1645159981]: ---"Transaction committed" 251ms (18:15:00.987) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[1645159981]: [538.039756ms] [538.039756ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.988235 698 trace.go:205] Trace[851908788]: "Patch" url:/api/v1/namespaces/default/events/blocky-tcp.166226ab8ec20028,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.37 (09-Feb-2021 18:15:42.449) (total time: 538ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[851908788]: ---"About to apply patch" 285ms (18:15:00.735) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[851908788]: ---"Object stored in database" 252ms (18:15:00.988) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[851908788]: [538.347749ms] [538.347749ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.990794 698 trace.go:205] Trace[707611822]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:42.450) (total time: 539ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[707611822]: ---"initial value restored" 338ms (18:15:00.788) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[707611822]: ---"Transaction committed" 198ms (18:15:00.990) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[707611822]: [539.990246ms] [539.990246ms] END | |
| Feb 09 18:15:42 k3s-0 k3s[698]: I0209 18:15:42.990916 698 trace.go:205] Trace[2090314669]: "Patch" url:/api/v1/namespaces/default/events/mcbr-minecraft-bedrock.1661feac9947c3f1,user-agent:speaker/v0.0.0 (linux/arm64) kubernetes/$Format,client:10.2.0.33 (09-Feb-2021 18:15:42.450) (total time: 540ms): | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[2090314669]: ---"About to apply patch" 338ms (18:15:00.788) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[2090314669]: ---"Object stored in database" 199ms (18:15:00.990) | |
| Feb 09 18:15:42 k3s-0 k3s[698]: Trace[2090314669]: [540.210273ms] [540.210273ms] END | |
| Feb 09 18:15:43 k3s-0 k3s[698]: I0209 18:15:43.097266 698 trace.go:205] Trace[1285667260]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:42.451) (total time: 645ms): | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1285667260]: ---"initial value restored" 284ms (18:15:00.736) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1285667260]: ---"Transaction committed" 359ms (18:15:00.097) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1285667260]: [645.367371ms] [645.367371ms] END | |
| Feb 09 18:15:43 k3s-0 k3s[698]: I0209 18:15:43.125328 698 trace.go:205] Trace[1124177469]: "Patch" url:/api/v1/namespaces/kube-system/events/node-feature-discovery-worker-5v6nb.16620383f47b5f43,user-agent:k3s/v1.19.7+k3s1 (linux/arm64) kubernetes/5a00e38,client:10.2.0.32 (09-Feb-2021 18:15:42.451) (total time: 673ms): | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1124177469]: ---"About to apply patch" 284ms (18:15:00.736) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1124177469]: ---"Object stored in database" 388ms (18:15:00.125) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1124177469]: [673.516609ms] [673.516609ms] END | |
| Feb 09 18:15:43 k3s-0 k3s[698]: I0209 18:15:43.103200 698 trace.go:205] Trace[1794700679]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:42.548) (total time: 554ms): | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1794700679]: ---"initial value restored" 385ms (18:15:00.934) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1794700679]: ---"Transaction committed" 168ms (18:15:00.102) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1794700679]: [554.680203ms] [554.680203ms] END | |
| Feb 09 18:15:43 k3s-0 k3s[698]: I0209 18:15:43.172146 698 trace.go:205] Trace[913000012]: "Patch" url:/api/v1/namespaces/kube-system/events/node-feature-discovery-worker-t6qz2.166203865420ac82,user-agent:k3s/v1.19.7+k3s1 (linux/arm64) kubernetes/5a00e38,client:10.2.0.33 (09-Feb-2021 18:15:42.548) (total time: 623ms): | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[913000012]: ---"About to apply patch" 385ms (18:15:00.934) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[913000012]: ---"Object stored in database" 237ms (18:15:00.172) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[913000012]: [623.829017ms] [623.829017ms] END | |
| Feb 09 18:15:43 k3s-0 k3s[698]: E0209 18:15:43.237620 698 customresource_handler.go:668] error building openapi models for thanosrulers.monitoring.coreos.com: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.containers.items.<array>.properties.env.items.<array>.properties.valueFrom.properties.resourceFieldRef.properties.divisor has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.containers.items.<array>.properties.lifecycle.properties.postStart.properties.httpGet.properties.port has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.containers.items.<array>.properties.lifecycle.properties.postStart.properties.tcpSocket.properties.port has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.containers.items.<array>.properties.lifecycle.properties.preStop.properties.httpGet.properties.port has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.containers.items.<array>.properties.lifecycle.properties.preStop.properties.tcpSocket.properties.port has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.containers.items.<array>.properties.livenessProbe.properties.httpGet.properties.port has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.containers.items.<array>.properties.livenessProbe.properties.tcpSocket.properties.port has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.containers.items.<array>.properties.readinessProbe.properties.httpGet.properties.port has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.containers.items.<array>.properties.readinessProbe.properties.tcpSocket.properties.port has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.containers.items.<array>.properties.resources.properties.limits.additionalProperties.schema has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.containers.items.<array>.properties.resources.properties.requests.additionalProperties.schema has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.containers.items.<array>.properties.startupProbe.properties.httpGet.properties.port has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.containers.items.<array>.properties.startupProbe.properties.tcpSocket.properties.port has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.initContainers.items.<array>.properties.env.items.<array>.properties.valueFrom.properties.resourceFieldRef.properties.divisor has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.initContainers.items.<array>.properties.lifecycle.properties.postStart.properties.httpGet.properties.port has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.initContainers.items.<array>.properties.lifecycle.properties.postStart.properties.tcpSocket.properties.port has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.initContainers.items.<array>.properties.lifecycle.properties.preStop.properties.httpGet.properties.port has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.initContainers.items.<array>.properties.lifecycle.properties.preStop.properties.tcpSocket.properties.port has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.initContainers.items.<array>.properties.livenessProbe.properties.httpGet.properties.port has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.initContainers.items.<array>.properties.livenessProbe.properties.tcpSocket.properties.port has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.initContainers.items.<array>.properties.readinessProbe.properties.httpGet.properties.port has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.initContainers.items.<array>.properties.readinessProbe.properties.tcpSocket.properties.port has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.initContainers.items.<array>.properties.resources.properties.limits.additionalProperties.schema has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.initContainers.items.<array>.properties.resources.properties.requests.additionalProperties.schema has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.initContainers.items.<array>.properties.startupProbe.properties.httpGet.properties.port has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.initContainers.items.<array>.properties.startupProbe.properties.tcpSocket.properties.port has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.resources.properties.limits.additionalProperties.schema has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.resources.properties.requests.additionalProperties.schema has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.storage.properties.emptyDir.properties.sizeLimit has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.storage.properties.volumeClaimTemplate.properties.spec.properties.resources.properties.limits.additionalProperties.schema has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.storage.properties.volumeClaimTemplate.properties.spec.properties.resources.properties.requests.additionalProperties.schema has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.storage.properties.volumeClaimTemplate.properties.status.properties.capacity.additionalProperties.schema has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.volumes.items.<array>.properties.downwardAPI.properties.items.items.<array>.properties.resourceFieldRef.properties.divisor has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.volumes.items.<array>.properties.emptyDir.properties.sizeLimit has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: ERROR $root.definitions.com.coreos.monitoring.v1.ThanosRuler.properties.spec.properties.volumes.items.<array>.properties.projected.properties.sources.items.<array>.properties.downwardAPI.properties.items.items.<array>.properties.resourceFieldRef.properties.divisor has invalid property: anyOf | |
| Feb 09 18:15:43 k3s-0 k3s[698]: I0209 18:15:43.251991 698 trace.go:205] Trace[1566171764]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:42.721) (total time: 530ms): | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1566171764]: ---"initial value restored" 268ms (18:15:00.989) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1566171764]: ---"Transaction committed" 261ms (18:15:00.251) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1566171764]: [530.406766ms] [530.406766ms] END | |
| Feb 09 18:15:43 k3s-0 k3s[698]: I0209 18:15:43.270247 698 trace.go:205] Trace[1215226114]: "Patch" url:/api/v1/namespaces/kube-system/events/coredns-coredns.166221a7b28071b6,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.36 (09-Feb-2021 18:15:42.637) (total time: 632ms): | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1215226114]: ---"About to apply patch" 347ms (18:15:00.989) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1215226114]: ---"Object stored in database" 279ms (18:15:00.269) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1215226114]: [632.288463ms] [632.288463ms] END | |
| Feb 09 18:15:43 k3s-0 k3s[698]: I0209 18:15:43.376181 698 trace.go:205] Trace[980659556]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:42.690) (total time: 684ms): | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[980659556]: ---"initial value restored" 242ms (18:15:00.933) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[980659556]: ---"Transaction committed" 440ms (18:15:00.374) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[980659556]: [684.731197ms] [684.731197ms] END | |
| Feb 09 18:15:43 k3s-0 k3s[698]: I0209 18:15:43.379002 698 trace.go:205] Trace[126933503]: "Patch" url:/api/v1/namespaces/kube-system/events/ingress-nginx-controller.1661fed906320d82,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 18:15:42.690) (total time: 688ms): | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[126933503]: ---"About to apply patch" 242ms (18:15:00.933) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[126933503]: ---"Object stored in database" 442ms (18:15:00.376) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[126933503]: [688.147485ms] [688.147485ms] END | |
| Feb 09 18:15:43 k3s-0 k3s[698]: E0209 18:15:43.434098 698 remote_runtime.go:140] StopPodSandbox "4377c82d9e468214d25e4cfb85d22a78d08da3faba8d053848f913d496916097" from runtime service failed: rpc error: code = NotFound desc = an error occurred when try to find sandbox "4377c82d9e468214d25e4cfb85d22a78d08da3faba8d053848f913d496916097": not found | |
| Feb 09 18:15:43 k3s-0 k3s[698]: E0209 18:15:43.434665 698 kuberuntime_manager.go:909] Failed to stop sandbox {"containerd" "4377c82d9e468214d25e4cfb85d22a78d08da3faba8d053848f913d496916097"} | |
| Feb 09 18:15:43 k3s-0 k3s[698]: E0209 18:15:43.435376 698 kuberuntime_manager.go:688] killPodWithSyncResult failed: failed to "KillPodSandbox" for "891b66f0-d916-4b8a-bee9-f74dac9f8d88" with KillPodSandboxError: "rpc error: code = NotFound desc = an error occurred when try to find sandbox \"4377c82d9e468214d25e4cfb85d22a78d08da3faba8d053848f913d496916097\": not found" | |
| Feb 09 18:15:43 k3s-0 k3s[698]: E0209 18:15:43.435900 698 pod_workers.go:191] Error syncing pod 891b66f0-d916-4b8a-bee9-f74dac9f8d88 ("node-feature-discovery-worker-h55fq_kube-system(891b66f0-d916-4b8a-bee9-f74dac9f8d88)"), skipping: failed to "KillPodSandbox" for "891b66f0-d916-4b8a-bee9-f74dac9f8d88" with KillPodSandboxError: "rpc error: code = NotFound desc = an error occurred when try to find sandbox \"4377c82d9e468214d25e4cfb85d22a78d08da3faba8d053848f913d496916097\": not found" | |
| Feb 09 18:15:43 k3s-0 k3s[698]: I0209 18:15:43.494654 698 trace.go:205] Trace[892208738]: "List" url:/api/v1/secrets,user-agent:manager/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 18:15:34.644) (total time: 8849ms): | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[892208738]: ---"Writing http response done" count:508 8847ms (18:15:00.494) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[892208738]: [8.849665684s] [8.849665684s] END | |
| Feb 09 18:15:43 k3s-0 k3s[698]: I0209 18:15:43.573402 698 trace.go:205] Trace[1870534738]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:42.969) (total time: 603ms): | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1870534738]: ---"initial value restored" 210ms (18:15:00.179) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1870534738]: ---"Transaction committed" 392ms (18:15:00.573) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1870534738]: [603.719907ms] [603.719907ms] END | |
| Feb 09 18:15:43 k3s-0 k3s[698]: I0209 18:15:43.573623 698 trace.go:205] Trace[1541089113]: "Patch" url:/api/v1/namespaces/default/events/flood-bt.1661fff1f139fc0d,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:42.969) (total time: 604ms): | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1541089113]: ---"About to apply patch" 210ms (18:15:00.179) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1541089113]: ---"Object stored in database" 393ms (18:15:00.573) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1541089113]: [604.062933ms] [604.062933ms] END | |
| Feb 09 18:15:43 k3s-0 k3s[698]: I0209 18:15:43.677395 698 trace.go:205] Trace[747533648]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:42.868) (total time: 808ms): | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[747533648]: ---"initial value restored" 312ms (18:15:00.181) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[747533648]: ---"Transaction committed" 493ms (18:15:00.677) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[747533648]: [808.940379ms] [808.940379ms] END | |
| Feb 09 18:15:43 k3s-0 k3s[698]: I0209 18:15:43.677735 698 trace.go:205] Trace[1282646062]: "Patch" url:/api/v1/namespaces/default/events/nzbget.1661fec1b7858139,user-agent:speaker/v0.0.0 (linux/arm64) kubernetes/$Format,client:10.2.0.31 (09-Feb-2021 18:15:42.780) (total time: 897ms): | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1282646062]: ---"About to apply patch" 401ms (18:15:00.181) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1282646062]: ---"Object stored in database" 495ms (18:15:00.677) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1282646062]: [897.560108ms] [897.560108ms] END | |
| Feb 09 18:15:43 k3s-0 k3s[698]: I0209 18:15:43.679001 698 trace.go:205] Trace[1984323889]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:43.014) (total time: 664ms): | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1984323889]: ---"initial value restored" 389ms (18:15:00.404) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1984323889]: ---"Transaction committed" 273ms (18:15:00.678) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1984323889]: [664.63598ms] [664.63598ms] END | |
| Feb 09 18:15:43 k3s-0 k3s[698]: I0209 18:15:43.679228 698 trace.go:205] Trace[1562104106]: "Patch" url:/api/v1/namespaces/default/events/mc-minecraft.1661feb7c2e43283,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.37 (09-Feb-2021 18:15:43.014) (total time: 664ms): | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1562104106]: ---"About to apply patch" 389ms (18:15:00.404) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1562104106]: ---"Object stored in database" 274ms (18:15:00.679) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1562104106]: [664.996178ms] [664.996178ms] END | |
| Feb 09 18:15:43 k3s-0 k3s[698]: I0209 18:15:43.769905 698 trace.go:205] Trace[201257674]: "Get" url:/apis/coordination.k8s.io/v1/namespaces/rook-ceph/leases/external-snapshotter-leader-rook-ceph-cephfs-csi-ceph-com,user-agent:csi-snapshotter/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 18:15:43.214) (total time: 555ms): | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[201257674]: ---"About to write a response" 552ms (18:15:00.769) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[201257674]: [555.301558ms] [555.301558ms] END | |
| Feb 09 18:15:43 k3s-0 k3s[698]: I0209 18:15:43.826174 698 trace.go:205] Trace[1146847936]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:43.054) (total time: 771ms): | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1146847936]: ---"initial value restored" 351ms (18:15:00.405) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1146847936]: ---"Transaction committed" 379ms (18:15:00.825) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1146847936]: [771.466581ms] [771.466581ms] END | |
| Feb 09 18:15:43 k3s-0 k3s[698]: I0209 18:15:43.955237 698 trace.go:205] Trace[1019729439]: "Patch" url:/api/v1/namespaces/default/events/unifi-discovery.1661feac99d0986e,user-agent:speaker/v0.0.0 (linux/arm64) kubernetes/$Format,client:10.2.0.33 (09-Feb-2021 18:15:43.035) (total time: 918ms): | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1019729439]: ---"About to apply patch" 369ms (18:15:00.405) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1019729439]: ---"Object stored in database" 508ms (18:15:00.954) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1019729439]: [918.366895ms] [918.366895ms] END | |
| Feb 09 18:15:43 k3s-0 k3s[698]: I0209 18:15:43.977811 698 trace.go:205] Trace[1187010055]: "Create" url:/api/v1/namespaces/rook-ceph/events,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:127.0.0.1 (09-Feb-2021 18:15:43.343) (total time: 628ms): | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1187010055]: ---"Object stored in database" 627ms (18:15:00.971) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[1187010055]: [628.092812ms] [628.092812ms] END | |
| Feb 09 18:15:43 k3s-0 k3s[698]: I0209 18:15:43.986882 698 trace.go:205] Trace[81195403]: "Get" url:/api/v1/namespaces/rook-ceph/secrets/rook-ceph-mon,user-agent:rook/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.36 (09-Feb-2021 18:15:43.395) (total time: 591ms): | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[81195403]: ---"About to write a response" 591ms (18:15:00.986) | |
| Feb 09 18:15:43 k3s-0 k3s[698]: Trace[81195403]: [591.647167ms] [591.647167ms] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.023125 698 trace.go:205] Trace[320187948]: "Create" url:/api/v1/namespaces/kube-system/events,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.38 (09-Feb-2021 18:15:43.462) (total time: 560ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[320187948]: ---"Object stored in database" 560ms (18:15:00.022) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[320187948]: [560.386067ms] [560.386067ms] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.027330 698 trace.go:205] Trace[735831778]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:43.193) (total time: 833ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[735831778]: ---"initial value restored" 274ms (18:15:00.468) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[735831778]: ---"Transaction committed" 557ms (18:15:00.026) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[735831778]: [833.528814ms] [833.528814ms] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.028229 698 trace.go:205] Trace[266427032]: "Patch" url:/api/v1/namespaces/kube-system/events/node-feature-discovery-worker-t6qz2.166226dd0125f144,user-agent:k3s/v1.19.7+k3s1 (linux/arm64) kubernetes/5a00e38,client:10.2.0.33 (09-Feb-2021 18:15:43.193) (total time: 834ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[266427032]: ---"About to apply patch" 274ms (18:15:00.468) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[266427032]: ---"Object stored in database" 558ms (18:15:00.027) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[266427032]: [834.707464ms] [834.707464ms] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.171180 698 trace.go:205] Trace[139141142]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:43.325) (total time: 845ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[139141142]: ---"initial value restored" 230ms (18:15:00.555) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[139141142]: ---"Transaction committed" 608ms (18:15:00.171) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[139141142]: [845.644091ms] [845.644091ms] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.171486 698 trace.go:205] Trace[1271820106]: "Patch" url:/api/v1/namespaces/default/events/mc-minecraft.16621effe9d5ac1c,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.36 (09-Feb-2021 18:15:43.325) (total time: 846ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1271820106]: ---"About to apply patch" 230ms (18:15:00.555) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1271820106]: ---"Object stored in database" 608ms (18:15:00.171) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1271820106]: [846.128152ms] [846.128152ms] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.171888 698 trace.go:205] Trace[2003515289]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:43.054) (total time: 1116ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[2003515289]: ---"initial value restored" 339ms (18:15:00.393) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[2003515289]: ---"Transaction committed" 767ms (18:15:00.171) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[2003515289]: [1.116928947s] [1.116928947s] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.172052 698 trace.go:205] Trace[2097418666]: "Patch" url:/api/v1/namespaces/flux-system/events/helm-controller-c858b9c65-h9lrr.166226df2d781d4a,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.34 (09-Feb-2021 18:15:42.981) (total time: 1190ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[2097418666]: ---"About to apply patch" 412ms (18:15:00.394) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[2097418666]: ---"Object stored in database" 768ms (18:15:00.171) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[2097418666]: [1.190778211s] [1.190778211s] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.272793 698 trace.go:205] Trace[861459060]: "Create" url:/api/v1/namespaces/kube-system/events,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.35 (09-Feb-2021 18:15:43.452) (total time: 820ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[861459060]: ---"Object stored in database" 819ms (18:15:00.272) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[861459060]: [820.138447ms] [820.138447ms] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.410093 698 trace.go:205] Trace[2023280007]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:43.447) (total time: 962ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[2023280007]: ---"initial value restored" 366ms (18:15:00.814) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[2023280007]: ---"Transaction committed" 591ms (18:15:00.409) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[2023280007]: [962.170978ms] [962.170978ms] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.422309 698 trace.go:205] Trace[1157428863]: "Patch" url:/api/v1/namespaces/logs/events/loki-promtail-syslog.1661fecf18bf5732,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 18:15:43.447) (total time: 974ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1157428863]: ---"About to apply patch" 367ms (18:15:00.814) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1157428863]: ---"Object stored in database" 592ms (18:15:00.410) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1157428863]: [974.722175ms] [974.722175ms] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.273422 698 trace.go:205] Trace[2140157268]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:43.466) (total time: 807ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[2140157268]: ---"initial value restored" 307ms (18:15:00.773) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[2140157268]: ---"Transaction committed" 496ms (18:15:00.273) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[2140157268]: [807.132539ms] [807.132539ms] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.430097 698 trace.go:205] Trace[1704290047]: "Patch" url:/api/v1/namespaces/kube-system/events/registry-creds-registry-creds-controller-5b84f897f6-xbbn2.166226df625916cc,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.37 (09-Feb-2021 18:15:43.466) (total time: 963ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1704290047]: ---"About to apply patch" 307ms (18:15:00.773) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1704290047]: ---"Object stored in database" 649ms (18:15:00.424) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1704290047]: [963.881432ms] [963.881432ms] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.435484 698 trace.go:205] Trace[1278231711]: "List etcd3" key:/monitoring.coreos.com/thanosrulers,resourceVersion:,resourceVersionMatch:,limit:10000,continue: (09-Feb-2021 18:15:43.485) (total time: 949ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1278231711]: [949.7062ms] [949.7062ms] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.527939 698 trace.go:205] Trace[593353319]: "Get" url:/apis/coordination.k8s.io/v1/namespaces/rook-ceph/leases/external-resizer-rook-ceph-rbd-csi-ceph-com,user-agent:csi-resizer/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 18:15:43.952) (total time: 575ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[593353319]: ---"About to write a response" 575ms (18:15:00.527) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[593353319]: [575.250151ms] [575.250151ms] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.436663 698 trace.go:205] Trace[1781255982]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:43.449) (total time: 986ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1781255982]: ---"initial value restored" 194ms (18:15:00.644) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1781255982]: ---"Transaction committed" 789ms (18:15:00.436) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1781255982]: [986.61931ms] [986.61931ms] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.529214 698 trace.go:205] Trace[1130849251]: "Patch" url:/api/v1/namespaces/default/events/unifi-gui.16620076512c25d6,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.34 (09-Feb-2021 18:15:43.396) (total time: 1132ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1130849251]: ---"About to apply patch" 248ms (18:15:00.644) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1130849251]: ---"Object stored in database" 882ms (18:15:00.528) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1130849251]: [1.132739053s] [1.132739053s] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.534365 698 trace.go:205] Trace[438157683]: "cacher list" type:*unstructured.Unstructured (09-Feb-2021 18:15:43.471) (total time: 1062ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[438157683]: ---"Ready" 1062ms (18:15:00.534) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[438157683]: [1.062850894s] [1.062850894s] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.534813 698 trace.go:205] Trace[715625716]: "List" url:/apis/monitoring.coreos.com/v1/thanosrulers,user-agent:operator/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 18:15:43.471) (total time: 1063ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[715625716]: ---"Listing from storage done" 1063ms (18:15:00.534) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[715625716]: [1.063386235s] [1.063386235s] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.274117 698 trace.go:205] Trace[1431067619]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:43.181) (total time: 1092ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1431067619]: ---"initial value restored" 382ms (18:15:00.563) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1431067619]: ---"Transaction committed" 708ms (18:15:00.273) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1431067619]: [1.092947326s] [1.092947326s] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.535821 698 trace.go:205] Trace[1477727933]: "Patch" url:/api/v1/namespaces/kube-system/events/node-feature-discovery-worker-5v6nb.16620384041381d7,user-agent:k3s/v1.19.7+k3s1 (linux/arm64) kubernetes/5a00e38,client:10.2.0.32 (09-Feb-2021 18:15:43.180) (total time: 1354ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1477727933]: ---"About to apply patch" 382ms (18:15:00.563) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1477727933]: ---"Object stored in database" 970ms (18:15:00.535) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1477727933]: [1.354781531s] [1.354781531s] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.275218 698 trace.go:205] Trace[819155423]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:43.058) (total time: 1216ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[819155423]: ---"initial value restored" 321ms (18:15:00.379) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[819155423]: ---"Transaction committed" 835ms (18:15:00.274) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[819155423]: [1.216435644s] [1.216435644s] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.536509 698 trace.go:205] Trace[832446979]: "Patch" url:/api/v1/namespaces/default/events/unifi-stun.1661feaaa5992ec4,user-agent:speaker/v0.0.0 (linux/arm64) kubernetes/$Format,client:10.2.0.32 (09-Feb-2021 18:15:43.054) (total time: 1482ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[832446979]: ---"About to apply patch" 325ms (18:15:00.379) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[832446979]: ---"Object stored in database" 1099ms (18:15:00.536) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[832446979]: [1.482108538s] [1.482108538s] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.357073 698 trace.go:205] Trace[637921430]: "Get" url:/api/v1/namespaces/rook-ceph/pods/csi-rbdplugin-7qgcb,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:127.0.0.1 (09-Feb-2021 18:15:43.770) (total time: 586ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[637921430]: ---"About to write a response" 586ms (18:15:00.356) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[637921430]: [586.789889ms] [586.789889ms] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.378704 698 trace.go:205] Trace[680643257]: "Get" url:/api/v1/namespaces/kube-system/pods/registry-creds-registry-creds-controller-5b84f897f6-xbbn2,user-agent:botkube/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:43.642) (total time: 736ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[680643257]: ---"About to write a response" 735ms (18:15:00.378) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[680643257]: [736.263209ms] [736.263209ms] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.273750 698 trace.go:205] Trace[1785205432]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:43.215) (total time: 1057ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1785205432]: ---"initial value restored" 253ms (18:15:00.469) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1785205432]: ---"Transaction committed" 752ms (18:15:00.273) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1785205432]: [1.057749169s] [1.057749169s] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.537126 698 trace.go:205] Trace[478691040]: "Patch" url:/api/v1/namespaces/kube-system/events/node-feature-discovery-worker-r6tzg.166202d251ffbfd0,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.36 (09-Feb-2021 18:15:43.215) (total time: 1321ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[478691040]: ---"About to apply patch" 253ms (18:15:00.469) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[478691040]: ---"Object stored in database" 1016ms (18:15:00.536) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[478691040]: [1.321373157s] [1.321373157s] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.467209 698 trace.go:205] Trace[1013783983]: "Get" url:/apis/rbac.authorization.k8s.io/v1/clusterroles/system:certificates.k8s.io:kube-apiserver-client-approver,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:127.0.0.1 (09-Feb-2021 18:15:43.481) (total time: 985ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1013783983]: ---"About to write a response" 985ms (18:15:00.467) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1013783983]: [985.319355ms] [985.319355ms] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.611306 698 trace.go:205] Trace[236015266]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:43.801) (total time: 810ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[236015266]: ---"initial value restored" 629ms (18:15:00.430) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[236015266]: ---"Transaction committed" 175ms (18:15:00.611) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[236015266]: [810.123393ms] [810.123393ms] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.615442 698 trace.go:205] Trace[712016122]: "Patch" url:/api/v1/namespaces/default/events/flood-bt.1661feb7c2d2ab3e,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.37 (09-Feb-2021 18:15:43.800) (total time: 814ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[712016122]: ---"About to apply patch" 629ms (18:15:00.430) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[712016122]: ---"Object stored in database" 179ms (18:15:00.615) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[712016122]: [814.434913ms] [814.434913ms] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.617946 698 trace.go:205] Trace[1451402230]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:44.026) (total time: 591ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1451402230]: ---"initial value restored" 591ms (18:15:00.617) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1451402230]: [591.35217ms] [591.35217ms] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.625086 698 trace.go:205] Trace[1744809993]: "Patch" url:/api/v1/namespaces/rook-ceph/events/csi-rbdplugin-provisioner-6dd559f8b4-h52qg.1661ffdd0a1d6b00,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.38 (09-Feb-2021 18:15:44.026) (total time: 598ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1744809993]: ---"About to apply patch" 591ms (18:15:00.617) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1744809993]: [598.635919ms] [598.635919ms] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.691840 698 trace.go:205] Trace[937028792]: "Get" url:/api/v1/namespaces/flux-system/pods/kustomize-controller-f674fdd7b-vjvpf,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.34 (09-Feb-2021 18:15:43.970) (total time: 721ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[937028792]: ---"About to write a response" 720ms (18:15:00.691) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[937028792]: [721.276923ms] [721.276923ms] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.895293 698 trace.go:205] Trace[1953446675]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:43.660) (total time: 1235ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1953446675]: ---"initial value restored" 776ms (18:15:00.436) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1953446675]: ---"Transaction committed" 456ms (18:15:00.895) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1953446675]: [1.235076943s] [1.235076943s] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.895863 698 trace.go:205] Trace[2096064876]: "Patch" url:/api/v1/namespaces/default/events/nzbget.1661fff878e72a0c,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:43.659) (total time: 1236ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[2096064876]: ---"About to apply patch" 777ms (18:15:00.436) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[2096064876]: ---"Object stored in database" 457ms (18:15:00.895) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[2096064876]: [1.236017988s] [1.236017988s] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.914893 698 trace.go:205] Trace[2141036788]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:43.807) (total time: 1106ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[2141036788]: ---"initial value restored" 630ms (18:15:00.438) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[2141036788]: ---"Transaction committed" 460ms (18:15:00.900) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[2141036788]: [1.106994814s] [1.106994814s] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.915146 698 trace.go:205] Trace[216399689]: "Patch" url:/api/v1/namespaces/default/events/unifi-stun.16620076523cb671,user-agent:speaker/v0.0.0 (linux/arm64) kubernetes/$Format,client:10.2.0.31 (09-Feb-2021 18:15:43.806) (total time: 1108ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[216399689]: ---"About to apply patch" 631ms (18:15:00.438) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[216399689]: ---"Object stored in database" 475ms (18:15:00.914) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[216399689]: [1.108444691s] [1.108444691s] END | |
| Feb 09 18:15:44 k3s-0 k3s[698]: W0209 18:15:44.980709 698 controller.go:142] slow openapi aggregation of "prometheuses.monitoring.coreos.com": 1.747804968s | |
| Feb 09 18:15:44 k3s-0 k3s[698]: I0209 18:15:44.988279 698 trace.go:205] Trace[1904317143]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:44.464) (total time: 523ms): | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1904317143]: ---"initial value restored" 434ms (18:15:00.898) | |
| Feb 09 18:15:44 k3s-0 k3s[698]: Trace[1904317143]: [523.961ms] [523.961ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.029655 698 trace.go:205] Trace[1478812375]: "Patch" url:/api/v1/namespaces/flux-system/events/notification-controller-db467b4fb-5dg27.166226df51836735,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.35 (09-Feb-2021 18:15:44.463) (total time: 565ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1478812375]: ---"About to apply patch" 434ms (18:15:00.898) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1478812375]: ---"Object stored in database" 129ms (18:15:00.029) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1478812375]: [565.667169ms] [565.667169ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.053192 698 trace.go:205] Trace[1225432973]: "List etcd3" key:/pods,resourceVersion:,resourceVersionMatch:,limit:0,continue: (09-Feb-2021 18:15:42.956) (total time: 2096ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1225432973]: [2.096597182s] [2.096597182s] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.155327 698 trace.go:205] Trace[554370641]: "Get" url:/apis/coordination.k8s.io/v1/namespaces/rook-ceph/leases/external-attacher-leader-rook-ceph-rbd-csi-ceph-com,user-agent:csi-attacher/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:44.431) (total time: 724ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[554370641]: ---"About to write a response" 723ms (18:15:00.155) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[554370641]: [724.044824ms] [724.044824ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.188711 698 trace.go:205] Trace[621776356]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:44.148) (total time: 1040ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[621776356]: ---"initial value restored" 477ms (18:15:00.625) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[621776356]: ---"Transaction committed" 561ms (18:15:00.188) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[621776356]: [1.04032413s] [1.04032413s] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.188921 698 trace.go:205] Trace[417805420]: "Patch" url:/api/v1/namespaces/default/events/unifi-gui.1661feac997d8748,user-agent:speaker/v0.0.0 (linux/arm64) kubernetes/$Format,client:10.2.0.33 (09-Feb-2021 18:15:44.035) (total time: 1153ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[417805420]: ---"About to apply patch" 589ms (18:15:00.625) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[417805420]: ---"Object stored in database" 562ms (18:15:00.188) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[417805420]: [1.153221068s] [1.153221068s] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.190293 698 trace.go:205] Trace[1435913890]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:44.133) (total time: 1056ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1435913890]: ---"initial value restored" 499ms (18:15:00.633) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1435913890]: ---"Transaction committed" 555ms (18:15:00.190) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1435913890]: [1.056462446s] [1.056462446s] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.190453 698 trace.go:205] Trace[2079881630]: "Patch" url:/api/v1/namespaces/kube-system/events/node-feature-discovery-worker-t6qz2.166226dd0125f144,user-agent:k3s/v1.19.7+k3s1 (linux/arm64) kubernetes/5a00e38,client:10.2.0.33 (09-Feb-2021 18:15:44.133) (total time: 1056ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[2079881630]: ---"About to apply patch" 499ms (18:15:00.633) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[2079881630]: ---"Object stored in database" 556ms (18:15:00.190) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[2079881630]: [1.056737108s] [1.056737108s] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.201161 698 trace.go:205] Trace[286724507]: "Patch" url:/api/v1/namespaces/default/events/vernemq.1661feb7c2b1d26e,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.37 (09-Feb-2021 18:15:44.696) (total time: 504ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[286724507]: ---"About to apply patch" 242ms (18:15:00.938) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[286724507]: ---"Object stored in database" 261ms (18:15:00.200) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[286724507]: [504.520452ms] [504.520452ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: E0209 18:15:45.154974 698 available_controller.go:490] v1beta1.metrics.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1beta1.metrics.k8s.io": the object has been modified; please apply your changes to the latest version and try again | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.184701 698 trace.go:205] Trace[1491316313]: "List" url:/api/v1/pods,user-agent:descheduler/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.38 (09-Feb-2021 18:15:42.956) (total time: 2228ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1491316313]: ---"Listing from storage done" 2096ms (18:15:00.053) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1491316313]: ---"Writing http response done" count:18 131ms (18:15:00.184) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1491316313]: [2.228135975s] [2.228135975s] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.187656 698 trace.go:205] Trace[311037247]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:44.316) (total time: 871ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[311037247]: ---"initial value restored" 314ms (18:15:00.631) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[311037247]: ---"Transaction committed" 555ms (18:15:00.187) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[311037247]: [871.054457ms] [871.054457ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.236335 698 trace.go:205] Trace[1036399166]: "Patch" url:/api/v1/namespaces/default/events/flood-bt.166200cf0c163971,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.36 (09-Feb-2021 18:15:44.314) (total time: 921ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1036399166]: ---"About to apply patch" 316ms (18:15:00.631) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1036399166]: ---"Object stored in database" 604ms (18:15:00.235) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1036399166]: [921.596574ms] [921.596574ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.265706 698 trace.go:205] Trace[662342308]: "List etcd3" key:/deployments/rook-ceph,resourceVersion:,resourceVersionMatch:,limit:0,continue: (09-Feb-2021 18:15:44.528) (total time: 737ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[662342308]: [737.433895ms] [737.433895ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.267572 698 trace.go:205] Trace[1833695971]: "List" url:/apis/apps/v1/namespaces/rook-ceph/deployments,user-agent:rook/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.36 (09-Feb-2021 18:15:44.528) (total time: 739ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1833695971]: ---"Listing from storage done" 737ms (18:15:00.265) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1833695971]: [739.403648ms] [739.403648ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.284689 698 trace.go:205] Trace[584167398]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:44.350) (total time: 934ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[584167398]: ---"initial value restored" 281ms (18:15:00.632) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[584167398]: ---"Transaction committed" 651ms (18:15:00.284) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[584167398]: [934.028266ms] [934.028266ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.284881 698 trace.go:205] Trace[2102566748]: "Patch" url:/api/v1/namespaces/flux-system/events/kustomize-controller-f674fdd7b-vjvpf.166202d2b92ba339,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.34 (09-Feb-2021 18:15:44.350) (total time: 934ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[2102566748]: ---"About to apply patch" 282ms (18:15:00.632) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[2102566748]: ---"Object stored in database" 651ms (18:15:00.284) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[2102566748]: [934.719401ms] [934.719401ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.289792 698 trace.go:205] Trace[515070293]: "Get" url:/apis/rbac.authorization.k8s.io/v1/clusterroles/system:certificates.k8s.io:kube-apiserver-client-kubelet-approver,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:127.0.0.1 (09-Feb-2021 18:15:44.773) (total time: 515ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[515070293]: ---"About to write a response" 515ms (18:15:00.289) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[515070293]: [515.886963ms] [515.886963ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.291035 698 trace.go:205] Trace[904051888]: "GuaranteedUpdate etcd3" type:*admissionregistration.MutatingWebhookConfiguration (09-Feb-2021 18:15:44.471) (total time: 819ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[904051888]: [819.576198ms] [819.576198ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.387177 698 trace.go:205] Trace[373581445]: "Patch" url:/apis/admissionregistration.k8s.io/v1beta1/mutatingwebhookconfigurations/vault-agent-injector-cfg,user-agent:vault-k8s/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.34 (09-Feb-2021 18:15:44.471) (total time: 916ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[373581445]: ---"Object stored in database" 902ms (18:15:00.386) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[373581445]: [916.043812ms] [916.043812ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.433969 698 trace.go:205] Trace[1946364675]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:44.627) (total time: 806ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1946364675]: ---"initial value restored" 557ms (18:15:00.185) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1946364675]: ---"Transaction committed" 247ms (18:15:00.433) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1946364675]: [806.315255ms] [806.315255ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.468624 698 trace.go:205] Trace[2040005113]: "Patch" url:/api/v1/namespaces/kube-system/events/node-feature-discovery-worker-r6tzg.166202d251ffbfd0,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.36 (09-Feb-2021 18:15:44.625) (total time: 843ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[2040005113]: ---"About to apply patch" 559ms (18:15:00.185) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[2040005113]: ---"Object stored in database" 282ms (18:15:00.468) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[2040005113]: [843.197039ms] [843.197039ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.450528 698 trace.go:205] Trace[988982956]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:44.655) (total time: 794ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[988982956]: ---"initial value restored" 534ms (18:15:00.190) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[988982956]: ---"Transaction committed" 249ms (18:15:00.450) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[988982956]: [794.524416ms] [794.524416ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.500073 698 trace.go:205] Trace[1189392019]: "Patch" url:/api/v1/namespaces/kube-system/events/node-feature-discovery-worker-ps7qf.1662038416d5a430,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.37 (09-Feb-2021 18:15:44.594) (total time: 905ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1189392019]: ---"About to apply patch" 534ms (18:15:00.190) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1189392019]: ---"Object stored in database" 299ms (18:15:00.499) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1189392019]: [905.08325ms] [905.08325ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.502213 698 trace.go:205] Trace[1330704003]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:44.628) (total time: 873ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1330704003]: ---"initial value restored" 417ms (18:15:00.046) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1330704003]: ---"Transaction committed" 452ms (18:15:00.502) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1330704003]: [873.385715ms] [873.385715ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.503129 698 trace.go:205] Trace[754658675]: "Patch" url:/api/v1/namespaces/logs/events/loki-promtail-syslog.1661feaaa5cdf33d,user-agent:speaker/v0.0.0 (linux/arm64) kubernetes/$Format,client:10.2.0.32 (09-Feb-2021 18:15:44.628) (total time: 874ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[754658675]: ---"About to apply patch" 417ms (18:15:00.046) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[754658675]: ---"Object stored in database" 453ms (18:15:00.502) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[754658675]: [874.420374ms] [874.420374ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.514861 698 trace.go:205] Trace[525255252]: "List" url:/api/v1/pods,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:10.2.0.35 (09-Feb-2021 18:15:43.844) (total time: 1670ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[525255252]: ---"Listing from storage done" 227ms (18:15:00.071) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[525255252]: ---"Writing http response done" count:181 1442ms (18:15:00.514) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[525255252]: [1.670025796s] [1.670025796s] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.521833 698 trace.go:205] Trace[624924283]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:44.966) (total time: 554ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[624924283]: ---"initial value restored" 222ms (18:15:00.189) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[624924283]: ---"Transaction committed" 331ms (18:15:00.521) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[624924283]: [554.96585ms] [554.96585ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.522861 698 trace.go:205] Trace[1751803652]: "Patch" url:/api/v1/namespaces/default/events/unifi-controller.1662007657687e47,user-agent:speaker/v0.0.0 (linux/arm64) kubernetes/$Format,client:10.2.0.31 (09-Feb-2021 18:15:44.966) (total time: 556ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1751803652]: ---"About to apply patch" 222ms (18:15:00.189) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1751803652]: ---"Object stored in database" 332ms (18:15:00.522) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1751803652]: [556.092131ms] [556.092131ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.524107 698 trace.go:205] Trace[2032779760]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:44.638) (total time: 885ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[2032779760]: ---"initial value restored" 676ms (18:15:00.314) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[2032779760]: ---"Transaction committed" 208ms (18:15:00.523) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[2032779760]: [885.875295ms] [885.875295ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.525036 698 trace.go:205] Trace[1740679480]: "Patch" url:/api/v1/namespaces/default/events/unifi-stun.16620076521f4a89,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.34 (09-Feb-2021 18:15:44.637) (total time: 887ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1740679480]: ---"About to apply patch" 676ms (18:15:00.314) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1740679480]: ---"Object stored in database" 209ms (18:15:00.524) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1740679480]: [887.185362ms] [887.185362ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.526243 698 trace.go:205] Trace[1112562490]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:44.725) (total time: 801ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1112562490]: ---"initial value restored" 307ms (18:15:00.032) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1112562490]: ---"Transaction committed" 493ms (18:15:00.526) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1112562490]: [801.133928ms] [801.133928ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.527372 698 trace.go:205] Trace[1311861183]: "List" url:/apis/velero.io/v1/namespaces/velero/podvolumebackups,user-agent:restic-server/v1.5.3 (linux/arm64) 123109a3bcac11dbb6783d2758207bac0d0817cb,client:10.2.0.32 (09-Feb-2021 18:15:43.152) (total time: 2374ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1311861183]: ---"Writing http response done" count:344 2360ms (18:15:00.527) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1311861183]: [2.374276565s] [2.374276565s] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.528288 698 trace.go:205] Trace[1248427213]: "Patch" url:/api/v1/namespaces/kube-system/events/node-feature-discovery-worker-5v6nb.166226e64288df8e,user-agent:k3s/v1.19.7+k3s1 (linux/arm64) kubernetes/5a00e38,client:10.2.0.32 (09-Feb-2021 18:15:44.724) (total time: 803ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1248427213]: ---"About to apply patch" 307ms (18:15:00.032) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1248427213]: ---"Object stored in database" 494ms (18:15:00.526) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1248427213]: [803.372679ms] [803.372679ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.534691 698 trace.go:205] Trace[693599440]: "GuaranteedUpdate etcd3" type:*core.Pod (09-Feb-2021 18:15:44.717) (total time: 817ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[693599440]: ---"Transaction prepared" 455ms (18:15:00.172) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[693599440]: ---"Transaction committed" 361ms (18:15:00.534) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[693599440]: [817.540656ms] [817.540656ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.536469 698 trace.go:205] Trace[1212191814]: "Patch" url:/api/v1/namespaces/rook-ceph/pods/csi-rbdplugin-7qgcb/status,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:127.0.0.1 (09-Feb-2021 18:15:44.716) (total time: 819ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1212191814]: ---"About to check admission control" 189ms (18:15:00.906) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1212191814]: ---"Object stored in database" 629ms (18:15:00.535) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1212191814]: [819.750031ms] [819.750031ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.718706 698 trace.go:205] Trace[1111618751]: "Create" url:/api/v1/namespaces/monitoring/events,user-agent:k3s/v1.19.7+k3s1 (linux/amd64) kubernetes/5a00e38,client:127.0.0.1 (09-Feb-2021 18:15:45.205) (total time: 512ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1111618751]: ---"Object stored in database" 512ms (18:15:00.718) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1111618751]: [512.721837ms] [512.721837ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.719645 698 trace.go:205] Trace[635312357]: "GuaranteedUpdate etcd3" type:*core.Event (09-Feb-2021 18:15:44.485) (total time: 1233ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[635312357]: ---"initial value restored" 701ms (18:15:00.187) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[635312357]: ---"Transaction committed" 530ms (18:15:00.719) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[635312357]: [1.233726817s] [1.233726817s] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.848087 698 trace.go:205] Trace[993451380]: "Patch" url:/api/v1/namespaces/kube-system/events/coredns-coredns.1661fed9c31748aa,user-agent:speaker/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 18:15:44.485) (total time: 1362ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[993451380]: ---"About to apply patch" 702ms (18:15:00.187) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[993451380]: ---"Object stored in database" 659ms (18:15:00.847) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[993451380]: [1.362650765s] [1.362650765s] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: I0209 18:15:45.753235 698 trace.go:205] Trace[1352488654]: "Get" url:/apis/coordination.k8s.io/v1/namespaces/rook-ceph/leases/rook-ceph-cephfs-csi-ceph-com,user-agent:csi-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.2.0.35 (09-Feb-2021 18:15:45.250) (total time: 502ms): | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1352488654]: ---"About to write a response" 501ms (18:15:00.752) | |
| Feb 09 18:15:45 k3s-0 k3s[698]: Trace[1352488654]: [502.233254ms] [502.233254ms] END | |
| Feb 09 18:15:45 k3s-0 k3s[698]: F0209 18:15:45.836020 698 controllermanager.go:262] Failed to wait for apiserver being healthy: timed out waiting for the condition: failed to get apiserver /healthz status: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]poststarthook/start-kube-apiserver-admission-initializer ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[+]poststarthook/bootstrap-controller ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/scheduling/bootstrap-system-priority-classes ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/aggregator-reload-proxy-client-cert ok\n[+]poststarthook/start-kube-aggregator-informers ok\n[+]poststarthook/apiservice-registration-controller ok\n[+]poststarthook/apiservice-status-available-controller ok\n[+]poststarthook/kube-apiserver-autoregistration ok\n[+]autoregister-completion ok\n[+]poststarthook/apiservice-openapi-controller ok\nhealthz check failed") has prevented the request from succeeding | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 13396 [running]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/klog/v2.stacks(0xc000120001, 0xc01bef3400, 0x4b7, 0x4fe) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/klog/v2/klog.go:996 +0xb9 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/klog/v2.(*loggingT).output(0x6ecca40, 0xc000000003, 0x0, 0x0, 0xc00d903dc0, 0x6b58732, 0x14, 0x106, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/klog/v2/klog.go:945 +0x191 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/klog/v2.(*loggingT).printf(0x6ecca40, 0xc000000003, 0x0, 0x0, 0x458c2e9, 0x2e, 0xc00a7a57a8, 0x1, 0x1) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/klog/v2/klog.go:733 +0x17a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/klog/v2.Fatalf(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/klog/v2/klog.go:1456 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kubernetes/cmd/cloud-controller-manager/app.startControllers(0xc012fe50d8, 0x0, 0x4c8a220, 0xc013d27b90, 0xc0126218f0, 0x0, 0x8) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kubernetes/cmd/cloud-controller-manager/app/controllermanager.go:262 +0x73d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kubernetes/cmd/cloud-controller-manager/app.Run.func1(0x4c51220, 0xc00011c018) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kubernetes/cmd/cloud-controller-manager/app/controllermanager.go:179 +0x246 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kubernetes/cmd/cloud-controller-manager/app.Run(0xc012fe50d8, 0xc000100660, 0xc01aec7f10, 0x4) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kubernetes/cmd/cloud-controller-manager/app/controllermanager.go:185 +0xc30 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kubernetes/cmd/cloud-controller-manager/app.NewCloudControllerManagerCommand.func1(0xc00482c000, 0xc010ab52c0, 0x0, 0xa) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kubernetes/cmd/cloud-controller-manager/app/controllermanager.go:77 +0x20a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/spf13/cobra.(*Command).execute(0xc00482c000, 0xc001848500, 0xa, 0x10, 0xc00482c000, 0xc001848500) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/spf13/cobra/command.go:846 +0x2c2 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/spf13/cobra.(*Command).ExecuteC(0xc00482c000, 0x4, 0x4547b6d, 0x23) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/spf13/cobra/command.go:950 +0x375 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/spf13/cobra.(*Command).Execute(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/spf13/cobra/command.go:887 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/daemons/control.cloudControllerManager.func1(0xc00107d180, 0x4c511e0, 0xc001096640, 0xc001848500, 0xa, 0x10, 0xc00482c000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/daemons/control/server.go:945 +0x285 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/pkg/daemons/control.cloudControllerManager | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/daemons/control/server.go:930 +0x4f8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 1 [chan receive]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/agent.run(0x4c511e0, 0xc001096640, 0xc00a89fe30, 0x6a, 0x0, 0x0, 0x0, 0x0, 0xc00b581c00, 0x16, ...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/agent/run.go:119 +0x2b0 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/agent.Run(0x4c511e0, 0xc001096640, 0xc00a89fe30, 0x6a, 0x0, 0x0, 0x0, 0x0, 0xc00b581c00, 0x16, ...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/agent/run.go:170 +0x438 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cli/server.run(0xc000e869a0, 0x6ecd9e0, 0xc001376ea8, 0x48) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cli/server/server.go:283 +0x1778 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cli/server.Run(0xc000e869a0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cli/server/server.go:38 +0x65 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/urfave/cli.HandleAction(0x3d8c4e0, 0x46c3568, 0xc000e869a0, 0xc000e869a0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/urfave/cli/app.go:523 +0xfd | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/urfave/cli.Command.Run(0x44c5713, 0x6, 0x0, 0x0, 0x0, 0x0, 0x0, 0x44f9ed1, 0x15, 0xc000ff56a0, ...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/urfave/cli/command.go:174 +0x58e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/urfave/cli.(*App).Run(0xc000c9b340, 0xc000125b80, 0xb, 0xb, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/urfave/cli/app.go:276 +0x7d4 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: main.main() | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/cmd/server/main.go:47 +0x61a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 19 [runnable]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/klog/v2.(*loggingT).flushDaemon(0x6ecca40) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/klog/v2/klog.go:1131 +0x8b | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/klog/v2.init.0 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/klog/v2/klog.go:416 +0xd8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 20 [chan receive]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/klog.(*loggingT).flushDaemon(0x6ecc880) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/klog/klog.go:1010 +0x8b | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/klog.init.0 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/klog/klog.go:411 +0xd8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 28 [sleep]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: time.Sleep(0x3b9aca00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/runtime/time.go:188 +0xbf | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kubernetes/pkg/scheduler/framework/runtime.(*metricsRecorder).run(0xc000fdbd70) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kubernetes/pkg/scheduler/framework/runtime/metrics_recorder.go:88 +0x3f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/kubernetes/pkg/scheduler/framework/runtime.newMetricsRecorder | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kubernetes/pkg/scheduler/framework/runtime/metrics_recorder.go:60 +0x108 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 139 [chan receive]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil.(*MergeLogger).outputLoop(0xc000e1c2a0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil/merge_logger.go:173 +0x3b3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil.NewMergeLogger | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil/merge_logger.go:91 +0x85 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 458 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0018e9450, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0014e2540, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc00197f680) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 48 [chan receive]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil.(*MergeLogger).outputLoop(0xc000eb5340) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil/merge_logger.go:173 +0x3b3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil.NewMergeLogger | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil/merge_logger.go:91 +0x85 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 142 [chan receive]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil.(*MergeLogger).outputLoop(0xc000e1c580) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil/merge_logger.go:173 +0x3b3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil.NewMergeLogger | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil/merge_logger.go:91 +0x85 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 204 [chan receive]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.preparedGenericAPIServer.Run(0xc003008b40, 0xc000e7e0c0, 0x4b9b260, 0xc003008b40) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/genericapiserver.go:338 +0xc5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.preparedAPIAggregator.Run(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/apiserver.go:302 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kubernetes/cmd/kube-apiserver/app.Run(0xc00022db80, 0xc000e7e0c0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kubernetes/cmd/kube-apiserver/app/server.go:189 +0x18a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kubernetes/cmd/kube-apiserver/app.NewAPIServerCommand.func2(0xc00139e000, 0xc00000cb40, 0x0, 0x1e, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kubernetes/cmd/kube-apiserver/app/server.go:131 +0x10c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/spf13/cobra.(*Command).execute(0xc00139e000, 0xc00138e200, 0x1e, 0x20, 0xc00139e000, 0xc00138e200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/spf13/cobra/command.go:842 +0x47c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/spf13/cobra.(*Command).ExecuteC(0xc00139e000, 0x467cc96, 0x442c76, 0x46d07e8) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/spf13/cobra/command.go:950 +0x375 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/spf13/cobra.(*Command).Execute(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/spf13/cobra/command.go:887 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/daemons/executor.Embedded.APIServer.func1(0xc00139e000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/daemons/executor/embed.go:54 +0x2f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/pkg/daemons/executor.Embedded.APIServer | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/daemons/executor/embed.go:53 +0xaf | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 210 [syscall]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: os/signal.signal_recv(0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/runtime/sigqueue.go:147 +0x9d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: os/signal.loop() | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/os/signal/signal_unix.go:23 +0x25 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by os/signal.Notify.func1.1 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/os/signal/signal.go:150 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 211 [chan receive]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/rancher/wrangler/pkg/signals.SetupSignalHandler.func1(0xc00104aba0, 0xc000667710) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/wrangler/pkg/signals/signal.go:37 +0x34 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/github.com/rancher/wrangler/pkg/signals.SetupSignalHandler | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/wrangler/pkg/signals/signal.go:36 +0xe8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 212 [runnable]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/rancher/dynamiclistener/storage/kubernetes.New.func1(0xc0000f7820, 0xc0010e9260, 0x4c511e0, 0xc001096640) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/dynamiclistener/storage/kubernetes/controller.go:49 +0x109 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/github.com/rancher/dynamiclistener/storage/kubernetes.New | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/dynamiclistener/storage/kubernetes/controller.go:40 +0xea | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 213 [sleep]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: time.Sleep(0x6fc23ac00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/runtime/time.go:188 +0xbf | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/rancher/dynamiclistener.(*listener).WrapExpiration.func1(0xc00111abb0, 0x5a, 0x4c511e0, 0xc001097e40) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/dynamiclistener/listener.go:156 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/github.com/rancher/dynamiclistener.(*listener).WrapExpiration | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/dynamiclistener/listener.go:155 +0x87 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 214 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.(*pipe).Read(0xc00104bf80, 0xc0000e05fe, 0xa02, 0xa02, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/pipe.go:57 +0xe7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.(*PipeReader).Read(0xc00038b3e0, 0xc0000e05fe, 0xa02, 0xa02, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/pipe.go:134 +0x4c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Scanner).Scan(0xc010f39f38, 0x1) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/scan.go:214 +0xa9 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/sirupsen/logrus.(*Entry).writerScanner(0xc0010e92d0, 0xc00038b3e0, 0xc0000f7950) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/sirupsen/logrus/writer.go:59 +0xb4 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/github.com/sirupsen/logrus.(*Entry).WriterLevel | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/sirupsen/logrus/writer.go:51 +0x1b7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 215 [runnable]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.runtime_pollWait(0x7faa1e6257d0, 0x72, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).wait(0xc0010da418, 0x72, 0x0, 0x0, 0x44c714f) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).waitRead(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*FD).Accept(0xc0010da400, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_unix.go:394 +0x1fc | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*netFD).accept(0xc0010da400, 0x44beabe, 0x8, 0x7faa1daef6b8) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/fd_unix.go:172 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*TCPListener).accept(0xc00124b740, 0x203003, 0x203003, 0x31ce65e) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/tcpsock_posix.go:139 +0x32 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*TCPListener).AcceptTCP(0xc00124b740, 0x40f230, 0xc00dd0ebe0, 0x50) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/tcpsock.go:248 +0x65 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/rancher/dynamiclistener.tcpKeepAliveListener.Accept(0xc00124b740, 0x7faa1d8d46f8, 0x50, 0x50, 0x7faa453077d0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/dynamiclistener/tcp.go:31 +0x2f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/rancher/dynamiclistener.(*listener).Accept(0xc00111abb0, 0x0, 0xc0033fbe00, 0x46f37b, 0x6d5546460) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/dynamiclistener/listener.go:232 +0x7b | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*listener).Accept(0xc0011a8320, 0xc0033fbe78, 0x18, 0xc000da7680, 0x8daf0c) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/tls.go:67 +0x37 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*Server).Serve(0xc001173180, 0x4c0d5e0, 0xc0011a8320, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2937 +0x266 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).initClusterAndHTTPS.func1(0xc001173180, 0x4c0d5e0, 0xc0011a8320) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/https.go:80 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/pkg/cluster.(*Cluster).initClusterAndHTTPS | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/https.go:79 +0x287 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 216 [chan receive]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).initClusterAndHTTPS.func2(0x4c511e0, 0xc001096640, 0xc001173180) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/https.go:86 +0x48 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/pkg/cluster.(*Cluster).initClusterAndHTTPS | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/https.go:85 +0x2c6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 217 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: database/sql.(*DB).connectionOpener(0xc00117edd0, 0x4c511e0, 0xc001097e80) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/database/sql/sql.go:1126 +0xf5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by database/sql.OpenDB | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/database/sql/sql.go:740 +0x12a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 27045 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc013ce6f70) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:149 +0x1d6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:110 +0x128 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 175 [semacquire]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: sync.runtime_Semacquire(0xc000537ff8) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/runtime/sema.go:56 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: sync.(*WaitGroup).Wait(0xc000537ff0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/sync/waitgroup.go:130 +0x65 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/logstructured.(*LogStructured).ttlEvents.func1(0xc000537ff0, 0xc000e7ec00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/logstructured/logstructured.go:264 +0x2b | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/logstructured.(*LogStructured).ttlEvents | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/logstructured/logstructured.go:263 +0x9c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 228 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc005340380, 0xc0148b9e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:115 +0x265 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc005340380, 0xc0148b9d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc005340380, 0xc0148b9d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc005340380, 0xc0148b9c00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc005340380, 0xc0148b9c00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc005340380, 0xc0148b9b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc005340380, 0xc0148b9b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc005340380, 0xc0148b9b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc005340380, 0xc0148b9b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc0192f1500, 0xc0148b9a00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc0192f1500, 0xc0148b9a00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc0192f1500, 0xc0148b9a00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc0192f1500, 0xc0148b9a00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc0192f1500, 0xc0148b9a00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc0192f1500, 0xc0148b9800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc0192f1500, 0xc0148b9600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc0192f1500, 0xc0148b9400) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc0192f1500, 0xc018de5a00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc0192f1500, 0xc018de5a00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc0192f1500, 0xc018de5a00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc0192f1500, 0xc018de5a00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc0192f1500, 0xc018de5a00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc0192f1500, 0xc018de5a00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).serve(0xc000726140, 0x4c511e0, 0xc000555080) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 229 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc0439c9600, 0x4c29860, 0xc041899a00, 0xc0439d7d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc04302d8f0, 0xc0275e5d40, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc0439d7d00, 0xc04399fd90, 0x44ccc4d, 0x9, 0xc0439f5100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc041899a00, 0xc0439d7d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentHandlerFunc.func1(0x4c29a20, 0xc04302d880, 0xc0439d7d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:406 +0x25e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0439d4960, 0x4c29a20, 0xc04302d880, 0xc0439d7d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc04302d880, 0xc0439d7d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0439d9710, 0x4c29a20, 0xc04302d880, 0xc0439d7d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiextensions-apiserver/pkg/apiserver.(*crdHandler).ServeHTTP(0xc0010e4300, 0x4c29a20, 0xc04302d880, 0xc0439d7d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiextensions-apiserver/pkg/apiserver/customresource_handler.go:379 +0x867 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc0047f9dc0, 0x4c29a20, 0xc04302d880, 0xc0439d7d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0014f3570, 0x4c29a20, 0xc04302d880, 0xc0439d7d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x4503919, 0x17, 0xc0018222d0, 0xc0014f3570, 0x4c29a20, 0xc04302d880, 0xc0439d7d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc018080a80, 0x4c29a20, 0xc04302d880, 0xc0439d7d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:254 +0x20f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc000e83030, 0x4c29a20, 0xc04302d880, 0xc0439d7d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc04302d880, 0xc0439d7d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e714870, 0x4c29a20, 0xc04302d880, 0xc0439d7d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc02450f500, 0x4c29a20, 0xc04302d880, 0xc0439d7d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc04302d880, 0xc0439d7d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc04302d880, 0xc0439d7d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc04302d880, 0xc0439d7d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc04302d880, 0xc0439d7d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc04302d880, 0xc0439d7d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc04302d880, 0xc0439d7d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc04302d880, 0xc0439d7d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc04302d880, 0xc0439d7d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc04302d880, 0xc0439d7b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc04302d880, 0xc0439d7b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc04302d880, 0xc0439d7b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc04302d880, 0xc0439d7b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc04302d880, 0xc0439d7b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc04302d880, 0xc0439d7a00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc04302d880, 0xc0439d7a00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc04302d880, 0xc0439d7900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc04302d880, 0xc0439d7900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc04302d880, 0xc0439d7900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc04302d880, 0xc0439d7900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc042f429a0, 0xc0439d7800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc042f429a0, 0xc0439d7800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc042f429a0, 0xc0439d7800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc042f429a0, 0xc0439d7800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc042f429a0, 0xc0439d7800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc042f429a0, 0xc0439d7600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc042f429a0, 0xc0439d7400) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc042f429a0, 0xc0439d7200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc042f429a0, 0xc0439d7000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc042f429a0, 0xc0439d7000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc042f429a0, 0xc0439d7000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc042f429a0, 0xc0439d7000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc042f429a0, 0xc0439d7000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc042f429a0, 0xc0439d7000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).serve(0xc0007261e0, 0x4c511e0, 0xc0011e1ac0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 460 [IO wait]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.runtime_pollWait(0x7faa1e2024b0, 0x72, 0x4b9c820) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).wait(0xc00126d418, 0x72, 0x4b9c800, 0x6c56e88, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).waitRead(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*FD).Read(0xc00126d400, 0xc00159e000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*netFD).Read(0xc00126d400, 0xc00159e000, 0x8000, 0x8000, 0x203009, 0x800000601, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*conn).Read(0xc00043a1e8, 0xc00159e000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/net.go:182 +0x8e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).Read(0xc0014e23c0, 0xc001415b58, 0x9, 0x9, 0xc00159e016, 0x10000c0016a2400, 0x7faa1d558d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.ReadAtLeast(0x4b8f420, 0xc0014e23c0, 0xc001415b58, 0x9, 0x9, 0x9, 0x6022d149, 0xc001508dd0, 0x49dca6) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:314 +0x87 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.ReadFull(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:333 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc001415b58, 0x9, 0x9, 0x4b8f420, 0xc0014e23c0, 0x0, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc001415b20, 0xc0262252a0, 0x6eca980, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc00197f680, 0xc000629470, 0x46c8338) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000378480, 0x4c8a640, 0xc00197f680) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000378480, 0x4c8a640, 0xc00197f680) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 27750 [IO wait]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.runtime_pollWait(0x7faa1d607048, 0x72, 0x4b9c820) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).wait(0xc00c5a4218, 0x72, 0x4b9c800, 0x6c56e88, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).waitRead(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*FD).Read(0xc00c5a4200, 0xc0198e5000, 0x730, 0x730, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*netFD).Read(0xc00c5a4200, 0xc0198e5000, 0x730, 0x730, 0x47704168732b7358, 0x8, 0x2b52396c38386637) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*conn).Read(0xc01f5d7608, 0xc0198e5000, 0x730, 0x730, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/net.go:182 +0x8e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*atLeastReader).Read(0xc009a0f340, 0xc0198e5000, 0x730, 0x730, 0x58366b2b385a6332, 0x4239416f38655366, 0xc01a42a668) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:779 +0x62 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bytes.(*Buffer).ReadFrom(0xc00c33c280, 0x4b8f660, 0xc009a0f340, 0x40cf45, 0x3f2ee80, 0x41c0be0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bytes/buffer.go:204 +0xb1 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readFromUntil(0xc00c33c000, 0x7faa1d8ea7d8, 0xc0079df560, 0x5, 0xc0079df560, 0x516b4e514d514441) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:801 +0xf3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readRecordOrCCS(0xc00c33c000, 0x0, 0x0, 0x52524e4259625158) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:608 +0x115 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readRecord(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:576 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).Read(0xc00c33c000, 0xc028530000, 0x1000, 0x1000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:1252 +0x15f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*persistConn).Read(0xc00d63ad80, 0xc028530000, 0x1000, 0x1000, 0x406b70, 0x60, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/transport.go:1887 +0x77 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).fill(0xc014b8c720) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:101 +0x105 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).Peek(0xc014b8c720, 0x1, 0xc01c04f980, 0x4be080, 0xc0008a0080, 0xf, 0xf) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:139 +0x4f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*persistConn).readLoop(0xc00d63ad80) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/transport.go:2040 +0x1a8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by net/http.(*Transport).dialConn | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/transport.go:1708 +0xcb7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 39971 [IO wait]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.runtime_pollWait(0x7faa1d31fdb8, 0x72, 0x4b9c820) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).wait(0xc011c45b18, 0x72, 0x4b9c800, 0x6c56e88, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).waitRead(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*FD).Read(0xc011c45b00, 0xc028cfe800, 0x746, 0x746, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*netFD).Read(0xc011c45b00, 0xc028cfe800, 0x746, 0x746, 0x203009, 0x2c65646f6e20656d, 0x65202c656e6f7a20) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*conn).Read(0xc007c2f970, 0xc028cfe800, 0x746, 0x746, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/net.go:182 +0x8e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*atLeastReader).Read(0xc024435b40, 0xc028cfe800, 0x746, 0x746, 0x207365646f6e206f, 0x7461732074616874, 0xc011983a58) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:779 +0x62 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bytes.(*Buffer).ReadFrom(0xc011c65080, 0x4b8f660, 0xc024435b40, 0x40cf45, 0x3f2ee80, 0x43ace20) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bytes/buffer.go:204 +0xb1 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readFromUntil(0xc011c64e00, 0x4b987a0, 0xc007c2f970, 0x5, 0xc007c2f970, 0x6f206d7573207473) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:801 +0xf3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readRecordOrCCS(0xc011c64e00, 0x0, 0x0, 0x696b3a66222c7d7b) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:608 +0x115 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readRecord(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:576 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).Read(0xc011c64e00, 0xc035fa3181, 0x1, 0x1, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:1252 +0x15f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*connReader).backgroundRead(0xc035fa3170) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:690 +0x58 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by net/http.(*connReader).startBackgroundRead | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:686 +0xd5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 177 [chan receive]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/logstructured.(*LogStructured).ttlEvents.func3(0xc000537ff0, 0xc00091a190, 0x4c511e0, 0xc001096640, 0xc000e7ec00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/logstructured/logstructured.go:289 +0x12a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/logstructured.(*LogStructured).ttlEvents | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/logstructured/logstructured.go:287 +0x130 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 203 [IO wait]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.runtime_pollWait(0x7faa1e625518, 0x72, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).wait(0xc0008d3698, 0x72, 0x0, 0x0, 0x44c714f) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).waitRead(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*FD).Accept(0xc0008d3680, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_unix.go:394 +0x1fc | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*netFD).accept(0xc0008d3680, 0xc0073fac28, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/fd_unix.go:172 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*UnixListener).accept(0xc000541920, 0xc0000a2e38, 0xc0000a2e40, 0x18) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/unixsock_posix.go:162 +0x32 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*UnixListener).Accept(0xc000541920, 0x46c82f8, 0xc000378480, 0x4c87340, 0xc0073fac28) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/unixsock.go:260 +0x65 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).Serve(0xc000378480, 0x4c2f8e0, 0xc000541920, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:597 +0x216 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/endpoint.Listen.func1(0xc000378480, 0x4c2f8e0, 0xc000541920, 0x4c511e0, 0xc001096640) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/endpoint/endpoint.go:80 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/endpoint.Listen | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/endpoint/endpoint.go:79 +0x2e5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 202 [chan receive]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/logstructured.(*LogStructured).ttl(0xc00091a190, 0x4c511e0, 0xc001096640) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/logstructured/logstructured.go:304 +0xdd | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/logstructured.(*LogStructured).Start | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/logstructured/logstructured.go:42 +0x1d5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 2292 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc003a79e10, 0xc002b89da0, 0xc002dc99e0, 0xc00076a7e0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:361 +0x16f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:355 +0x2a5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 2165 [chan receive]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/server.(*watcher).Start.func1(0xc002fdb2c0, 0xe, 0x4c511e0, 0xc002fdb300, 0xc0072445d0, 0x23, 0xc00698e690) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/server/watch.go:74 +0x194 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/server.(*watcher).Start | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/server/watch.go:63 +0x346 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 2172 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc00122a000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1f7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8bb | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 2169 [IO wait]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.runtime_pollWait(0x7faa1e10a2f0, 0x72, 0x4b9c820) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).wait(0xc005bc3f98, 0x72, 0x4b9c800, 0x6c56e88, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).waitRead(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*FD).Read(0xc005bc3f80, 0xc002e8c000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*netFD).Read(0xc005bc3f80, 0xc002e8c000, 0x8000, 0x8000, 0x203002, 0x800000601, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*conn).Read(0xc00217c818, 0xc002e8c000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/net.go:182 +0x8e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).Read(0xc0083b1860, 0xc0020aa658, 0x9, 0x9, 0xc002e8c027, 0x10000c0016a2800, 0x7faa1d4233a0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.ReadAtLeast(0x4b8f420, 0xc0083b1860, 0xc0020aa658, 0x9, 0x9, 0x9, 0x6022d148, 0xc001525dd0, 0x49dca6) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:314 +0x87 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.ReadFull(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:333 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0020aa658, 0x9, 0x9, 0x4b8f420, 0xc0083b1860, 0x0, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0020aa620, 0xc02955a4c0, 0x6eca980, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc006e68900, 0xc0075d4a50, 0x46c8338) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000378480, 0x4c8a640, 0xc006e68900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000378480, 0x4c8a640, 0xc006e68900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 2163 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc003a79ba0, 0xc0030de9a0, 0xc002b89500) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 2162 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc0088894a0, 0xc0069feb10, 0x5, 0x5, 0x100, 0x80, 0x7f) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc0088894a0, 0xc0069feb10, 0x5, 0x5, 0xc00519eee0, 0x46d0ae8, 0xc002e43960) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0075d4540, 0xc0069feb10, 0x5, 0x5, 0xc0016a2800, 0xc002e43988, 0x972e3c) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.ReadAtLeast(0x4b931c0, 0xc0075d4540, 0xc0069feb10, 0x5, 0x5, 0x5, 0xc00519efe0, 0xc002f1c9e2, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:314 +0x87 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.ReadFull(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:333 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc001eabd00, 0xc0069feb10, 0x5, 0x5, 0x3f19780, 0x2, 0x2) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc0069feb00, 0x7fffffff, 0xc002f1c9e0, 0x6, 0x6, 0x0, 0x0, 0x4c1b360) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc0069feb00, 0xc001eabd00, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc002f1c901, 0x0, ...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc0069feb00, 0x7faa1e112690, 0x6f03c30, 0xc001eabd00, 0x0, 0x0, 0x4321000, 0xc0088897c0, 0x7fffffff, 0x0, ...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc005bc3e80, 0x4321000, 0xc0088897c0, 0x0, 0xc002e43d20, 0x44b1b3) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc005bc3e80, 0xc002e43d60, 0x46a2b7) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0058feb40, 0xc002e43e10, 0xc002e43de0, 0x44bbff, 0xc002b89320) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0058feb40, 0x4321000, 0xc0088897c0, 0x50, 0x42a3820) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc0069feb20, 0x4321000, 0xc0088897c0, 0xc002e43ef4, 0x2) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc0074f5980, 0xc002e43ef0, 0x2, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc003a79ba0, 0x4c851e0, 0xc0074f5980) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 2161 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc005bffc00, 0xc0058feb40, 0x4c512a0, 0xc0075d44b0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 2159 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc003a79ba0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 2164 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc008889630, 0xc0069fed10, 0x5, 0x5, 0x0, 0x0, 0xc007244570) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc008889630, 0xc0069fed10, 0x5, 0x5, 0xc00519ef60, 0x46d0ae8, 0xc001524778) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0075d46c0, 0xc0069fed10, 0x5, 0x5, 0xc0016a2800, 0xc0015247a0, 0x9742dc) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.ReadAtLeast(0x4b931c0, 0xc0075d46c0, 0xc0069fed10, 0x5, 0x5, 0x5, 0x3f9c940, 0xc00217c810, 0x51) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:314 +0x87 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.ReadFull(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:333 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc001eabe00, 0xc0069fed10, 0x5, 0x5, 0x3f19780, 0x8, 0x7faa1e20adc0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc0069fed00, 0x400000, 0x40f230, 0xc0018233b0, 0x90, 0x90, 0x4122360, 0xc001524970) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc0069fed00, 0xc001eabe00, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc0074f5a90, 0x10, ...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc0069fed00, 0x7faa1e112690, 0x6f03c30, 0xc001eabe00, 0x0, 0x0, 0x4294f40, 0xc0074f5aa0, 0x400000, 0x0, ...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc0068fa0c0, 0x4294f40, 0xc0074f5aa0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc0074f5a60, 0x4c511e0, 0xc002fdb300, 0xc00698e690) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/server.(*KVServerBridge).Watch(0xc00126b1b0, 0x4c85240, 0xc0074f5a60, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/server/watch.go:26 +0x142 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x4270a00, 0xc00126b1b0, 0x4c71560, 0xc0068fa0c0, 0x6f03c30, 0xc001eabe00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000378480, 0x4c8a640, 0xc003887680, 0xc001eabe00, 0xc0005416b0, 0x6c17e40, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000378480, 0x4c8a640, 0xc003887680, 0xc001eabe00, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc00175d130, 0xc000378480, 0x4c8a640, 0xc003887680, 0xc001eabe00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 252 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc01c53f500, 0x4c29860, 0xc0153dba00, 0xc01c545e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc00e795730, 0xc0039271e0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc01c545e00, 0xc01c638e70, 0x44ccc4d, 0x9, 0xc001447a78) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc0153dba00, 0xc01c545e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc01c61fa70, 0xc00e7956c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc01c61fa70, 0xc00e7956c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc00e795650, 0xc01c545e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc00e795650, 0xc01c545e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc018081b00, 0x4c29a20, 0xc00e795650, 0xc01c545e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:254 +0x20f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc00e795650, 0xc01c545e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc00e795650, 0xc01c545e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc00e795650, 0xc01c545e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc00e795650, 0xc01c545e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc00e795650, 0xc01c545e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc00e795650, 0xc01c545e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc00e795650, 0xc01c545e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc00e795650, 0xc01c545e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc00e795650, 0xc01c545c00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc00e795650, 0xc01c545c00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc00e795650, 0xc01c545c00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc00e795650, 0xc01c545c00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc00e795650, 0xc01c545c00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc00e795650, 0xc01c545b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc00e795650, 0xc01c545b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc00e795650, 0xc01c545a00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc00e795650, 0xc01c545a00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc00e795650, 0xc01c545a00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc00e795650, 0xc01c545a00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc01c5d4620, 0xc01c545900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc01c5d4620, 0xc01c545900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc01c5d4620, 0xc01c545900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc01c5d4620, 0xc01c545900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc01c5d4620, 0xc01c545900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc01c5d4620, 0xc01c545700) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc01c5d4620, 0xc01c545500) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc01c5d4620, 0xc01c545300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc01c5d4620, 0xc01c545100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc01c5d4620, 0xc01c545100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc01c5d4620, 0xc01c545100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc01c5d4620, 0xc01c545100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc01c5d4620, 0xc01c545100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc01c5d4620, 0xc01c545100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).serve(0xc000726c80, 0x4c511e0, 0xc0011af480) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 3333 [chan receive]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4c511e0, 0xc000370300, 0xc000555a10, 0xc0043c0060) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 3212 [chan receive]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/broadcaster.(*Broadcaster).stream(0xc000555a10, 0xc007209aa0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/broadcaster/broadcaster.go:64 +0x105 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/broadcaster.(*Broadcaster).start | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/broadcaster/broadcaster.go:58 +0x79 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 10797 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/logstructured.(*LogStructured).ttl.func1(0x4c511e0, 0xc001096640, 0xc000537fe0, 0xc00091a190, 0xc006920c80) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/logstructured/logstructured.go:306 +0xea | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/logstructured.(*LogStructured).ttl | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/logstructured/logstructured.go:305 +0xc5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 205 [runnable]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc00139ca20) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 206 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc00139cba0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 2155 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc003a79ad0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:149 +0x1d6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:110 +0x128 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 2158 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: context.propagateCancel.func1(0x4c525a0, 0xc0074f58d0, 0x4beede0, 0xc002fdaec0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/context/context.go:279 +0xda | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by context.propagateCancel | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/context/context.go:278 +0x1fb | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 1927 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc000568000, 0xc000fe0120, 0x4c512a0, 0xc002bb55c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 263 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc01bd90180, 0x4c29860, 0xc019644428, 0xc01bb11b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc00315e850, 0xc00204eea0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc01bb11b00, 0xc01016d1e0, 0x44ccc4d, 0x9, 0xc001575848) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc019644428, 0xc01bb11b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc01bd933e0, 0xc00315e7e0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc01bd933e0, 0xc00315e7e0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc00315e770, 0xc01bb11b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc00315e770, 0xc01bb11b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e72c320, 0x4c29a20, 0xc00315e770, 0xc01bb11b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc00315e770, 0xc01bb11b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc00315e770, 0xc01bb11b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc00315e770, 0xc01bb11b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc00315e770, 0xc01bb11b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc00315e770, 0xc01bb11b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc00315e770, 0xc01bb11b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc00315e770, 0xc01bb11b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc00315e770, 0xc01bb11b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc00315e770, 0xc01bb11b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc00315e770, 0xc01bb11900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc00315e770, 0xc01bb11900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc00315e770, 0xc01bb11900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc00315e770, 0xc01bb11900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc00315e770, 0xc01bb11900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc00315e770, 0xc01bb11800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc00315e770, 0xc01bb11800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc00315e770, 0xc01bb11700) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc00315e770, 0xc01bb11700) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc00315e770, 0xc01bb11700) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc00315e770, 0xc01bb11700) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc016e59dc0, 0xc01bb11600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc016e59dc0, 0xc01bb11600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc016e59dc0, 0xc01bb11600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc016e59dc0, 0xc01bb11600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc016e59dc0, 0xc01bb11600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc016e59dc0, 0xc01bb11400) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc016e59dc0, 0xc01bb11200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc016e59dc0, 0xc01bb11000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc016e59dc0, 0xc01b7e6700) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc016e59dc0, 0xc01b7e6700) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc016e59dc0, 0xc01b7e6700) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc016e59dc0, 0xc01b7e6700) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc016e59dc0, 0xc01b7e6700) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc016e59dc0, 0xc01b7e6700) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).serve(0xc001402280, 0x4c511e0, 0xc0011af200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 278 [IO wait]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.runtime_pollWait(0x7faa1e10aa30, 0x72, 0x4b9c820) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).wait(0xc0010da618, 0x72, 0x4b9c800, 0x6c56e88, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).waitRead(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*FD).Read(0xc0010da600, 0xc001401000, 0x745, 0x745, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*netFD).Read(0xc0010da600, 0xc001401000, 0x745, 0x745, 0x203006, 0x88, 0x90) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*conn).Read(0xc00038b438, 0xc001401000, 0x745, 0x745, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/net.go:182 +0x8e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*atLeastReader).Read(0xc01bca13a0, 0xc001401000, 0x745, 0x745, 0x3c5c160, 0xc043a52840, 0xc00144d2b0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:779 +0x62 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bytes.(*Buffer).ReadFrom(0xc00107de80, 0x4b8f660, 0xc01bca13a0, 0x40cf45, 0x3f2ee80, 0x43ace20) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bytes/buffer.go:204 +0xb1 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readFromUntil(0xc00107dc00, 0x4b987a0, 0xc00038b438, 0x5, 0xc00038b438, 0xc043d83200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:801 +0xf3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readRecordOrCCS(0xc00107dc00, 0x0, 0x0, 0x4aeeb7) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:608 +0x115 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readRecord(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:576 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).Read(0xc00107dc00, 0xc001456000, 0x1000, 0x1000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:1252 +0x15f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*connReader).Read(0xc000a81020, 0xc001456000, 0x1000, 0x1000, 0xc00a908000, 0x30a, 0x500) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:798 +0x1ad | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).fill(0xc0014449c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:101 +0x105 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).ReadSlice(0xc0014449c0, 0xc00144d90a, 0x40bc3f, 0xc00144d988, 0x40f230, 0xc01c4de900, 0x100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:360 +0x3d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).ReadLine(0xc0014449c0, 0xc01c4de900, 0x47d8d4, 0xc0191e8800, 0x0, 0xc01bb08120, 0x301) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:389 +0x34 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/textproto.(*Reader).readLineSlice(0xc01bb08120, 0xc01c4de900, 0x0, 0xc028b70180, 0xc00144da08, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/textproto/reader.go:58 +0x6c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/textproto.(*Reader).ReadLine(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/textproto/reader.go:39 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.readRequest(0xc0014449c0, 0x0, 0xc01c4de900, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/request.go:1012 +0xaa | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).readRequest(0xc000f4f860, 0x4c511e0, 0xc0014500c0, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:984 +0x19a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).serve(0xc000f4f860, 0x4c511e0, 0xc0014500c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1851 +0x705 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 208 [runnable]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc0015ecba0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 209 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc0015ecd20) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 1486 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc0016187d0, 0xc00186fe90, 0x5, 0x5, 0x0, 0x0, 0xc00154aa20) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc0016187d0, 0xc00186fe90, 0x5, 0x5, 0xc00154a9e0, 0x46d0ae8, 0xc003032778) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc002f54360, 0xc00186fe90, 0x5, 0x5, 0xc00044b000, 0xc0030327a0, 0x9742dc) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.ReadAtLeast(0x4b931c0, 0xc002f54360, 0xc00186fe90, 0x5, 0x5, 0x5, 0x3f9c940, 0xc000011748, 0x35) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:314 +0x87 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.ReadFull(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:333 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc0018f9000, 0xc00186fe90, 0x5, 0x5, 0x3f19780, 0x8, 0x7faa1e20adc0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc00186fe80, 0x400000, 0x40f428, 0x7faa1e10cf10, 0xc002c88ab0, 0x90, 0x90, 0xc003032970) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc00186fe80, 0xc0018f9000, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0x7faa1e119c10, 0xc002f50240, ...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc00186fe80, 0x7faa1e112690, 0x6f03c30, 0xc0018f9000, 0x0, 0x0, 0x4294f40, 0xc002f50250, 0x400000, 0x0, ...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc000747740, 0x4294f40, 0xc002f50250, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc002f50210, 0x4c511e0, 0xc002f32680, 0xc0006189a0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/server.(*KVServerBridge).Watch(0xc00126b1b0, 0x4c85240, 0xc002f50210, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/rancher/kine/pkg/server/watch.go:26 +0x142 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x4270a00, 0xc00126b1b0, 0x4c71560, 0xc000747740, 0x6f03c30, 0xc0018f9000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000378480, 0x4c8a640, 0xc00217a600, 0xc0018f9000, 0xc0005416b0, 0x6c17e40, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000378480, 0x4c8a640, 0xc00217a600, 0xc0018f9000, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc001872330, 0xc000378480, 0x4c8a640, 0xc00217a600, 0xc0018f9000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 290 [chan receive]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc0015ecea0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 291 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc0015ed020) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 1477 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc0010bad00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:149 +0x1d6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:110 +0x128 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 292 [runnable]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc001719140) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 1553 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc00075cf70, 0xc0032b1230) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:257 +0x139 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:147 +0xda | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 355 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc0017fa1c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 354 [chan receive]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc000408b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 861 [IO wait]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.runtime_pollWait(0x7faa1e210350, 0x72, 0x4b9c820) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).wait(0xc001771798, 0x72, 0x4b9c800, 0x6c56e88, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).waitRead(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*FD).Read(0xc001771780, 0xc00076c000, 0x72e, 0x72e, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*netFD).Read(0xc001771780, 0xc00076c000, 0x72e, 0x72e, 0x203000, 0x7fdafb, 0xc000486160) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*conn).Read(0xc00126a378, 0xc00076c000, 0x72e, 0x72e, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/net.go:182 +0x8e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*atLeastReader).Read(0xc0017f0860, 0xc00076c000, 0x72e, 0x72e, 0x14c, 0x729, 0xc0028452b0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:779 +0x62 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bytes.(*Buffer).ReadFrom(0xc000486280, 0x4b8f660, 0xc0017f0860, 0x40cf45, 0x3f2ee80, 0x43ace20) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bytes/buffer.go:204 +0xb1 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readFromUntil(0xc000486000, 0x4b987a0, 0xc00126a378, 0x5, 0xc00126a378, 0x13b) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:801 +0xf3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readRecordOrCCS(0xc000486000, 0x0, 0x0, 0x4aeeb7) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:608 +0x115 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readRecord(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:576 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).Read(0xc000486000, 0xc001814000, 0x1000, 0x1000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:1252 +0x15f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*connReader).Read(0xc0016b0a50, 0xc001814000, 0x1000, 0x1000, 0xc0020f1400, 0xc5, 0x247) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:798 +0x1ad | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).fill(0xc001800480) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:101 +0x105 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).ReadSlice(0xc001800480, 0xc00284590a, 0x40bc3f, 0xc002845988, 0x40f230, 0xc001071000, 0x100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:360 +0x3d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).ReadLine(0xc001800480, 0xc001071000, 0x47d8d4, 0xc00077b400, 0x0, 0x3, 0xc5) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:389 +0x34 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/textproto.(*Reader).readLineSlice(0xc0016b0a80, 0xc001071000, 0x0, 0x0, 0xc002845a08, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/textproto/reader.go:58 +0x6c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/textproto.(*Reader).ReadLine(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/textproto/reader.go:39 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.readRequest(0xc001800480, 0x0, 0xc001071000, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/request.go:1012 +0xaa | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).readRequest(0xc0007cc780, 0x4c511e0, 0xc000d85440, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:984 +0x19a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).serve(0xc0007cc780, 0x4c511e0, 0xc000d85440) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1851 +0x705 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 296 [runnable]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc0017194a0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 297 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc0017195c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 298 [runnable]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc0017196e0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 299 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc001719800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 2171 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudget).periodicallyRefresh(0xc00519f0e0, 0xc002b89da0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:64 +0xe5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:56 +0x6e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 2167 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc008889860, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0083b18c0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc006e68900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 353 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc0014512c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 300 [runnable]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc00177e660) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 373 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc001772600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 313 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc013c7bd80, 0x4c29860, 0xc0153dbe50, 0xc011c95d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc011d2f030, 0xc002f221a0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc011c95d00, 0xc00175f4a0, 0x44ccc4d, 0x9, 0xc0018bf848) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc0153dbe50, 0xc011c95d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc013c761e0, 0xc011d2efc0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc013c761e0, 0xc011d2efc0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc011d2ef50, 0xc011c95d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc011d2ef50, 0xc011c95d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e72c320, 0x4c29a20, 0xc011d2ef50, 0xc011c95d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc011d2ef50, 0xc011c95d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc011d2ef50, 0xc011c95d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc011d2ef50, 0xc011c95d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc011d2ef50, 0xc011c95d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc011d2ef50, 0xc011c95d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc011d2ef50, 0xc011c95d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc011d2ef50, 0xc011c95d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc011d2ef50, 0xc011c95d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc011d2ef50, 0xc011c95d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc011d2ef50, 0xc011c95b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc011d2ef50, 0xc011c95b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc011d2ef50, 0xc011c95b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc011d2ef50, 0xc011c95b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc011d2ef50, 0xc011c95b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc011d2ef50, 0xc011c95a00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc011d2ef50, 0xc011c95a00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc011d2ef50, 0xc011c95900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc011d2ef50, 0xc011c95900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc011d2ef50, 0xc011c95900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc011d2ef50, 0xc011c95900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc0120fd7a0, 0xc011c95800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc0120fd7a0, 0xc011c95800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc0120fd7a0, 0xc011c95800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc0120fd7a0, 0xc011c95800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc0120fd7a0, 0xc011c95800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc0120fd7a0, 0xc011c95600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc0120fd7a0, 0xc011c95400) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc0120fd7a0, 0xc011c95200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc0120fd7a0, 0xc00e78c600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc0120fd7a0, 0xc00e78c600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc0120fd7a0, 0xc00e78c600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc0120fd7a0, 0xc00e78c600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc0120fd7a0, 0xc00e78c600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc0120fd7a0, 0xc00e78c600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).serve(0xc0007272c0, 0x4c511e0, 0xc0016df9c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 314 [IO wait]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.runtime_pollWait(0x7faa1e10a038, 0x72, 0x4b9c820) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).wait(0xc000722f98, 0x72, 0x4b9c800, 0x6c56e88, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).waitRead(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*FD).Read(0xc000722f80, 0xc0018d4000, 0x90b, 0x90b, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*netFD).Read(0xc000722f80, 0xc0018d4000, 0x90b, 0x90b, 0x203000, 0x7fdafb, 0xc00183ebe0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*conn).Read(0xc0001211f8, 0xc0018d4000, 0x90b, 0x90b, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/net.go:182 +0x8e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*atLeastReader).Read(0xc0018b8be0, 0xc0018d4000, 0x90b, 0x90b, 0x493, 0x906, 0xc0014ad2b0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:779 +0x62 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bytes.(*Buffer).ReadFrom(0xc00183ed00, 0x4b8f660, 0xc0018b8be0, 0x40cf45, 0x3f2ee80, 0x43ace20) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bytes/buffer.go:204 +0xb1 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readFromUntil(0xc00183ea80, 0x4b987a0, 0xc0001211f8, 0x5, 0xc0001211f8, 0x482) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:801 +0xf3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readRecordOrCCS(0xc00183ea80, 0x0, 0x0, 0x4aeeb7) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:608 +0x115 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readRecord(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:576 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).Read(0xc00183ea80, 0xc0018d2000, 0x1000, 0x1000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:1252 +0x15f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*connReader).Read(0xc0018ce090, 0xc0018d2000, 0x1000, 0x1000, 0xc000e51400, 0xc5, 0x247) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:798 +0x1ad | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).fill(0xc0018b2c00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:101 +0x105 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).ReadSlice(0xc0018b2c00, 0xc0014ad90a, 0x40bc3f, 0xc0014ad988, 0x40f428, 0x7faa1e2df310, 0xc0013ed600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:360 +0x3d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).ReadLine(0xc0018b2c00, 0xc0013ed600, 0x47d8d4, 0xc00077a000, 0xc001840300, 0x1, 0xc5) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:389 +0x34 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/textproto.(*Reader).readLineSlice(0xc000a81770, 0xc0013ed600, 0x0, 0x0, 0xc0014ada08, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/textproto/reader.go:58 +0x6c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/textproto.(*Reader).ReadLine(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/textproto/reader.go:39 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.readRequest(0xc0018b2c00, 0x0, 0xc0013ed600, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/request.go:1012 +0xaa | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).readRequest(0xc000727360, 0x4c511e0, 0xc0016df340, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:984 +0x19a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).serve(0xc000727360, 0x4c511e0, 0xc0016df340) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1851 +0x705 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 372 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0018e80f0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0018ea4e0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc001772600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 316 [IO wait]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.runtime_pollWait(0x7faa1e109e68, 0x72, 0x4b9c820) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).wait(0xc000723098, 0x72, 0x4b9c800, 0x6c56e88, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).waitRead(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*FD).Read(0xc000723080, 0xc001732800, 0x745, 0x745, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*netFD).Read(0xc000723080, 0xc001732800, 0x745, 0x745, 0x203000, 0x7fdafb, 0xc00183f2e0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*conn).Read(0xc000121218, 0xc001732800, 0x745, 0x745, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/net.go:182 +0x8e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*atLeastReader).Read(0xc0018b90a0, 0xc001732800, 0x745, 0x745, 0xd4, 0x368, 0xc0018c52b0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:779 +0x62 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bytes.(*Buffer).ReadFrom(0xc00183f400, 0x4b8f660, 0xc0018b90a0, 0x40cf45, 0x3f2ee80, 0x43ace20) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bytes/buffer.go:204 +0xb1 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readFromUntil(0xc00183f180, 0x4b987a0, 0xc000121218, 0x5, 0xc000121218, 0xc3) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:801 +0xf3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readRecordOrCCS(0xc00183f180, 0x0, 0x0, 0x4aeeb7) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:608 +0x115 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readRecord(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:576 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).Read(0xc00183f180, 0xc0018d8000, 0x1000, 0x1000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:1252 +0x15f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*connReader).Read(0xc0018ce2d0, 0xc0018d8000, 0x1000, 0x1000, 0xc000761b80, 0xc5, 0x247) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:798 +0x1ad | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).fill(0xc0018b30e0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:101 +0x105 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).ReadSlice(0xc0018b30e0, 0xc0018c590a, 0x40bc3f, 0xc0018c5988, 0x40f428, 0x7faa1e2df310, 0xc0013ed800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:360 +0x3d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).ReadLine(0xc0018b30e0, 0xc0013ed800, 0x47d8d4, 0xc00077a000, 0xc001840600, 0x1, 0xc5) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:389 +0x34 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/textproto.(*Reader).readLineSlice(0xc0018ce300, 0xc0013ed800, 0x0, 0x0, 0xc0018c5a08, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/textproto/reader.go:58 +0x6c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/textproto.(*Reader).ReadLine(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/textproto/reader.go:39 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.readRequest(0xc0018b30e0, 0x0, 0xc0013ed800, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/request.go:1012 +0xaa | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).readRequest(0xc0007274a0, 0x4c511e0, 0xc0016df4c0, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:984 +0x19a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).serve(0xc0007274a0, 0x4c511e0, 0xc0016df4c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1851 +0x705 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 2098 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: context.propagateCancel.func1(0x4c525a0, 0xc007e37600, 0x4beede0, 0xc0077d55c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/context/context.go:279 +0xda | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by context.propagateCancel | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/context/context.go:278 +0x1fb | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 2402 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc001720410, 0xc0018b6e40, 0xc0040eaf00, 0xc0014f9260) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:361 +0x16f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:355 +0x2a5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 379 [IO wait]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.runtime_pollWait(0x7faa1e202938, 0x72, 0x4b9c820) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).wait(0xc00126cb98, 0x72, 0x4b9c800, 0x6c56e88, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).waitRead(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*FD).Read(0xc00126cb80, 0xc001a20000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*netFD).Read(0xc00126cb80, 0xc001a20000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*conn).Read(0xc00043a520, 0xc001a20000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/net.go:182 +0x8e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).Read(0xc00197a780, 0xc001556498, 0x9, 0x9, 0xc001a20009, 0xc00044a400, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.ReadAtLeast(0x4b8f420, 0xc00197a780, 0xc001556498, 0x9, 0x9, 0x9, 0x2fee9b018, 0xc000736e50, 0x49d6fa) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:314 +0x87 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.ReadFull(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:333 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc001556498, 0x9, 0x9, 0x4b8f420, 0xc00197a780, 0x0, 0x0, 0x6eca980, 0x149fcb) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc001556460, 0xc0013e8c60, 0x6eca980, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc000c9a000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 320 [IO wait]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.runtime_pollWait(0x7faa1e202768, 0x72, 0x4b9c820) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).wait(0xc000723298, 0x72, 0x4b9c800, 0x6c56e88, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).waitRead(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*FD).Read(0xc000723280, 0xc000197200, 0x8a0, 0x8a0, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*netFD).Read(0xc000723280, 0xc000197200, 0x8a0, 0x8a0, 0x203000, 0x7fdafb, 0xc001844160) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*conn).Read(0xc000121258, 0xc000197200, 0x8a0, 0x8a0, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/net.go:182 +0x8e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*atLeastReader).Read(0xc00186e1a0, 0xc000197200, 0x8a0, 0x8a0, 0x496, 0x89b, 0xc00106f2b0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:779 +0x62 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bytes.(*Buffer).ReadFrom(0xc001844280, 0x4b8f660, 0xc00186e1a0, 0x40cf45, 0x3f2ee80, 0x43ace20) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bytes/buffer.go:204 +0xb1 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readFromUntil(0xc001844000, 0x4b987a0, 0xc000121258, 0x5, 0xc000121258, 0x485) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:801 +0xf3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readRecordOrCCS(0xc001844000, 0x0, 0x0, 0x4aeeb7) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:608 +0x115 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readRecord(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:576 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).Read(0xc001844000, 0xc0018de000, 0x1000, 0x1000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:1252 +0x15f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*connReader).Read(0xc0018ce4e0, 0xc0018de000, 0x1000, 0x1000, 0xc000e51b80, 0xc5, 0x247) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:798 +0x1ad | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).fill(0xc0018b3920) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:101 +0x105 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).ReadSlice(0xc0018b3920, 0xc00106f90a, 0x40bc3f, 0xc00106f988, 0x40f428, 0x7faa1e32c4d0, 0xc001848300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:360 +0x3d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).ReadLine(0xc0018b3920, 0xc001848300, 0x47d8d4, 0xc00077a000, 0xc001840c00, 0x3, 0xc5) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:389 +0x34 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/textproto.(*Reader).readLineSlice(0xc0018ce510, 0xc001848300, 0x0, 0x0, 0xc00106fa08, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/textproto/reader.go:58 +0x6c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/textproto.(*Reader).ReadLine(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/textproto/reader.go:39 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.readRequest(0xc0018b3920, 0x0, 0xc001848300, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/request.go:1012 +0xaa | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).readRequest(0xc000727720, 0x4c511e0, 0xc0016df600, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:984 +0x19a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).serve(0xc000727720, 0x4c511e0, 0xc0016df600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1851 +0x705 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 301 [IO wait]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.runtime_pollWait(0x7faa1e10a5a8, 0x72, 0x4b9c820) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).wait(0xc001770618, 0x72, 0x4b9c800, 0x6c56e88, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).waitRead(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*FD).Read(0xc001770600, 0xc0018d4a80, 0x91b, 0x91b, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*netFD).Read(0xc001770600, 0xc0018d4a80, 0x91b, 0x91b, 0x203000, 0x7fdafb, 0xc0013cf2e0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*conn).Read(0xc00126b9b8, 0xc0018d4a80, 0x91b, 0x91b, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/net.go:182 +0x8e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*atLeastReader).Read(0xc0018e63c0, 0xc0018d4a80, 0x91b, 0x91b, 0x4f6, 0x916, 0xc00184f2b0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:779 +0x62 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bytes.(*Buffer).ReadFrom(0xc0013cf400, 0x4b8f660, 0xc0018e63c0, 0x40cf45, 0x3f2ee80, 0x43ace20) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bytes/buffer.go:204 +0xb1 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readFromUntil(0xc0013cf180, 0x4b987a0, 0xc00126b9b8, 0x5, 0xc00126b9b8, 0x4e5) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:801 +0xf3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readRecordOrCCS(0xc0013cf180, 0x0, 0x0, 0x4aeeb7) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:608 +0x115 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).readRecord(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:576 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: crypto/tls.(*Conn).Read(0xc0013cf180, 0xc0018e0000, 0x1000, 0x1000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:1252 +0x15f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*connReader).Read(0xc0018ce5d0, 0xc0018e0000, 0x1000, 0x1000, 0x18, 0xc5, 0x7faa1e204648) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:798 +0x1ad | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).fill(0xc0018b3da0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:101 +0x105 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).ReadSlice(0xc0018b3da0, 0xc00184f90a, 0x7faa1e204648, 0xc00184f988, 0x40f230, 0xc0018f8100, 0x100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:360 +0x3d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).ReadLine(0xc0018b3da0, 0xc0018f8100, 0x47d8d4, 0xc001430000, 0x0, 0x0, 0xc5) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:389 +0x34 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/textproto.(*Reader).readLineSlice(0xc0018ce600, 0xc0018f8100, 0x0, 0x0, 0xc00184fa08, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/textproto/reader.go:58 +0x6c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/textproto.(*Reader).ReadLine(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/textproto/reader.go:39 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.readRequest(0xc0018b3da0, 0x0, 0xc0018f8100, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/request.go:1012 +0xaa | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).readRequest(0xc00173fae0, 0x4c511e0, 0xc0016df6c0, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:984 +0x19a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).serve(0xc00173fae0, 0x4c511e0, 0xc0016df6c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1851 +0x705 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 356 [IO wait]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.runtime_pollWait(0x7faa1e202850, 0x72, 0x4b9c820) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).wait(0xc00126c798, 0x72, 0x4b9c800, 0x6c56e88, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).waitRead(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*FD).Read(0xc00126c780, 0xc001988000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*netFD).Read(0xc00126c780, 0xc001988000, 0x8000, 0x8000, 0x94a93e, 0x10401, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*conn).Read(0xc00043a478, 0xc001988000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/net.go:182 +0x8e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).Read(0xc00197a0c0, 0xc0014157d8, 0x9, 0x9, 0x9, 0xc00077a000, 0xc00121f980) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.ReadAtLeast(0x4b8f420, 0xc00197a0c0, 0xc0014157d8, 0x9, 0x9, 0x9, 0x91cbb0, 0xc0018ced50, 0x4b188eb) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:314 +0x87 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.ReadFull(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:333 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0014157d8, 0x9, 0x9, 0x4b8f420, 0xc00197a0c0, 0x0, 0x0, 0xc0018ced50, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0014157a0, 0xc0018ced50, 0x6eca900, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc0017fa1c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 357 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0017dedc0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc00197a2a0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc0017fa1c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 374 [IO wait]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.runtime_pollWait(0x7faa1e109f50, 0x72, 0x4b9c820) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).wait(0xc001770718, 0x72, 0x4b9c800, 0x6c56e88, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).waitRead(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*FD).Read(0xc001770700, 0xc0018f0000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*netFD).Read(0xc001770700, 0xc0018f0000, 0x8000, 0x8000, 0x94a93e, 0x10401, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*conn).Read(0xc00126b9c0, 0xc0018f0000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/net.go:182 +0x8e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).Read(0xc0018ea2a0, 0xc0001a5538, 0x9, 0x9, 0x9, 0xc00077a000, 0xc001772780) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.ReadAtLeast(0x4b8f420, 0xc0018ea2a0, 0xc0001a5538, 0x9, 0x9, 0x9, 0x91cbb0, 0xc0018ced80, 0x4b188eb) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:314 +0x87 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.ReadFull(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:333 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0001a5538, 0x9, 0x9, 0x4b8f420, 0xc0018ea2a0, 0x0, 0x0, 0xc0018ced80, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0001a5500, 0xc0018ced80, 0x6eca980, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc001772600, 0xc0018ced20, 0x46c8338) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000378480, 0x4c8a640, 0xc001772600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000378480, 0x4c8a640, 0xc001772600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 378 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc000c9a000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 359 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.compactor(0x4c511e0, 0xc001451600, 0xc000c3d1e0, 0x45d964b800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/compact.go:116 +0x10c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.StartCompactor | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/compact.go:63 +0x1a8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 360 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc001451840) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 361 [chan receive]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc00197c2c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 380 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001618190, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0018ea780, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc000c9a000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 2054 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc0198bf180, 0x4c29860, 0xc012ce5f30, 0xc00a414000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc005174000, 0xc008bf11e0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc00a414000, 0xc01016c2c0, 0x44ccc4d, 0x9, 0xc0114797d8) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc012ce5f30, 0xc00a414000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc0081cfce0, 0xc00e6c5f10) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc0081cfce0, 0xc00e6c5f10) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/warning.AddWarningsHandler.func1(0xc0081cfce0, 0xc00e6c5f10) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/warning/warning.go:37 +0xe4 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc00e6c5ea0, 0xc00a414000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc00e6c5ea0, 0xc00a414000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e786af0, 0x4c29a20, 0xc00e6c5ea0, 0xc00a414000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc00e6c5ea0, 0xc00a414000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc00e6c5ea0, 0xc00a414000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc00e6c5ea0, 0xc00a414000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc00e6c5ea0, 0xc00a414000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc00e6c5ea0, 0xc00a414000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc00e6c5ea0, 0xc00a414000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc00e6c5ea0, 0xc00a414000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc00e6c5ea0, 0xc00a414000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc00e6c5ea0, 0xc00a414000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc00e6c5ea0, 0xc00a3dfe00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc00e6c5ea0, 0xc00a3dfe00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc00e6c5ea0, 0xc00a3dfe00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc00e6c5ea0, 0xc00a3dfe00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc00e6c5ea0, 0xc00a3dfe00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc00e6c5ea0, 0xc00a3dfd00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc00e6c5ea0, 0xc00a3dfd00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc00e6c5ea0, 0xc00a3dfc00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc00e6c5ea0, 0xc00a3dfc00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc00e6c5ea0, 0xc00a3dfc00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc00e6c5ea0, 0xc00a3dfc00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc011794000, 0xc00a3dfb00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc011794000, 0xc00a3dfb00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc011794000, 0xc00a3dfb00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc011794000, 0xc00a3dfb00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc011794000, 0xc00a3dfb00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc011794000, 0xc00a3df900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc011794000, 0xc00a3df700) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc011794000, 0xc00a3df500) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc011794000, 0xc009b6e200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc011794000, 0xc009b6e200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc011794000, 0xc009b6e200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc011794000, 0xc009b6e200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc011794000, 0xc009b6e200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc011794000, 0xc009b6e200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).serve(0xc0072545a0, 0x4c511e0, 0xc0077d4840) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 382 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001fa1f80, 0x4b93b40, 0xc001567d40, 0xc0011ae201, 0xc00155ce40) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001494f80, 0x6fc23ac00, 0x3fe0000000000000, 0x1, 0xc00155ce40) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntilWithContext(0x4c511e0, 0xc0011ae200, 0xc0015665d0, 0x6fc23ac00, 0x3fe0000000000000, 0x1) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:185 +0xa6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/storagebackend/factory.startDBSizeMonitorPerEndpoint | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/storagebackend/factory/etcd3.go:272 +0x3c5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 383 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudget).periodicallyRefresh(0xc001614ae0, 0xc00155c3c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:64 +0xe5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:56 +0x6e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 384 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc0018e3340) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1f7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8bb | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 385 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc00117ef70, 0xc000d230592974b3, 0xc013a0ab, 0x6eca980, 0x4bfaa20, 0xc0056d3a00, 0xc004603b90, 0xc00807f260, 0xc00155c3c0, 0x0, ...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:451 +0x1a5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc00117ef70, 0xc00155c3c0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:415 +0x657 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc0018e3340, 0xc00155c3c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x110 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc001496f88) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc004603f88, 0x4b93b40, 0xc001876240, 0x1, 0xc00155c3c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001496f88, 0x3b9aca00, 0x0, 0x1, 0xc00155c3c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc0018e3340, 0xc00155c3c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x90e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 386 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001567800, 0x4b93b40, 0xc0018cf200, 0x1, 0xc00155c480) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001567800, 0xdf8475800, 0x3ff3333333333333, 0x44f6101, 0xc00155c480) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1380 +0x239 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 387 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc0011ae900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 388 [chan receive]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc00176d600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 389 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc000c9a1c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 390 [IO wait]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.runtime_pollWait(0x7faa1e109d80, 0x72, 0x4b9c820) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).wait(0xc0010da398, 0x72, 0x4b9c800, 0x6c56e88, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).waitRead(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*FD).Read(0xc0010da380, 0xc0004ee000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*netFD).Read(0xc0010da380, 0xc0004ee000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*conn).Read(0xc00038a970, 0xc0004ee000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/net.go:182 +0x8e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).Read(0xc0018ead80, 0xc001556738, 0x9, 0x9, 0xc0004ee009, 0xc0016a3000, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.ReadAtLeast(0x4b8f420, 0xc0018ead80, 0xc001556738, 0x9, 0x9, 0x9, 0x2ee55d96a, 0xc000734e50, 0x49d6fa) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:314 +0x87 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.ReadFull(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:333 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc001556738, 0x9, 0x9, 0x4b8f420, 0xc0018ead80, 0x0, 0x0, 0x6eca980, 0x308cce) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc001556700, 0xc000847e40, 0x6eca980, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc000c9a1c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 391 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0016186e0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0018eae40, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc000c9a1c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 1922 [chan receive]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc00075d450, 0xc002060cc0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:227 +0x21a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:143 +0x7f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 367 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0016180a0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0018746c0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc001622300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 465 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc019a89d80, 0x4c29860, 0xc012ce5f98, 0xc00ac78100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc00c6e2230, 0xc0086d2ea0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc00ac78100, 0xc01a6d1ce0, 0x44ccc4d, 0x9, 0xc00b083848) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc012ce5f98, 0xc00ac78100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc00e30fd40, 0xc00c6e2150) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc00e30fd40, 0xc00c6e2150) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc00c6e20e0, 0xc00ac78100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc00c6e20e0, 0xc00ac78100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e72c320, 0x4c29a20, 0xc00c6e20e0, 0xc00ac78100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc00c6e20e0, 0xc00ac78100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc00c6e20e0, 0xc00ac78100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc00c6e20e0, 0xc00ac78100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc00c6e20e0, 0xc00ac78100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc00c6e20e0, 0xc00ac78100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc00c6e20e0, 0xc00ac78100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc00c6e20e0, 0xc00ac78100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc00c6e20e0, 0xc00ac78100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc00c6e20e0, 0xc00ac78100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc00c6e20e0, 0xc00ac77f00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc00c6e20e0, 0xc00ac77f00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc00c6e20e0, 0xc00ac77f00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc00c6e20e0, 0xc00ac77f00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc00c6e20e0, 0xc00ac77f00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc00c6e20e0, 0xc00ac77e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc00c6e20e0, 0xc00ac77e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc00c6e20e0, 0xc00ac77d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc00c6e20e0, 0xc00ac77d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc00c6e20e0, 0xc00ac77d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc00c6e20e0, 0xc00ac77d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc00fecc1c0, 0xc00ac77c00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc00fecc1c0, 0xc00ac77c00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc00fecc1c0, 0xc00ac77c00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc00fecc1c0, 0xc00ac77c00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc00fecc1c0, 0xc00ac77c00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc00fecc1c0, 0xc00ac77a00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc00fecc1c0, 0xc00ac77800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc00fecc1c0, 0xc00ac77600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc00fecc1c0, 0xc006891900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc00fecc1c0, 0xc006891900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc00fecc1c0, 0xc006891900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc00fecc1c0, 0xc006891900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc00fecc1c0, 0xc006891900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc00fecc1c0, 0xc006891900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).serve(0xc000727c20, 0x4c511e0, 0xc0014a3480) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 464 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc01c308580, 0x4c29860, 0xc011499dc0, 0xc01c34c600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc0052bacb0, 0xc00204eea0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc01c34c600, 0xc01b87dd90, 0x44ccc4d, 0x9, 0xc01b64d848) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc011499dc0, 0xc01c34c600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc01c2442d0, 0xc0052ba9a0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc01c2442d0, 0xc0052ba9a0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc0052ba850, 0xc01c34c600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc0052ba850, 0xc01c34c600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e72c320, 0x4c29a20, 0xc0052ba850, 0xc01c34c600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc0052ba850, 0xc01c34c600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc0052ba850, 0xc01c34c600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc0052ba850, 0xc01c34c600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc0052ba850, 0xc01c34c600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc0052ba850, 0xc01c34c600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc0052ba850, 0xc01c34c600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc0052ba850, 0xc01c34c600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc0052ba850, 0xc01c34c600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc0052ba850, 0xc01c34c600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc0052ba850, 0xc01c34c400) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc0052ba850, 0xc01c34c400) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc0052ba850, 0xc01c34c400) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc0052ba850, 0xc01c34c400) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc0052ba850, 0xc01c34c400) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc0052ba850, 0xc01c34c300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc0052ba850, 0xc01c34c300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc0052ba850, 0xc01c34c200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc0052ba850, 0xc01c34c200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc0052ba850, 0xc01c34c200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc0052ba850, 0xc01c34c200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc0177e3dc0, 0xc01c34c100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc0177e3dc0, 0xc01c34c100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc0177e3dc0, 0xc01c34c100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc0177e3dc0, 0xc01c34c100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc0177e3dc0, 0xc01c34c100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc0177e3dc0, 0xc01c17bf00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc0177e3dc0, 0xc01c17bd00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc0177e3dc0, 0xc01c17bb00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc0177e3dc0, 0xc01b658c00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc0177e3dc0, 0xc01b658c00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc0177e3dc0, 0xc01b658c00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc0177e3dc0, 0xc01b658c00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc0177e3dc0, 0xc01b658c00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc0177e3dc0, 0xc01b658c00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).serve(0xc000727b80, 0x4c511e0, 0xc0014a33c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 2065 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc002f000d0, 0xc00303d3c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:257 +0x139 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:147 +0xda | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 2064 [chan receive]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc002f000d0, 0xc002ffbc80) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:227 +0x21a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:143 +0x7f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 364 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0017df1d0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001874420, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc001772a80) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 365 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc001772a80) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 366 [IO wait]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.runtime_pollWait(0x7faa1e202680, 0x72, 0x4b9c820) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).wait(0xc001770998, 0x72, 0x4b9c800, 0x6c56e88, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).waitRead(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*FD).Read(0xc001770980, 0xc001a38000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*netFD).Read(0xc001770980, 0xc001a38000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*conn).Read(0xc00126a000, 0xc001a38000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/net.go:182 +0x8e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).Read(0xc0018743c0, 0xc0001a43b8, 0x9, 0x9, 0xc001a38027, 0x10000c001431400, 0x7faa1d4cf570) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.ReadAtLeast(0x4b8f420, 0xc0018743c0, 0xc0001a43b8, 0x9, 0x9, 0x9, 0x6022d141, 0xc00155fdd0, 0x49dca6) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:314 +0x87 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.ReadFull(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:333 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0001a43b8, 0x9, 0x9, 0x4b8f420, 0xc0018743c0, 0x0, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0001a4380, 0xc0048c0c20, 0x6eca980, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc001772a80, 0xc0017ef230, 0x46c8338) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000378480, 0x4c8a640, 0xc001772a80) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000378480, 0x4c8a640, 0xc001772a80) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 368 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc001622300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 369 [IO wait]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.runtime_pollWait(0x7faa1e10a208, 0x72, 0x4b9c820) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).wait(0xc0010da098, 0x72, 0x4b9c800, 0x6c56e88, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*pollDesc).waitRead(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: internal/poll.(*FD).Read(0xc0010da080, 0xc001056000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*netFD).Read(0xc0010da080, 0xc001056000, 0x8000, 0x8000, 0x203002, 0x800000601, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net.(*conn).Read(0xc00038a040, 0xc001056000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/net.go:182 +0x8e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: bufio.(*Reader).Read(0xc0018ea6c0, 0xc0015561f8, 0x9, 0x9, 0xc001056027, 0x10000c00044a400, 0x7faa1dc41c30) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.ReadAtLeast(0x4b8f420, 0xc0018ea6c0, 0xc0015561f8, 0x9, 0x9, 0x9, 0x6022d141, 0xc000735dd0, 0x49dca6) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:314 +0x87 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: io.ReadFull(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:333 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0015561f8, 0x9, 0x9, 0x4b8f420, 0xc0018ea6c0, 0x0, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0015561c0, 0xc0013e8920, 0x6eca980, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc001622300, 0xc0017ef290, 0x46c8338) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000378480, 0x4c8a640, 0xc001622300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000378480, 0x4c8a640, 0xc001622300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 1923 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc00075d450, 0xc002c8cc70) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:257 +0x139 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:147 +0xda | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 2052 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc02f3aa880, 0x4c29860, 0xc007c2e738, 0xc00e625300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc0069a2770, 0xc000527040, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc00e625300, 0xc007b22630, 0x44ccc4d, 0x9, 0xc002a59848) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc007c2e738, 0xc00e625300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc01b676030, 0xc0069a2700) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc01b676030, 0xc0069a2700) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc0069a2690, 0xc00e625300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc0069a2690, 0xc00e625300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e72c320, 0x4c29a20, 0xc0069a2690, 0xc00e625300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc0069a2690, 0xc00e625300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc0069a2690, 0xc00e625300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc0069a2690, 0xc00e625300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc0069a2690, 0xc00e625300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc0069a2690, 0xc00e625300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc0069a2690, 0xc00e625300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc0069a2690, 0xc00e625300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc0069a2690, 0xc00e625300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc0069a2690, 0xc00e625300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc0069a2690, 0xc00e625100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc0069a2690, 0xc00e625100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc0069a2690, 0xc00e625100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc0069a2690, 0xc00e625100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc0069a2690, 0xc00e625100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc0069a2690, 0xc00e625000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc0069a2690, 0xc00e625000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc0069a2690, 0xc00e624f00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc0069a2690, 0xc00e624f00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc0069a2690, 0xc00e624f00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc0069a2690, 0xc00e624f00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc00be8a620, 0xc00e624e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc00be8a620, 0xc00e624e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc00be8a620, 0xc00e624e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc00be8a620, 0xc00e624e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc00be8a620, 0xc00e624e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc00be8a620, 0xc00e624c00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc00be8a620, 0xc00e624a00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc00be8a620, 0xc00e624800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc00be8a620, 0xc02a00aa00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc00be8a620, 0xc02a00aa00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc00be8a620, 0xc02a00aa00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc00be8a620, 0xc02a00aa00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc00be8a620, 0xc02a00aa00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc00be8a620, 0xc02a00aa00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).serve(0xc007254460, 0x4c511e0, 0xc0077d49c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 2045 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc00812ae00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 403 [runnable]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudget).periodicallyRefresh(0xc0017c1ca0, 0xc0018b6e40) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:64 +0xe5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:56 +0x6e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 404 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc0017d9600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1f7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8bb | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 405 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc001720410, 0xc000d2304807c815, 0xaef1f410, 0x6eca980, 0x4bfaa20, 0xc0084ff520, 0xc00446bb90, 0xc0014f9260, 0xc0018b6e40, 0x0, ...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:451 +0x1a5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc001720410, 0xc0018b6e40, 0x0, 0x0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:415 +0x657 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc0017d9600, 0xc0018b6e40) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x110 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc00072cf88) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc00446bf88, 0x4b93b40, 0xc000114c30, 0xc00155c101, 0xc0018b6e40) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00072cf88, 0x3b9aca00, 0x0, 0x100000000000001, 0xc0018b6e40) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc0017d9600, 0xc0018b6e40) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x90e | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 406 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0017ef890, 0x4b93b40, 0xc000e1a090, 0x1, 0xc0018b6ea0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0017ef890, 0xdf8475800, 0x3ff3333333333333, 0x44f6101, 0xc0018b6ea0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1380 +0x239 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 4830 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc00117ef70, 0xc00155c3c0, 0xc004352a80, 0xc00807f260) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:361 +0x16f | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:355 +0x2a5 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 463 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc00bd5e600, 0x4c29860, 0xc011631870, 0xc00bd4fc00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc00de247e0, 0xc00204eea0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc00bd4fc00, 0xc003d6c0b0, 0x44ccc4d, 0x9, 0xc019b3f848) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc011631870, 0xc00bd4fc00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc00bf015c0, 0xc00de24770) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc00bf015c0, 0xc00de24770) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc00de24700, 0xc00bd4fc00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc00de24700, 0xc00bd4fc00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e72c320, 0x4c29a20, 0xc00de24700, 0xc00bd4fc00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc00de24700, 0xc00bd4fc00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc00de24700, 0xc00bd4fc00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc00de24700, 0xc00bd4fc00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc00de24700, 0xc00bd4fc00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc00de24700, 0xc00bd4fc00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc00de24700, 0xc00bd4fc00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc00de24700, 0xc00bd4fc00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc00de24700, 0xc00bd4fc00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc00de24700, 0xc00bd4fc00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc00de24700, 0xc00bd4fa00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc00de24700, 0xc00bd4fa00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc00de24700, 0xc00bd4fa00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc00de24700, 0xc00bd4fa00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc00de24700, 0xc00bd4fa00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc00de24700, 0xc00bd4f900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc00de24700, 0xc00bd4f900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc00de24700, 0xc00bd4f800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc00de24700, 0xc00bd4f800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc00de24700, 0xc00bd4f800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc00de24700, 0xc00bd4f800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc011e1a620, 0xc00bd4f700) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc011e1a620, 0xc00bd4f700) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc011e1a620, 0xc00bd4f700) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc011e1a620, 0xc00bd4f700) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc011e1a620, 0xc00bd4f700) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc011e1a620, 0xc00bd4f500) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc011e1a620, 0xc00bd4f300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc011e1a620, 0xc00bd4f100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc011e1a620, 0xc00b950b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc011e1a620, 0xc00b950b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc011e1a620, 0xc00b950b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc011e1a620, 0xc00b950b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc011e1a620, 0xc00b950b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc011e1a620, 0xc00b950b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).serve(0xc000727ae0, 0x4c511e0, 0xc0014a37c0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 2301 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc002d51ee0, 0xc003a7d4a0, 0xc002dc9ce0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 2053 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc01b916200, 0x4c29860, 0xc00fcb9180, 0xc0105f0b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc00d42c620, 0xc002f23040, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc0105f0b00, 0xc0047a6210, 0x44ccc4d, 0x9, 0xc013081848) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc00fcb9180, 0xc0105f0b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc01172b620, 0xc00d42c5b0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc01172b620, 0xc00d42c5b0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc00d42c540, 0xc0105f0b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc00d42c540, 0xc0105f0b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e72c320, 0x4c29a20, 0xc00d42c540, 0xc0105f0b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc00d42c540, 0xc0105f0b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc00d42c540, 0xc0105f0b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc00d42c540, 0xc0105f0b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc00d42c540, 0xc0105f0b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc00d42c540, 0xc0105f0b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc00d42c540, 0xc0105f0b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc00d42c540, 0xc0105f0b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc00d42c540, 0xc0105f0b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc00d42c540, 0xc0105f0b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc00d42c540, 0xc0105f0900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc00d42c540, 0xc0105f0900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc00d42c540, 0xc0105f0900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc00d42c540, 0xc0105f0900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc00d42c540, 0xc0105f0900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc00d42c540, 0xc0105f0800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc00d42c540, 0xc0105f0800) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc00d42c540, 0xc0105f0600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc00d42c540, 0xc0105f0600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc00d42c540, 0xc0105f0600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc00d42c540, 0xc0105f0600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc011c6ba40, 0xc0105f0500) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc011c6ba40, 0xc0105f0500) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc011c6ba40, 0xc0105f0500) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc011c6ba40, 0xc0105f0500) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc011c6ba40, 0xc0105f0500) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc011c6ba40, 0xc0105f0300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc011c6ba40, 0xc0105f0100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc011c6ba40, 0xc010653f00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc011c6ba40, 0xc010652900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc011c6ba40, 0xc010652900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc011c6ba40, 0xc010652900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc011c6ba40, 0xc010652900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc011c6ba40, 0xc010652900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc011c6ba40, 0xc010652900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).serve(0xc007254500, 0x4c511e0, 0xc0077d4900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 1841 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc00075d450) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:149 +0x1d6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:110 +0x128 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 1929 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc00075d520, 0xc0018e4840, 0xc0020613e0) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 459 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc00197f680) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 450 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc01664c180, 0x4c29860, 0xc01c6ea5e0, 0xc01664e600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc0166421c0, 0xc0037b5a00, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc01664e600, 0xc003a7c0b0, 0x44ccc4d, 0x9, 0xc0114af848) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc01c6ea5e0, 0xc01664e600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc01663b9b0, 0xc016642150) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc01663b9b0, 0xc016642150) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc0166420e0, 0xc01664e600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc0166420e0, 0xc01664e600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e72c320, 0x4c29a20, 0xc0166420e0, 0xc01664e600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc0166420e0, 0xc01664e600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc0166420e0, 0xc01664e600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc0166420e0, 0xc01664e600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc0166420e0, 0xc01664e600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc0166420e0, 0xc01664e600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc0166420e0, 0xc01664e600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc0166420e0, 0xc01664e600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc0166420e0, 0xc01664e600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc0166420e0, 0xc01664e600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc0166420e0, 0xc01664e400) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc0166420e0, 0xc01664e400) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc0166420e0, 0xc01664e400) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc0166420e0, 0xc01664e400) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc0166420e0, 0xc01664e400) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc0166420e0, 0xc01664e300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc0166420e0, 0xc01664e300) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc0166420e0, 0xc01664e200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc0166420e0, 0xc01664e200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc0166420e0, 0xc01664e200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc0166420e0, 0xc01664e200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc014a30a80, 0xc01664e100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc014a30a80, 0xc01664e100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc014a30a80, 0xc01664e100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc014a30a80, 0xc01664e100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc014a30a80, 0xc01664e100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc014a30a80, 0xc01661bf00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc014a30a80, 0xc01661bd00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc014a30a80, 0xc01661bb00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc014a30a80, 0xc0158b4600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc014a30a80, 0xc0158b4600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc014a30a80, 0xc0158b4600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc014a30a80, 0xc0158b4600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc014a30a80, 0xc0158b4600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc014a30a80, 0xc0158b4600) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).serve(0xc000726a00, 0x4c511e0, 0xc001451a40) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 451 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc0145f7c00, 0x4c29860, 0xc00c037b20, 0xc014cd2200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc014cce0e0, 0xc0013b5d40, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc014cd2200, 0xc002856fd0, 0x44ccc4d, 0x9, 0xc010e29848) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc00c037b20, 0xc014cd2200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc014cd0180, 0xc014cce070) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc014cd0180, 0xc014cce070) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc014cce000, 0xc014cd2200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc014cce000, 0xc014cd2200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e72c320, 0x4c29a20, 0xc014cce000, 0xc014cd2200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc014cce000, 0xc014cd2200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc014cce000, 0xc014cd2200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc014cce000, 0xc014cd2200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc014cce000, 0xc014cd2200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc014cce000, 0xc014cd2200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc014cce000, 0xc014cd2200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc014cce000, 0xc014cd2200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc014cce000, 0xc014cd2200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc014cce000, 0xc014cd2200) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc014cce000, 0xc014cd2000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc014cce000, 0xc014cd2000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc014cce000, 0xc014cd2000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc014cce000, 0xc014cd2000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc014cce000, 0xc014cd2000) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc014cce000, 0xc014975f00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc014cce000, 0xc014975f00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc014cce000, 0xc014975e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc014cce000, 0xc014975e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc014cce000, 0xc014975e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc014cce000, 0xc014975e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc01494a7e0, 0xc014975d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc01494a7e0, 0xc014975d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc01494a7e0, 0xc014975d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc01494a7e0, 0xc014975d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc01494a7e0, 0xc014975d00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc01494a7e0, 0xc014975b00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc01494a7e0, 0xc014975900) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc01494a7e0, 0xc014975700) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc01494a7e0, 0xc013c90100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc01494a7e0, 0xc013c90100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc01494a7e0, 0xc013c90100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc01494a7e0, 0xc013c90100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc01494a7e0, 0xc013c90100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc01494a7e0, 0xc013c90100) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:46 k3s-0 k3s[698]: net/http.(*conn).serve(0xc000726aa0, 0x4c511e0, 0xc0011afa80) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:46 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:46 k3s-0 k3s[698]: goroutine 530 [select]: | |
| Feb 09 18:15:46 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc01fc05900, 0x4c29860, 0xc019644928, 0xc01c544e00) | |
| Feb 09 18:15:46 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc0005a4b60, 0xc00204eea0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc01c544e00, 0xc013344580, 0x44ccc4d, 0x9, 0xc010e6b848) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc019644928, 0xc01c544e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc019ba2cc0, 0xc0005a4af0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc019ba2cc0, 0xc0005a4af0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc0005a4a80, 0xc01c544e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc0005a4a80, 0xc01c544e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e72c320, 0x4c29a20, 0xc0005a4a80, 0xc01c544e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc0005a4a80, 0xc01c544e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc0005a4a80, 0xc01c544e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc0005a4a80, 0xc01c544e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc0005a4a80, 0xc01c544e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc0005a4a80, 0xc01c544e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc0005a4a80, 0xc01c544e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc0005a4a80, 0xc01c544e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc0005a4a80, 0xc01c544e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc0005a4a80, 0xc01c544e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc0005a4a80, 0xc01c544c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc0005a4a80, 0xc01c544c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc0005a4a80, 0xc01c544c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc0005a4a80, 0xc01c544c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc0005a4a80, 0xc01c544c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc0005a4a80, 0xc01c544b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc0005a4a80, 0xc01c544b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc0005a4a80, 0xc01c544a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc0005a4a80, 0xc01c544a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc0005a4a80, 0xc01c544a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc0005a4a80, 0xc01c544a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc01c435260, 0xc01c544900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc01c435260, 0xc01c544900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc01c435260, 0xc01c544900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc01c435260, 0xc01c544900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc01c435260, 0xc01c544900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc01c435260, 0xc01c544700) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc01c435260, 0xc01c544500) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc01c435260, 0xc01c544300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc01c435260, 0xc01c4de800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc01c435260, 0xc01c4de800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc01c435260, 0xc01c4de800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc01c435260, 0xc01c4de800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc01c435260, 0xc01c4de800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc01c435260, 0xc01c4de800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.(*conn).serve(0xc000727cc0, 0x4c511e0, 0xc0014a3d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 456 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc00c49cb00, 0x4c29860, 0xc00b629f60, 0xc02866a900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc02ba9e070, 0xc0154dfa00, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc02866a900, 0xc01ba05a20, 0x44ccc4d, 0x9, 0xc0141ad100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc00b629f60, 0xc02866a900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentHandlerFunc.func1(0x4c29a20, 0xc02ba9e000, 0xc02866a900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:406 +0x25e | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0122721e0, 0x4c29a20, 0xc02ba9e000, 0xc02866a900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc02ba9e000, 0xc02866a900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00e32d6b0, 0x4c29a20, 0xc02ba9e000, 0xc02866a900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiextensions-apiserver/pkg/apiserver.(*crdHandler).ServeHTTP(0xc0010e4300, 0x4c29a20, 0xc02ba9e000, 0xc02866a900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiextensions-apiserver/pkg/apiserver/customresource_handler.go:379 +0x867 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc0047f9dc0, 0x4c29a20, 0xc02ba9e000, 0xc02866a900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0014f3570, 0x4c29a20, 0xc02ba9e000, 0xc02866a900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x4503919, 0x17, 0xc0018222d0, 0xc0014f3570, 0x4c29a20, 0xc02ba9e000, 0xc02866a900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc018080a80, 0x4c29a20, 0xc02ba9e000, 0xc02866a900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:254 +0x20f | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc000e83030, 0x4c29a20, 0xc02ba9e000, 0xc02866a900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc02ba9e000, 0xc02866a900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e714460, 0x4c29a20, 0xc02ba9e000, 0xc02866a900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc02ba9e000, 0xc02866a900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc02ba9e000, 0xc02866a900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc02ba9e000, 0xc02866a900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc02ba9e000, 0xc02866a900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc02ba9e000, 0xc02866a900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc02ba9e000, 0xc02866a900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc02ba9e000, 0xc02866a900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc02ba9e000, 0xc02866a900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc02ba9e000, 0xc02866a900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc02ba9e000, 0xc02866a700) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc02ba9e000, 0xc02866a700) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc02ba9e000, 0xc02866a700) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc02ba9e000, 0xc02866a700) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc02ba9e000, 0xc02866a700) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc02ba9e000, 0xc02866a600) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc02ba9e000, 0xc02866a600) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc02ba9e000, 0xc02866a500) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc02ba9e000, 0xc02866a500) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc02ba9e000, 0xc02866a500) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc02ba9e000, 0xc02866a500) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc028515b20, 0xc02866a300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc028515b20, 0xc02866a300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc028515b20, 0xc02866a300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc028515b20, 0xc02866a300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc028515b20, 0xc02866a300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc028515b20, 0xc028af7f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc028515b20, 0xc028af7d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc028515b20, 0xc028af7b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc028515b20, 0xc028ac5200) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc028515b20, 0xc028ac5200) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc028515b20, 0xc028ac5200) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc028515b20, 0xc028ac5200) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc028515b20, 0xc028ac5200) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc028515b20, 0xc028ac5200) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.(*conn).serve(0xc000727900, 0x4c511e0, 0xc000ef2340) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 407 [chan receive]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc001548780) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 408 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc001548900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 409 [chan receive]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc001549c20) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 410 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc001549da0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 411 [chan receive]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc001549e60) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 412 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc00128a000) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 413 [chan receive]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc00128a120) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 414 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc00128a2a0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 415 [chan receive]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc00128a360) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 416 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc00128a4e0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 417 [chan receive]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc00128a6c0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 466 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc00128ad20) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 467 [chan receive]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc00128ade0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 468 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc00128af60) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 428 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0014e9450, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000373e00, 0x0, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc000432480) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 469 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc000d61fc0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 470 [chan receive]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc0011242c0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 471 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc0011b8000) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 472 [IO wait]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: internal/poll.runtime_pollWait(0x7faa1e624b20, 0x72, 0x4b9c820) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: internal/poll.(*pollDesc).wait(0xc001134998, 0x72, 0x4b9c800, 0x6c56e88, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: internal/poll.(*pollDesc).waitRead(...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: internal/poll.(*FD).Read(0xc001134980, 0xc0016e6000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net.(*netFD).Read(0xc001134980, 0xc0016e6000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net.(*conn).Read(0xc00126b5b0, 0xc0016e6000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/net.go:182 +0x8e | |
| Feb 09 18:15:47 k3s-0 k3s[698]: bufio.(*Reader).Read(0xc00128b3e0, 0xc0001a4738, 0x9, 0x9, 0xc0016e6009, 0xc000102c00, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: io.ReadAtLeast(0x4b8f420, 0xc00128b3e0, 0xc0001a4738, 0x9, 0x9, 0x9, 0x4e7248602, 0xc001509e50, 0x49d6fa) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:314 +0x87 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: io.ReadFull(...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:333 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0001a4738, 0x9, 0x9, 0x4b8f420, 0xc00128b3e0, 0x0, 0x200000000, 0x6eca980, 0x341e473) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0001a4700, 0xc0277cb0c0, 0x6eca980, 0x0, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc0011b8000) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 473 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0010eb860, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000373a40, 0x0, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc0011b8000) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 462 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc01fc04100, 0x4c29860, 0xc019644020, 0xc00f13f200) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc0005a4150, 0xc0086d2ea0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc00f13f200, 0xc013344000, 0x44ccc4d, 0x9, 0xc010e6b848) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc019644020, 0xc00f13f200) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc01f77f7d0, 0xc0005a40e0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc01f77f7d0, 0xc0005a40e0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc0005a4000, 0xc00f13f200) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc0005a4000, 0xc00f13f200) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e72c320, 0x4c29a20, 0xc0005a4000, 0xc00f13f200) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc0005a4000, 0xc00f13f200) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc0005a4000, 0xc00f13f200) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc0005a4000, 0xc00f13f200) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc0005a4000, 0xc00f13f200) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc0005a4000, 0xc00f13f200) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc0005a4000, 0xc00f13f200) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc0005a4000, 0xc00f13f200) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc0005a4000, 0xc00f13f200) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc0005a4000, 0xc00f13f200) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc0005a4000, 0xc00f13ef00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc0005a4000, 0xc00f13ef00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc0005a4000, 0xc00f13ef00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc0005a4000, 0xc00f13ef00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc0005a4000, 0xc00f13ef00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc0005a4000, 0xc00f13ee00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc0005a4000, 0xc00f13ee00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc0005a4000, 0xc00f13ed00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc0005a4000, 0xc00f13ed00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc0005a4000, 0xc00f13ed00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc0005a4000, 0xc00f13ed00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc01c434ee0, 0xc00f13ec00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc01c434ee0, 0xc00f13ec00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc01c434ee0, 0xc00f13ec00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc01c434ee0, 0xc00f13ec00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc01c434ee0, 0xc00f13ec00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc01c434ee0, 0xc00f13ea00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc01c434ee0, 0xc00f13e700) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc01c434ee0, 0xc00f13e500) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc01c434ee0, 0xc01ba35500) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc01c434ee0, 0xc01ba35500) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc01c434ee0, 0xc01ba35500) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc01c434ee0, 0xc01ba35500) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc01c434ee0, 0xc01ba35500) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc01c434ee0, 0xc01ba35500) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.(*conn).serve(0xc000727a40, 0x4c511e0, 0xc0014a3680) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 477 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc0014a2cc0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 478 [chan receive]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc0011258c0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 479 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc0011b9340) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 480 [IO wait]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: internal/poll.runtime_pollWait(0x7faa1e2022e0, 0x72, 0x4b9c820) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: internal/poll.(*pollDesc).wait(0xc001134f18, 0x72, 0x4b9c800, 0x6c56e88, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: internal/poll.(*pollDesc).waitRead(...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: internal/poll.(*FD).Read(0xc001134f00, 0xc001700000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net.(*netFD).Read(0xc001134f00, 0xc001700000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net.(*conn).Read(0xc00126b700, 0xc001700000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/net.go:182 +0x8e | |
| Feb 09 18:15:47 k3s-0 k3s[698]: bufio.(*Reader).Read(0xc001444300, 0xc001074658, 0x9, 0x9, 0xc001700009, 0xc00077a800, 0xc00156c600) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: io.ReadAtLeast(0x4b8f420, 0xc001444300, 0xc001074658, 0x9, 0x9, 0x9, 0x29d632a20, 0xc001503e50, 0x85) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:314 +0x87 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: io.ReadFull(...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:333 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc001074658, 0x9, 0x9, 0x4b8f420, 0xc001444300, 0x0, 0x0, 0x6eca980, 0x77d91) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc001074620, 0xc0020ad0a0, 0x6eca980, 0x0, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc0011b9340) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 481 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0010ebef0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001444480, 0x0, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc0011b9340) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 628 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc00123c9c0, 0xc00187e0c0, 0xc001ecb920, 0xc0020567e0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:361 +0x16f | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:355 +0x2a5 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 429 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc000432480) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 430 [IO wait]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: internal/poll.runtime_pollWait(0x7faa1e2021f8, 0x72, 0x4b9c820) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: internal/poll.(*pollDesc).wait(0xc0010db298, 0x72, 0x4b9c800, 0x6c56e88, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: internal/poll.(*pollDesc).waitRead(...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: internal/poll.(*FD).Read(0xc0010db280, 0xc001736000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net.(*netFD).Read(0xc0010db280, 0xc001736000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net.(*conn).Read(0xc00038acb8, 0xc001736000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/net.go:182 +0x8e | |
| Feb 09 18:15:47 k3s-0 k3s[698]: bufio.(*Reader).Read(0xc000373c80, 0xc00074e498, 0x9, 0x9, 0xc001736027, 0x10000c00077a800, 0x7faa1e3ef370) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: io.ReadAtLeast(0x4b8f420, 0xc000373c80, 0xc00074e498, 0x9, 0x9, 0x9, 0x6022d13f, 0xc000ecddd0, 0x4b188ed) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:314 +0x87 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: io.ReadFull(...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/io/io.go:333 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc00074e498, 0x9, 0x9, 0x4b8f420, 0xc000373c80, 0x0, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc00074e460, 0xc0020ad080, 0x6eca980, 0x0, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc000432480, 0xc000e1ad80, 0x46c8338) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000378480, 0x4c8a640, 0xc000432480) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000378480, 0x4c8a640, 0xc000432480) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 432 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudget).periodicallyRefresh(0xc000b0c5c0, 0xc00187e0c0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:64 +0xe5 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:56 +0x6e | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 433 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc001243e40) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1f7 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8bb | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 482 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc00123c9c0, 0xc000d22fee87cba7, 0x5e3c63b6, 0x6eca980, 0x4bfaa20, 0xc00075c820, 0xc001665b90, 0xc0020567e0, 0xc00187e0c0, 0x0, ...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:451 +0x1a5 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc00123c9c0, 0xc00187e0c0, 0x0, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:415 +0x657 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc001243e40, 0xc00187e0c0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x110 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc00072f788) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001665f88, 0x4b93b40, 0xc00159a450, 0x1, 0xc00187e0c0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00072f788, 0x3b9aca00, 0x0, 0x1, 0xc00187e0c0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc001243e40, 0xc00187e0c0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x90e | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 483 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000e1be60, 0x4b93b40, 0xc000bdab10, 0x1, 0xc00187e120) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000e1be60, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc00187e120) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1380 +0x239 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 484 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc00074bd00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 485 [chan receive]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc00187cb00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 633 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc00075c8f0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 673 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc016a26300, 0x4c29860, 0xc00b629d40, 0xc028ac0c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc02b6c5030, 0xc002f221a0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc028ac0c00, 0xc01ba046e0, 0x44ccc4d, 0x9, 0xc00230f848) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc00b629d40, 0xc028ac0c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc00c69fb90, 0xc02b6c4fc0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc00c69fb90, 0xc02b6c4fc0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc02b6c4f50, 0xc028ac0c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc02b6c4f50, 0xc028ac0c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e72c320, 0x4c29a20, 0xc02b6c4f50, 0xc028ac0c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc02b6c4f50, 0xc028ac0c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc02b6c4f50, 0xc028ac0c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc02b6c4f50, 0xc028ac0c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc02b6c4f50, 0xc028ac0c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc02b6c4f50, 0xc028ac0c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc02b6c4f50, 0xc028ac0c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc02b6c4f50, 0xc028ac0c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc02b6c4f50, 0xc028ac0c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc02b6c4f50, 0xc028ac0c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc02b6c4f50, 0xc028ac0a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc02b6c4f50, 0xc028ac0a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc02b6c4f50, 0xc028ac0a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc02b6c4f50, 0xc028ac0a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc02b6c4f50, 0xc028ac0a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc02b6c4f50, 0xc028ac0900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc02b6c4f50, 0xc028ac0900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc02b6c4f50, 0xc028ac0800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc02b6c4f50, 0xc028ac0800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc02b6c4f50, 0xc028ac0800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc02b6c4f50, 0xc028ac0800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc01f5c8540, 0xc028ac0700) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc01f5c8540, 0xc028ac0700) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc01f5c8540, 0xc028ac0700) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc01f5c8540, 0xc028ac0700) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc01f5c8540, 0xc028ac0700) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc01f5c8540, 0xc028ac0500) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc01f5c8540, 0xc028ac0300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc01f5c8540, 0xc028ac0100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc01f5c8540, 0xc00b17fd00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc01f5c8540, 0xc00b17fd00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc01f5c8540, 0xc00b17fd00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc01f5c8540, 0xc00b17fd00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc01f5c8540, 0xc00b17fd00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc01f5c8540, 0xc00b17fd00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.(*conn).serve(0xc00069cb40, 0x4c511e0, 0xc002122340) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 672 [IO wait]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: internal/poll.runtime_pollWait(0x7faa1e114560, 0x72, 0x4b9c820) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: internal/poll.(*pollDesc).wait(0xc000723d98, 0x72, 0x4b9c800, 0x6c56e88, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: internal/poll.(*pollDesc).waitRead(...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: internal/poll.(*FD).Read(0xc000723d80, 0xc00076d000, 0x746, 0x746, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net.(*netFD).Read(0xc000723d80, 0xc00076d000, 0x746, 0x746, 0x203000, 0x7fdafb, 0xc00160d2e0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net.(*conn).Read(0xc0000104f0, 0xc00076d000, 0x746, 0x746, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/net.go:182 +0x8e | |
| Feb 09 18:15:47 k3s-0 k3s[698]: crypto/tls.(*atLeastReader).Read(0xc001fef020, 0xc00076d000, 0x746, 0x746, 0xd4, 0x366, 0xc001ff92b0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:779 +0x62 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: bytes.(*Buffer).ReadFrom(0xc00160d400, 0x4b8f660, 0xc001fef020, 0x40cf45, 0x3f2ee80, 0x43ace20) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/bytes/buffer.go:204 +0xb1 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: crypto/tls.(*Conn).readFromUntil(0xc00160d180, 0x4b987a0, 0xc0000104f0, 0x5, 0xc0000104f0, 0xc3) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:801 +0xf3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: crypto/tls.(*Conn).readRecordOrCCS(0xc00160d180, 0x0, 0x0, 0x4aeeb7) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:608 +0x115 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: crypto/tls.(*Conn).readRecord(...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:576 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: crypto/tls.(*Conn).Read(0xc00160d180, 0xc001ffc000, 0x1000, 0x1000, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/crypto/tls/conn.go:1252 +0x15f | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.(*connReader).Read(0xc001fe8b40, 0xc001ffc000, 0x1000, 0x1000, 0xc0020f0280, 0xc5, 0x247) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:798 +0x1ad | |
| Feb 09 18:15:47 k3s-0 k3s[698]: bufio.(*Reader).fill(0xc001fcd7a0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:101 +0x105 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: bufio.(*Reader).ReadSlice(0xc001fcd7a0, 0xc001ff990a, 0x40bc3f, 0xc001ff9988, 0x40f428, 0x7faa1e1ba968, 0xc001fc9500) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:360 +0x3d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: bufio.(*Reader).ReadLine(0xc001fcd7a0, 0xc001fc9500, 0x47d8d4, 0xc00044a400, 0xc001841980, 0x1, 0xc5) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/bufio/bufio.go:389 +0x34 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/textproto.(*Reader).readLineSlice(0xc001fe8b70, 0xc001fc9500, 0x0, 0x0, 0xc001ff9a08, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/textproto/reader.go:58 +0x6c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/textproto.(*Reader).ReadLine(...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/textproto/reader.go:39 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.readRequest(0xc001fcd7a0, 0x0, 0xc001fc9500, 0x0, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/request.go:1012 +0xaa | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.(*conn).readRequest(0xc00069caa0, 0x4c511e0, 0xc001fdc940, 0x0, 0x0, 0x0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:984 +0x19a | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.(*conn).serve(0xc00069caa0, 0x4c511e0, 0xc001fdc940) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1851 +0x705 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 632 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: context.propagateCancel.func1(0x4c525a0, 0xc000cce9a0, 0x4beede0, 0xc001ec31c0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/context/context.go:279 +0xda | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by context.propagateCancel | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/context/context.go:278 +0x1fb | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 531 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc01bcd3080, 0x4c29860, 0xc012ce5080, 0xc00a3b3000) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc00e2dfab0, 0xc0086d2ea0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc00a3b3000, 0xc01016c000, 0x44ccc4d, 0x9, 0xc011479848) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc012ce5080, 0xc00a3b3000) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc007a8a0f0, 0xc00e2dfa40) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc007a8a0f0, 0xc00e2dfa40) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc00e2df9d0, 0xc00a3b3000) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc00e2df9d0, 0xc00a3b3000) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e72c320, 0x4c29a20, 0xc00e2df9d0, 0xc00a3b3000) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc00e2df9d0, 0xc00a3b3000) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc00e2df9d0, 0xc00a3b3000) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc00e2df9d0, 0xc00a3b3000) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc00e2df9d0, 0xc00a3b3000) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc00e2df9d0, 0xc00a3b3000) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc00e2df9d0, 0xc00a3b3000) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc00e2df9d0, 0xc00a3b3000) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc00e2df9d0, 0xc00a3b3000) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc00e2df9d0, 0xc00a3b3000) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc00e2df9d0, 0xc00a3b2e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc00e2df9d0, 0xc00a3b2e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc00e2df9d0, 0xc00a3b2e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc00e2df9d0, 0xc00a3b2e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc00e2df9d0, 0xc00a3b2e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc00e2df9d0, 0xc00a3b2d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc00e2df9d0, 0xc00a3b2d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc00e2df9d0, 0xc00a3b2c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc00e2df9d0, 0xc00a3b2c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc00e2df9d0, 0xc00a3b2c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc00e2df9d0, 0xc00a3b2c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc00e3c3500, 0xc00a3b2b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc00e3c3500, 0xc00a3b2b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc00e3c3500, 0xc00a3b2b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc00e3c3500, 0xc00a3b2b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc00e3c3500, 0xc00a3b2b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc00e3c3500, 0xc00a3b2900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc00e3c3500, 0xc00a3b2700) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc00e3c3500, 0xc00a3b2500) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc00e3c3500, 0xc0096c5800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc00e3c3500, 0xc0096c5800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc00e3c3500, 0xc0096c5800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc00e3c3500, 0xc0096c5800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc00e3c3500, 0xc0096c5800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc00e3c3500, 0xc0096c5800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.(*conn).serve(0xc000727d60, 0x4c511e0, 0xc0014a3c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 532 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc01f7a6280, 0x4c29860, 0xc01f5d6150, 0xc01f7a4e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc00b6fca80, 0xc0039271e0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc01f7a4e00, 0xc01c401550, 0x44ccc4d, 0x9, 0xc01b729848) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc01f5d6150, 0xc01f7a4e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc01f780e70, 0xc00b6fca10) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc01f780e70, 0xc00b6fca10) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc00b6fc9a0, 0xc01f7a4e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc00b6fc9a0, 0xc01f7a4e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e72c320, 0x4c29a20, 0xc00b6fc9a0, 0xc01f7a4e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc00b6fc9a0, 0xc01f7a4e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc00b6fc9a0, 0xc01f7a4e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc00b6fc9a0, 0xc01f7a4e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc00b6fc9a0, 0xc01f7a4e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc00b6fc9a0, 0xc01f7a4e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc00b6fc9a0, 0xc01f7a4e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc00b6fc9a0, 0xc01f7a4e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc00b6fc9a0, 0xc01f7a4e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc00b6fc9a0, 0xc01f7a4e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc00b6fc9a0, 0xc01f7a4c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc00b6fc9a0, 0xc01f7a4c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc00b6fc9a0, 0xc01f7a4c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc00b6fc9a0, 0xc01f7a4c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc00b6fc9a0, 0xc01f7a4c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc00b6fc9a0, 0xc01f7a4b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc00b6fc9a0, 0xc01f7a4b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc00b6fc9a0, 0xc01f7a4a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc00b6fc9a0, 0xc01f7a4a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc00b6fc9a0, 0xc01f7a4a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc00b6fc9a0, 0xc01f7a4a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc01c4347e0, 0xc01f7a4900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc01c4347e0, 0xc01f7a4900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc01c4347e0, 0xc01f7a4900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc01c4347e0, 0xc01f7a4900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc01c4347e0, 0xc01f7a4900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc01c4347e0, 0xc01f7a4700) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc01c4347e0, 0xc01f7a4500) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc01c4347e0, 0xc01f7a4300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc01c4347e0, 0xc01ba34e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc01c4347e0, 0xc01ba34e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc01c4347e0, 0xc01ba34e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc01c4347e0, 0xc01ba34e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc01c4347e0, 0xc01ba34e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc01c4347e0, 0xc01ba34e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.(*conn).serve(0xc000727e00, 0x4c511e0, 0xc000ef3d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 533 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc0125e8c00, 0x4c29860, 0xc01f5d6d70, 0xc009645d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc00a20efc0, 0xc002f23040, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc009645d00, 0xc0073a33f0, 0x44ccc4d, 0x9, 0xc0109bd848) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc01f5d6d70, 0xc009645d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc005bec8a0, 0xc00a20ef50) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc005bec8a0, 0xc00a20ef50) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc00a20eee0, 0xc009645d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc00a20eee0, 0xc009645d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e72c320, 0x4c29a20, 0xc00a20eee0, 0xc009645d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc00a20eee0, 0xc009645d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc00a20eee0, 0xc009645d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc00a20eee0, 0xc009645d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc00a20eee0, 0xc009645d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc00a20eee0, 0xc009645d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc00a20eee0, 0xc009645d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc00a20eee0, 0xc009645d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc00a20eee0, 0xc009645d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc00a20eee0, 0xc009645d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc00a20eee0, 0xc009645b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc00a20eee0, 0xc009645b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc00a20eee0, 0xc009645b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc00a20eee0, 0xc009645b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc00a20eee0, 0xc009645b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc00a20eee0, 0xc009645a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc00a20eee0, 0xc009645a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc00a20eee0, 0xc009645900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc00a20eee0, 0xc009645900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc00a20eee0, 0xc009645900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc00a20eee0, 0xc009645900) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc00f67c8c0, 0xc009645800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc00f67c8c0, 0xc009645800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc00f67c8c0, 0xc009645800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc00f67c8c0, 0xc009645800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc00f67c8c0, 0xc009645800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc00f67c8c0, 0xc009645600) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc00f67c8c0, 0xc009645400) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc00f67c8c0, 0xc009645200) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc00f67c8c0, 0xc00d77fb00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc00f67c8c0, 0xc00d77fb00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc00f67c8c0, 0xc00d77fb00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc00f67c8c0, 0xc00d77fb00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc00f67c8c0, 0xc00d77fb00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc00f67c8c0, 0xc00d77fb00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.(*conn).serve(0xc000727ea0, 0x4c511e0, 0xc00074bfc0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 534 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc006cea900, 0x4c29860, 0xc019644a58, 0xc01fc37100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc0005a56c0, 0xc0039271e0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc01fc37100, 0xc013345130, 0x44ccc4d, 0x9, 0xc010e6b848) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc019644a58, 0xc01fc37100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc00a341320, 0xc0005a5650) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc00a341320, 0xc0005a5650) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc0005a55e0, 0xc01fc37100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc0005a55e0, 0xc01fc37100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e72c320, 0x4c29a20, 0xc0005a55e0, 0xc01fc37100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc0005a55e0, 0xc01fc37100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc0005a55e0, 0xc01fc37100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc0005a55e0, 0xc01fc37100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc0005a55e0, 0xc01fc37100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc0005a55e0, 0xc01fc37100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc0005a55e0, 0xc01fc37100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc0005a55e0, 0xc01fc37100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc0005a55e0, 0xc01fc37100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc0005a55e0, 0xc01fc37100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc0005a55e0, 0xc01fc36f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc0005a55e0, 0xc01fc36f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc0005a55e0, 0xc01fc36f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc0005a55e0, 0xc01fc36f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc0005a55e0, 0xc01fc36f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc0005a55e0, 0xc01fc36e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc0005a55e0, 0xc01fc36e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc0005a55e0, 0xc01fc36d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc0005a55e0, 0xc01fc36d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc0005a55e0, 0xc01fc36d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc0005a55e0, 0xc01fc36d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc01c435340, 0xc01fc36c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc01c435340, 0xc01fc36c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc01c435340, 0xc01fc36c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc01c435340, 0xc01fc36c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc01c435340, 0xc01fc36c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc01c435340, 0xc01fc36a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc01c435340, 0xc01fc36800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc01c435340, 0xc01fc36600) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc01c435340, 0xc01c4df700) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc01c435340, 0xc01c4df700) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc01c435340, 0xc01c4df700) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc01c435340, 0xc01c4df700) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc01c435340, 0xc01c4df700) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc01c435340, 0xc01c4df700) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.(*conn).serve(0xc000727f40, 0x4c511e0, 0xc000ef38c0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 535 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc016027480, 0x4c29860, 0xc0124d6b00, 0xc005dfa100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc007fbd420, 0xc0039271e0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc005dfa100, 0xc01c638790, 0x44ccc4d, 0x9, 0xc001803848) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc0124d6b00, 0xc005dfa100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc0115d1c50, 0xc007fbd3b0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc0115d1c50, 0xc007fbd3b0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc007fbd340, 0xc005dfa100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc007fbd340, 0xc005dfa100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e72c320, 0x4c29a20, 0xc007fbd340, 0xc005dfa100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc007fbd340, 0xc005dfa100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc007fbd340, 0xc005dfa100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc007fbd340, 0xc005dfa100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc007fbd340, 0xc005dfa100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc007fbd340, 0xc005dfa100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc007fbd340, 0xc005dfa100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc007fbd340, 0xc005dfa100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc007fbd340, 0xc005dfa100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc007fbd340, 0xc005dfa100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc007fbd340, 0xc005de3f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc007fbd340, 0xc005de3f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc007fbd340, 0xc005de3f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc007fbd340, 0xc005de3f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc007fbd340, 0xc005de3f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc007fbd340, 0xc005de3e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc007fbd340, 0xc005de3e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc007fbd340, 0xc005de3d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc007fbd340, 0xc005de3d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc007fbd340, 0xc005de3d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc007fbd340, 0xc005de3d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc01c5d4540, 0xc005de3c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc01c5d4540, 0xc005de3c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc01c5d4540, 0xc005de3c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc01c5d4540, 0xc005de3c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc01c5d4540, 0xc005de3c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc01c5d4540, 0xc005de3a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc01c5d4540, 0xc005de3800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc01c5d4540, 0xc005de3600) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc01c5d4540, 0xc00d77f100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc01c5d4540, 0xc00d77f100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc01c5d4540, 0xc00d77f100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc01c5d4540, 0xc00d77f100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc01c5d4540, 0xc00d77f100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc01c5d4540, 0xc00d77f100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.(*conn).serve(0xc00056a000, 0x4c511e0, 0xc0014a38c0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 536 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc013c89a00, 0x4c29860, 0xc0196450b0, 0xc01aba0f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc01abb90a0, 0xc00a361860, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc01aba0f00, 0xc028516000, 0x44ccc4d, 0x9, 0xc01a229a78) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc0196450b0, 0xc01aba0f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc01b08ad20, 0xc01abb9030) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc01b08ad20, 0xc01abb9030) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc01abb8fc0, 0xc01aba0f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc01abb8fc0, 0xc01aba0f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc01abb8fc0, 0xc01aba0f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:254 +0x20f | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc01abb8fc0, 0xc01aba0f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc01abb8fc0, 0xc01aba0f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc01abb8fc0, 0xc01aba0f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc01abb8fc0, 0xc01aba0f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc01abb8fc0, 0xc01aba0f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc01abb8fc0, 0xc01aba0f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc01abb8fc0, 0xc01aba0f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc01abb8fc0, 0xc01aba0f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc01abb8fc0, 0xc01aba0d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc01abb8fc0, 0xc01aba0d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc01abb8fc0, 0xc01aba0d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc01abb8fc0, 0xc01aba0d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc01abb8fc0, 0xc01aba0d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc01abb8fc0, 0xc01aba0c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc01abb8fc0, 0xc01aba0c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc01abb8fc0, 0xc01aba0b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc01abb8fc0, 0xc01aba0b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc01abb8fc0, 0xc01aba0b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc01abb8fc0, 0xc01aba0b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc028514000, 0xc01aba0a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc028514000, 0xc01aba0a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc028514000, 0xc01aba0a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc028514000, 0xc01aba0a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc028514000, 0xc01aba0a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc028514000, 0xc01aba0800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc028514000, 0xc01aba0600) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc028514000, 0xc01aba0400) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc028514000, 0xc013d3ab00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc028514000, 0xc013d3ab00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc028514000, 0xc013d3ab00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc028514000, 0xc013d3ab00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc028514000, 0xc013d3ab00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc028514000, 0xc013d3ab00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.(*conn).serve(0xc00056a0a0, 0x4c511e0, 0xc0014a3580) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 537 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc006cead00, 0x4c29860, 0xc019644ae8, 0xc01fc44f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc0005a5a40, 0xc00204eea0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc01fc44f00, 0xc0133453f0, 0x44ccc4d, 0x9, 0xc010e6b848) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc019644ae8, 0xc01fc44f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc0094d6240, 0xc0005a59d0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc0094d6240, 0xc0005a59d0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc0005a5960, 0xc01fc44f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc0005a5960, 0xc01fc44f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e72c320, 0x4c29a20, 0xc0005a5960, 0xc01fc44f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc0005a5960, 0xc01fc44f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc0005a5960, 0xc01fc44f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc0005a5960, 0xc01fc44f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc0005a5960, 0xc01fc44f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc0005a5960, 0xc01fc44f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc0005a5960, 0xc01fc44f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc0005a5960, 0xc01fc44f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc0005a5960, 0xc01fc44f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc0005a5960, 0xc01fc44f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc0005a5960, 0xc01fc44d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc0005a5960, 0xc01fc44d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc0005a5960, 0xc01fc44d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc0005a5960, 0xc01fc44d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc0005a5960, 0xc01fc44d00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc0005a5960, 0xc01fc44c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc0005a5960, 0xc01fc44c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc0005a5960, 0xc01fc44b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc0005a5960, 0xc01fc44b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc0005a5960, 0xc01fc44b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc0005a5960, 0xc01fc44b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc01c435500, 0xc01fc44a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc01c435500, 0xc01fc44a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc01c435500, 0xc01fc44a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc01c435500, 0xc01fc44a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc01c435500, 0xc01fc44a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc01c435500, 0xc01fc44800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc01c435500, 0xc01fc44600) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc01c435500, 0xc01fc44400) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc01c435500, 0xc01c4def00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc01c435500, 0xc01c4def00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc01c435500, 0xc01c4def00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc01c435500, 0xc01c4def00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc01c435500, 0xc01c4def00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc01c435500, 0xc01c4def00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.(*conn).serve(0xc00056a140, 0x4c511e0, 0xc000ef29c0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 538 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc012c4df80, 0x4c29860, 0xc0153da268, 0xc013b52800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc013b48230, 0xc0013b4d00, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc013b52800, 0xc0086a2a50, 0x44ccc4d, 0x9, 0xc014fa3848) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc0153da268, 0xc013b52800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc01befcf30, 0xc013b481c0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc01befcf30, 0xc013b481c0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc013b48150, 0xc013b52800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc013b48150, 0xc013b52800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e72c320, 0x4c29a20, 0xc013b48150, 0xc013b52800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc013b48150, 0xc013b52800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc013b48150, 0xc013b52800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc013b48150, 0xc013b52800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc013b48150, 0xc013b52800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc013b48150, 0xc013b52800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc013b48150, 0xc013b52800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc013b48150, 0xc013b52800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc013b48150, 0xc013b52800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc013b48150, 0xc013b52800) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc013b48150, 0xc013b52600) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc013b48150, 0xc013b52600) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc013b48150, 0xc013b52600) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc013b48150, 0xc013b52600) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc013b48150, 0xc013b52600) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc013b48150, 0xc013b52500) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc013b48150, 0xc013b52500) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc013b48150, 0xc013b52400) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc013b48150, 0xc013b52400) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc013b48150, 0xc013b52400) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc013b48150, 0xc013b52400) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc00d1b5ea0, 0xc013b52300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc00d1b5ea0, 0xc013b52300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc00d1b5ea0, 0xc013b52300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc00d1b5ea0, 0xc013b52300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc00d1b5ea0, 0xc013b52300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc00d1b5ea0, 0xc013b52100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc00d1b5ea0, 0xc013b1df00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc00d1b5ea0, 0xc013b1dd00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc00d1b5ea0, 0xc0068c3e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc00d1b5ea0, 0xc0068c3e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc00d1b5ea0, 0xc0068c3e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc00d1b5ea0, 0xc0068c3e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc00d1b5ea0, 0xc0068c3e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc00d1b5ea0, 0xc0068c3e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.(*conn).serve(0xc00056a1e0, 0x4c511e0, 0xc0014a3340) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 539 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc011d8c000, 0x4c29860, 0xc01f5d62c8, 0xc00f151300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc00059e460, 0xc002f23040, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc00f151300, 0xc01ba05810, 0x44ccc4d, 0x9, 0xc010e63848) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc01f5d62c8, 0xc00f151300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc016071ce0, 0xc00059e3f0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc016071ce0, 0xc00059e3f0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc00059e380, 0xc00f151300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc00059e380, 0xc00f151300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e72c320, 0x4c29a20, 0xc00059e380, 0xc00f151300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc00059e380, 0xc00f151300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc00059e380, 0xc00f151300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc00059e380, 0xc00f151300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc00059e380, 0xc00f151300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc00059e380, 0xc00f151300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc00059e380, 0xc00f151300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc00059e380, 0xc00f151300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc00059e380, 0xc00f151300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc00059e380, 0xc00f151300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc00059e380, 0xc00f151100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc00059e380, 0xc00f151100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc00059e380, 0xc00f151100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc00059e380, 0xc00f151100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc00059e380, 0xc00f151100) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc00059e380, 0xc00f151000) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc00059e380, 0xc00f151000) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc00059e380, 0xc00f150f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e080, 0x4c29a20, 0xc00059e380, 0xc00f150f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1(0x4c29a20, 0xc00059e380, 0xc00f150f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/cachecontrol.go:31 +0xa8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0a0, 0x4c29a20, 0xc00059e380, 0xc00f150f00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog.WithLogging.func1(0x4c2fb60, 0xc0198d20e0, 0xc00f150c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/httplog/httplog.go:91 +0x2f2 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0c0, 0x4c2fb60, 0xc0198d20e0, 0xc00f150c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1(0x4c2fb60, 0xc0198d20e0, 0xc00f150c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/wrap.go:51 +0xe6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00472e0e0, 0x4c2fb60, 0xc0198d20e0, 0xc00f150c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc006747080, 0x4c2fb60, 0xc0198d20e0, 0xc00f150c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:189 +0x51 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1440, 0x4c2fb60, 0xc0198d20e0, 0xc00f150a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c15c0, 0x4c2fb60, 0xc0198d20e0, 0xc00f150500) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1680, 0x4c2fb60, 0xc0198d20e0, 0xc00f150300) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/gorilla/mux.(*Router).ServeHTTP(0xc0079c1740, 0x4c2fb60, 0xc0198d20e0, 0xc01ba35e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/gorilla/mux/mux.go:210 +0xd3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).router.func1(0x4c2fb60, 0xc0198d20e0, 0xc01ba35e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:27 +0x64 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0000f7900, 0x4c2fb60, 0xc0198d20e0, 0xc01ba35e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/pkg/cluster.(*Cluster).getHandler.func1(0x4c2fb60, 0xc0198d20e0, 0xc01ba35e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/pkg/cluster/router.go:14 +0x95 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc0008dccf0, 0x4c2fb60, 0xc0198d20e0, 0xc01ba35e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.serverHandler.ServeHTTP(0xc001173180, 0x4c2fb60, 0xc0198d20e0, 0xc01ba35e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2843 +0xa3 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.(*conn).serve(0xc00056a280, 0x4c511e0, 0xc000ef3400) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:1925 +0x8ad | |
| Feb 09 18:15:47 k3s-0 k3s[698]: created by net/http.(*Server).Serve | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2969 +0x36c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: goroutine 540 [select]: | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc01f7d7e00, 0x4c29860, 0xc01f5d6288, 0xc01f881e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:213 +0xc88 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.serveWatch(0x4bfa920, 0xc00315f960, 0xc0086d2ea0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/watch.go:138 +0x9d6 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2() | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:269 +0xd8 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc01f881e00, 0xc01ba056b0, 0x44ccc4d, 0x9, 0xc010e63848) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:340 +0x289 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1(0x4c29860, 0xc01f5d6288, 0xc01f881e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/handlers/get.go:268 +0xb59 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc01fb9cf90, 0xc00315f8f0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/installer.go:1157 +0x91 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc01fb9cf90, 0xc00315f8f0) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/metrics/metrics.go:384 +0x282 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).dispatch(0xc0008f8090, 0x4c29a20, 0xc004d4fea0, 0xc01f881e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:288 +0xa84 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/github.com/emicklei/go-restful.(*Container).Dispatch(...) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/github.com/emicklei/go-restful/container.go:199 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44ddc97, 0xe, 0xc0008f8090, 0xc000e83030, 0x4c29a20, 0xc004d4fea0, 0xc01f881e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:146 +0x539 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.(*proxyHandler).ServeHTTP(0xc00e72c320, 0x4c29a20, 0xc004d4fea0, 0xc01f881e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/handler_proxy.go:121 +0x183 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc01b867d80, 0x4c29a20, 0xc004d4fea0, 0xc01f881e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:248 +0x3db | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0004b2150, 0x4c29a20, 0xc004d4fea0, 0xc01f881e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/mux/pathrecorder.go:234 +0x8c | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.director.ServeHTTP(0x44e1b04, 0xf, 0xc009ad0900, 0xc0004b2150, 0x4c29a20, 0xc004d4fea0, 0xc01f881e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/handler.go:154 +0x74d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1(0x4c29a20, 0xc004d4fea0, 0xc01f881e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authorization.go:64 +0x563 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b7191c0, 0x4c29a20, 0xc004d4fea0, 0xc01f881e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1(0x4c29a20, 0xc004d4fea0, 0xc01f881e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/maxinflight.go:149 +0x582 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006746ff0, 0x4c29a20, 0xc004d4fea0, 0xc01f881e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1(0x4c29a20, 0xc004d4fea0, 0xc01f881e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/impersonation.go:50 +0x231d | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc00b719200, 0x4c29a20, 0xc004d4fea0, 0xc01f881e00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithAuthentication.func1(0x4c29a20, 0xc004d4fea0, 0xc01f881c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/authentication.go:70 +0x672 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc005ba6780, 0x4c29a20, 0xc004d4fea0, 0xc01f881c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc00472e060, 0x4c29a20, 0xc004d4fea0, 0xc01f881c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/timeout.go:92 +0x42a | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1(0x4c29a20, 0xc004d4fea0, 0xc01f881c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/filters/waitgroup.go:59 +0x137 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747020, 0x4c29a20, 0xc004d4fea0, 0xc01f881c00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1(0x4c29a20, 0xc004d4fea0, 0xc01f881b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/requestinfo.go:39 +0x269 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP(0xc006747050, 0x4c29a20, 0xc004d4fea0, 0xc01f881b00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /usr/local/go/src/net/http/server.go:2042 +0x44 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1(0x4c29a20, 0xc004d4fea0, 0xc01f881a00) | |
| Feb 09 18:15:47 k3s-0 k3s[698]: /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/endpoints/filters/warning.go:35 +0x1a7 | |
| Feb 09 18:15:47 k3s-0 k3s[698]: net/http.HandlerFunc.ServeHTTP( |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment