Created
January 26, 2022 15:30
-
-
Save ncdc/bf8eb1338f48a65559b7cd56710d3f99 to your computer and use it in GitHub Desktop.
Output from kcp e2e tests on a 2019 16" MacBook Pro 2.6 GHz 6-Core Intel Core i7 32GB RAM
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| --- FAIL: TestAPIInheritance (0.00s) | |
| --- FAIL: TestAPIInheritance/Basic_workspace_API_inheritance (70.00s) | |
| util.go:85: Saving test artifacts and data under /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestAPIInheritanceBasic_workspace_API_inheritance2907862924/001/TestAPIInheritance/Basic_workspace_API_inheritance/758656762. | |
| test.go:105: Starting kcp servers... | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestAPIInheritanceBasic_workspace_API_inheritance2907862924/001/TestAPIInheritance/Basic_workspace_API_inheritance/758656762/data/kcp/main --listen=:60446 --etcd-client-port=60447 --etcd-peer-port=60448 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig --install-workspace-controller | |
| test.go:137: error contacting /livez: Get "https://[::1]:60446/livez": context deadline exceeded | |
| test.go:137: error contacting /readyz: Get "https://[::1]:60446/readyz": context deadline exceeded | |
| kcp.go:132: cleanup: ending kcp server | |
| FAIL | |
| FAIL github.com/kcp-dev/kcp/test/e2e/api_inheritance 71.658s | |
| ok github.com/kcp-dev/kcp/test/e2e/framework 1.056s | |
| --- FAIL: TestClusterController (0.00s) | |
| --- FAIL: TestClusterController/update_a_synced_object,_expect_status_to_sync_to_source (73.58s) | |
| util.go:85: Saving test artifacts and data under /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestClusterControllerupdate_a_synced_object,_expect_status_to_sync_to_source862173056/001/TestClusterController/update_a_synced_object,_expect_status_to_sync_to_source/1863318276. | |
| test.go:105: Starting kcp servers... | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestClusterControllerupdate_a_synced_object,_expect_status_to_sync_to_source862173056/001/TestClusterController/update_a_synced_object,_expect_status_to_sync_to_source/1863318276/data/kcp/source --listen=:60450 --etcd-client-port=60451 --etcd-peer-port=60453 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig --push-mode --install-cluster-controller --resources-to-sync=cowboys.wildwest.dev --auto-publish-apis | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestClusterControllerupdate_a_synced_object,_expect_status_to_sync_to_source862173056/001/TestClusterController/update_a_synced_object,_expect_status_to_sync_to_source/1863318276/data/kcp/sink --listen=:60455 --etcd-client-port=60457 --etcd-peer-port=60459 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig | |
| test.go:137: error contacting /readyz: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]informer-sync ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-cluster-controller ok\n[+]shutdown ok\nreadyz check failed") has prevented the request from succeeding | |
| test.go:137: error contacting /livez: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-cluster-controller ok\nlivez check failed") has prevented the request from succeeding | |
| test.go:137: error contacting /livez: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-cluster-controller ok\nlivez check failed") has prevented the request from succeeding | |
| test.go:137: error contacting /readyz: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]informer-sync ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-cluster-controller ok\n[+]shutdown ok\nreadyz check failed") has prevented the request from succeeding | |
| test.go:137: error contacting /readyz: Get "https://[::1]:60455/readyz": context deadline exceeded | |
| test.go:137: error contacting /livez: Get "https://[::1]:60455/livez": context deadline exceeded | |
| kcp.go:132: cleanup: ending kcp server | |
| kcp.go:132: cleanup: ending kcp server | |
| --- FAIL: TestClusterController/create_an_object,_expect_spec_to_sync_to_sink (73.69s) | |
| util.go:85: Saving test artifacts and data under /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestClusterControllercreate_an_object,_expect_spec_to_sync_to_sink228170106/001/TestClusterController/create_an_object,_expect_spec_to_sync_to_sink/2378913202. | |
| test.go:105: Starting kcp servers... | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestClusterControllercreate_an_object,_expect_spec_to_sync_to_sink228170106/001/TestClusterController/create_an_object,_expect_spec_to_sync_to_sink/2378913202/data/kcp/source --listen=:60449 --etcd-client-port=60452 --etcd-peer-port=60454 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig --push-mode --install-cluster-controller --resources-to-sync=cowboys.wildwest.dev --auto-publish-apis | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestClusterControllercreate_an_object,_expect_spec_to_sync_to_sink228170106/001/TestClusterController/create_an_object,_expect_spec_to_sync_to_sink/2378913202/data/kcp/sink --listen=:60456 --etcd-client-port=60458 --etcd-peer-port=60460 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig | |
| test.go:137: error contacting /readyz: Get "https://[::1]:60449/readyz": context deadline exceeded | |
| test.go:137: error contacting /livez: Get "https://[::1]:60449/livez": context deadline exceeded | |
| test.go:137: error contacting /livez: Get "https://[::1]:60456/livez": context deadline exceeded | |
| test.go:137: error contacting /readyz: Get "https://[::1]:60456/readyz": context deadline exceeded | |
| kcp.go:132: cleanup: ending kcp server | |
| kcp.go:132: cleanup: ending kcp server | |
| FAIL | |
| FAIL github.com/kcp-dev/kcp/test/e2e/reconciler/cluster 75.710s | |
| ? github.com/kcp-dev/kcp/test/e2e/reconciler/cluster/apis/wildwest [no test files] | |
| ? github.com/kcp-dev/kcp/test/e2e/reconciler/cluster/apis/wildwest/v1alpha1 [no test files] | |
| ? github.com/kcp-dev/kcp/test/e2e/reconciler/cluster/client/clientset/versioned [no test files] | |
| ? github.com/kcp-dev/kcp/test/e2e/reconciler/cluster/client/clientset/versioned/fake [no test files] | |
| ? github.com/kcp-dev/kcp/test/e2e/reconciler/cluster/client/clientset/versioned/scheme [no test files] | |
| ? github.com/kcp-dev/kcp/test/e2e/reconciler/cluster/client/clientset/versioned/typed/wildwest/v1alpha1 [no test files] | |
| ? github.com/kcp-dev/kcp/test/e2e/reconciler/cluster/client/clientset/versioned/typed/wildwest/v1alpha1/fake [no test files] | |
| ? github.com/kcp-dev/kcp/test/e2e/reconciler/cluster/client/informers/externalversions [no test files] | |
| ? github.com/kcp-dev/kcp/test/e2e/reconciler/cluster/client/informers/externalversions/internalinterfaces [no test files] | |
| ? github.com/kcp-dev/kcp/test/e2e/reconciler/cluster/client/informers/externalversions/wildwest [no test files] | |
| ? github.com/kcp-dev/kcp/test/e2e/reconciler/cluster/client/informers/externalversions/wildwest/v1alpha1 [no test files] | |
| ? github.com/kcp-dev/kcp/test/e2e/reconciler/cluster/client/listers/wildwest/v1alpha1 [no test files] | |
| --- FAIL: TestIngressController (0.00s) | |
| --- FAIL: TestIngressController/create_an_ingress_that_points_to_a_valid_service_and_expect_the_Ingress_to_be_scheduled_to_the_same_cluster (70.99s) | |
| util.go:85: Saving test artifacts and data under /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestIngressControllercreate_an_ingress_that_points_to_a_valid_service_and_expect_the_Ingress_to_be_scheduled_to_the_same_cluster378493697/001/TestIngressController/create_an_ingress_that_points_to_a_valid_service_and_expect_the_Ingress_to_be_scheduled_to_the_same_cluster/1009326321. | |
| test.go:105: Starting kcp servers... | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestIngressControllercreate_an_ingress_that_points_to_a_valid_service_and_expect_the_Ingress_to_be_scheduled_to_the_same_cluster378493697/001/TestIngressController/create_an_ingress_that_points_to_a_valid_service_and_expect_the_Ingress_to_be_scheduled_to_the_same_cluster/1009326321/data/kcp/source --listen=:60907 --etcd-client-port=60919 --etcd-peer-port=60939 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig --push-mode --install-cluster-controller --auto-publish-apis=true --resources-to-sync=ingresses.networking.k8s.io,deployments.apps,services | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestIngressControllercreate_an_ingress_that_points_to_a_valid_service_and_expect_the_Ingress_to_be_scheduled_to_the_same_cluster378493697/001/TestIngressController/create_an_ingress_that_points_to_a_valid_service_and_expect_the_Ingress_to_be_scheduled_to_the_same_cluster/1009326321/data/kcp/sink --listen=:60987 --etcd-client-port=60995 --etcd-peer-port=61015 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig | |
| test.go:137: `kcp` failed: exit status 255 logs: | |
| I0126 10:28:27.241614 96315 etcd.go:57] Creating embedded etcd server\nn"level":"warn","ts":1643210908.8094988,"caller":"fileutil/fileutil.go:57","msg":"check file permission","error":"directory \"/var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestIngressControllercreate_an_ingress_that_points_to_a_valid_service_and_expect_the_Ingress_to_be_scheduled_to_the_same_cluster378493697/001/TestIngressController/create_an_ingress_that_points_to_a_valid_service_and_expect_the_Ingress_to_be_scheduled_to_the_same_cluster/1009326321/data/kcp/source\" exist, but the permission is \"drwxr-xr-x\". The recommended permission is \"-rwx------\" to prevent possible unprivileged access to the data"}\nn"level":"warn","ts":"2022-01-26T10:28:31.211-0500","caller":"etcdserver/metrics.go:224","msg":"failed to get file descriptor usage","error":"cannot get FDUsage on darwin"}\nnonnected to etcd 5307569640043707373 default\nn0126 10:28:33.081712 96315 serving.go:341] Generated self-signed cert (/var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestIngressControllercreate_an_ingress_that_points_to_a_valid_service_and_expect_the_Ingress_to_be_scheduled_to_the_same_cluster378493697/001/TestIngressController/create_an_ingress_that_points_to_a_valid_service_and_expect_the_Ingress_to_be_scheduled_to_the_same_cluster/1009326321/data/kcp/source/apiserver.crt, /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestIngressControllercreate_an_ingress_that_points_to_a_valid_service_and_expect_the_Ingress_to_be_scheduled_to_the_same_cluster378493697/001/TestIngressController/create_an_ingress_that_points_to_a_valid_service_and_expect_the_Ingress_to_be_scheduled_to_the_same_cluster/1009326321/data/kcp/source/apiserver.key)\nn0126 10:28:33.081759 96315 server.go:399] external host was not specified, using 192.168.4.118\nn0126 10:28:33.088509 96315 plugins.go:158] Loaded 1 mutating admission controller(s) successfully in the following order: NamespaceLifecycle.\nn0126 10:28:33.660614 96315 genericapiserver.go:454] Skipping API authentication.k8s.io/v1beta1 because it has no resources.\nn0126 10:28:33.661376 96315 genericapiserver.go:454] Skipping API authorization.k8s.io/v1beta1 because it has no resources.\nn0126 10:28:33.661971 96315 genericapiserver.go:454] Skipping API certificates.k8s.io/v1beta1 because it has no resources.\nn0126 10:28:33.662401 96315 genericapiserver.go:454] Skipping API coordination.k8s.io/v1beta1 because it has no resources.\nn0126 10:28:33.663426 96315 genericapiserver.go:454] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources.\nn0126 10:28:33.663432 96315 genericapiserver.go:454] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources.\nn0126 10:28:33.664192 96315 genericapiserver.go:454] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources.\nn0126 10:28:33.664617 96315 genericapiserver.go:454] Skipping API events.k8s.io/v1beta1 because it has no resources.\nn0126 10:28:33.664853 96315 plugins.go:158] Loaded 1 mutating admission controller(s) successfully in the following order: NamespaceLifecycle.\nn0126 10:28:33.951560 96315 dynamic_serving_content.go:129] "Starting controller" name="serving-cert::/var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestIngressControllercreate_an_ingress_that_points_to_a_valid_service_and_expect_the_Ingress_to_be_scheduled_to_the_same_cluster378493697/001/TestIngressController/create_an_ingress_that_points_to_a_valid_service_and_expect_the_Ingress_to_be_scheduled_to_the_same_cluster/1009326321/data/kcp/source/apiserver.crt::/var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestIngressControllercreate_an_ingress_that_points_to_a_valid_service_and_expect_the_Ingress_to_be_scheduled_to_the_same_cluster378493697/001/TestIngressController/create_an_ingress_that_points_to_a_valid_service_and_expect_the_Ingress_to_be_scheduled_to_the_same_cluster/1009326321/data/kcp/source/apiserver.key"\nn0126 10:28:33.951639 96315 secure_serving.go:256] Serving securely on [::]:60907\nn0126 10:28:33.951683 96315 tlsconfig.go:240] "Starting DynamicServingCertificateController"\nn0126 10:28:33.951714 96315 crd_finalizer.go:269] Starting CRDFinalizer\nn0126 10:28:33.951856 96315 establishing_controller.go:77] Starting EstablishingController\nn0126 10:28:33.951859 96315 controller.go:130] Starting OpenAPI controller\nn0126 10:28:33.951858 96315 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController\nn0126 10:28:33.951773 96315 naming_controller.go:296] Starting NamingConditionController\nn0126 10:28:33.951907 96315 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController\nn0126 10:28:33.952384 96315 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller\nn0126 10:28:33.952398 96315 shared_informer.go:240] Waiting for caches to sync for cluster_authentication_trust_controller\nn0126 10:28:33.952447 96315 namespace_controller.go:200] Starting namespace controller\nn0126 10:28:33.952508 96315 shared_informer.go:240] Waiting for caches to sync for namespace\nn0126 10:28:34.052547 96315 bootstrap.go:76] bootstrapping clusters.cluster.example.dev\nn0126 10:28:34.052551 96315 bootstrap.go:76] bootstrapping apiresourceimports.apiresource.kcp.dev\nn0126 10:28:34.052608 96315 bootstrap.go:76] bootstrapping negotiatedapiresources.apiresource.kcp.dev\nn0126 10:28:34.052619 96315 shared_informer.go:247] Caches are synced for cluster_authentication_trust_controller \nn0126 10:28:34.052678 96315 shared_informer.go:247] Caches are synced for namespace \nn"level":"warn","ts":"2022-01-26T10:28:34.176-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"119.757486ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/negotiatedapiresources.apiresource.kcp.dev\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:34.176-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"216.39464ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/system-node-high\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:34.176-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"119.832578ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/clusters.cluster.example.dev\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:34.176-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"119.76331ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/apiresourceimports.apiresource.kcp.dev\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:34.498-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"318.443059ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/probes\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:34.498-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:34.179-0500","time spent":"318.51579ms","remote":"127.0.0.1:61850","response type":"/etcdserverpb.KV/Range","request count":0,"request size":65,"response count":0,"response size":26,"request content":"key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/probes\" "}\nn"level":"warn","ts":"2022-01-26T10:28:34.498-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:34.179-0500","time spent":"318.263088ms","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":3477,"response count":0,"response size":36,"request content":"compare:<target:MOD key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/clusters.cluster.example.dev\" mod_revision:0 > success:<request_put:<key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/clusters.cluster.example.dev\" value_size:3378 >> failure:<>"}\nn"level":"warn","ts":"2022-01-26T10:28:34.498-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:34.179-0500","time spent":"318.290094ms","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":7336,"response count":0,"response size":36,"request content":"compare:<target:MOD key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/negotiatedapiresources.apiresource.kcp.dev\" mod_revision:0 > success:<request_put:<key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/negotiatedapiresources.apiresource.kcp.dev\" value_size:7223 >> failure:<>"}\nn"level":"warn","ts":"2022-01-26T10:28:34.498-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:34.180-0500","time spent":"318.194907ms","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":7518,"response count":0,"response size":36,"request content":"compare:<target:MOD key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/apiresourceimports.apiresource.kcp.dev\" mod_revision:0 > success:<request_put:<key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/apiresourceimports.apiresource.kcp.dev\" value_size:7409 >> failure:<>"}\nn"level":"warn","ts":"2022-01-26T10:28:35.295-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718375,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:35.795-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718375,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:35.910-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.618331147s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:35.910-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.618299965s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:35.910-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:34.291-0500","time spent":"1.618426458s","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":26,"request content":"key:\"/registry/health\" "}\nn"level":"warn","ts":"2022-01-26T10:28:35.910-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:34.291-0500","time spent":"1.618451158s","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":26,"request content":"key:\"/registry/health\" "}\nn"level":"warn","ts":"2022-01-26T10:28:35.910-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.115437292s","expected-duration":"100ms","prefix":"","request":"header:<ID:18153304860016718374 auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/probes\" mod_revision:0 > success:<request_put:<key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/probes\" value_size:598 >> failure:<>>","response":"size:14"}\nn"level":"warn","ts":"2022-01-26T10:28:35.910-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:34.500-0500","time spent":"1.410315096s","remote":"127.0.0.1:61850","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":669,"response count":0,"response size":36,"request content":"compare:<target:MOD key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/probes\" mod_revision:0 > success:<request_put:<key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/probes\" value_size:598 >> failure:<>"}\nn0126 10:28:35.911790 96315 trace.go:205] Trace[1345261303]: "Create" url:/apis/flowcontrol.apiserver.k8s.io/v1beta1/flowschemas,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:9568e4c2-5667-4356-a8c8-5324b253fcca,client:::1,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:34.499) (total time: 1412ms):\nnrace[1345261303]: ---"Object stored in database" 1411ms (10:28:35.911)\nnrace[1345261303]: [1.412134534s] [1.412134534s] END\nn"level":"warn","ts":"2022-01-26T10:28:36.293-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.339950437s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/rbac.authorization.k8s.io/clusterroles/admin/\" range_end:\"/registry/rbac.authorization.k8s.io/clusterroles/admin0\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:36.293-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"267.927148ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:36.293-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.792554283s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/clusters.cluster.example.dev\" ","response":"range_response_count:1 size:3489"}\nn"level":"warn","ts":"2022-01-26T10:28:36.293-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.792282554s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/apiresourceimports.apiresource.kcp.dev\" ","response":"range_response_count:1 size:7530"}\nn"level":"warn","ts":"2022-01-26T10:28:36.293-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.792275092s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/negotiatedapiresources.apiresource.kcp.dev\" ","response":"range_response_count:1 size:7348"}\nn"level":"warn","ts":"2022-01-26T10:28:36.293-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:34.501-0500","time spent":"1.792330093s","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Range","request count":0,"request size":103,"response count":1,"response size":7552,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/apiresourceimports.apiresource.kcp.dev\" "}\nn"level":"warn","ts":"2022-01-26T10:28:36.293-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"380.019395ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/system-leader-election\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:36.293-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:34.501-0500","time spent":"1.792627192s","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Range","request count":0,"request size":93,"response count":1,"response size":3511,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/clusters.cluster.example.dev\" "}\nn"level":"warn","ts":"2022-01-26T10:28:36.293-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:34.953-0500","time spent":"1.340011746s","remote":"127.0.0.1:61846","response type":"/etcdserverpb.KV/Range","request count":0,"request size":114,"response count":0,"response size":26,"request content":"key:\"/registry/rbac.authorization.k8s.io/clusterroles/admin/\" range_end:\"/registry/rbac.authorization.k8s.io/clusterroles/admin0\" "}\nn"level":"warn","ts":"2022-01-26T10:28:36.293-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:34.501-0500","time spent":"1.792320361s","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Range","request count":0,"request size":107,"response count":1,"response size":7370,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/negotiatedapiresources.apiresource.kcp.dev\" "}\nn"level":"warn","ts":"2022-01-26T10:28:36.293-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.791382671s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/clusters.cluster.example.dev\" ","response":"range_response_count:1 size:3489"}\nn"level":"warn","ts":"2022-01-26T10:28:36.293-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:35.913-0500","time spent":"380.110397ms","remote":"127.0.0.1:61850","response type":"/etcdserverpb.KV/Range","request count":0,"request size":81,"response count":0,"response size":26,"request content":"key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/system-leader-election\" "}\nn"level":"warn","ts":"2022-01-26T10:28:36.293-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:34.502-0500","time spent":"1.791630524s","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Range","request count":0,"request size":93,"response count":1,"response size":3511,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/clusters.cluster.example.dev\" "}\nn"level":"warn","ts":"2022-01-26T10:28:36.293-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"267.943741ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:4"}\nn0126 10:28:36.294175 96315 trace.go:205] Trace[170274028]: "List etcd3" key:/rbac.authorization.k8s.io/clusterroles/admin,resourceVersion:,resourceVersionMatch:,limit:0,continue: (26-Jan-2022 10:28:34.953) (total time: 1340ms):\nnrace[170274028]: [1.340806406s] [1.340806406s] END\nn0126 10:28:36.294469 96315 trace.go:205] Trace[712626006]: "List" url:/apis/rbac.authorization.k8s.io/v1/clusterroles,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:11a06f56-f583-49ce-bd45-66e740814e04,client:::1,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:34.953) (total time: 1341ms):\nnrace[712626006]: ---"Listing from storage done" 1340ms (10:28:36.294)\nnrace[712626006]: [1.341109749s] [1.341109749s] END\nn0126 10:28:36.294911 96315 trace.go:205] Trace[1696485770]: "Get" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/clusters.cluster.example.dev,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:5547d09b-6a56-432d-97b2-26638fa58d8a,client:192.168.4.118,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:34.500) (total time: 1793ms):\nnrace[1696485770]: ---"About to write a response" 1793ms (10:28:36.294)\nnrace[1696485770]: [1.793939326s] [1.793939326s] END\nn0126 10:28:36.295272 96315 trace.go:205] Trace[1429756868]: "Get" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/apiresourceimports.apiresource.kcp.dev,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:10264435-3417-4363-9131-e403936874ef,client:192.168.4.118,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:34.501) (total time: 1794ms):\nnrace[1429756868]: ---"About to write a response" 1793ms (10:28:36.294)\nnrace[1429756868]: [1.794114125s] [1.794114125s] END\nn0126 10:28:36.295405 96315 trace.go:205] Trace[1877276823]: "Get" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/negotiatedapiresources.apiresource.kcp.dev,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:525b135a-f363-4454-8f73-d341324dafb8,client:192.168.4.118,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:34.501) (total time: 1794ms):\nnrace[1877276823]: ---"About to write a response" 1793ms (10:28:36.294)\nnrace[1877276823]: [1.794276746s] [1.794276746s] END\nn0126 10:28:36.357018 96315 trace.go:205] Trace[526002222]: "GuaranteedUpdate etcd3" type:*apiextensions.CustomResourceDefinition (26-Jan-2022 10:28:34.502) (total time: 1854ms):\nnrace[526002222]: ---"initial value restored" 1792ms (10:28:36.294)\nnrace[526002222]: [1.854861884s] [1.854861884s] END\nn0126 10:28:36.357397 96315 trace.go:205] Trace[1390840455]: "Update" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/clusters.cluster.example.dev/status,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:b774a84f-8ba2-4d2e-b11a-81a89965e9f3,client:::1,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:34.501) (total time: 1855ms):\nnrace[1390840455]: ---"Object stored in database" 1854ms (10:28:36.357)\nnrace[1390840455]: [1.855489193s] [1.855489193s] END\nn"level":"warn","ts":"2022-01-26T10:28:36.695-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"394.05407ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/rbac.authorization.k8s.io/clusterroles/admin/system:aggregate-to-admin\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:36.695-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:36.358-0500","time spent":"337.359582ms","remote":"127.0.0.1:61850","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":816,"response count":0,"response size":36,"request content":"compare:<target:MOD key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/workload-leader-election\" mod_revision:0 > success:<request_put:<key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/workload-leader-election\" value_size:727 >> failure:<>"}\nn"level":"warn","ts":"2022-01-26T10:28:36.695-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:36.301-0500","time spent":"394.114455ms","remote":"127.0.0.1:61846","response type":"/etcdserverpb.KV/Range","request count":0,"request size":82,"response count":0,"response size":26,"request content":"key:\"/registry/rbac.authorization.k8s.io/clusterroles/admin/system:aggregate-to-admin\" "}\nn"level":"warn","ts":"2022-01-26T10:28:37.196-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718383,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:37.696-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718383,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:38.196-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718383,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:38.276-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.876113368s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/negotiatedapiresources.apiresource.kcp.dev\" ","response":"range_response_count:1 size:7348"}\nn"level":"warn","ts":"2022-01-26T10:28:38.276-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.917280405s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/negotiatedapiresources.apiresource.kcp.dev\" ","response":"range_response_count:1 size:7348"}\nn"level":"warn","ts":"2022-01-26T10:28:38.276-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.869033981s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:38.276-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.869094915s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:38.276-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:36.400-0500","time spent":"1.876191155s","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Range","request count":0,"request size":107,"response count":1,"response size":7370,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/negotiatedapiresources.apiresource.kcp.dev\" "}\nn"level":"warn","ts":"2022-01-26T10:28:38.276-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:36.359-0500","time spent":"1.917335419s","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Range","request count":0,"request size":107,"response count":1,"response size":7370,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/negotiatedapiresources.apiresource.kcp.dev\" "}\nn"level":"warn","ts":"2022-01-26T10:28:38.276-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.579207938s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/rbac.authorization.k8s.io/clusterroles/admin/admin\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:38.276-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:36.407-0500","time spent":"1.869171995s","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":26,"request content":"key:\"/registry/health\" "}\nn"level":"warn","ts":"2022-01-26T10:28:38.276-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:36.407-0500","time spent":"1.869116329s","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":26,"request content":"key:\"/registry/health\" "}\nn"level":"warn","ts":"2022-01-26T10:28:38.276-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:36.697-0500","time spent":"1.579259675s","remote":"127.0.0.1:61846","response type":"/etcdserverpb.KV/Range","request count":0,"request size":62,"response count":0,"response size":26,"request content":"key:\"/registry/rbac.authorization.k8s.io/clusterroles/admin/admin\" "}\nn"level":"warn","ts":"2022-01-26T10:28:38.276-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.876377728s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/apiresourceimports.apiresource.kcp.dev\" ","response":"range_response_count:1 size:7530"}\nn"level":"warn","ts":"2022-01-26T10:28:38.276-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.917614837s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/clusters.cluster.example.dev\" ","response":"range_response_count:1 size:4400"}\nn"level":"warn","ts":"2022-01-26T10:28:38.276-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.876368693s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/clusters.cluster.example.dev\" ","response":"range_response_count:1 size:4400"}\nn"level":"warn","ts":"2022-01-26T10:28:38.276-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:36.400-0500","time spent":"1.876433302s","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Range","request count":0,"request size":103,"response count":1,"response size":7552,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/apiresourceimports.apiresource.kcp.dev\" "}\nn"level":"warn","ts":"2022-01-26T10:28:38.276-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:36.358-0500","time spent":"1.917664718s","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Range","request count":0,"request size":93,"response count":1,"response size":4422,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/clusters.cluster.example.dev\" "}\nn"level":"warn","ts":"2022-01-26T10:28:38.276-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.57938821s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/kube-controller-manager\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:38.276-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:36.400-0500","time spent":"1.87641939s","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Range","request count":0,"request size":93,"response count":1,"response size":4422,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/clusters.cluster.example.dev\" "}\nn"level":"warn","ts":"2022-01-26T10:28:38.276-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:36.697-0500","time spent":"1.579464169s","remote":"127.0.0.1:61850","response type":"/etcdserverpb.KV/Range","request count":0,"request size":82,"response count":0,"response size":26,"request content":"key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/kube-controller-manager\" "}\nn0126 10:28:38.277019 96315 trace.go:205] Trace[210301787]: "Get" url:/apis/rbac.authorization.k8s.io/v1/clusterroles/admin,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:22e5e978-8690-485d-9121-09ddce7b5c8e,client:::1,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:36.696) (total time: 1579ms):\nnrace[210301787]: [1.579971887s] [1.579971887s] END\nn0126 10:28:38.277100 96315 trace.go:205] Trace[2073545190]: "Get" url:/apis/flowcontrol.apiserver.k8s.io/v1beta1/flowschemas/kube-controller-manager,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:7b1348bf-fcf9-411e-957b-4d7ac5ea6eb0,client:::1,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:36.697) (total time: 1579ms):\nnrace[2073545190]: [1.579969029s] [1.579969029s] END\nn0126 10:28:38.278161 96315 trace.go:205] Trace[89478404]: "Get" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/negotiatedapiresources.apiresource.kcp.dev,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:0e715666-6222-4292-886d-eb542b94f136,client:192.168.4.118,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:36.399) (total time: 1878ms):\nnrace[89478404]: ---"About to write a response" 1877ms (10:28:38.277)\nnrace[89478404]: [1.87815267s] [1.87815267s] END\nn0126 10:28:38.278265 96315 trace.go:205] Trace[942318863]: "Get" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/clusters.cluster.example.dev,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:77e2c309-09e3-46a6-89c5-0c4383b2efba,client:192.168.4.118,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:36.399) (total time: 1878ms):\nnrace[942318863]: ---"About to write a response" 1877ms (10:28:38.277)\nnrace[942318863]: [1.878202671s] [1.878202671s] END\nn0126 10:28:38.278411 96315 trace.go:205] Trace[1345049094]: "Get" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/apiresourceimports.apiresource.kcp.dev,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:25049195-feb0-4273-9919-bef0e505c989,client:192.168.4.118,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:36.399) (total time: 1878ms):\nnrace[1345049094]: ---"About to write a response" 1877ms (10:28:38.277)\nnrace[1345049094]: [1.878458073s] [1.878458073s] END\nn0126 10:28:38.280718 96315 trace.go:205] Trace[1155023149]: "GuaranteedUpdate etcd3" type:*apiextensions.CustomResourceDefinition (26-Jan-2022 10:28:36.358) (total time: 1921ms):\nnrace[1155023149]: ---"initial value restored" 1919ms (10:28:38.277)\nnrace[1155023149]: [1.921845335s] [1.921845335s] END\nn0126 10:28:38.280976 96315 trace.go:205] Trace[1981489191]: "Update" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/clusters.cluster.example.dev/status,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:77995fb7-c50a-4bf7-b95e-1381936b56e8,client:::1,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:36.358) (total time: 1922ms):\nnrace[1981489191]: ---"Object stored in database" 1921ms (10:28:38.280)\nnrace[1981489191]: [1.922465053s] [1.922465053s] END\nn"level":"warn","ts":"2022-01-26T10:28:38.596-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"108.042524ms","expected-duration":"100ms","prefix":"","request":"header:<ID:18153304860016718389 auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/kube-controller-manager\" mod_revision:0 > success:<request_put:<key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/kube-controller-manager\" value_size:647 >> failure:<>>","response":"size:14"}\nn"level":"warn","ts":"2022-01-26T10:28:38.596-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:38.280-0500","time spent":"315.752679ms","remote":"127.0.0.1:61850","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":735,"response count":0,"response size":36,"request content":"compare:<target:MOD key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/kube-controller-manager\" mod_revision:0 > success:<request_put:<key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/kube-controller-manager\" value_size:647 >> failure:<>"}\nn"level":"warn","ts":"2022-01-26T10:28:38.596-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"315.576792ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/rbac.authorization.k8s.io/clusterroles/admin/system:aggregate-to-view\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:38.596-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:38.280-0500","time spent":"315.616976ms","remote":"127.0.0.1:61846","response type":"/etcdserverpb.KV/Range","request count":0,"request size":81,"response count":0,"response size":26,"request content":"key:\"/registry/rbac.authorization.k8s.io/clusterroles/admin/system:aggregate-to-view\" "}\nn"level":"warn","ts":"2022-01-26T10:28:38.596-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:38.280-0500","time spent":"315.571134ms","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":8303,"response count":0,"response size":36,"request content":"compare:<target:MOD key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/negotiatedapiresources.apiresource.kcp.dev\" mod_revision:5 > success:<request_put:<key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/negotiatedapiresources.apiresource.kcp.dev\" value_size:8190 >> failure:<request_range:<key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/negotiatedapiresources.apiresource.kcp.dev\" > >"}\nn0126 10:28:38.597378 96315 trace.go:205] Trace[981998503]: "GuaranteedUpdate etcd3" type:*apiextensions.CustomResourceDefinition (26-Jan-2022 10:28:36.358) (total time: 2238ms):\nnrace[981998503]: ---"initial value restored" 1919ms (10:28:38.277)\nnrace[981998503]: ---"Transaction committed" 316ms (10:28:38.597)\nnrace[981998503]: [2.238461783s] [2.238461783s] END\nn0126 10:28:38.597697 96315 trace.go:205] Trace[1619112757]: "Update" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/negotiatedapiresources.apiresource.kcp.dev/status,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:5c8e349f-89e2-42e3-b95b-7c00fa77ec42,client:::1,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:36.358) (total time: 2239ms):\nnrace[1619112757]: ---"Object stored in database" 2238ms (10:28:38.597)\nnrace[1619112757]: [2.239111994s] [2.239111994s] END\nn"level":"warn","ts":"2022-01-26T10:28:39.062-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"464.332452ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/kube-scheduler\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:39.062-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"464.393543ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/rbac.authorization.k8s.io/clusterroles/admin/view\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:39.062-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"673.891091ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:39.062-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"460.274026ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/apiresourceimports.apiresource.kcp.dev\" ","response":"range_response_count:1 size:7530"}\nn"level":"warn","ts":"2022-01-26T10:28:39.062-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"764.0828ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/negotiatedapiresources.apiresource.kcp.dev\" ","response":"range_response_count:1 size:8315"}\nn"level":"warn","ts":"2022-01-26T10:28:39.062-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"460.236435ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/negotiatedapiresources.apiresource.kcp.dev\" ","response":"range_response_count:1 size:8315"}\nn"level":"warn","ts":"2022-01-26T10:28:39.062-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:38.597-0500","time spent":"464.477008ms","remote":"127.0.0.1:61846","response type":"/etcdserverpb.KV/Range","request count":0,"request size":61,"response count":0,"response size":26,"request content":"key:\"/registry/rbac.authorization.k8s.io/clusterroles/admin/view\" "}\nn"level":"warn","ts":"2022-01-26T10:28:39.062-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"673.925744ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:39.062-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:38.388-0500","time spent":"673.942405ms","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":26,"request content":"key:\"/registry/health\" "}\nn"level":"warn","ts":"2022-01-26T10:28:39.062-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"764.043864ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/clusters.cluster.example.dev\" ","response":"range_response_count:1 size:4409"}\nn"level":"warn","ts":"2022-01-26T10:28:39.062-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:38.298-0500","time spent":"764.139682ms","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Range","request count":0,"request size":107,"response count":1,"response size":8337,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/negotiatedapiresources.apiresource.kcp.dev\" "}\nn"level":"warn","ts":"2022-01-26T10:28:39.062-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:38.597-0500","time spent":"464.395805ms","remote":"127.0.0.1:61850","response type":"/etcdserverpb.KV/Range","request count":0,"request size":73,"response count":0,"response size":26,"request content":"key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/kube-scheduler\" "}\nn"level":"warn","ts":"2022-01-26T10:28:39.062-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:38.388-0500","time spent":"673.994182ms","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":26,"request content":"key:\"/registry/health\" "}\nn"level":"warn","ts":"2022-01-26T10:28:39.062-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:38.602-0500","time spent":"460.394296ms","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Range","request count":0,"request size":107,"response count":1,"response size":8337,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/negotiatedapiresources.apiresource.kcp.dev\" "}\nn"level":"warn","ts":"2022-01-26T10:28:39.062-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:38.298-0500","time spent":"764.121888ms","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Range","request count":0,"request size":93,"response count":1,"response size":4431,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/clusters.cluster.example.dev\" "}\nn"level":"warn","ts":"2022-01-26T10:28:39.062-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:38.602-0500","time spent":"460.333868ms","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Range","request count":0,"request size":103,"response count":1,"response size":7552,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/apiresourceimports.apiresource.kcp.dev\" "}\nn"level":"warn","ts":"2022-01-26T10:28:39.062-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"764.036657ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/apiresourceimports.apiresource.kcp.dev\" ","response":"range_response_count:1 size:7530"}\nn"level":"warn","ts":"2022-01-26T10:28:39.062-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:38.298-0500","time spent":"764.552752ms","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Range","request count":0,"request size":103,"response count":1,"response size":7552,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/apiresourceimports.apiresource.kcp.dev\" "}\nn0126 10:28:39.064406 96315 trace.go:205] Trace[2072815744]: "Get" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/clusters.cluster.example.dev,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:04454384-5f37-498d-9618-2ca5902f14e5,client:192.168.4.118,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:38.298) (total time: 766ms):\nnrace[2072815744]: ---"About to write a response" 765ms (10:28:39.064)\nnrace[2072815744]: [766.331695ms] [766.331695ms] END\nn0126 10:28:39.064506 96315 trace.go:205] Trace[1856030311]: "Get" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/negotiatedapiresources.apiresource.kcp.dev,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:ed93aa3c-cc77-4183-bd0b-4dedf8520984,client:192.168.4.118,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:38.298) (total time: 766ms):\nnrace[1856030311]: ---"About to write a response" 766ms (10:28:39.064)\nnrace[1856030311]: [766.448923ms] [766.448923ms] END\nn0126 10:28:39.064923 96315 bootstrap.go:78] bootstrapped clusters.cluster.example.dev after 5.012232697s\nn0126 10:28:39.065207 96315 trace.go:205] Trace[1283759695]: "Get" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/apiresourceimports.apiresource.kcp.dev,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:22a65dc4-5fd6-4920-b5d4-5ee35640547a,client:192.168.4.118,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:38.298) (total time: 767ms):\nnrace[1283759695]: ---"About to write a response" 766ms (10:28:39.064)\nnrace[1283759695]: [767.130942ms] [767.130942ms] END\nn"level":"warn","ts":"2022-01-26T10:28:39.566-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718394,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:40.066-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718394,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:40.566-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718394,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:41.067-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718394,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:41.166-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.000813809s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"}\nn"level":"warn","ts":"2022-01-26T10:28:41.166-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:39.165-0500","time spent":"2.000878296s","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "}\nn"level":"warn","ts":"2022-01-26T10:28:41.166-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.000719649s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"}\nn"level":"warn","ts":"2022-01-26T10:28:41.166-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:39.165-0500","time spent":"2.000795723s","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "}\nn"level":"warn","ts":"2022-01-26T10:28:41.568-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718394,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:41.768-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.702825231s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/rbac.authorization.k8s.io/clusterroles/admin/cluster-admin\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:41.768-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:39.066-0500","time spent":"2.702356083s","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":8469,"response count":0,"response size":36,"request content":"compare:<target:MOD key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/apiresourceimports.apiresource.kcp.dev\" mod_revision:6 > success:<request_put:<key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/apiresourceimports.apiresource.kcp.dev\" value_size:8360 >> failure:<request_range:<key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/apiresourceimports.apiresource.kcp.dev\" > >"}\nn"level":"warn","ts":"2022-01-26T10:28:41.768-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:39.066-0500","time spent":"2.702081207s","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":8312,"response count":0,"response size":36,"request content":"compare:<target:MOD key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/negotiatedapiresources.apiresource.kcp.dev\" mod_revision:13 > success:<request_put:<key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/negotiatedapiresources.apiresource.kcp.dev\" value_size:8199 >> failure:<request_range:<key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/negotiatedapiresources.apiresource.kcp.dev\" > >"}\nn"level":"warn","ts":"2022-01-26T10:28:41.768-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:39.065-0500","time spent":"2.702874382s","remote":"127.0.0.1:61846","response type":"/etcdserverpb.KV/Range","request count":0,"request size":70,"response count":0,"response size":26,"request content":"key:\"/registry/rbac.authorization.k8s.io/clusterroles/admin/cluster-admin\" "}\nn0126 10:28:41.769110 96315 trace.go:205] Trace[858476287]: "Get" url:/apis/rbac.authorization.k8s.io/v1/clusterroles/cluster-admin,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:f07f69c5-aaa5-42df-afba-6eaa02b17cc2,client:::1,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:39.065) (total time: 2703ms):\nnrace[858476287]: [2.703282132s] [2.703282132s] END\nn0126 10:28:41.769356 96315 trace.go:205] Trace[1212478594]: "GuaranteedUpdate etcd3" type:*apiextensions.CustomResourceDefinition (26-Jan-2022 10:28:38.601) (total time: 3167ms):\nnrace[1212478594]: ---"initial value restored" 462ms (10:28:39.064)\nnrace[1212478594]: ---"Transaction committed" 2702ms (10:28:41.769)\nnrace[1212478594]: [3.167394749s] [3.167394749s] END\nn0126 10:28:41.769479 96315 trace.go:205] Trace[1825284128]: "GuaranteedUpdate etcd3" type:*apiextensions.CustomResourceDefinition (26-Jan-2022 10:28:38.601) (total time: 3167ms):\nnrace[1825284128]: ---"initial value restored" 462ms (10:28:39.064)\nnrace[1825284128]: ---"Transaction committed" 2702ms (10:28:41.769)\nnrace[1825284128]: [3.167497047s] [3.167497047s] END\nn0126 10:28:41.769636 96315 trace.go:205] Trace[1952753215]: "Update" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/apiresourceimports.apiresource.kcp.dev/status,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:06a2f223-5cbe-4467-b398-9ebe019cd727,client:::1,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:38.601) (total time: 3168ms):\nnrace[1952753215]: ---"Object stored in database" 3167ms (10:28:41.769)\nnrace[1952753215]: [3.168483713s] [3.168483713s] END\nn0126 10:28:41.769768 96315 trace.go:205] Trace[196601849]: "Update" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/negotiatedapiresources.apiresource.kcp.dev/status,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:326858bd-8da4-4cb6-8357-98c0768047d2,client:::1,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:38.600) (total time: 3168ms):\nnrace[196601849]: ---"Object stored in database" 3167ms (10:28:41.769)\nnrace[196601849]: [3.16866395s] [3.16866395s] END\nn"level":"warn","ts":"2022-01-26T10:28:42.269-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718398,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:42.414-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.145702653s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:42.414-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"3.315996733s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/apiresourceimports.apiresource.kcp.dev\" ","response":"range_response_count:1 size:8481"}\nn"level":"warn","ts":"2022-01-26T10:28:42.414-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"3.315952446s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/negotiatedapiresources.apiresource.kcp.dev\" ","response":"range_response_count:1 size:8324"}\nn"level":"warn","ts":"2022-01-26T10:28:42.414-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:39.098-0500","time spent":"3.316058347s","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Range","request count":0,"request size":103,"response count":1,"response size":8503,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/apiresourceimports.apiresource.kcp.dev\" "}\nn"level":"warn","ts":"2022-01-26T10:28:42.414-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:41.268-0500","time spent":"1.145955336s","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":26,"request content":"key:\"/registry/health\" "}\nn"level":"warn","ts":"2022-01-26T10:28:42.414-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:39.098-0500","time spent":"3.316100614s","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Range","request count":0,"request size":107,"response count":1,"response size":8346,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/negotiatedapiresources.apiresource.kcp.dev\" "}\nn"level":"warn","ts":"2022-01-26T10:28:42.415-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"3.348561374s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/kube-system-service-accounts\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:42.415-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:39.066-0500","time spent":"3.34863411s","remote":"127.0.0.1:61850","response type":"/etcdserverpb.KV/Range","request count":0,"request size":87,"response count":0,"response size":26,"request content":"key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/kube-system-service-accounts\" "}\nn"level":"warn","ts":"2022-01-26T10:28:42.415-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.146214822s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:42.415-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:41.268-0500","time spent":"1.146271616s","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":26,"request content":"key:\"/registry/health\" "}\nn"level":"warn","ts":"2022-01-26T10:28:42.415-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:41.770-0500","time spent":"644.360397ms","remote":"127.0.0.1:61846","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":563,"response count":0,"response size":36,"request content":"compare:<target:MOD key:\"/registry/rbac.authorization.k8s.io/clusterroles/admin/cluster-admin\" mod_revision:0 > success:<request_put:<key:\"/registry/rbac.authorization.k8s.io/clusterroles/admin/cluster-admin\" value_size:487 >> failure:<>"}\nn0126 10:28:42.415856 96315 trace.go:205] Trace[1448924862]: "Get" url:/apis/flowcontrol.apiserver.k8s.io/v1beta1/flowschemas/kube-system-service-accounts,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:acd5efa0-2c61-4974-83e9-2c62398460d2,client:::1,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:39.066) (total time: 3349ms):\nnrace[1448924862]: [3.349542946s] [3.349542946s] END\nn0126 10:28:42.415949 96315 trace.go:205] Trace[421276790]: "Create" url:/apis/rbac.authorization.k8s.io/v1/clusterroles,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:044e5357-91b3-407e-9ba0-b7a2e5fcb52b,client:::1,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:41.769) (total time: 645ms):\nnrace[421276790]: ---"Object stored in database" 645ms (10:28:42.415)\nnrace[421276790]: [645.98785ms] [645.98785ms] END\nn0126 10:28:42.416949 96315 trace.go:205] Trace[694014240]: "Get" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/apiresourceimports.apiresource.kcp.dev,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:3c152fd0-d2bc-4e21-b810-e3a37ec7973b,client:192.168.4.118,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:39.098) (total time: 3318ms):\nnrace[694014240]: ---"About to write a response" 3317ms (10:28:42.416)\nnrace[694014240]: [3.318518935s] [3.318518935s] END\nn0126 10:28:42.417444 96315 trace.go:205] Trace[569742256]: "Get" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/negotiatedapiresources.apiresource.kcp.dev,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:2fb946fa-4f79-4231-af82-1684e9994d8b,client:192.168.4.118,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:39.098) (total time: 3319ms):\nnrace[569742256]: ---"About to write a response" 3318ms (10:28:42.416)\nnrace[569742256]: [3.319071501s] [3.319071501s] END\nn0126 10:28:42.418171 96315 bootstrap.go:78] bootstrapped negotiatedapiresources.apiresource.kcp.dev after 8.365315267s\nn"level":"warn","ts":"2022-01-26T10:28:42.914-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718400,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:43.414-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718400,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:43.915-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718400,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:44.416-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718400,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:44.523-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.000340198s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"}\nn"level":"warn","ts":"2022-01-26T10:28:44.523-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.000424335s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"}\nn"level":"warn","ts":"2022-01-26T10:28:44.523-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:42.523-0500","time spent":"2.000431234s","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "}\nn"level":"warn","ts":"2022-01-26T10:28:44.523-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:42.523-0500","time spent":"2.000491809s","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "}\nn"level":"warn","ts":"2022-01-26T10:28:44.916-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718400,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:45.416-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718400,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:45.917-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718400,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:46.417-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718400,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:46.640-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.000590247s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"}\nn"level":"warn","ts":"2022-01-26T10:28:46.640-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:44.639-0500","time spent":"2.000664224s","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "}\nn"level":"warn","ts":"2022-01-26T10:28:46.640-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.000832376s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"}\nn"level":"warn","ts":"2022-01-26T10:28:46.640-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:44.639-0500","time spent":"2.000915122s","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "}\nn"level":"warn","ts":"2022-01-26T10:28:46.917-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718400,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:47.418-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718400,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:47.918-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718400,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:48.419-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718400,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:48.719-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:42.417-0500","time spent":"6.30174877s","remote":"127.0.0.1:61850","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":739,"response count":0,"response size":36,"request content":"compare:<target:MOD key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/kube-system-service-accounts\" mod_revision:0 > success:<request_put:<key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/kube-system-service-accounts\" value_size:646 >> failure:<>"}\nn"level":"warn","ts":"2022-01-26T10:28:48.719-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"6.947873204s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/apiresourceimports.apiresource.kcp.dev\" ","response":"range_response_count:1 size:8481"}\nn"level":"warn","ts":"2022-01-26T10:28:48.719-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:41.771-0500","time spent":"6.947978331s","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Range","request count":0,"request size":103,"response count":1,"response size":8503,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/apiresourceimports.apiresource.kcp.dev\" "}\nn0126 10:28:48.720161 96315 trace.go:205] Trace[1578543805]: "Create" url:/apis/flowcontrol.apiserver.k8s.io/v1beta1/flowschemas,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:980bb495-4406-409d-9922-d955f8bf3db1,client:::1,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:42.416) (total time: 6303ms):\nnrace[1578543805]: ---"Object stored in database" 6302ms (10:28:48.720)\nnrace[1578543805]: [6.303107547s] [6.303107547s] END\nn"level":"warn","ts":"2022-01-26T10:28:48.756-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.999989848s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"}\nn"level":"warn","ts":"2022-01-26T10:28:48.756-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:46.756-0500","time spent":"2.00004454s","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "}\nn"level":"warn","ts":"2022-01-26T10:28:48.756-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.000016741s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context canceled"}\nn0126 10:28:48.756419 96315 server.go:1299] [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"\nn"level":"warn","ts":"2022-01-26T10:28:48.756-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:46.756-0500","time spent":"2.000101544s","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "}\nn0126 10:28:48.756504 96315 server.go:1299] [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"\nn"level":"warn","ts":"2022-01-26T10:28:48.887-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"6.469219526s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/rbac.authorization.k8s.io/clusterroles/admin/system:discovery\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:48.887-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"6.388021909s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/apiresourceimports.apiresource.kcp.dev\" ","response":"range_response_count:1 size:8481"}\nn"level":"warn","ts":"2022-01-26T10:28:48.887-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:42.418-0500","time spent":"6.469307666s","remote":"127.0.0.1:61846","response type":"/etcdserverpb.KV/Range","request count":0,"request size":73,"response count":0,"response size":26,"request content":"key:\"/registry/rbac.authorization.k8s.io/clusterroles/admin/system:discovery\" "}\nn"level":"warn","ts":"2022-01-26T10:28:48.887-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:42.499-0500","time spent":"6.388171801s","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Range","request count":0,"request size":103,"response count":1,"response size":8503,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/apiresourceimports.apiresource.kcp.dev\" "}\nn0126 10:28:48.888220 96315 trace.go:205] Trace[971738333]: "Get" url:/apis/rbac.authorization.k8s.io/v1/clusterroles/system:discovery,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:46106ee0-4fef-426f-a3cb-357089ad6be4,client:::1,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:42.417) (total time: 6470ms):\nnrace[971738333]: [6.470190512s] [6.470190512s] END\nn0126 10:28:48.888613 96315 trace.go:205] Trace[1702793802]: "GuaranteedUpdate etcd3" type:*apiextensions.CustomResourceDefinition (26-Jan-2022 10:28:41.771) (total time: 7116ms):\nnrace[1702793802]: ---"initial value restored" 6949ms (10:28:48.720)\nnrace[1702793802]: ---"Transaction committed" 165ms (10:28:48.888)\nnrace[1702793802]: [7.116922874s] [7.116922874s] END\nn0126 10:28:48.888917 96315 trace.go:205] Trace[23694997]: "Get" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/apiresourceimports.apiresource.kcp.dev,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:9913a0a9-27a7-4480-bf9a-e313ec242afd,client:192.168.4.118,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:42.498) (total time: 6389ms):\nnrace[23694997]: ---"About to write a response" 6389ms (10:28:48.888)\nnrace[23694997]: [6.389713441s] [6.389713441s] END\nn0126 10:28:48.888937 96315 trace.go:205] Trace[456785101]: "Update" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/apiresourceimports.apiresource.kcp.dev/status,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:a73181e7-db37-468b-a5ca-031b3ec91678,client:::1,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:41.771) (total time: 7117ms):\nnrace[456785101]: ---"Object stored in database" 7116ms (10:28:48.888)\nnrace[456785101]: [7.117578166s] [7.117578166s] END\nn"level":"warn","ts":"2022-01-26T10:28:49.178-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"453.481567ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/service-accounts\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:49.178-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:48.725-0500","time spent":"453.555653ms","remote":"127.0.0.1:61850","response type":"/etcdserverpb.KV/Range","request count":0,"request size":75,"response count":0,"response size":26,"request content":"key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/service-accounts\" "}\nn"level":"warn","ts":"2022-01-26T10:28:49.679-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718406,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:50.179-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718406,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:50.680-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718406,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:50.866-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.000076341s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"}\nn"level":"warn","ts":"2022-01-26T10:28:50.866-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:48.866-0500","time spent":"2.000164505s","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "}\nn0126 10:28:50.866662 96315 server.go:1299] [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"\nn"level":"warn","ts":"2022-01-26T10:28:50.866-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.000278384s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"}\nn"level":"warn","ts":"2022-01-26T10:28:50.866-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:48.866-0500","time spent":"2.000350212s","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "}\nn0126 10:28:50.866827 96315 server.go:1299] [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"\nn"level":"warn","ts":"2022-01-26T10:28:51.086-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:49.180-0500","time spent":"1.906061468s","remote":"127.0.0.1:61850","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":708,"response count":0,"response size":36,"request content":"compare:<target:MOD key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/service-accounts\" mod_revision:0 > success:<request_put:<key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/service-accounts\" value_size:627 >> failure:<>"}\nn"level":"warn","ts":"2022-01-26T10:28:51.086-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.187464532s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/apiresourceimports.apiresource.kcp.dev\" ","response":"range_response_count:1 size:8490"}\nn"level":"warn","ts":"2022-01-26T10:28:51.086-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:48.899-0500","time spent":"2.18753226s","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Range","request count":0,"request size":103,"response count":1,"response size":8512,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/admin/apiresourceimports.apiresource.kcp.dev\" "}\nn0126 10:28:51.087066 96315 trace.go:205] Trace[2019376571]: "Create" url:/apis/flowcontrol.apiserver.k8s.io/v1beta1/flowschemas,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:b1b3f98a-6128-4f50-aeb7-e896205e72ab,client:::1,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:49.179) (total time: 1906ms):\nnrace[2019376571]: ---"Object stored in database" 1906ms (10:28:51.086)\nnrace[2019376571]: [1.906977745s] [1.906977745s] END\nn0126 10:28:51.088119 96315 trace.go:205] Trace[697408119]: "Get" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/apiresourceimports.apiresource.kcp.dev,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:b9b1025a-db63-45d2-bce0-b5fe87fc2f62,client:192.168.4.118,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:48.898) (total time: 2189ms):\nnrace[697408119]: ---"About to write a response" 2188ms (10:28:51.087)\nnrace[697408119]: [2.189143521s] [2.189143521s] END\nn0126 10:28:51.088745 96315 bootstrap.go:78] bootstrapped apiresourceimports.apiresource.kcp.dev after 17.03568593s\nn0126 10:28:51.088923 96315 bootstrap.go:76] bootstrapping clusters.cluster.example.dev\nn0126 10:28:51.088955 96315 bootstrap.go:76] bootstrapping apiresourceimports.apiresource.kcp.dev\nn0126 10:28:51.088976 96315 bootstrap.go:76] bootstrapping negotiatedapiresources.apiresource.kcp.dev\nn"level":"warn","ts":"2022-01-26T10:28:51.256-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"166.366388ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/user/apiresourceimports.apiresource.kcp.dev\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:51.256-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"166.384316ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/user/negotiatedapiresources.apiresource.kcp.dev\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:51.256-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"167.606289ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/global-default\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:51.256-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"287.014003ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:51.256-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"166.828837ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/user/clusters.cluster.example.dev\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:51.256-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.076546909s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/rbac.authorization.k8s.io/clusterroles/admin/system:monitoring\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:51.256-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"287.084794ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:51.256-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:49.180-0500","time spent":"2.076629336s","remote":"127.0.0.1:61846","response type":"/etcdserverpb.KV/Range","request count":0,"request size":74,"response count":0,"response size":26,"request content":"key:\"/registry/rbac.authorization.k8s.io/clusterroles/admin/system:monitoring\" "}\nn0126 10:28:51.257804 96315 trace.go:205] Trace[238073347]: "Get" url:/apis/rbac.authorization.k8s.io/v1/clusterroles/system:monitoring,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:c3607b13-1b76-4d70-8f0c-32414aa7b85c,client:::1,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:49.180) (total time: 2077ms):\nnrace[238073347]: [2.077707534s] [2.077707534s] END\nn"level":"warn","ts":"2022-01-26T10:28:51.727-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:51.260-0500","time spent":"466.532543ms","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":7517,"response count":0,"response size":36,"request content":"compare:<target:MOD key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/user/apiresourceimports.apiresource.kcp.dev\" mod_revision:0 > success:<request_put:<key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/user/apiresourceimports.apiresource.kcp.dev\" value_size:7409 >> failure:<>"}\nn"level":"warn","ts":"2022-01-26T10:28:51.727-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:51.260-0500","time spent":"466.826703ms","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":3476,"response count":0,"response size":36,"request content":"compare:<target:MOD key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/user/clusters.cluster.example.dev\" mod_revision:0 > success:<request_put:<key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/user/clusters.cluster.example.dev\" value_size:3378 >> failure:<>"}\nn"level":"warn","ts":"2022-01-26T10:28:51.727-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:51.260-0500","time spent":"466.498363ms","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":7335,"response count":0,"response size":36,"request content":"compare:<target:MOD key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/user/negotiatedapiresources.apiresource.kcp.dev\" mod_revision:0 > success:<request_put:<key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/user/negotiatedapiresources.apiresource.kcp.dev\" value_size:7223 >> failure:<>"}\nn"level":"warn","ts":"2022-01-26T10:28:51.727-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:51.259-0500","time spent":"467.745707ms","remote":"127.0.0.1:61850","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":739,"response count":0,"response size":36,"request content":"compare:<target:MOD key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/global-default\" mod_revision:0 > success:<request_put:<key:\"/registry/flowcontrol.apiserver.k8s.io/flowschemas/admin/global-default\" value_size:660 >> failure:<>"}\nn"level":"warn","ts":"2022-01-26T10:28:51.727-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"466.759915ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/rbac.authorization.k8s.io/clusterroles/admin/system:basic-user\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:51.727-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:51.260-0500","time spent":"467.024338ms","remote":"127.0.0.1:61846","response type":"/etcdserverpb.KV/Range","request count":0,"request size":74,"response count":0,"response size":26,"request content":"key:\"/registry/rbac.authorization.k8s.io/clusterroles/admin/system:basic-user\" "}\nn"level":"warn","ts":"2022-01-26T10:28:51.919-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"558.321648ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:51.919-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"558.244574ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:4"}\nn"level":"warn","ts":"2022-01-26T10:28:51.919-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:51.360-0500","time spent":"558.439314ms","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":26,"request content":"key:\"/registry/health\" "}\nn"level":"warn","ts":"2022-01-26T10:28:51.919-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:51.360-0500","time spent":"558.416807ms","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":26,"request content":"key:\"/registry/health\" "}\nn"level":"warn","ts":"2022-01-26T10:28:52.395-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718418,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:52.895-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718418,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:53.396-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718418,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:53.897-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718418,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:54.023-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"1.999960998s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"}\nn"level":"warn","ts":"2022-01-26T10:28:54.023-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:52.023-0500","time spent":"2.00005276s","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "}\nn"level":"warn","ts":"2022-01-26T10:28:54.023-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.000011981s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context canceled"}\nn"level":"warn","ts":"2022-01-26T10:28:54.023-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:52.023-0500","time spent":"2.000071226s","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "}\nn0126 10:28:54.023987 96315 server.go:1299] [core] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"\nn"level":"warn","ts":"2022-01-26T10:28:54.401-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718418,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:54.902-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718418,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:55.403-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718418,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:55.903-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718418,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:56.139-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.000242731s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"}\nn"level":"warn","ts":"2022-01-26T10:28:56.139-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.00028729s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"}\nn"level":"warn","ts":"2022-01-26T10:28:56.139-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:54.139-0500","time spent":"2.000381717s","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "}\nn"level":"warn","ts":"2022-01-26T10:28:56.139-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:54.139-0500","time spent":"2.000325852s","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "}\nn"level":"warn","ts":"2022-01-26T10:28:56.404-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718418,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:56.904-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718418,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:57.405-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718418,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:57.905-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718418,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:58.256-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.000166085s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"}\nn"level":"warn","ts":"2022-01-26T10:28:58.256-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.000144876s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"}\nn"level":"warn","ts":"2022-01-26T10:28:58.256-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:56.256-0500","time spent":"2.000213835s","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "}\nn"level":"warn","ts":"2022-01-26T10:28:58.256-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:56.256-0500","time spent":"2.000275514s","remote":"127.0.0.1:61922","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "}\nn"level":"warn","ts":"2022-01-26T10:28:58.406-0500","caller":"etcdserver/v3_server.go:815","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":18153304860016718418,"retry-timeout":"500ms"}\nn"level":"warn","ts":"2022-01-26T10:28:58.895-0500","caller":"etcdserver/v3_server.go:827","msg":"timed out waiting for read index response (local node might have slow network)","timeout":"7s"}\nn"level":"warn","ts":"2022-01-26T10:28:58.895-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"7.163974718s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/user/clusters.cluster.example.dev\" ","response":"","error":"etcdserver: request timed out"}\nn"level":"warn","ts":"2022-01-26T10:28:58.895-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"7.16431219s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/admin/system\" ","response":"","error":"etcdserver: request timed out"}\nn"level":"warn","ts":"2022-01-26T10:28:58.895-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"7.164109161s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/user/negotiatedapiresources.apiresource.kcp.dev\" ","response":"","error":"etcdserver: request timed out"}\nn"level":"warn","ts":"2022-01-26T10:28:58.895-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:51.731-0500","time spent":"7.164033194s","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Range","request count":0,"request size":92,"response count":0,"response size":0,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/user/clusters.cluster.example.dev\" "}\nn"level":"warn","ts":"2022-01-26T10:28:58.895-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:51.731-0500","time spent":"7.164388743s","remote":"127.0.0.1:61852","response type":"/etcdserverpb.KV/Range","request count":0,"request size":81,"response count":0,"response size":0,"request content":"key:\"/registry/flowcontrol.apiserver.k8s.io/prioritylevelconfigurations/admin/system\" "}\nn"level":"warn","ts":"2022-01-26T10:28:58.895-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:51.731-0500","time spent":"7.164172232s","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Range","request count":0,"request size":106,"response count":0,"response size":0,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/user/negotiatedapiresources.apiresource.kcp.dev\" "}\nn"level":"warn","ts":"2022-01-26T10:28:58.895-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"7.164767382s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/user/clusters.cluster.example.dev\" ","response":"","error":"etcdserver: request timed out"}\nn"level":"warn","ts":"2022-01-26T10:28:58.895-0500","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"7.164635912s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/user/apiresourceimports.apiresource.kcp.dev\" ","response":"","error":"etcdserver: request timed out"}\nn"level":"warn","ts":"2022-01-26T10:28:58.895-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:51.730-0500","time spent":"7.164831566s","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Range","request count":0,"request size":92,"response count":0,"response size":0,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/user/clusters.cluster.example.dev\" "}\nn"level":"warn","ts":"2022-01-26T10:28:58.895-0500","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-01-26T10:28:51.730-0500","time spent":"7.164704086s","remote":"127.0.0.1:61822","response type":"/etcdserverpb.KV/Range","request count":0,"request size":102,"response count":0,"response size":0,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/user/apiresourceimports.apiresource.kcp.dev\" "}\nn0126 10:28:58.896150 96315 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out\nn0126 10:28:58.896214 96315 trace.go:205] Trace[1114010983]: "GuaranteedUpdate etcd3" type:*apiextensions.CustomResourceDefinition (26-Jan-2022 10:28:51.731) (total time: 7164ms):\nnrace[1114010983]: [7.164577691s] [7.164577691s] END\nn0126 10:28:58.896244 96315 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out\nn0126 10:28:58.896244 96315 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out\nn0126 10:28:58.896244 96315 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out\nn0126 10:28:58.896253 96315 status.go:71] apiserver received an error that is not an metav1.Status: rpctypes.EtcdError{code:0xe, desc:"etcdserver: request timed out"}: etcdserver: request timed out\nn0126 10:28:58.896460 96315 trace.go:205] Trace[1595138463]: "Get" url:/apis/flowcontrol.apiserver.k8s.io/v1beta1/prioritylevelconfigurations/system,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:5b10b80d-6e4b-4228-b43a-ab946a401374,client:::1,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:51.730) (total time: 7165ms):\nnrace[1595138463]: [7.165576567s] [7.165576567s] END\nn0126 10:28:58.897215 96315 storage_flowcontrol.go:120] "APF bootstrap ensurer ran into error, will retry later" err="failed ensuring suggested settings - failed to retrieve PriorityLevelConfiguration type=suggested name=\"system\" error=etcdserver: request timed out"\nn0126 10:28:58.897426 96315 trace.go:205] Trace[435383338]: "Get" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/clusters.cluster.example.dev,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:e0bb5d19-9815-4bda-87d7-228bab07f59e,client:192.168.4.118,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:51.730) (total time: 7167ms):\nnrace[435383338]: [7.167068724s] [7.167068724s] END\nn0126 10:28:58.897689 96315 bootstrap.go:78] bootstrapped clusters.cluster.example.dev after 7.808534442s\nn0126 10:28:58.898623 96315 trace.go:205] Trace[1439402023]: "Update" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/clusters.cluster.example.dev/status,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:6e8bc0e2-29f8-4c41-bfb6-70fc89d01b79,client:::1,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:51.730) (total time: 7167ms):\nnrace[1439402023]: [7.167475147s] [7.167475147s] END\nn0126 10:28:58.899636 96315 trace.go:205] Trace[1222870046]: "Get" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/negotiatedapiresources.apiresource.kcp.dev,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:e734a583-e154-4530-b9be-ec966289253e,client:192.168.4.118,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:51.731) (total time: 7168ms):\nnrace[1222870046]: [7.168210881s] [7.168210881s] END\nn0126 10:28:58.899943 96315 bootstrap.go:78] bootstrapped negotiatedapiresources.apiresource.kcp.dev after 7.810737084s\nn0126 10:28:58.900710 96315 trace.go:205] Trace[20724946]: "Get" url:/apis/apiextensions.k8s.io/v1/customresourcedefinitions/apiresourceimports.apiresource.kcp.dev,user-agent:kcp/v0.0.0 (darwin/amd64) kubernetes/$Format,audit-id:bf8d6b11-9562-4c43-a629-2d27e3d6ec5d,client:192.168.4.118,accept:application/json, */*,protocol:HTTP/2.0 (26-Jan-2022 10:28:51.730) (total time: 7169ms):\nnrace[20724946]: [7.169839051s] [7.169839051s] END\nn0126 10:28:58.900973 96315 bootstrap.go:78] bootstrapped apiresourceimports.apiresource.kcp.dev after 7.811785815s\nn0126 10:28:58.901009 96315 hooks.go:202] PostStartHook "install-cluster-controller" failed: could not bootstrap CRDs: [Error fetching CRD clusters.cluster.example.dev: etcdserver: request timed out, Error fetching CRD negotiatedapiresources.apiresource.kcp.dev: etcdserver: request timed out, Error fetching CRD apiresourceimports.apiresource.kcp.dev: etcdserver: request timed out]\nnoroutine 1129 [running]:\nn8s.io/klog/v2.stacks(0x1)\nn/Users/angoldst/go/pkg/mod/k8s.io/klog/[email protected]/klog.go:1026 +0x8a\nn8s.io/klog/v2.(*loggingT).output(0x50d0e20, 0x3, {0x0, 0x0}, 0xc0004c51f0, 0x0, {0x4128317, 0xc0013648c0}, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/k8s.io/klog/[email protected]/klog.go:975 +0x63d\nn8s.io/klog/v2.(*loggingT).printf(0xc0007fe6c0, 0x5f6000, {0x0, 0x0}, {0x0, 0x0}, {0x3516cc7, 0x1b}, {0xc0013648c0, 0x2, ...})\nn/Users/angoldst/go/pkg/mod/k8s.io/klog/[email protected]/klog.go:753 +0x1e5\nn8s.io/klog/v2.Fatalf(...)\nn/Users/angoldst/go/pkg/mod/k8s.io/klog/[email protected]/klog.go:1514\nn8s.io/apiserver/pkg/server.runPostStartHook({0x351551a, 0x1a}, {0xc0011e0200, {0xc00251cf00, 0x39a1318}, 0xc0007fe6c0}, {0xc0005f6000, 0xc00022ac00})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/hooks.go:202 +0x185\nnreated by k8s.io/apiserver/pkg/server.(*GenericAPIServer).RunPostStartHooks\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/hooks.go:165 +0xf6\nngoroutine 1 [chan receive]:\nn8s.io/apiserver/pkg/server.preparedGenericAPIServer.Run({0xc0001cb8c0}, 0xc0000c03c0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/genericapiserver.go:378 +0x3ad\nnithub.com/kcp-dev/kcp/pkg/server.(*Server).Run(0xc0001cb900, {0x39c05f0, 0xc0001cb8c0})\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/pkg/server/server.go:682 +0x2cd8\nnain.main.func2(0xc0004a4500, {0x34e7bee, 0xb, 0xb})\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/cmd/kcp/kcp.go:77 +0x248\nnithub.com/spf13/cobra.(*Command).execute(0xc0004a4500, {0xc0001cfc30, 0xb, 0xb})\nn/Users/angoldst/go/pkg/mod/github.com/spf13/[email protected]/command.go:852 +0x60e\nnithub.com/spf13/cobra.(*Command).ExecuteC(0xc0004a4280)\nn/Users/angoldst/go/pkg/mod/github.com/spf13/[email protected]/command.go:960 +0x3ad\nnithub.com/spf13/cobra.(*Command).Execute(...)\nn/Users/angoldst/go/pkg/mod/github.com/spf13/[email protected]/command.go:897\nnain.main()\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/cmd/kcp/kcp.go:82 +0x219\nngoroutine 35 [chan receive]:\nn8s.io/klog/v2.(*loggingT).flushDaemon(0x0)\nn/Users/angoldst/go/pkg/mod/k8s.io/klog/[email protected]/klog.go:1169 +0x6a\nnreated by k8s.io/klog/v2.init.0\nn/Users/angoldst/go/pkg/mod/k8s.io/klog/[email protected]/klog.go:420 +0xfb\nngoroutine 412 [chan receive]:\nnoogle.golang.org/grpc.(*addrConn).resetTransport(0xc00086a2c0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:1214 +0x48f\nnreated by google.golang.org/grpc.(*addrConn).connect\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:844 +0x147\nngoroutine 1448 [chan receive]:\nnithub.com/kcp-dev/kcp/pkg/server.adaptContext.func1(0xc000087778)\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/pkg/server/server.go:772 +0x25\nnreated by github.com/kcp-dev/kcp/pkg/server.adaptContext\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/pkg/server/server.go:771 +0xe5\nngoroutine 1407 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc000951fd0, 0x2)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x60)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/util/workqueue.(*Type).Get(0xc001978900)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:151 +0x9e\nn8s.io/apiextensions-apiserver/pkg/controller/finalizer.(*CRDFinalizer).processNextWorkItem(0xc00043dd10)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/finalizer/crd_finalizer.go:290 +0x58\nn8s.io/apiextensions-apiserver/pkg/controller/finalizer.(*CRDFinalizer).runWorker(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/finalizer/crd_finalizer.go:284\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd4c06a0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x300d020, {0x39705a0, 0xc0040d23c0}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0x3b9aca00, 0x0, 0x1, 0x1040a25)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0x0, 0xc00022ac00, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/apiextensions-apiserver/pkg/controller/finalizer.(*CRDFinalizer).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/finalizer/crd_finalizer.go:277 +0x245\nngoroutine 223 [select]:\nno.etcd.io/etcd/server/v3/mvcc/backend.(*backend).run(0xc0005d2160)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/mvcc/backend/backend.go:405 +0x10f\nnreated by go.etcd.io/etcd/server/v3/mvcc/backend.newBackend\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/mvcc/backend/backend.go:221 +0x6c7\nngoroutine 95 [syscall]:\nns/signal.signal_recv()\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sigqueue.go:166 +0x28\nns/signal.loop()\nn/usr/local/Cellar/go/1.17.6/libexec/src/os/signal/signal_unix.go:24 +0x19\nnreated by os/signal.Notify.func1.1\nn/usr/local/Cellar/go/1.17.6/libexec/src/os/signal/signal.go:151 +0x2c\nngoroutine 97 [select]:\nns/signal.NotifyContext.func1()\nn/usr/local/Cellar/go/1.17.6/libexec/src/os/signal/signal.go:288 +0x76\nnreated by os/signal.NotifyContext\nn/usr/local/Cellar/go/1.17.6/libexec/src/os/signal/signal.go:287 +0x169\nngoroutine 219 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd0d9e78, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc0006aa000, 0x5a0bc98, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Accept(0xc0006aa000)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:402 +0x22c\nnet.(*netFD).accept(0xc0006aa000)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_unix.go:173 +0x35\nnet.(*TCPListener).accept(0xc0006a6018)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/tcpsock_posix.go:140 +0x28\nnet.(*TCPListener).Accept(0xc0006a6018)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/tcpsock.go:262 +0x3d\nno.etcd.io/etcd/client/pkg/v3/transport.(*rwTimeoutListener).Accept(0xc0006a8020)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/pkg/[email protected]/transport/timeout_listener.go:36 +0x2d\nnrypto/tls.(*listener).Accept(0xc0006a61c8)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/tls.go:66 +0x2d\nno.etcd.io/etcd/client/pkg/v3/transport.(*tlsListener).acceptLoop(0xc0006ce080)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/pkg/[email protected]/transport/listener_tls.go:126 +0x137\nnreated by go.etcd.io/etcd/client/pkg/v3/transport.newTLSListener\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/pkg/[email protected]/transport/listener_tls.go:84 +0x345\nngoroutine 258 [select]:\nno.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).run(0xc000297800)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/server.go:1109 +0x7c7\nnreated by go.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).start\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/server.go:853 +0xf8f\nngoroutine 228 [select]:\nno.etcd.io/etcd/server/v3/wal.(*filePipeline).run(0xc000968000)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/wal/file_pipeline.go:97 +0x111\nnreated by go.etcd.io/etcd/server/v3/wal.newFilePipeline\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/wal/file_pipeline.go:55 +0x27b\nngoroutine 242 [select]:\nno.etcd.io/etcd/raft/v3.(*node).run(0xc0006b2060)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/raft/[email protected]/node.go:341 +0x78a\nnreated by go.etcd.io/etcd/raft/v3.StartNode\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/raft/[email protected]/node.go:230 +0x295\nngoroutine 230 [select]:\nno.etcd.io/etcd/server/v3/lease.(*lessor).runLoop(0xc0001cf550)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/lease/lessor.go:590 +0xd2\nnreated by go.etcd.io/etcd/server/v3/lease.newLessor\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/lease/lessor.go:221 +0x2fb\nngoroutine 231 [select]:\nno.etcd.io/etcd/pkg/v3/schedule.(*fifo).run(0xc000858360)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/pkg/[email protected]/schedule/schedule.go:143 +0x218\nnreated by go.etcd.io/etcd/pkg/v3/schedule.NewFIFOScheduler\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/pkg/[email protected]/schedule/schedule.go:70 +0x15c\nngoroutine 47 [select]:\nno.etcd.io/etcd/client/pkg/v3/fileutil.purgeFile.func1()\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/pkg/[email protected]/fileutil/purge.go:85 +0x292\nnreated by go.etcd.io/etcd/client/pkg/v3/fileutil.purgeFile\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/pkg/[email protected]/fileutil/purge.go:44 +0x2b4\nngoroutine 1425 [select]:\nnolang.org/x/net/http2.(*ClientConn).roundTrip(0xc0036a0000, 0xc003c0d800)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/transport.go:1155 +0xcba\nnolang.org/x/net/http2.(*Transport).RoundTripOpt(0xc0009eaf50, 0xc003c0d800, {0x60})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/transport.go:478 +0x1b7\nnolang.org/x/net/http2.(*Transport).RoundTrip(...)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/transport.go:439\nnolang.org/x/net/http2.noDialH2RoundTripper.RoundTrip({0xc0002fa140}, 0xc003c0d800)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/transport.go:2695 +0x1b\nnet/http.(*Transport).roundTrip(0xc0002fa140, 0xc003c0d700)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/transport.go:539 +0x390\nnet/http.(*Transport).RoundTrip(0x305d0e0, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/roundtrip.go:18 +0x19\nn8s.io/kubernetes/pkg/genericcontrolplane/clientutils.(*multiClusterClientConfigRoundTripper).RoundTrip(0xc00194f890, 0xc003c0d500)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/[email protected]/pkg/genericcontrolplane/clientutils/multiclusterconfig.go:166 +0x8b9\nn8s.io/client-go/transport.(*bearerAuthRoundTripper).RoundTrip(0xc00194f8c0, 0xc003c0d400)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/transport/round_trippers.go:298 +0x242\nn8s.io/client-go/transport.(*userAgentRoundTripper).RoundTrip(0xc0012c5ca0, 0xc003c0d300)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/transport/round_trippers.go:160 +0x1ad\nnet/http.send(0xc003c0d300, {0x39713e0, 0xc0012c5ca0}, {0x3470fc0, 0x89d761dd00000001, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/client.go:252 +0x5d8\nnet/http.(*Client).send(0xc00194f8f0, 0xc003c0d300, {0xc004468060, 0x1c, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/client.go:176 +0x9b\nnet/http.(*Client).do(0xc00194f8f0, 0xc003c0d300)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/client.go:725 +0x908\nnet/http.(*Client).Do(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/client.go:593\nn8s.io/client-go/rest.(*Request).request(0xc0026b4f00, {0x39be948, 0xc00018a008}, 0x203000)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/rest/request.go:1040 +0x479\nn8s.io/client-go/rest.(*Request).Do(0xd07a608, {0x39be948, 0xc00018a008})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/rest/request.go:1107 +0xcc\nn8s.io/apiextensions-apiserver/pkg/client/clientset/clientset/typed/apiextensions/v1.(*customResourceDefinitions).UpdateStatus(0xc001497a80, {0x39be948, 0xc00018a008}, 0xc000a23400, {{{0x0, 0x0}, {0x0, 0x0}}, {0x0, 0x0, ...}, ...})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/client/clientset/clientset/typed/apiextensions/v1/customresourcedefinition.go:150 +0x1bc\nn8s.io/apiextensions-apiserver/pkg/controller/status.(*NamingConditionController).sync(0xc00043d950, {0xc0010caf30, 0x23})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/status/naming_controller.go:271 +0x64b\nn8s.io/apiextensions-apiserver/pkg/controller/status.(*NamingConditionController).processNextWorkItem(0xc00043d950)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/status/naming_controller.go:322 +0xf7\nn8s.io/apiextensions-apiserver/pkg/controller/status.(*NamingConditionController).runWorker(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/status/naming_controller.go:310\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd7ddec0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x300d020, {0x39705a0, 0xc004047d40}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0x3b9aca00, 0x0, 0x0, 0x1040a25)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0x0, 0xc00022ac00, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/apiextensions-apiserver/pkg/controller/status.(*NamingConditionController).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/status/naming_controller.go:304 +0x297\nngoroutine 44 [select]:\nno.etcd.io/etcd/server/v3/mvcc.(*watchableStore).syncWatchersLoop(0xc00061c000)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/mvcc/watchable_store.go:233 +0x1ab\nnreated by go.etcd.io/etcd/server/v3/mvcc.newWatchableStore\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/mvcc/watchable_store.go:95 +0x5a7\nngoroutine 45 [select]:\nno.etcd.io/etcd/server/v3/mvcc.(*watchableStore).syncVictimsLoop(0xc00061c000)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/mvcc/watchable_store.go:259 +0x16a\nnreated by go.etcd.io/etcd/server/v3/mvcc.newWatchableStore\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/mvcc/watchable_store.go:96 +0x5e9\nngoroutine 487 [select]:\nnoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000aa70e0, 0x1)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:407 +0x11b\nnoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc00087d020)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:527 +0x85\nnoogle.golang.org/grpc/internal/transport.newHTTP2Client.func3()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:396 +0x65\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:394 +0x1da5\nngoroutine 291 [select]:\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.monitorLeader.func1()\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/interceptor.go:316 +0xc5\nno.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).GoAttach.func1()\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/server.go:2659 +0x64\nnreated by go.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).GoAttach\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/server.go:2657 +0x117\nngoroutine 261 [select]:\nno.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).purgeFile(0xc000297800)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/server.go:868 +0x3aa\nno.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).GoAttach.func1()\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/server.go:2659 +0x64\nnreated by go.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).GoAttach\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/server.go:2657 +0x117\nngoroutine 411 [select]:\nnoogle.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc000968c80)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:69 +0x95\nnreated by google.golang.org/grpc.newCCBalancerWrapper\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:60 +0x1d5\nngoroutine 263 [select]:\nno.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).monitorVersions(0xc000297800)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/server.go:2434 +0xb2\nno.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).GoAttach.func1()\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/server.go:2659 +0x64\nnreated by go.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).GoAttach\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/server.go:2657 +0x117\nngoroutine 264 [select]:\nno.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).requestCurrentIndex(0xc000297800, 0xc0000c0a80, 0xfbed7e9700ab3253)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/v3_server.go:781 +0x25c\nno.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).linearizableReadLoop(0xc000297800)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/v3_server.go:731 +0x2bf\nno.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).GoAttach.func1()\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/server.go:2659 +0x64\nnreated by go.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).GoAttach\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/server.go:2657 +0x117\nngoroutine 116 [chan receive]:\nnithub.com/kcp-dev/kcp/pkg/server.adaptContext.func1(0xc00095cfb8)\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/pkg/server/server.go:772 +0x25\nnreated by github.com/kcp-dev/kcp/pkg/server.adaptContext\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/pkg/server/server.go:771 +0xe5\nngoroutine 266 [select]:\nno.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).monitorDowngrade(0xc000297800)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/server.go:2555 +0xc5\nno.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).GoAttach.func1()\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/server.go:2659 +0x64\nnreated by go.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).GoAttach\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/server.go:2657 +0x117\nngoroutine 48 [select]:\nno.etcd.io/etcd/client/pkg/v3/fileutil.purgeFile.func1()\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/pkg/[email protected]/fileutil/purge.go:85 +0x292\nnreated by go.etcd.io/etcd/client/pkg/v3/fileutil.purgeFile\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/pkg/[email protected]/fileutil/purge.go:44 +0x2b4\nngoroutine 49 [select]:\nno.etcd.io/etcd/client/pkg/v3/fileutil.purgeFile.func1()\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/pkg/[email protected]/fileutil/purge.go:85 +0x292\nnreated by go.etcd.io/etcd/client/pkg/v3/fileutil.purgeFile\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/pkg/[email protected]/fileutil/purge.go:44 +0x2b4\nngoroutine 69 [chan receive]:\nno.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).applyAll(0xc000297800, 0xc000286100, 0xc003248c60)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/server.go:1187 +0xf3\nno.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).run.func8({0xc00310ff90, 0xc00310ff58})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/server.go:1111 +0x25\nno.etcd.io/etcd/pkg/v3/schedule.(*fifo).run(0xc000306000)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/pkg/[email protected]/schedule/schedule.go:157 +0x119\nnreated by go.etcd.io/etcd/pkg/v3/schedule.NewFIFOScheduler\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/pkg/[email protected]/schedule/schedule.go:70 +0x15c\nngoroutine 70 [syscall]:\nnyscall.syscall(0x107f2a0, 0xc002d74300, 0xc002d4c340, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sys_darwin.go:22 +0x3b\nnyscall.Rename({0xc0009d8000, 0x18c}, {0xc000c6c9c0, 0x18c})\nn/usr/local/Cellar/go/1.17.6/libexec/src/syscall/zsyscall_darwin_amd64.go:1234 +0x169\nns.rename.func1(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/os/file_unix.go:43\nns.ignoringEINTR(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/os/file_posix.go:246\nns.rename({0xc0009d8000, 0xc00058b4f8}, {0xc000c6c9c0, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/os/file_unix.go:42 +0x2e7\nns.Rename(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/os/file.go:355\nno.etcd.io/etcd/server/v3/wal.(*WAL).cut(0xc0006ac9a0)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/wal/wal.go:755 +0x4a5\nno.etcd.io/etcd/server/v3/wal.(*WAL).Save(0xc0006ac9a0, {0x2, 0x49a846778773fbed, 0x1e}, {0xc00304b710, 0x1, 0x2})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/wal/wal.go:944 +0x2dc\nno.etcd.io/etcd/server/v3/etcdserver.(*raftNode).start.func1()\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/raft.go:245 +0x910\nnreated by go.etcd.io/etcd/server/v3/etcdserver.(*raftNode).start\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/raft.go:169 +0x85\nngoroutine 267 [select]:\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.monitorLeader.func1()\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/interceptor.go:316 +0xc5\nno.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).GoAttach.func1()\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/server.go:2659 +0x64\nnreated by go.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).GoAttach\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/server.go:2657 +0x117\nngoroutine 268 [select]:\nnithub.com/soheilhy/cmux.muxListener.Accept({{0x39a4d40, 0xc0006ce080}, 0xc000976ba0, 0xc0000c08a0})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:262 +0x7f\nnoogle.golang.org/grpc.(*Server).Serve(0xc00013d500, {0x39b2690, 0xc0004db940})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:786 +0x362\nnreated by go.etcd.io/etcd/server/v3/embed.(*Etcd).servePeers\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/etcd.go:544 +0x38f\nngoroutine 269 [select]:\nnithub.com/soheilhy/cmux.muxListener.Accept({{0x39a4d40, 0xc0006ce080}, 0xc000976c00, 0xc0000c0900})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:262 +0x7f\nnet/http.(*Server).Serve(0xc0006ad260, {0x39b2690, 0xc0004db9a0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3002 +0x394\nnreated by go.etcd.io/etcd/server/v3/embed.(*Etcd).servePeers\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/etcd.go:550 +0x571\nngoroutine 270 [select]:\nno.etcd.io/etcd/client/pkg/v3/transport.(*tlsListener).Accept(0xc0006ce080)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/pkg/[email protected]/transport/listener_tls.go:89 +0x6f\nnithub.com/soheilhy/cmux.(*cMux).Serve(0xc000aa67d0)\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:170 +0xa9\nno.etcd.io/etcd/server/v3/embed.(*Etcd).servePeers.func1()\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/etcd.go:556 +0x12f\nno.etcd.io/etcd/server/v3/embed.(*Etcd).servePeers.func3(0xc000966e60)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/etcd.go:584 +0x12e\nnreated by go.etcd.io/etcd/server/v3/embed.(*Etcd).servePeers\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/etcd.go:578 +0x785\nngoroutine 274 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd0d9d90, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc0006aa200, 0x106d415, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Accept(0xc0006aa200)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:402 +0x22c\nnet.(*netFD).accept(0xc0006aa200)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_unix.go:173 +0x35\nnet.(*TCPListener).accept(0xc0006a6228)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/tcpsock_posix.go:140 +0x28\nnet.(*TCPListener).Accept(0xc0006a6228)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/tcpsock.go:262 +0x3d\nno.etcd.io/etcd/client/pkg/v3/transport.(*keepaliveListener).Accept(0xc00087eb88)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/pkg/[email protected]/transport/keepalive_listener.go:49 +0x25\nnithub.com/soheilhy/cmux.(*cMux).Serve(0xc0000be4b0)\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:170 +0xa9\nno.etcd.io/etcd/server/v3/embed.(*serveCtx).serve(0xc0003841c0, 0xc000297800, 0xc00093d360, {0x3971ca0, 0xc00096f480}, 0xc0004080e0, {0xc0004dbaa0, 0x2, 0x2})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/serve.go:195 +0x1212\nno.etcd.io/etcd/server/v3/embed.(*Etcd).serveClients.func1(0xc000976f00)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/etcd.go:733 +0xa8\nnreated by go.etcd.io/etcd/server/v3/embed.(*Etcd).serveClients\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/etcd.go:732 +0xbb3\nngoroutine 275 [chan receive]:\nnithub.com/kcp-dev/kcp/pkg/etcd.(*Server).Run.func1()\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/pkg/etcd/etcd.go:100 +0x32\nnreated by github.com/kcp-dev/kcp/pkg/etcd.(*Server).Run\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/pkg/etcd/etcd.go:99 +0xc05\nngoroutine 796 [select]:\nnet/http.(*http2serverConn).serve(0xc0006d5080)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4529 +0x8ed\nnet/http.(*http2Server).ServeConn(0xc00071e780, {0x3a03390, 0xc0014fe700}, 0xc001f83b48)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4131 +0xa71\nnet/http.http2ConfigureServer.func1(0xc0003d0700, 0x3a03390, {0x39745e0, 0xc0020039e0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3957 +0xe6\nnet/http.(*conn).serve(0xc002010820, {0x39be9b8, 0xc00071cc60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 243 [chan receive]:\nnithub.com/kcp-dev/kcp/pkg/sharding.New.func1()\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/pkg/sharding/clients.go:62 +0x78\nnreated by github.com/kcp-dev/kcp/pkg/sharding.New\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/pkg/sharding/clients.go:60 +0x44f\nngoroutine 306 [select]:\nnoogle.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc00071e1c0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:69 +0x95\nnreated by google.golang.org/grpc.newCCBalancerWrapper\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:60 +0x1d5\nngoroutine 307 [chan receive]:\nnoogle.golang.org/grpc.(*addrConn).resetTransport(0xc000920000)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:1214 +0x48f\nnreated by google.golang.org/grpc.(*addrConn).connect\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:844 +0x147\nngoroutine 279 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd0d9ca8, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc000a92000, 0xc000347500, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc000a92000, {0xc000347500, 0x666, 0x666})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc000a92000, {0xc000347500, 0xc00034750d, 0x21})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc000206158, {0xc000347500, 0x659, 0xc000587798})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc000115080, {0xc000347500, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc000308cf8, {0x396c0e0, 0xc000115080})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc000308a80, {0xd104358, 0xc000206158}, 0x666)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc000308a80, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc000308a80, {0xc0009c6000, 0x8000, 0xd0c6288})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc000977a40, {0xc0006ad7d8, 0x9, 0xa989cba7})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc000977a40}, {0xc0006ad7d8, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc0006ad7d8, 0x9, 0x50cee00}, {0x396bee0, 0xc000977a40})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc0006ad7a0)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc000a105a0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1347 +0x414\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:346 +0x174f\nngoroutine 277 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd0d9bc0, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc000286200, 0xc000815c00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc000286200, {0xc000815c00, 0x666, 0x666})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc000286200, {0xc000815c00, 0xc000815c0d, 0x19})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc000206170, {0xc000815c00, 0x659, 0xc000630798})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc00096ae70, {0xc000815c00, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc000309078, {0x396c0e0, 0xc00096ae70})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc000308e00, {0xd104358, 0xc000206170}, 0x666)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc000308e00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc000308e00, {0xc0009ae000, 0x8000, 0xc000630c70})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc0009777a0, {0xc0006ad6f8, 0x9, 0xc000301680})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc0009777a0}, {0xc0006ad6f8, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc0006ad6f8, 0x9, 0xc000985500}, {0x396bee0, 0xc0009777a0})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc0006ad6c0)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc000a101e0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1347 +0x414\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:346 +0x174f\nngoroutine 292 [select]:\nnoogle.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc0003f4000)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:69 +0x95\nnreated by google.golang.org/grpc.newCCBalancerWrapper\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:60 +0x1d5\nngoroutine 293 [chan receive]:\nnoogle.golang.org/grpc.(*addrConn).resetTransport(0xc00086a000)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:1214 +0x48f\nnreated by google.golang.org/grpc.(*addrConn).connect\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:844 +0x147\nngoroutine 294 [chan receive]:\nno.etcd.io/etcd/server/v3/embed.(*serveCtx).registerGateway.func1()\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/serve.go:252 +0x50\nnreated by go.etcd.io/etcd/server/v3/embed.(*serveCtx).registerGateway\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/serve.go:251 +0x485\nngoroutine 295 [select]:\nnithub.com/soheilhy/cmux.muxListener.Accept({{0x39a4c80, 0xc00009b910}, 0xc00087d0e0, 0xc000982a80})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:262 +0x7f\nnrypto/tls.(*listener).Accept(0xc0006a6828)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/tls.go:66 +0x2d\nno.etcd.io/etcd/client/pkg/v3/transport.(*tlsListener).acceptLoop(0xc0003f4140)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/pkg/[email protected]/transport/listener_tls.go:126 +0x137\nnreated by go.etcd.io/etcd/client/pkg/v3/transport.newTLSListener\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/pkg/[email protected]/transport/listener_tls.go:84 +0x345\nngoroutine 296 [select]:\nno.etcd.io/etcd/client/pkg/v3/transport.(*tlsListener).Accept(0xc0003f4140)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/pkg/[email protected]/transport/listener_tls.go:89 +0x6f\nnet/http.(*Server).Serve(0xc0003d0700, {0x39a4d40, 0xc0003f4140})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3002 +0x394\nno.etcd.io/etcd/server/v3/embed.(*serveCtx).serve.func4()\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/serve.go:185 +0x2e\nnreated by go.etcd.io/etcd/server/v3/embed.(*serveCtx).serve\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/serve.go:185 +0x1065\nngoroutine 325 [select]:\nnet/http.(*http2serverConn).serve(0xc0006def00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4529 +0x8ed\nnet/http.(*http2Server).ServeConn(0xc00071e780, {0x3a03390, 0xc00020fc00}, 0xc00049ab48)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4131 +0xa71\nnet/http.http2ConfigureServer.func1(0xc0003d0700, 0x3a03390, {0x39745e0, 0xc0001bb000})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3957 +0xe6\nnet/http.(*conn).serve(0xc00087a000, {0x39be9b8, 0xc00071cc60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 300 [select]:\nnet/http.(*http2serverConn).serve(0xc00061af00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4529 +0x8ed\nnet/http.(*http2Server).ServeConn(0xc00071e780, {0x3a03390, 0xc00082ae00}, 0xc000a97b48)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4131 +0xa71\nnet/http.http2ConfigureServer.func1(0xc0003d0700, 0x3a03390, {0x39745e0, 0xc0006a9800})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3957 +0xe6\nnet/http.(*conn).serve(0xc00061c280, {0x39be9b8, 0xc00071cc60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 435 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd0d9820, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc00079e700, 0xc000817100, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc00079e700, {0xc000817100, 0x666, 0x666})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc00079e700, {0xc000817100, 0xc000817137, 0x19})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc000116ed8, {0xc000817100, 0x62f, 0xc00049c798})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc000636ba0, {0xc000817100, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc0004a0cf8, {0x396c0e0, 0xc000636ba0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc0004a0a80, {0xd104358, 0xc000116ed8}, 0x63c)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc0004a0a80, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc0004a0a80, {0xc0008c8000, 0x8000, 0xc00049cc70})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc000306f60, {0xc0001f82d8, 0x9, 0xc000101680})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc000306f60}, {0xc0001f82d8, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc0001f82d8, 0x9, 0xc00049cd70}, {0x396bee0, 0xc000306f60})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc0001f82a0)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc000a10000)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1347 +0x414\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:346 +0x174f\nngoroutine 73 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd0d99f0, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc000239500, 0xc000816a00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc000239500, {0xc000816a00, 0x621, 0x621})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc000239500, {0xc000816a00, 0xc000092848, 0x125643a})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0006b0198, {0xc000816a00, 0xc000816a0d, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnithub.com/soheilhy/cmux.(*bufferedReader).Read(0xc000384da0, {0xc000816a00, 0x614, 0x621})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/buffer.go:53 +0x13e\nnithub.com/soheilhy/cmux.(*MuxConn).Read(0x101904d, {0xc000816a00, 0x12, 0x100000000000000})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:297 +0x25\nnrypto/tls.(*atLeastReader).Read(0xc000199dd0, {0xc000816a00, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc00082b078, {0x396c0e0, 0xc000199dd0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc00082ae00, {0xd0b9570, 0xc000384d90}, 0x621)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc00082ae00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc00082ae00, {0xc0003d0c78, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc00082ae00}, {0xc0003d0c78, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnet/http.http2readFrameHeader({0xc0003d0c78, 0x9, 0xc000977960}, {0xd0bd758, 0xc00082ae00})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1555 +0x6e\nnet/http.(*http2Framer).ReadFrame(0xc0003d0c40)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1813 +0x95\nnet/http.(*http2serverConn).readFrames(0xc00061af00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4415 +0x91\nnreated by net/http.(*http2serverConn).serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4521 +0x585\nngoroutine 278 [select]:\nnoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000aa6e10, 0x1)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:407 +0x11b\nnoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000977860)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:527 +0x85\nnoogle.golang.org/grpc/internal/transport.newHTTP2Client.func3()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:396 +0x65\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:394 +0x1da5\nngoroutine 280 [select]:\nnoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000aa6f50, 0x1)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:407 +0x11b\nnoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000977b60)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:527 +0x85\nnoogle.golang.org/grpc/internal/transport.newHTTP2Client.func3()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:396 +0x65\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:394 +0x1da5\nngoroutine 328 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd0d9ad8, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc000239480, 0xc000348300, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc000239480, {0xc000348300, 0x621, 0x621})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc000239480, {0xc000348300, 0xc0003bb848, 0x125643a})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0006b0190, {0xc000348300, 0xc00034830d, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnithub.com/soheilhy/cmux.(*bufferedReader).Read(0xc0009e8080, {0xc000348300, 0x614, 0x621})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/buffer.go:53 +0x13e\nnithub.com/soheilhy/cmux.(*MuxConn).Read(0x7fffe3007fffe2, {0xc000348300, 0xac, 0x100000e000e000e})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:297 +0x25\nnrypto/tls.(*atLeastReader).Read(0xc000115050, {0xc000348300, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc00020fe78, {0x396c0e0, 0xc000115050})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc00020fc00, {0xd0b9570, 0xc0009e8070}, 0x621)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc00020fc00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc00020fc00, {0xc000aee498, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc00020fc00}, {0xc000aee498, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnet/http.http2readFrameHeader({0xc000aee498, 0x9, 0xc000977f00}, {0xd0bd758, 0xc00020fc00})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1555 +0x6e\nnet/http.(*http2Framer).ReadFrame(0xc000aee460)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1813 +0x95\nnet/http.(*http2serverConn).readFrames(0xc0006def00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4415 +0x91\nnreated by net/http.(*http2serverConn).serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4521 +0x585\nngoroutine 356 [chan receive]:\nn8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc0006b2c00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:204 +0xa7\nnreated by k8s.io/client-go/util/workqueue.newQueue\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:62 +0x1af\nngoroutine 689 [select]:\nnet/http.(*http2serverConn).serve(0xc000b0fb00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4529 +0x8ed\nnet/http.(*http2Server).ServeConn(0xc00071e780, {0x3a03390, 0xc0014fe380}, 0xc001525b48)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4131 +0xa71\nnet/http.http2ConfigureServer.func1(0xc0003d0700, 0x3a03390, {0x39745e0, 0xc0014e2dc0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3957 +0xe6\nnet/http.(*conn).serve(0xc001960000, {0x39be9b8, 0xc00071cc60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 357 [select]:\nn8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc0006b2d80)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/delaying_queue.go:231 +0x34e\nnreated by k8s.io/client-go/util/workqueue.newDelayingQueue\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/delaying_queue.go:68 +0x23b\nngoroutine 358 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd0d9738, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc00079e780, 0xc0008bc700, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc00079e780, {0xc0008bc700, 0x621, 0x621})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc00079e780, {0xc0008bc700, 0xc00062a848, 0x125643a})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0000108e0, {0xc0008bc700, 0xc0008bc70d, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnithub.com/soheilhy/cmux.(*bufferedReader).Read(0xc0009ebb30, {0xc0008bc700, 0x614, 0x621})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/buffer.go:53 +0x13e\nnithub.com/soheilhy/cmux.(*MuxConn).Read(0x0, {0xc0008bc700, 0x0, 0x100000000000000})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:297 +0x25\nnrypto/tls.(*atLeastReader).Read(0xc0006a7f68, {0xc0008bc700, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc00082be78, {0x396c0e0, 0xc0006a7f68})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc00082bc00, {0xd0b9570, 0xc0009ebb20}, 0x621)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc00082bc00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc00082bc00, {0xc0006acab8, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc00082bc00}, {0xc0006acab8, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnet/http.http2readFrameHeader({0xc0006acab8, 0x9, 0xc0010af5a0}, {0xd0bd758, 0xc00082bc00})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1555 +0x6e\nnet/http.(*http2Framer).ReadFrame(0xc0006aca80)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1813 +0x95\nnet/http.(*http2serverConn).readFrames(0xc00061a600)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4415 +0x91\nnreated by net/http.(*http2serverConn).serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4521 +0x585\nngoroutine 434 [select]:\nnoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc000a10000)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1421 +0x169\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:341 +0x1705\nngoroutine 247 [select]:\nnet/http.(*http2serverConn).serve(0xc00061a600)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4529 +0x8ed\nnet/http.(*http2Server).ServeConn(0xc00071e780, {0x3a03390, 0xc00082bc00}, 0xc00062cb48)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4131 +0xa71\nnet/http.http2ConfigureServer.func1(0xc0003d0700, 0x3a03390, {0x39745e0, 0xc001190b00})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3957 +0xe6\nnet/http.(*conn).serve(0xc00037b9a0, {0x39be9b8, 0xc00071cc60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 436 [select]:\nnoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0000be2d0, 0x1)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:407 +0x11b\nnoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000307080)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:527 +0x85\nnoogle.golang.org/grpc/internal/transport.newHTTP2Client.func3()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:396 +0x65\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:394 +0x1da5\nngoroutine 692 [select]:\nnet/http.(*http2serverConn).serve(0xc00032fe00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4529 +0x8ed\nnet/http.(*http2Server).ServeConn(0xc00071e780, {0x3a03390, 0xc001a7a000}, 0xc000569b48)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4131 +0xa71\nnet/http.http2ConfigureServer.func1(0xc0003d0700, 0x3a03390, {0x39745e0, 0xc001e20920})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3957 +0xe6\nnet/http.(*conn).serve(0xc001b888c0, {0x39be9b8, 0xc00071cc60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 438 [select]:\nn8s.io/apiserver/pkg/storage/etcd3.compactor({0x39be910, 0xc0000e8c80}, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/compact.go:116 +0xe5\nnreated by k8s.io/apiserver/pkg/storage/etcd3.StartCompactor\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/compact.go:63 +0x35b\nngoroutine 1108 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc000247090, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x399f400)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/util/workqueue.(*Type).Get(0xc0006b2c00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:151 +0x9e\nn8s.io/apiserver/pkg/server/dynamiccertificates.(*DynamicCertKeyPairContent).processNextWorkItem(0xc00010e3f0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/dynamiccertificates/dynamic_serving_content.go:152 +0x58\nn8s.io/apiserver/pkg/server/dynamiccertificates.(*DynamicCertKeyPairContent).runWorker(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/dynamiccertificates/dynamic_serving_content.go:147\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd742c20)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0003164a0, {0x39705a0, 0xc003f0c090}, 0x1, 0xc000afe0c0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001197c20, 0x3b9aca00, 0x0, 0x20, 0xc000769f38)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0xc00010e3f0, 0xc001197b60, 0xc000afe0c0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/apiserver/pkg/server/dynamiccertificates.(*DynamicCertKeyPairContent).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/dynamiccertificates/dynamic_serving_content.go:133 +0x2ff\nngoroutine 439 [select]:\nnoogle.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc0000e8f00)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:69 +0x95\nnreated by google.golang.org/grpc.newCCBalancerWrapper\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:60 +0x1d5\nngoroutine 440 [chan receive]:\nnoogle.golang.org/grpc.(*addrConn).resetTransport(0xc000920b00)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:1214 +0x48f\nnreated by google.golang.org/grpc.(*addrConn).connect\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:844 +0x147\nngoroutine 361 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd0d9568, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc000287180, 0xc000349100, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc000287180, {0xc000349100, 0x621, 0x621})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc000287180, {0xc000349100, 0xc000a9c848, 0x125643a})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc000a280e8, {0xc000349100, 0xc00034910d, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnithub.com/soheilhy/cmux.(*bufferedReader).Read(0xc00085c1d0, {0xc000349100, 0x614, 0x621})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/buffer.go:53 +0x13e\nnithub.com/soheilhy/cmux.(*MuxConn).Read(0x42400000008, {0xc000349100, 0x0, 0x1000000000003b3})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:297 +0x25\nnrypto/tls.(*atLeastReader).Read(0xc000636c90, {0xc000349100, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc00020f778, {0x396c0e0, 0xc000636c90})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc00020f500, {0xd0b9570, 0xc00085c1c0}, 0x621)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc00020f500, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc00020f500, {0xc0003d08f8, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc00020f500}, {0xc0003d08f8, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnet/http.http2readFrameHeader({0xc0003d08f8, 0x9, 0xc000880d60}, {0xd0bd758, 0xc00020f500})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1555 +0x6e\nnet/http.(*http2Framer).ReadFrame(0xc0003d08c0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1813 +0x95\nnet/http.(*http2serverConn).readFrames(0xc000b5ac00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4415 +0x91\nnreated by net/http.(*http2serverConn).serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4521 +0x585\nngoroutine 826 [select]:\nn8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc0031ed180, {0x0, 0x0, 0x50cee00}, {0x399add8, 0xc00404c140}, 0xc001e85ba0, 0xc003d48d80, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:468 +0x1b6\nn8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc0031ed180, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:428 +0x6b6\nn8s.io/client-go/tools/cache.(*Reflector).Run.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:221 +0x26\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd752d40)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000ff4050, {0x3970580, 0xc001478000}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/client-go/tools/cache.(*Reflector).Run(0xc0031ed180, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:220 +0x237\nn8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:56 +0x22\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 449 [select]:\nnoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc000a10780)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1421 +0x169\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:341 +0x1705\nngoroutine 515 [select]:\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0005507d0, {0x39705a0, 0xc000a3e270}, 0x1, 0xc000983e00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:167 +0x13b\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0010ac000, 0xdf8475800, 0x3ff3333333333333, 0x6, 0xc000b5d4a0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nnreated by k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/registry/generic/registry/store.go:1460 +0x40f\nngoroutine 304 [select]:\nnet/http.(*http2serverConn).serve(0xc000b5ac00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4529 +0x8ed\nnet/http.(*http2Server).ServeConn(0xc00071e780, {0x3a03390, 0xc00020f500}, 0xc000895b48)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4131 +0xa71\nnet/http.http2ConfigureServer.func1(0xc0003d0700, 0x3a03390, {0x39745e0, 0xc0005c8e60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3957 +0xe6\nnet/http.(*conn).serve(0xc00061c3c0, {0x39be9b8, 0xc00071cc60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 466 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd0d9650, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc000287100, 0xc000347c00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc000287100, {0xc000347c00, 0x666, 0x666})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc000287100, {0xc000347c00, 0xc000347c0d, 0x21})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0005d0070, {0xc000347c00, 0x659, 0xc000896798})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc0001af7b8, {0xc000347c00, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc0003093f8, {0x396c0e0, 0xc0001af7b8})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc000309180, {0xd104358, 0xc0005d0070}, 0x666)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc000309180, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc000309180, {0xc0008f0000, 0x8000, 0xc0005eb360})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc000307aa0, {0xc0001f8818, 0x9, 0xed84ccb6})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc000307aa0}, {0xc0001f8818, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc0001f8818, 0x9, 0x50cee00}, {0x396bee0, 0xc000307aa0})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc0001f87e0)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc000a10780)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1347 +0x414\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:346 +0x174f\nngoroutine 467 [select]:\nnoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0000bf090, 0x1)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:407 +0x11b\nnoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000307ec0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:527 +0x85\nnoogle.golang.org/grpc/internal/transport.newHTTP2Client.func3()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:396 +0x65\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:394 +0x1da5\nngoroutine 1543 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd4b9b70, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc004205c80, 0xc004221500, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc004205c80, {0xc004221500, 0x666, 0x666})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc004205c80, {0xc004221500, 0xc00422150d, 0x1d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc001066428, {0xc004221500, 0x659, 0xc000898798})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc000637908, {0xc004221500, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc0042505f8, {0x396c0e0, 0xc000637908})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc004250380, {0xd104358, 0xc001066428}, 0x666)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc004250380, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc004250380, {0xc004178000, 0x8000, 0xc000898c70})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc004153e60, {0xc0030b6738, 0x9, 0xc001986e3c})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc004153e60}, {0xc0030b6738, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc0030b6738, 0x9, 0xc001986ed0}, {0x396bee0, 0xc004153e60})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc0030b6700)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc00194d680)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1347 +0x414\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:346 +0x174f\nngoroutine 422 [select]:\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000983260, {0x39705a0, 0xc000faf530}, 0x1, 0xc000983260)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:167 +0x13b\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000969180, 0x6fc23ac00, 0x3fe0000000000000, 0xe0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.JitterUntilWithContext({0x39be910, 0xc000969180}, 0xc00071c5d0, 0xc0005517d0, 0x12e4d46, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:185 +0x99\nnreated by k8s.io/apiserver/pkg/storage/storagebackend/factory.startDBSizeMonitorPerEndpoint\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/storagebackend/factory/etcd3.go:299 +0x4e5\nngoroutine 423 [select]:\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0006b0170, {0x39705a0, 0xc0005661e0}, 0x1, 0xc00018de00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:167 +0x13b\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0000be4b0, 0xdf8475800, 0x3ff3333333333333, 0xa0, 0xc00095f790)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nnreated by k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/registry/generic/registry/store.go:1460 +0x40f\nngoroutine 504 [chan receive]:\nn8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc001946f60)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:204 +0xa7\nnreated by k8s.io/client-go/util/workqueue.newQueue\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:62 +0x1af\nngoroutine 681 [select]:\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x0, {0x39705a0, 0xc001bfffb0}, 0x1, 0xc001a6e600)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:167 +0x13b\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0006df380, 0xdf8475800, 0x3ff3333333333333, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nnreated by k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/registry/generic/registry/store.go:1460 +0x40f\nngoroutine 707 [chan receive]:\nn8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc00087c780)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:204 +0xa7\nnreated by k8s.io/client-go/util/workqueue.newQueue\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:62 +0x1af\nngoroutine 981 [select]:\nnet/http.(*http2serverConn).serve(0xc0006dfe00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4529 +0x8ed\nnet/http.(*http2Server).ServeConn(0xc00071e780, {0x3a03390, 0xc00020f180}, 0xc001f84b48)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4131 +0xa71\nnet/http.http2ConfigureServer.func1(0xc0003d0700, 0x3a03390, {0x39745e0, 0xc001446d00})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3957 +0xe6\nnet/http.(*conn).serve(0xc001961cc0, {0x39be9b8, 0xc00071cc60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 424 [select]:\nnoogle.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc000969480)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:69 +0x95\nnreated by google.golang.org/grpc.newCCBalancerWrapper\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:60 +0x1d5\nngoroutine 425 [chan receive]:\nnoogle.golang.org/grpc.(*addrConn).resetTransport(0xc00086b080)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:1214 +0x48f\nnreated by google.golang.org/grpc.(*addrConn).connect\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:844 +0x147\nngoroutine 1049 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc000fcc0c8, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x4be7bd0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc000fcc0a0, 0xc000fd2010)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/delta_fifo.go:525 +0x1f6\nn8s.io/client-go/tools/cache.(*controller).processLoop(0xc0010b61b0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/controller.go:183 +0x36\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd365e90)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x15a4be8, {0x39705a0, 0xc000fd0030}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0010b6218, 0x3b9aca00, 0x0, 0x20, 0xd39b888)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90\nn8s.io/client-go/tools/cache.(*controller).Run(0xc0010b61b0, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/controller.go:154 +0x2fb\nn8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc0000ebf40, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:410 +0x449\nnreated by k8s.io/client-go/informers.(*sharedInformerFactory).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/informers/factory.go:134 +0x1cf\nngoroutine 1296 [select]:\nn8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:373 +0x139\nnreated by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:367 +0x3a5\nngoroutine 485 [select]:\nnoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc000b5d4a0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1421 +0x169\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:341 +0x1705\nngoroutine 937 [select]:\nnoogle.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc0019a9b40)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:69 +0x95\nnreated by google.golang.org/grpc.newCCBalancerWrapper\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:60 +0x1d5\nngoroutine 498 [select]:\nnet/http.(*http2serverConn).serve(0xc0006d5800)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4529 +0x8ed\nnet/http.(*http2Server).ServeConn(0xc00071e780, {0x3a03390, 0xc000716380}, 0xc000568b48)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4131 +0xa71\nnet/http.http2ConfigureServer.func1(0xc0003d0700, 0x3a03390, {0x39745e0, 0xc000b1c300})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3957 +0xe6\nnet/http.(*conn).serve(0xc000b068c0, {0x39be9b8, 0xc00071cc60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 486 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd0d92b0, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc00079eb80, 0xc0047ae000, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc00079eb80, {0xc0047ae000, 0x3565, 0x3565})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc00079eb80, {0xc0047ae000, 0xc0047ae00d, 0x26})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc00111e078, {0xc0047ae000, 0x3558, 0xc000a96798})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc0031c0de0, {0xc0047ae000, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc001150978, {0x396c0e0, 0xc0031c0de0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc001150700, {0xd104358, 0xc00111e078}, 0x2)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc001150700, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc001150700, {0xc000ae2000, 0x8000, 0xc00037bea0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc00087cf60, {0xc0006ad998, 0x9, 0xc000b5d4a0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc00087cf60}, {0xc0006ad998, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc0006ad998, 0x9, 0x0}, {0x396bee0, 0xc00087cf60})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc0006ad960)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc000b5d4a0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1347 +0x414\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:346 +0x174f\nngoroutine 911 [select]:\nnoogle.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc0014d3780)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:69 +0x95\nnreated by google.golang.org/grpc.newCCBalancerWrapper\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:60 +0x1d5\nngoroutine 741 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd39ac48, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc001964400, 0xc001b2ce00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc001964400, {0xc001b2ce00, 0x666, 0x666})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc001964400, {0xc001b2ce00, 0xc001b2ce0d, 0x21})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0007e6200, {0xc001b2ce00, 0x659, 0xc001531798})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc003821ef0, {0xc001b2ce00, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc001b3c978, {0x396c0e0, 0xc003821ef0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc001b3c700, {0xd104358, 0xc0007e6200}, 0x666)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc001b3c700, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc001b3c700, {0xc00073c000, 0x8000, 0xc001531c70})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc001980ea0, {0xc0003d01f8, 0x9, 0x1c2f8952})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc001980ea0}, {0xc0003d01f8, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc0003d01f8, 0x9, 0x50cee00}, {0x396bee0, 0xc001980ea0})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc0003d01c0)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc001b5a1e0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1347 +0x414\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:346 +0x174f\nngoroutine 912 [chan receive]:\nnoogle.golang.org/grpc.(*addrConn).resetTransport(0xc000921b80)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:1214 +0x48f\nnreated by google.golang.org/grpc.(*addrConn).connect\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:844 +0x147\nngoroutine 704 [select]:\nnoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001b86690, 0x1)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:407 +0x11b\nnoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001f1f7a0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:527 +0x85\nnoogle.golang.org/grpc/internal/transport.newHTTP2Client.func3()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:396 +0x65\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:394 +0x1da5\nngoroutine 994 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd4ba650, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc0019ab080, 0xc000736e00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc0019ab080, {0xc000736e00, 0x666, 0x666})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc0019ab080, {0xc000736e00, 0xc000736e0d, 0x21})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0007e6728, {0xc000736e00, 0x659, 0xc00150b798})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc0049ee558, {0xc000736e00, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc001fb93f8, {0x396c0e0, 0xc0049ee558})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc001fb9180, {0xd104358, 0xc0007e6728}, 0x666)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc001fb9180, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc001fb9180, {0xc000f04000, 0x8000, 0xc001b88f00})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc00075f140, {0xc00077e9d8, 0x9, 0x4c8c55ba})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc00075f140}, {0xc00077e9d8, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc00077e9d8, 0x9, 0x50cee00}, {0x396bee0, 0xc00075f140})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc00077e9a0)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc00194d2c0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1347 +0x414\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:346 +0x174f\nngoroutine 573 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd39af00, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc001bb6a80, 0xc001d97500, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc001bb6a80, {0xc001d97500, 0x621, 0x621})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc001bb6a80, {0xc001d97500, 0xc000098848, 0x125643a})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc000a282b0, {0xc001d97500, 0xc001d9750d, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnithub.com/soheilhy/cmux.(*bufferedReader).Read(0xc000a54710, {0xc001d97500, 0x614, 0x621})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/buffer.go:53 +0x13e\nnithub.com/soheilhy/cmux.(*MuxConn).Read(0xc000098940, {0xc001d97500, 0x3, 0x100000000000003})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:297 +0x25\nnrypto/tls.(*atLeastReader).Read(0xc00051aeb8, {0xc001d97500, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc001bea278, {0x396c0e0, 0xc00051aeb8})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc001bea000, {0xd0b9570, 0xc000a54700}, 0x621)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc001bea000, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc001bea000, {0xc001d7e498, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc001bea000}, {0xc001d7e498, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnet/http.http2readFrameHeader({0xc001d7e498, 0x9, 0xc001a726a0}, {0xd0bd758, 0xc001bea000})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1555 +0x6e\nnet/http.(*http2Framer).ReadFrame(0xc001d7e460)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1813 +0x95\nnet/http.(*http2serverConn).readFrames(0xc0006df380)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4415 +0x91\nnreated by net/http.(*http2serverConn).serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4521 +0x585\nngoroutine 501 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd0d91c8, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc00079ec00, 0xc004800000, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc00079ec00, {0xc004800000, 0x7343, 0x7343})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc00079ec00, {0xc004800000, 0xc00062e848, 0x125643a})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc000010a30, {0xc004800000, 0xc00480000d, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnithub.com/soheilhy/cmux.(*bufferedReader).Read(0xc0009ebc80, {0xc004800000, 0x7336, 0x7343})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/buffer.go:53 +0x13e\nnithub.com/soheilhy/cmux.(*MuxConn).Read(0xe1fff06, {0xc004800000, 0x100200aaaaaaaa, 0x100000000000000})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:297 +0x25\nnrypto/tls.(*atLeastReader).Read(0xc002ea87b0, {0xc004800000, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc0007165f8, {0x396c0e0, 0xc002ea87b0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc000716380, {0xd0b9570, 0xc0009ebc70}, 0x203000)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc000716380, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc000716380, {0xc0000fcc78, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc000716380}, {0xc0000fcc78, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnet/http.http2readFrameHeader({0xc0000fcc78, 0x9, 0xc000977f00}, {0xd0bd758, 0xc000716380})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1555 +0x6e\nnet/http.(*http2Framer).ReadFrame(0xc0000fcc40)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1813 +0x95\nnet/http.(*http2serverConn).readFrames(0xc0006d5800)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4415 +0x91\nnreated by net/http.(*http2serverConn).serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4521 +0x585\nngoroutine 505 [select]:\nn8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc0019470e0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/delaying_queue.go:231 +0x34e\nnreated by k8s.io/client-go/util/workqueue.newDelayingQueue\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/delaying_queue.go:68 +0x23b\nngoroutine 938 [chan receive]:\nnoogle.golang.org/grpc.(*addrConn).resetTransport(0xc0007b5600)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:1214 +0x48f\nnreated by google.golang.org/grpc.(*addrConn).connect\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:844 +0x147\nngoroutine 523 [select]:\nnoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0014ce5f0, 0x1)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:407 +0x11b\nnoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0014cca80)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:527 +0x85\nnoogle.golang.org/grpc/internal/transport.newHTTP2Client.func3()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:396 +0x65\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:394 +0x1da5\nngoroutine 544 [select]:\nnet/http.(*http2serverConn).serve(0xc000b64600)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4529 +0x8ed\nnet/http.(*http2Server).ServeConn(0xc00071e780, {0x3a03390, 0xc000b14000}, 0xc000098b48)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4131 +0xa71\nnet/http.http2ConfigureServer.func1(0xc0003d0700, 0x3a03390, {0x39745e0, 0xc0013adce0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3957 +0xe6\nnet/http.(*conn).serve(0xc0019619a0, {0x39be9b8, 0xc00071cc60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 945 [select]:\nnoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc00194d2c0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1421 +0x169\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:341 +0x1705\nngoroutine 506 [chan receive]:\nn8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc0019781e0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:204 +0xa7\nnreated by k8s.io/client-go/util/workqueue.newQueue\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:62 +0x1af\nngoroutine 507 [select]:\nn8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc001978360)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/delaying_queue.go:231 +0x34e\nnreated by k8s.io/client-go/util/workqueue.newDelayingQueue\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/delaying_queue.go:68 +0x23b\nngoroutine 508 [chan receive]:\nn8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc001978480)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:204 +0xa7\nnreated by k8s.io/client-go/util/workqueue.newQueue\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:62 +0x1af\nngoroutine 509 [select]:\nn8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc001978600)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/delaying_queue.go:231 +0x34e\nnreated by k8s.io/client-go/util/workqueue.newDelayingQueue\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/delaying_queue.go:68 +0x23b\nngoroutine 510 [chan receive]:\nn8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc0019786c0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:204 +0xa7\nnreated by k8s.io/client-go/util/workqueue.newQueue\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:62 +0x1af\nngoroutine 511 [select]:\nn8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc001978840)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/delaying_queue.go:231 +0x34e\nnreated by k8s.io/client-go/util/workqueue.newDelayingQueue\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/delaying_queue.go:68 +0x23b\nngoroutine 512 [chan receive]:\nn8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc001978900)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:204 +0xa7\nnreated by k8s.io/client-go/util/workqueue.newQueue\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:62 +0x1af\nngoroutine 513 [select]:\nn8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc001978a80)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/delaying_queue.go:231 +0x34e\nnreated by k8s.io/client-go/util/workqueue.newDelayingQueue\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/delaying_queue.go:68 +0x23b\nngoroutine 530 [chan receive]:\nn8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc001978b40)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:204 +0xa7\nnreated by k8s.io/client-go/util/workqueue.newQueue\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:62 +0x1af\nngoroutine 531 [select]:\nn8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc001978cc0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/delaying_queue.go:231 +0x34e\nnreated by k8s.io/client-go/util/workqueue.newDelayingQueue\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/delaying_queue.go:68 +0x23b\nngoroutine 535 [select]:\nnoogle.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc001a21180)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:69 +0x95\nnreated by google.golang.org/grpc.newCCBalancerWrapper\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:60 +0x1d5\nngoroutine 536 [chan receive]:\nnoogle.golang.org/grpc.(*addrConn).resetTransport(0xc0007a8840)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:1214 +0x48f\nnreated by google.golang.org/grpc.(*addrConn).connect\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:844 +0x147\nngoroutine 368 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd0d9398, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc001965200, 0xc00163d100, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc001965200, {0xc00163d100, 0x666, 0x666})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc001965200, {0xc00163d100, 0xc00163d10d, 0x21})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0007e65c0, {0xc00163d100, 0x659, 0xc000099798})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc0007e8180, {0xc00163d100, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc000309e78, {0x396c0e0, 0xc0007e8180})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc000309c00, {0xd104358, 0xc0007e65c0}, 0x666)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc000309c00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc000309c00, {0xc00198c000, 0x8000, 0xc0019a4000})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc0019805a0, {0xc0003d0118, 0x9, 0xf24a5ccf})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc0019805a0}, {0xc0003d0118, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc0003d0118, 0x9, 0x50cee00}, {0x396bee0, 0xc0019805a0})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc0003d00e0)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc0019a6000)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1347 +0x414\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:346 +0x174f\nngoroutine 369 [select]:\nnoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001982280, 0x1)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:407 +0x11b\nnoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001980660)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:527 +0x85\nnoogle.golang.org/grpc/internal/transport.newHTTP2Client.func3()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:396 +0x65\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:394 +0x1da5\nngoroutine 367 [select]:\nnoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc0019a6000)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1421 +0x169\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:341 +0x1705\nngoroutine 863 [select]:\nnoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc001c7c1e0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1421 +0x169\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:341 +0x1705\nngoroutine 516 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd0d9480, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc001af2000, 0xc001a68000, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc001af2000, {0xc001a68000, 0x621, 0x621})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc001af2000, {0xc001a68000, 0xc00062c848, 0x125643a})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc000206070, {0xc001a68000, 0xc001a6800d, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnithub.com/soheilhy/cmux.(*bufferedReader).Read(0xc000a4e010, {0xc001a68000, 0x614, 0x621})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/buffer.go:53 +0x13e\nnithub.com/soheilhy/cmux.(*MuxConn).Read(0x8, {0xc001a68000, 0x1000000d07d770, 0x10000ffffffffff})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:297 +0x25\nnrypto/tls.(*atLeastReader).Read(0xc000b58318, {0xc001a68000, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc000b14278, {0x396c0e0, 0xc000b58318})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc000b14000, {0xd0b9570, 0xc000a4e000}, 0x621)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc000b14000, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc000b14000, {0xc0000fd538, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc000b14000}, {0xc0000fd538, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnet/http.http2readFrameHeader({0xc0000fd538, 0x9, 0xc001980700}, {0xd0bd758, 0xc000b14000})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1555 +0x6e\nnet/http.(*http2Framer).ReadFrame(0xc0000fd500)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1813 +0x95\nnet/http.(*http2serverConn).readFrames(0xc000b64600)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4415 +0x91\nnreated by net/http.(*http2serverConn).serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4521 +0x585\nngoroutine 549 [select]:\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0006b0170, {0x39705a0, 0xc0014d0060}, 0x1, 0xc0000c1380)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:167 +0x13b\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0000be4b0, 0xdf8475800, 0x3ff3333333333333, 0xa0, 0xc001574790)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nnreated by k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/registry/generic/registry/store.go:1460 +0x40f\nngoroutine 550 [select]:\nnoogle.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc001af6680)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:69 +0x95\nnreated by google.golang.org/grpc.newCCBalancerWrapper\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:60 +0x1d5\nngoroutine 551 [chan receive]:\nnoogle.golang.org/grpc.(*addrConn).resetTransport(0xc001af82c0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:1214 +0x48f\nnreated by google.golang.org/grpc.(*addrConn).connect\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:844 +0x147\nngoroutine 559 [select]:\nnet/http.(*http2serverConn).serve(0xc000b0f380)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4529 +0x8ed\nnet/http.(*http2Server).ServeConn(0xc00071e780, {0x3a03390, 0xc0014fe000}, 0xc00062db48)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4131 +0xa71\nnet/http.http2ConfigureServer.func1(0xc0003d0700, 0x3a03390, {0x39745e0, 0xc001b34480})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3957 +0xe6\nnet/http.(*conn).serve(0xc001afc1e0, {0x39be9b8, 0xc00071cc60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 522 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd0d90e0, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc001af2380, 0xc001b2c700, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc001af2380, {0xc001b2c700, 0x666, 0x666})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc001af2380, {0xc001b2c700, 0xc001b2c70d, 0x21})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0000de298, {0xc001b2c700, 0x659, 0xc000a99798})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc0005c7e48, {0xc001b2c700, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc000b15af8, {0x396c0e0, 0xc0005c7e48})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc000b15880, {0xd104358, 0xc0000de298}, 0x666)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc000b15880, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc000b15880, {0xc001c74000, 0x8000, 0xc0014e81e0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc0014cc9c0, {0xc0001f8658, 0x9, 0xf3d33b7c})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc0014cc9c0}, {0xc0001f8658, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc0001f8658, 0x9, 0x50cee00}, {0x396bee0, 0xc0014cc9c0})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc0001f8620)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc001c7c000)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1347 +0x414\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:346 +0x174f\nngoroutine 521 [select]:\nnoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc001c7c000)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1421 +0x169\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:341 +0x1705\nngoroutine 929 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd4ba738, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc001965280, 0xc001d97c00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc001965280, {0xc001d97c00, 0x621, 0x621})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc001965280, {0xc001d97c00, 0xc00104b848, 0x125643a})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0000de2b8, {0xc001d97c00, 0xc001d97c0d, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnithub.com/soheilhy/cmux.(*bufferedReader).Read(0xc000a4e7f0, {0xc001d97c00, 0x614, 0x621})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/buffer.go:53 +0x13e\nnithub.com/soheilhy/cmux.(*MuxConn).Read(0x0, {0xc001d97c00, 0x200aaaaaaaa, 0x10000000000002a})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:297 +0x25\nnrypto/tls.(*atLeastReader).Read(0xc000ac7a88, {0xc001d97c00, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc00076c5f8, {0x396c0e0, 0xc000ac7a88})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc00076c380, {0xd0b9570, 0xc000a4e7e0}, 0x203000)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc00076c380, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc00076c380, {0xc0001f9538, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc00076c380}, {0xc0001f9538, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnet/http.http2readFrameHeader({0xc0001f9538, 0x9, 0xc0019808e0}, {0xd0bd758, 0xc00076c380})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1555 +0x6e\nnet/http.(*http2Framer).ReadFrame(0xc0001f9500)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1813 +0x95\nnet/http.(*http2serverConn).readFrames(0xc000728900)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4415 +0x91\nnreated by net/http.(*http2serverConn).serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4521 +0x585\nngoroutine 594 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd0d8ff8, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc0014e0100, 0xc001b2d500, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc0014e0100, {0xc001b2d500, 0x621, 0x621})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc0014e0100, {0xc001b2d500, 0xc00056e848, 0x125643a})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc00111e050, {0xc001b2d500, 0xc001b2d50d, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnithub.com/soheilhy/cmux.(*bufferedReader).Read(0xc000a501d0, {0xc001b2d500, 0x614, 0x621})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/buffer.go:53 +0x13e\nnithub.com/soheilhy/cmux.(*MuxConn).Read(0x0, {0xc001b2d500, 0x0, 0x100000000000000})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:297 +0x25\nnrypto/tls.(*atLeastReader).Read(0xc000ac62e8, {0xc001b2d500, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc0014fe278, {0x396c0e0, 0xc000ac62e8})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc0014fe000, {0xd0b9570, 0xc000a501c0}, 0x621)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc0014fe000, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc0014fe000, {0xc000aeec78, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc0014fe000}, {0xc000aeec78, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnet/http.http2readFrameHeader({0xc000aeec78, 0x9, 0xc001b38460}, {0xd0bd758, 0xc0014fe000})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1555 +0x6e\nnet/http.(*http2Framer).ReadFrame(0xc000aeec40)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1813 +0x95\nnet/http.(*http2serverConn).readFrames(0xc000b0f380)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4415 +0x91\nnreated by net/http.(*http2serverConn).serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4521 +0x585\nngoroutine 604 [select]:\nnoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001afebe0, 0x1)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:407 +0x11b\nnoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001b38780)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:527 +0x85\nnoogle.golang.org/grpc/internal/transport.newHTTP2Client.func3()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:396 +0x65\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:394 +0x1da5\nngoroutine 351 [select]:\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x0, {0x39705a0, 0xc001984720}, 0x1, 0xc00022b1a0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:167 +0x13b\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0xdf8475800, 0x3ff3333333333333, 0x66, 0xc001af6680)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nnreated by k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/registry/generic/registry/store.go:1460 +0x40f\nngoroutine 936 [select]:\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x0, {0x39705a0, 0xc001a7f680}, 0x1, 0xc001029aa0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:167 +0x13b\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0xdf8475800, 0x3ff3333333333333, 0x6, 0xc001c7c1e0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nnreated by k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/registry/generic/registry/store.go:1460 +0x40f\nngoroutine 774 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd39a990, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc0019aaa00, 0xc001a69c00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc0019aaa00, {0xc001a69c00, 0x621, 0x621})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc0019aaa00, {0xc001a69c00, 0xc0015be848, 0x125643a})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0007e6500, {0xc001a69c00, 0xc001a69c0d, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnithub.com/soheilhy/cmux.(*bufferedReader).Read(0xc000a506a0, {0xc001a69c00, 0x614, 0x621})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/buffer.go:53 +0x13e\nnithub.com/soheilhy/cmux.(*MuxConn).Read(0xc00003b670, {0xc001a69c00, 0xc0001171a8, 0x10000c0001234c0})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:297 +0x25\nnrypto/tls.(*atLeastReader).Read(0xc000ac62d0, {0xc001a69c00, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc001b3daf8, {0x396c0e0, 0xc000ac62d0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc001b3d880, {0xd0b9570, 0xc000a50690}, 0x621)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc001b3d880, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc001b3d880, {0xc001efa9d8, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc001b3d880}, {0xc001efa9d8, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnet/http.http2readFrameHeader({0xc001efa9d8, 0x9, 0xc0011b6a60}, {0xd0bd758, 0xc001b3d880})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1555 +0x6e\nnet/http.(*http2Framer).ReadFrame(0xc001efa9a0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1813 +0x95\nnet/http.(*http2serverConn).readFrames(0xc00032fb00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4415 +0x91\nnreated by net/http.(*http2serverConn).serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4521 +0x585\nngoroutine 352 [select]:\nnoogle.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc001b80880)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:69 +0x95\nnreated by google.golang.org/grpc.newCCBalancerWrapper\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:60 +0x1d5\nngoroutine 353 [chan receive]:\nnoogle.golang.org/grpc.(*addrConn).resetTransport(0xc001b90b00)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:1214 +0x48f\nnreated by google.golang.org/grpc.(*addrConn).connect\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:844 +0x147\nngoroutine 633 [select]:\nnet/http.(*http2serverConn).serve(0xc0007a5980)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4529 +0x8ed\nnet/http.(*http2Server).ServeConn(0xc00071e780, {0x3a03390, 0xc001b3c000}, 0xc000882b48)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4131 +0xa71\nnet/http.http2ConfigureServer.func1(0xc0003d0700, 0x3a03390, {0x39745e0, 0xc001b8d140})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3957 +0xe6\nnet/http.(*conn).serve(0xc001b88320, {0x39be9b8, 0xc00071cc60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 603 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd39b1b8, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc001bb6380, 0xc001bace00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc001bb6380, {0xc001bace00, 0x666, 0x666})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc001bb6380, {0xc001bace00, 0xc001bace0d, 0x21})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc000a28178, {0xc001bace00, 0x659, 0xc00062d798})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc00051ae58, {0xc001bace00, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc001b9d078, {0x396c0e0, 0xc00051ae58})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc001b9ce00, {0xd104358, 0xc000a28178}, 0x666)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc001b9ce00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc001b9ce00, {0xc001b42000, 0x8000, 0xc001afc500})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc001b386c0, {0xc000aeed58, 0x9, 0xf5352efe})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc001b386c0}, {0xc000aeed58, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc000aeed58, 0x9, 0x50cee00}, {0x396bee0, 0xc001b386c0})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc000aeed20)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc001b5a000)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1347 +0x414\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:346 +0x174f\nngoroutine 602 [select]:\nnoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc001b5a000)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1421 +0x169\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:341 +0x1705\nngoroutine 751 [select]:\nnoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001afe8c0, 0x1)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:407 +0x11b\nnoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001981200)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:527 +0x85\nnoogle.golang.org/grpc/internal/transport.newHTTP2Client.func3()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:396 +0x65\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:394 +0x1da5\nngoroutine 526 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd39b0d0, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc001af2800, 0xc001badc00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc001af2800, {0xc001badc00, 0x621, 0x621})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc001af2800, {0xc001badc00, 0xc000496848, 0x125643a})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0000de360, {0xc001badc00, 0xc001badc0d, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnithub.com/soheilhy/cmux.(*bufferedReader).Read(0xc000a4e860, {0xc001badc00, 0x614, 0x621})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/buffer.go:53 +0x13e\nnithub.com/soheilhy/cmux.(*MuxConn).Read(0x8, {0xc001badc00, 0x140, 0x100000000000001})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:297 +0x25\nnrypto/tls.(*atLeastReader).Read(0xc00051ae40, {0xc001badc00, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc001b3c278, {0x396c0e0, 0xc00051ae40})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc001b3c000, {0xd0b9570, 0xc000a4e850}, 0x621)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc001b3c000, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc001b3c000, {0xc001ba1458, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc001b3c000}, {0xc001ba1458, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnet/http.http2readFrameHeader({0xc001ba1458, 0x9, 0xc0014cc520}, {0xd0bd758, 0xc001b3c000})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1555 +0x6e\nnet/http.(*http2Framer).ReadFrame(0xc001ba1420)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1813 +0x95\nnet/http.(*http2serverConn).readFrames(0xc0007a5980)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4415 +0x91\nnreated by net/http.(*http2serverConn).serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4521 +0x585\nngoroutine 637 [select]:\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0010f9fd0, {0x39705a0, 0xc001b3a3c0}, 0x1, 0xc001bd24e0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:167 +0x13b\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000054a80, 0xdf8475800, 0x3ff3333333333333, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nnreated by k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/registry/generic/registry/store.go:1460 +0x40f\nngoroutine 682 [select]:\nnoogle.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc000756280)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:69 +0x95\nnreated by google.golang.org/grpc.newCCBalancerWrapper\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:60 +0x1d5\nngoroutine 972 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd4ba480, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc0019ab500, 0xc000739100, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc0019ab500, {0xc000739100, 0x666, 0x666})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc0019ab500, {0xc000739100, 0xc00073910d, 0x21})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc001198350, {0xc000739100, 0x659, 0xc00049a798})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc00293da40, {0xc000739100, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc0007173f8, {0x396c0e0, 0xc00293da40})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc000717180, {0xd104358, 0xc001198350}, 0x666)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc000717180, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc000717180, {0xc000ff6000, 0x8000, 0xc0014e8780})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc0011b7e60, {0xc000aee658, 0x9, 0x3f50472b})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc0011b7e60}, {0xc000aee658, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc000aee658, 0x9, 0x50cee00}, {0x396bee0, 0xc0011b7e60})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc000aee620)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc001c7c3c0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1347 +0x414\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:346 +0x174f\nngoroutine 638 [select]:\nnoogle.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc001b81380)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:69 +0x95\nnreated by google.golang.org/grpc.newCCBalancerWrapper\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:60 +0x1d5\nngoroutine 639 [chan receive]:\nnoogle.golang.org/grpc.(*addrConn).resetTransport(0xc001b918c0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:1214 +0x48f\nnreated by google.golang.org/grpc.(*addrConn).connect\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:844 +0x147\nngoroutine 646 [select]:\nnoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc001bf4000)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1421 +0x169\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:341 +0x1705\nngoroutine 742 [select]:\nnoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001afe500, 0x1)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:407 +0x11b\nnoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001980f60)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:527 +0x85\nnoogle.golang.org/grpc/internal/transport.newHTTP2Client.func3()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:396 +0x65\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:394 +0x1da5\nngoroutine 659 [select]:\nnet/http.(*http2serverConn).serve(0xc0006df380)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4529 +0x8ed\nnet/http.(*http2Server).ServeConn(0xc00071e780, {0x3a03390, 0xc001bea000}, 0xc000631b48)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4131 +0xa71\nnet/http.http2ConfigureServer.func1(0xc0003d0700, 0x3a03390, {0x39745e0, 0xc00075aa20})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3957 +0xe6\nnet/http.(*conn).serve(0xc001dae000, {0x39be9b8, 0xc00071cc60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 647 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd39afe8, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc00076a000, 0xc001d96700, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc00076a000, {0xc001d96700, 0x666, 0x666})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc00076a000, {0xc001d96700, 0xc001d9670d, 0x21})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc000560030, {0xc001d96700, 0x659, 0xc00150c798})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc00051aed0, {0xc001d96700, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc00076c278, {0x396c0e0, 0xc00051aed0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc00076c000, {0xd104358, 0xc000560030}, 0x666)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc00076c000, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc00076c000, {0xc001bec000, 0x8000, 0xc001b88640})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc001bdac00, {0xc001be8578, 0x9, 0xf6af71c0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc001bdac00}, {0xc001be8578, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc001be8578, 0x9, 0x50cee00}, {0x396bee0, 0xc001bdac00})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc001be8540)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc001bf4000)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1347 +0x414\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:346 +0x174f\nngoroutine 648 [select]:\nnoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001b871d0, 0x1)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:407 +0x11b\nnoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc00075f9e0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:527 +0x85\nnoogle.golang.org/grpc/internal/transport.newHTTP2Client.func3()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:396 +0x65\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:394 +0x1da5\nngoroutine 750 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd39a8a8, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc002012380, 0xc0008bd500, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc002012380, {0xc0008bd500, 0x666, 0x666})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc002012380, {0xc0008bd500, 0xc0008bd50d, 0x21})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc001198928, {0xc0008bd500, 0x659, 0xc001521798})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc000ac6408, {0xc0008bd500, 0xc001b97d40, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc00201e5f8, {0x396c0e0, 0xc000ac6408})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc00201e380, {0xd104358, 0xc001198928}, 0x666)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc00201e380, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc00201e380, {0xc0020f0000, 0x8000, 0xc001521c80})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc001981140, {0xc0003d0498, 0x9, 0xfdaa22c9})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc001981140}, {0xc0003d0498, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc0003d0498, 0x9, 0x50cee00}, {0x396bee0, 0xc001981140})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc0003d0460)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc001b5a3c0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1347 +0x414\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:346 +0x174f\nngoroutine 650 [select]:\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x0, {0x39705a0, 0xc0007590b0}, 0x1, 0xc001bd2fc0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:167 +0x13b\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0xdf8475800, 0x3ff3333333333333, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nnreated by k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/registry/generic/registry/store.go:1460 +0x40f\nngoroutine 651 [select]:\nnoogle.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc001b81c80)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:69 +0x95\nnreated by google.golang.org/grpc.newCCBalancerWrapper\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:60 +0x1d5\nngoroutine 652 [chan receive]:\nnoogle.golang.org/grpc.(*addrConn).resetTransport(0xc001bf8840)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:1214 +0x48f\nnreated by google.golang.org/grpc.(*addrConn).connect\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:844 +0x147\nngoroutine 668 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd39ae18, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc001bb6e00, 0xc001baea00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc001bb6e00, {0xc001baea00, 0x666, 0x666})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc001bb6e00, {0xc001baea00, 0x7f, 0xc001dc3718})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc000a28398, {0xc001baea00, 0x6, 0xc001dc3798})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc0026f8be8, {0xc001baea00, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc001beb3f8, {0x396c0e0, 0xc0026f8be8})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc001beb180, {0xd104358, 0xc000a28398}, 0x666)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc001beb180, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc001beb180, {0xc001dc6000, 0x8000, 0xc001dc3c70})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc00075fda0, {0xc001d7e578, 0x9, 0x1c2ddf30})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc00075fda0}, {0xc001d7e578, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc001d7e578, 0x9, 0x50cee00}, {0x396bee0, 0xc00075fda0})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc001d7e540)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc001dde000)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1347 +0x414\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:346 +0x174f\nngoroutine 669 [select]:\nnoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0007608c0, 0x1)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:407 +0x11b\nnoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc00075fe60)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:527 +0x85\nnoogle.golang.org/grpc/internal/transport.newHTTP2Client.func3()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:396 +0x65\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:394 +0x1da5\nngoroutine 667 [select]:\nnoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc001dde000)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1421 +0x169\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:341 +0x1705\nngoroutine 1154 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc002fd2550, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x399f400)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/util/workqueue.(*Type).Get(0xc002ded500)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:151 +0x9e\nn8s.io/apiserver/pkg/server/dynamiccertificates.(*DynamicServingCertificateController).processNextWorkItem(0xc0033bcf00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/dynamiccertificates/tlsconfig.go:263 +0x58\nn8s.io/apiserver/pkg/server/dynamiccertificates.(*DynamicServingCertificateController).runWorker(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/dynamiccertificates/tlsconfig.go:258\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd466450)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0019185a0, {0x39705a0, 0xc0037a8060}, 0x1, 0xc000afe0c0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0000f95e0, 0x3b9aca00, 0x0, 0xd0, 0x1040a25)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0xc0019185a0, 0x0, 0xc0019185a0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/apiserver/pkg/server/dynamiccertificates.(*DynamicServingCertificateController).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/dynamiccertificates/tlsconfig.go:247 +0x24f\nngoroutine 670 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd39ad30, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc001965880, 0xc001baf800, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc001965880, {0xc001baf800, 0x621, 0x621})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc001965880, {0xc001baf800, 0xc000569848, 0x125643a})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0007e6650, {0xc001baf800, 0xc001baf80d, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnithub.com/soheilhy/cmux.(*bufferedReader).Read(0xc000a2abe0, {0xc001baf800, 0x614, 0x621})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/buffer.go:53 +0x13e\nnithub.com/soheilhy/cmux.(*MuxConn).Read(0xd451190, {0xc001baf800, 0x140, 0x100000000000001})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:297 +0x25\nnrypto/tls.(*atLeastReader).Read(0xc0026f8bd0, {0xc001baf800, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc001a7a278, {0x396c0e0, 0xc0026f8bd0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc001a7a000, {0xd0b9570, 0xc000a2abd0}, 0x621)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc001a7a000, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc001a7a000, {0xc001be9a78, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc001a7a000}, {0xc001be9a78, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnet/http.http2readFrameHeader({0xc001be9a78, 0x9, 0xc0037f4d60}, {0xd0bd758, 0xc001a7a000})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1555 +0x6e\nnet/http.(*http2Framer).ReadFrame(0xc001be9a40)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1813 +0x95\nnet/http.(*http2serverConn).readFrames(0xc00032fe00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4415 +0x91\nnreated by net/http.(*http2serverConn).serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4521 +0x585\nngoroutine 683 [chan receive]:\nnoogle.golang.org/grpc.(*addrConn).resetTransport(0xc001af8000)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:1214 +0x48f\nnreated by google.golang.org/grpc.(*addrConn).connect\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:844 +0x147\nngoroutine 740 [select]:\nnoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc001b5a1e0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1421 +0x169\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:341 +0x1705\nngoroutine 825 [chan receive]:\nn8s.io/client-go/tools/cache.(*controller).Run.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/controller.go:130 +0x28\nnreated by k8s.io/client-go/tools/cache.(*controller).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/controller.go:129 +0x105\nngoroutine 78 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd39ab60, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc001964500, 0xc001b2e300, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc001964500, {0xc001b2e300, 0x621, 0x621})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc001964500, {0xc001b2e300, 0xc001525848, 0x125643a})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0000de270, {0xc001b2e300, 0xc001b2e30d, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnithub.com/soheilhy/cmux.(*bufferedReader).Read(0xc000a4e1d0, {0xc001b2e300, 0x614, 0x621})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/buffer.go:53 +0x13e\nnithub.com/soheilhy/cmux.(*MuxConn).Read(0x6, {0xc001b2e300, 0x200aaaaaaaa, 0x10000000000002a})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:297 +0x25\nnrypto/tls.(*atLeastReader).Read(0xc003090d50, {0xc001b2e300, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc0014fe5f8, {0x396c0e0, 0xc003090d50})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc0014fe380, {0xd0b9570, 0xc000a4e1c0}, 0x621)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc0014fe380, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc0014fe380, {0xc000aeeab8, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc0014fe380}, {0xc000aeeab8, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnet/http.http2readFrameHeader({0xc000aeeab8, 0x9, 0xc0020158a0}, {0xd0bd758, 0xc0014fe380})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1555 +0x6e\nnet/http.(*http2Framer).ReadFrame(0xc000aeea80)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1813 +0x95\nnet/http.(*http2serverConn).readFrames(0xc000b0fb00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4415 +0x91\nnreated by net/http.(*http2serverConn).serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4521 +0x585\nngoroutine 757 [select]:\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0007657d0, {0x39705a0, 0xc001a7ef00}, 0x1, 0xc0015876e0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:167 +0x13b\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000054b58, 0xdf8475800, 0x3ff3333333333333, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nnreated by k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/registry/generic/registry/store.go:1460 +0x40f\nngoroutine 758 [select]:\nnoogle.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc000757080)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:69 +0x95\nnreated by google.golang.org/grpc.newCCBalancerWrapper\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:60 +0x1d5\nngoroutine 759 [chan receive]:\nnoogle.golang.org/grpc.(*addrConn).resetTransport(0xc001af9080)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:1214 +0x48f\nnreated by google.golang.org/grpc.(*addrConn).connect\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:844 +0x147\nngoroutine 766 [select]:\nnoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc0019a61e0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1421 +0x169\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:341 +0x1705\nngoroutine 813 [select]:\nnet/http.(*http2serverConn).serve(0xc000b65c80)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4529 +0x8ed\nnet/http.(*http2Server).ServeConn(0xc00071e780, {0x3a03390, 0xc001a7ae00}, 0xc001dc5b48)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4131 +0xa71\nnet/http.http2ConfigureServer.func1(0xc0003d0700, 0x3a03390, {0x39745e0, 0xc0014e3300})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3957 +0xe6\nnet/http.(*conn).serve(0xc001960e60, {0x39be9b8, 0xc00071cc60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 771 [select]:\nnet/http.(*http2serverConn).serve(0xc00032fb00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4529 +0x8ed\nnet/http.(*http2Server).ServeConn(0xc00071e780, {0x3a03390, 0xc001b3d880}, 0xc001526b48)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4131 +0xa71\nnet/http.http2ConfigureServer.func1(0xc0003d0700, 0x3a03390, {0x39745e0, 0xc00075ac80})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3957 +0xe6\nnet/http.(*conn).serve(0xc001dae280, {0x39be9b8, 0xc00071cc60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 767 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd39aa78, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc001bb6000, 0xc001a68e00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc001bb6000, {0xc001a68e00, 0x666, 0x666})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc001bb6000, {0xc001a68e00, 0xc001a68e0d, 0x21})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc000560038, {0xc001a68e00, 0x659, 0xc001522798})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc0007e9110, {0xc001a68e00, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc001a7a978, {0x396c0e0, 0xc0007e9110})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc001a7a700, {0xd104358, 0xc000560038}, 0x666)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc001a7a700, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc001a7a700, {0xc001f8e000, 0x8000, 0xc0019606e0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc001534840, {0xc000aefdf8, 0x9, 0xfb710dc8})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc001534840}, {0xc000aefdf8, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc000aefdf8, 0x9, 0x50cee00}, {0x396bee0, 0xc001534840})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc000aefdc0)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc0019a61e0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1347 +0x414\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:346 +0x174f\nngoroutine 768 [select]:\nnoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0014cf180, 0x1)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:407 +0x11b\nnoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001534900)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:527 +0x85\nnoogle.golang.org/grpc/internal/transport.newHTTP2Client.func3()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:396 +0x65\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:394 +0x1da5\nngoroutine 786 [select]:\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x0, {0x39705a0, 0xc0011a7110}, 0x1, 0xc001a6e420)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:167 +0x13b\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0xdf8475800, 0x3ff3333333333333, 0x6, 0xc0019a61e0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nnreated by k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/registry/generic/registry/store.go:1460 +0x40f\nngoroutine 838 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd39a6d8, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc001bb6080, 0xc001b2dc00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc001bb6080, {0xc001b2dc00, 0x666, 0x666})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc001bb6080, {0xc001b2dc00, 0xc001b2dc0d, 0x21})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0007e6248, {0xc001b2dc00, 0x659, 0xc001dc2798})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc000b58288, {0xc001b2dc00, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc001fb8978, {0x396c0e0, 0xc000b58288})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc001fb8700, {0xd104358, 0xc0007e6248}, 0x666)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc001fb8700, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc001fb8700, {0xc001b74000, 0x8000, 0xd0df8d0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc001980ae0, {0xc0003d0578, 0x9, 0xff22d256})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc001980ae0}, {0xc0003d0578, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc0003d0578, 0x9, 0x50cee00}, {0x396bee0, 0xc001980ae0})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc0003d0540)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc0019a63c0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1347 +0x414\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:346 +0x174f\nngoroutine 822 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc0031060c8, 0xb)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0xc000edc1c0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc0031060a0, 0xc003132010)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/delta_fifo.go:525 +0x1f6\nn8s.io/client-go/tools/cache.(*controller).processLoop(0xc0010c21b0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/controller.go:183 +0x36\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd752d40)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x15a4be8, {0x39705a0, 0xc003114030}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0010c2218, 0x3b9aca00, 0x0, 0x0, 0xd39b888)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90\nn8s.io/client-go/tools/cache.(*controller).Run(0xc0010c21b0, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/controller.go:154 +0x2fb\nn8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc001960d20, 0xc001b5a000)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:410 +0x449\nnreated by k8s.io/apiextensions-apiserver/pkg/client/informers/externalversions.(*sharedInformerFactory).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/client/informers/externalversions/factory.go:117 +0x1cf\nngoroutine 806 [select]:\nnoogle.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc0007565c0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:69 +0x95\nnreated by google.golang.org/grpc.newCCBalancerWrapper\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:60 +0x1d5\nngoroutine 787 [select]:\nnoogle.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc001e433c0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:69 +0x95\nnreated by google.golang.org/grpc.newCCBalancerWrapper\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:60 +0x1d5\nngoroutine 788 [chan receive]:\nnoogle.golang.org/grpc.(*addrConn).resetTransport(0xc00086a840)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:1214 +0x48f\nnreated by google.golang.org/grpc.(*addrConn).connect\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:844 +0x147\nngoroutine 1405 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc000951fd0, 0x1)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x60)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/util/workqueue.(*Type).Get(0xc001978900)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:151 +0x9e\nn8s.io/apiextensions-apiserver/pkg/controller/finalizer.(*CRDFinalizer).processNextWorkItem(0xc00043dd10)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/finalizer/crd_finalizer.go:290 +0x58\nn8s.io/apiextensions-apiserver/pkg/controller/finalizer.(*CRDFinalizer).runWorker(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/finalizer/crd_finalizer.go:284\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd710aa8)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x300d020, {0x39705a0, 0xc003c4a9f0}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0x3b9aca00, 0x0, 0x1, 0x1040a25)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0x0, 0xc00022ac00, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/apiextensions-apiserver/pkg/controller/finalizer.(*CRDFinalizer).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/finalizer/crd_finalizer.go:277 +0x245\nngoroutine 805 [select]:\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x0, {0x39705a0, 0xc0011a7b00}, 0x1, 0xc0015b63c0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:167 +0x13b\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x50cc290, 0xdf8475800, 0x3ff3333333333333, 0x20, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nnreated by k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/registry/generic/registry/store.go:1460 +0x40f\nngoroutine 749 [select]:\nnoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc001b5a3c0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1421 +0x169\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:341 +0x1705\nngoroutine 1431 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc000951dd0, 0xd)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x399f400)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/util/workqueue.(*Type).Get(0xc0019786c0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:151 +0x9e\nn8s.io/apiextensions-apiserver/pkg/controller/apiapproval.(*KubernetesAPIApprovalPolicyConformantConditionController).processNextWorkItem(0xc00043db80)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/apiapproval/apiapproval_controller.go:207 +0x58\nn8s.io/apiextensions-apiserver/pkg/controller/apiapproval.(*KubernetesAPIApprovalPolicyConformantConditionController).runWorker(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/apiapproval/apiapproval_controller.go:201\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd364730)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x18, {0x39705a0, 0xc003c952f0}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x18, 0x3b9aca00, 0x0, 0x0, 0xc004102420)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0x0, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/apiextensions-apiserver/pkg/controller/apiapproval.(*KubernetesAPIApprovalPolicyConformantConditionController).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/apiapproval/apiapproval_controller.go:194 +0x22e\nngoroutine 799 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd39a7c0, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc001965000, 0xc0008be300, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc001965000, {0xc0008be300, 0x621, 0x621})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc001965000, {0xc0008be300, 0xc000568848, 0x125643a})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0000de2d8, {0xc0008be300, 0x10182d0, 0x50fb948})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnithub.com/soheilhy/cmux.(*bufferedReader).Read(0xc000a4e400, {0xc0008be300, 0x6, 0x621})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/buffer.go:53 +0x13e\nnithub.com/soheilhy/cmux.(*MuxConn).Read(0x6, {0xc0008be300, 0x0, 0x100010000000000})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:297 +0x25\nnrypto/tls.(*atLeastReader).Read(0xc0006ea000, {0xc0008be300, 0xc00200d860, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc0014fe978, {0x396c0e0, 0xc0006ea000})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc0014fe700, {0xd0b9570, 0xc000a4e3f0}, 0x621)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc0014fe700, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc0014fe700, {0xc001d7e2d8, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc0014fe700}, {0xc001d7e2d8, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnet/http.http2readFrameHeader({0xc001d7e2d8, 0x9, 0xc001f1e0a0}, {0xd0bd758, 0xc0014fe700})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1555 +0x6e\nnet/http.(*http2Framer).ReadFrame(0xc001d7e2a0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1813 +0x95\nnet/http.(*http2serverConn).readFrames(0xc0006d5080)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4415 +0x91\nnreated by net/http.(*http2serverConn).serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4521 +0x585\nngoroutine 824 [chan receive]:\nn8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc000a17730, 0x100000000000000)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:628 +0x45\nn8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:56 +0x22\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 807 [chan receive]:\nnoogle.golang.org/grpc.(*addrConn).resetTransport(0xc001af8580)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:1214 +0x48f\nnreated by google.golang.org/grpc.(*addrConn).connect\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:844 +0x147\nngoroutine 837 [select]:\nnoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc0019a63c0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1421 +0x169\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:341 +0x1705\nngoroutine 864 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd4ba820, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc002012900, 0xc001d96000, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc002012900, {0xc001d96000, 0x666, 0x666})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc002012900, {0xc001d96000, 0xc001d9600d, 0x1d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0006b02f8, {0xc001d96000, 0x659, 0xc00152c798})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc00096ad68, {0xc001d96000, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc00201f078, {0x396c0e0, 0xc00096ad68})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc00201ee00, {0xd104358, 0xc0006b02f8}, 0x666)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc00201ee00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc00201ee00, {0xc000eb0000, 0x8000, 0xc00152cc70})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc0011b77a0, {0xc000aee2d8, 0x9, 0x4ac469cd})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc0011b77a0}, {0xc000aee2d8, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc000aee2d8, 0x9, 0xc0019e1610}, {0x396bee0, 0xc0011b77a0})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc000aee2a0)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc001c7c1e0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1347 +0x414\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:346 +0x174f\nngoroutine 840 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd39a5f0, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc001bb6100, 0xc001b2f100, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc001bb6100, {0xc001b2f100, 0x621, 0x621})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc001bb6100, {0xc001b2f100, 0xc001dc5848, 0x125643a})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc000560040, {0xc001b2f100, 0xc001b2f10d, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnithub.com/soheilhy/cmux.(*bufferedReader).Read(0xc000a54010, {0xc001b2f100, 0x614, 0x621})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/buffer.go:53 +0x13e\nnithub.com/soheilhy/cmux.(*MuxConn).Read(0x8, {0xc001b2f100, 0x10da69a45eb655, 0x10000ffffffffff})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:297 +0x25\nnrypto/tls.(*atLeastReader).Read(0xc0006a63d8, {0xc001b2f100, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc001a7b078, {0x396c0e0, 0xc0006a63d8})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc001a7ae00, {0xd0b9570, 0xc000a54000}, 0x621)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc001a7ae00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc001a7ae00, {0xc001efa1f8, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc001a7ae00}, {0xc001efa1f8, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnet/http.http2readFrameHeader({0xc001efa1f8, 0x9, 0xc0011b7540}, {0xd0bd758, 0xc001a7ae00})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1555 +0x6e\nnet/http.(*http2Framer).ReadFrame(0xc001efa1c0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1813 +0x95\nnet/http.(*http2serverConn).readFrames(0xc000b65c80)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4415 +0x91\nnreated by net/http.(*http2serverConn).serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4521 +0x585\nngoroutine 839 [select]:\nnoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000760140, 0x1)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:407 +0x11b\nnoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001980fc0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:527 +0x85\nnoogle.golang.org/grpc/internal/transport.newHTTP2Client.func3()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:396 +0x65\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:394 +0x1da5\nngoroutine 932 [select]:\nnet/http.(*http2serverConn).serve(0xc000728900)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4529 +0x8ed\nnet/http.(*http2Server).ServeConn(0xc00071e780, {0x3a03390, 0xc00076c380}, 0xc000631b48)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4131 +0xa71\nnet/http.http2ConfigureServer.func1(0xc0003d0700, 0x3a03390, {0x39745e0, 0xc001b359a0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3957 +0xe6\nnet/http.(*conn).serve(0xc001b88be0, {0x39be9b8, 0xc00071cc60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 817 [select]:\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0011a30c0, {0x39705a0, 0xc0019de450}, 0x1, 0xc0015b7200)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:167 +0x13b\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00211007d, 0xdf8475800, 0x3ff3333333333333, 0x6, 0xc0019a63c0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nnreated by k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/registry/generic/registry/store.go:1460 +0x40f\nngoroutine 849 [select]:\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x0, {0x39705a0, 0xc001f22c30}, 0x1, 0xc001b41020)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:167 +0x13b\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x50cc290, 0xdf8475800, 0x3ff3333333333333, 0x6, 0xc001b5a5a0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nnreated by k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/registry/generic/registry/store.go:1460 +0x40f\nngoroutine 900 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd39a338, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc001bb6d00, 0xc001bad500, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc001bb6d00, {0xc001bad500, 0x666, 0x666})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc001bb6d00, {0xc001bad500, 0xc001bad50d, 0x21})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0006b0120, {0xc001bad500, 0x659, 0xc001fe5798})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc0006a6558, {0xc001bad500, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc00201e978, {0x396c0e0, 0xc0006a6558})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc00201e700, {0xd104358, 0xc0006b0120}, 0x666)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc00201e700, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc00201e700, {0xc0020f8000, 0x8000, 0xc002010320})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc001a72960, {0xc001be9298, 0x9, 0x22ca595})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc001a72960}, {0xc001be9298, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc001be9298, 0x9, 0x50cee00}, {0x396bee0, 0xc001a72960})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc001be9260)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc001e3d2c0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1347 +0x414\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:346 +0x174f\nngoroutine 1404 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc000951fd0, 0x3)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0xc003475d80)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/util/workqueue.(*Type).Get(0xc001978900)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:151 +0x9e\nn8s.io/apiextensions-apiserver/pkg/controller/finalizer.(*CRDFinalizer).processNextWorkItem(0xc00043dd10)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/finalizer/crd_finalizer.go:290 +0x58\nn8s.io/apiextensions-apiserver/pkg/controller/finalizer.(*CRDFinalizer).runWorker(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/finalizer/crd_finalizer.go:284\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd4c06a0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001606050, {0x39705a0, 0xc0040d23f0}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0015b66c0, 0x3b9aca00, 0x0, 0x0, 0x1040a25)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0x0, 0xc003475f68, 0xc003475f78)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/apiextensions-apiserver/pkg/controller/finalizer.(*CRDFinalizer).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/finalizer/crd_finalizer.go:277 +0x245\nngoroutine 901 [select]:\nnoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0019826e0, 0x1)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:407 +0x11b\nnoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001a72a80)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:527 +0x85\nnoogle.golang.org/grpc/internal/transport.newHTTP2Client.func3()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:396 +0x65\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:394 +0x1da5\nngoroutine 914 [select]:\nnoogle.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc0011a30c0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:69 +0x95\nnreated by google.golang.org/grpc.newCCBalancerWrapper\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:60 +0x1d5\nngoroutine 866 [select]:\nnoogle.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc000757b00)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:69 +0x95\nnreated by google.golang.org/grpc.newCCBalancerWrapper\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:60 +0x1d5\nngoroutine 867 [chan receive]:\nnoogle.golang.org/grpc.(*addrConn).resetTransport(0xc00086adc0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:1214 +0x48f\nnreated by google.golang.org/grpc.(*addrConn).connect\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:844 +0x147\nngoroutine 702 [select]:\nnoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc001b5a5a0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1421 +0x169\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:341 +0x1705\nngoroutine 703 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd39a508, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc0014e0000, 0xc001a69500, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc0014e0000, {0xc001a69500, 0x666, 0x666})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc0014e0000, {0xc001a69500, 0xc001a6950d, 0x21})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc00111e088, {0xc001a69500, 0x659, 0xc001530798})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc000b586d8, {0xc001a69500, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc0014fecf8, {0x396c0e0, 0xc000b586d8})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc0014fea80, {0xd104358, 0xc00111e088}, 0x666)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc0014fea80, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc0014fea80, {0xc001e58000, 0x8000, 0xc001afc320})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc001f1f6e0, {0xc001d7e738, 0x9, 0x9506b5})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc001f1f6e0}, {0xc001d7e738, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc001d7e738, 0x9, 0x50cee00}, {0x396bee0, 0xc001f1f6e0})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc001d7e700)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc001b5a5a0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1347 +0x414\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:346 +0x174f\nngoroutine 874 [select]:\nnet/http.(*http2serverConn).serve(0xc0006dfb00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4529 +0x8ed\nnet/http.(*http2Server).ServeConn(0xc00071e780, {0x3a03390, 0xc001fb8e00}, 0xc00049db48)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4131 +0xa71\nnet/http.http2ConfigureServer.func1(0xc0003d0700, 0x3a03390, {0x39745e0, 0xc0014460e0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3957 +0xe6\nnet/http.(*conn).serve(0xc0019614a0, {0x39be9b8, 0xc00071cc60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 973 [select]:\nnoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000719770, 0x1)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:407 +0x11b\nnoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0011b7f20)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:527 +0x85\nnoogle.golang.org/grpc/internal/transport.newHTTP2Client.func3()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:396 +0x65\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:394 +0x1da5\nngoroutine 705 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd39a420, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc0019aae00, 0xc001b2f800, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc0019aae00, {0xc001b2f800, 0x621, 0x621})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc0019aae00, {0xc001b2f800, 0xc00049d848, 0x125643a})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0007e66e0, {0xc001b2f800, 0xc001b2f80d, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnithub.com/soheilhy/cmux.(*bufferedReader).Read(0xc000a507f0, {0xc001b2f800, 0x614, 0x621})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/buffer.go:53 +0x13e\nnithub.com/soheilhy/cmux.(*MuxConn).Read(0x2c, {0xc001b2f800, 0xf211f4a786eef159, 0x100009c7a86c174})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:297 +0x25\nnrypto/tls.(*atLeastReader).Read(0xc000ac6210, {0xc001b2f800, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc001fb9078, {0x396c0e0, 0xc000ac6210})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc001fb8e00, {0xd0b9570, 0xc000a507e0}, 0x621)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc001fb8e00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc001fb8e00, {0xc001efab98, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc001fb8e00}, {0xc001efab98, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnet/http.http2readFrameHeader({0xc001efab98, 0x9, 0xc001f1fb40}, {0xd0bd758, 0xc001fb8e00})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1555 +0x6e\nnet/http.(*http2Framer).ReadFrame(0xc001efab60)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1813 +0x95\nnet/http.(*http2serverConn).readFrames(0xc0006dfb00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4415 +0x91\nnreated by net/http.(*http2serverConn).serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4521 +0x585\nngoroutine 891 [select]:\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x0, {0x39705a0, 0xc00158f0e0}, 0x1, 0xc001e41500)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:167 +0x13b\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0012a2900, 0xdf8475800, 0x3ff3333333333333, 0xc0, 0xc000765fb8)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nnreated by k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/registry/generic/registry/store.go:1460 +0x40f\nngoroutine 620 [chan receive]:\nnoogle.golang.org/grpc.(*addrConn).resetTransport(0xc0001c6b00)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:1214 +0x48f\nnreated by google.golang.org/grpc.(*addrConn).connect\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:844 +0x147\nngoroutine 915 [chan receive]:\nnoogle.golang.org/grpc.(*addrConn).resetTransport(0xc001bf9080)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:1214 +0x48f\nnreated by google.golang.org/grpc.(*addrConn).connect\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:844 +0x147\nngoroutine 618 [select]:\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x0, {0x39705a0, 0xc002019320}, 0x1, 0xc001028b40)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:167 +0x13b\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x39be948, 0xdf8475800, 0x3ff3333333333333, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nnreated by k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/registry/generic/registry/store.go:1460 +0x40f\nngoroutine 619 [select]:\nnoogle.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc0019a8f80)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:69 +0x95\nnreated by google.golang.org/grpc.newCCBalancerWrapper\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:60 +0x1d5\nngoroutine 899 [select]:\nnoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc001e3d2c0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1421 +0x169\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:341 +0x1705\nngoroutine 865 [select]:\nnoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000718f00, 0x1)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:407 +0x11b\nnoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0011b7860)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:527 +0x85\nnoogle.golang.org/grpc/internal/transport.newHTTP2Client.func3()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:396 +0x65\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:394 +0x1da5\nngoroutine 924 [select]:\nnet/http.(*http2serverConn).serve(0xc001b7c900)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4529 +0x8ed\nnet/http.(*http2Server).ServeConn(0xc00071e780, {0x3a03390, 0xc001bea700}, 0xc001fe3b48)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4131 +0xa71\nnet/http.http2ConfigureServer.func1(0xc0003d0700, 0x3a03390, {0x39745e0, 0xc0019eeb20})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3957 +0xe6\nnet/http.(*conn).serve(0xc001dae8c0, {0x39be9b8, 0xc00071cc60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 1110 [select]:\nn8s.io/apimachinery/pkg/util/wait.contextForChannel.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:298 +0x77\nnreated by k8s.io/apimachinery/pkg/util/wait.contextForChannel\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:297 +0xc8\nngoroutine 902 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd4ba908, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc001bb6d80, 0xc0008bdc00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc001bb6d80, {0xc0008bdc00, 0x621, 0x621})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc001bb6d80, {0xc0008bdc00, 0xc001fe3848, 0x125643a})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0005601d8, {0xc0008bdc00, 0xc0008bdc0d, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnithub.com/soheilhy/cmux.(*bufferedReader).Read(0xc000a549b0, {0xc0008bdc00, 0x614, 0x621})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/buffer.go:53 +0x13e\nnithub.com/soheilhy/cmux.(*MuxConn).Read(0x2c, {0xc0008bdc00, 0x58971bf19bb446da, 0x100004cc9badb1c})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:297 +0x25\nnrypto/tls.(*atLeastReader).Read(0xc0001af470, {0xc0008bdc00, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc001bea978, {0x396c0e0, 0xc0001af470})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc001bea700, {0xd0b9570, 0xc000a549a0}, 0x621)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc001bea700, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc001bea700, {0xc0003d1ed8, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc001bea700}, {0xc0003d1ed8, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnet/http.http2readFrameHeader({0xc0003d1ed8, 0x9, 0xc001e1e700}, {0xd0bd758, 0xc001bea700})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1555 +0x6e\nnet/http.(*http2Framer).ReadFrame(0xc0003d1ea0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1813 +0x95\nnet/http.(*http2serverConn).readFrames(0xc001b7c900)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4415 +0x91\nnreated by net/http.(*http2serverConn).serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4521 +0x585\nngoroutine 910 [select]:\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x0, {0x39705a0, 0xc001f23320}, 0x1, 0xc00072d7a0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:167 +0x13b\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000728900, 0xdf8475800, 0x3ff3333333333333, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nnreated by k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/registry/generic/registry/store.go:1460 +0x40f\nngoroutine 996 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd4ba568, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc002013000, 0xc000738300, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc002013000, {0xc000738300, 0x621, 0x621})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc002013000, {0xc000738300, 0xc000ef1848, 0x125643a})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0006b0438, {0xc000738300, 0xc00073830d, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnithub.com/soheilhy/cmux.(*bufferedReader).Read(0xc0002da780, {0xc000738300, 0x614, 0x621})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/buffer.go:53 +0x13e\nnithub.com/soheilhy/cmux.(*MuxConn).Read(0x0, {0xc000738300, 0x0, 0x10000c000ee50e0})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:297 +0x25\nnrypto/tls.(*atLeastReader).Read(0xc0049ee540, {0xc000738300, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc00020f3f8, {0x396c0e0, 0xc0049ee540})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc00020f180, {0xd0b9570, 0xc0002da770}, 0x621)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc00020f180, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc00020f180, {0xc001efb0d8, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc00020f180}, {0xc001efb0d8, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnet/http.http2readFrameHeader({0xc001efb0d8, 0x9, 0xc004cb51e0}, {0xd0bd758, 0xc00020f180})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1555 +0x6e\nnet/http.(*http2Framer).ReadFrame(0xc001efb0a0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1813 +0x95\nnet/http.(*http2serverConn).readFrames(0xc0006dfe00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4415 +0x91\nnreated by net/http.(*http2serverConn).serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4521 +0x585\nngoroutine 995 [select]:\nnoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001affcc0, 0x1)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:407 +0x11b\nnoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc00075f200)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:527 +0x85\nnoogle.golang.org/grpc/internal/transport.newHTTP2Client.func3()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:396 +0x65\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:394 +0x1da5\nngoroutine 1213 [select]:\nno.etcd.io/etcd/client/v3.(*watchGrpcStream).serveSubstream(0xc00159a340, 0xc003850420, 0xc001a6fc20)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/watch.go:803 +0x265\nnreated by go.etcd.io/etcd/client/v3.(*watchGrpcStream).run\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/watch.go:554 +0xed1\nngoroutine 1111 [select]:\nn8s.io/apimachinery/pkg/util/wait.poller.func1.1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:705 +0x1c9\nnreated by k8s.io/apimachinery/pkg/util/wait.poller.func1\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:688 +0xcf\nngoroutine 992 [select]:\nnet/http.(*http2serverConn).serve(0xc000f2c000)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4529 +0x8ed\nnet/http.(*http2Server).ServeConn(0xc00071e780, {0x3a03390, 0xc001fb9500}, 0xc000631b48)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4131 +0xa71\nnet/http.http2ConfigureServer.func1(0xc0003d0700, 0x3a03390, {0x39745e0, 0xc001447780})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3957 +0xe6\nnet/http.(*conn).serve(0xc0019a4140, {0x39be9b8, 0xc00071cc60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 971 [select]:\nnoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc001c7c3c0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1421 +0x169\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:341 +0x1705\nngoroutine 1073 [select]:\nnet/http.(*http2serverConn).serve(0xc00108f680)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4529 +0x8ed\nnet/http.(*http2Server).ServeConn(0xc00071e780, {0x3a03390, 0xc001fb9880}, 0xc000f2bb48)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4131 +0xa71\nnet/http.http2ConfigureServer.func1(0xc0003d0700, 0x3a03390, {0x39745e0, 0xc000b1cae0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3957 +0xe6\nnet/http.(*conn).serve(0xc002011040, {0x39be9b8, 0xc00071cc60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 1035 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd4ba0e0, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc001af3c00, 0xc00163b500, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc001af3c00, {0xc00163b500, 0x666, 0x666})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc001af3c00, {0xc00163b500, 0xc00163b50d, 0x21})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc001198868, {0xc00163b500, 0x659, 0xc000eef798})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc0001af740, {0xc00163b500, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc001341078, {0x396c0e0, 0xc0001af740})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc001340e00, {0xd104358, 0xc001198868}, 0x666)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc001340e00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc001340e00, {0xc0011ca000, 0x8000, 0xc0019a45a0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc00061f440, {0xc001efb6f8, 0x9, 0x978e43d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc00061f440}, {0xc001efb6f8, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc001efb6f8, 0x9, 0x50cee00}, {0x396bee0, 0xc00061f440})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc001efb6c0)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc001dde1e0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1347 +0x414\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:346 +0x174f\nngoroutine 974 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd4ba398, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc0019ab580, 0xc000816300, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc0019ab580, {0xc000816300, 0x621, 0x621})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc0019ab580, {0xc000816300, 0xc000ef5848, 0x125643a})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0007e6790, {0xc000816300, 0xc00081630d, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnithub.com/soheilhy/cmux.(*bufferedReader).Read(0xc000a50e80, {0xc000816300, 0x614, 0x621})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/buffer.go:53 +0x13e\nnithub.com/soheilhy/cmux.(*MuxConn).Read(0x10189a6, {0xc000816300, 0x0, 0x100000100000000})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:297 +0x25\nnrypto/tls.(*atLeastReader).Read(0xc00293da10, {0xc000816300, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc001fb9778, {0x396c0e0, 0xc00293da10})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc001fb9500, {0xd0b9570, 0xc000a50e70}, 0x621)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc001fb9500, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc001fb9500, {0xc001efb618, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc001fb9500}, {0xc001efb618, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnet/http.http2readFrameHeader({0xc001efb618, 0x9, 0xc0037fbde0}, {0xd0bd758, 0xc001fb9500})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1555 +0x6e\nnet/http.(*http2Framer).ReadFrame(0xc001efb5e0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1813 +0x95\nnet/http.(*http2serverConn).readFrames(0xc000f2c000)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4415 +0x91\nnreated by net/http.(*http2serverConn).serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4521 +0x585\nngoroutine 1155 [select]:\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x3a0af00, {0x39705a0, 0xc0037a8030}, 0x1, 0xc000afe0c0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:167 +0x13b\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0xdf8475800, 0x0, 0x28, 0xc00054f740)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0xc0033bcf00, 0x20fa106, 0xc000afe0c0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/apiserver/pkg/server/dynamiccertificates.(*DynamicServingCertificateController).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/dynamiccertificates/tlsconfig.go:250 +0x30f\nngoroutine 1063 [select]:\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0007647d0, {0x39705a0, 0xc000b183f0}, 0x1, 0xc001197440)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:167 +0x13b\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000b662a0, 0xdf8475800, 0x3ff3333333333333, 0x6, 0xc001bf45a0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nnreated by k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/registry/generic/registry/store.go:1460 +0x40f\nngoroutine 1109 [select]:\nn8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x39be910, 0xc003f0e000}, 0xc0001c3b90, 0x15a680a)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:655 +0xe7\nn8s.io/apimachinery/pkg/util/wait.poll({0x39be910, 0xc003f0e000}, 0x38, 0x15a5305, 0xc003f0a060)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:591 +0x9a\nn8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext({0x39be910, 0xc003f0e000}, 0xc001573fd0, 0x12e5497)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:542 +0x49\nn8s.io/apimachinery/pkg/util/wait.PollImmediateUntil(0xc001961cc0, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:533 +0x7c\nnreated by k8s.io/apiserver/pkg/server/dynamiccertificates.(*DynamicCertKeyPairContent).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/dynamiccertificates/dynamic_serving_content.go:136 +0x3b6\nngoroutine 892 [select]:\nnoogle.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc001a79a00)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:69 +0x95\nnreated by google.golang.org/grpc.newCCBalancerWrapper\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:60 +0x1d5\nngoroutine 893 [chan receive]:\nnoogle.golang.org/grpc.(*addrConn).resetTransport(0xc000461600)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:1214 +0x48f\nnreated by google.golang.org/grpc.(*addrConn).connect\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:844 +0x147\nngoroutine 1046 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd4ba1c8, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc0014e0b00, 0xc00163a700, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc0014e0b00, {0xc00163a700, 0x621, 0x621})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc0014e0b00, {0xc00163a700, 0xc0015c2848, 0x125643a})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc00111e240, {0xc00163a700, 0xc00163a70d, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnithub.com/soheilhy/cmux.(*bufferedReader).Read(0xc000a52940, {0xc00163a700, 0x614, 0x621})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/buffer.go:53 +0x13e\nnithub.com/soheilhy/cmux.(*MuxConn).Read(0x0, {0xc00163a700, 0x1, 0x100000000000001})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:297 +0x25\nnrypto/tls.(*atLeastReader).Read(0xc0031c0288, {0xc00163a700, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc0014ffe78, {0x396c0e0, 0xc0031c0288})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc0014ffc00, {0xd0b9570, 0xc000a52930}, 0x203000)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc0014ffc00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc0014ffc00, {0xc000c72ff8, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc0014ffc00}, {0xc000c72ff8, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnet/http.http2readFrameHeader({0xc000c72ff8, 0x9, 0xc0019db180}, {0xd0bd758, 0xc0014ffc00})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1555 +0x6e\nnet/http.(*http2Framer).ReadFrame(0xc000c72fc0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1813 +0x95\nnet/http.(*http2serverConn).readFrames(0xc00108e000)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4415 +0x91\nnreated by net/http.(*http2serverConn).serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4521 +0x585\nngoroutine 1061 [select]:\nnoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0011aa500, 0x1)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:407 +0x11b\nnoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc00063dec0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:527 +0x85\nnoogle.golang.org/grpc/internal/transport.newHTTP2Client.func3()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:396 +0x65\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:394 +0x1da5\nngoroutine 1059 [select]:\nnoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc001bf45a0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1421 +0x169\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:341 +0x1705\nngoroutine 1060 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd4ba2b0, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc0014e0a80, 0xc000349800, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc0014e0a80, {0xc000349800, 0x666, 0x666})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc0014e0a80, {0xc000349800, 0xc00034980d, 0x3f})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc001198420, {0xc000349800, 0x659, 0xc000093798})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc0037a6378, {0xc000349800, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc000717778, {0x396c0e0, 0xc0037a6378})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc000717500, {0xd104358, 0xc001198420}, 0x14a5294a5294a5)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc000717500, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc000717500, {0xc001090000, 0x8000, 0xc002010dc0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc00063de00, {0xc000c730d8, 0x9, 0xc001bf45a0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc00063de00}, {0xc000c730d8, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc000c730d8, 0x9, 0x0}, {0x396bee0, 0xc00063de00})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc000c730a0)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnoogle.golang.org/grpc/internal/transport.(*http2Client).reader(0xc001bf45a0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1347 +0x414\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:346 +0x174f\nngoroutine 1024 [select]:\nnet/http.(*http2serverConn).serve(0xc00108e000)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4529 +0x8ed\nnet/http.(*http2Server).ServeConn(0xc00071e780, {0x3a03390, 0xc0014ffc00}, 0xc000eeeb48)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4131 +0xa71\nnet/http.http2ConfigureServer.func1(0xc0003d0700, 0x3a03390, {0x39745e0, 0xc001191800})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3957 +0xe6\nnet/http.(*conn).serve(0xc002010c80, {0x39be9b8, 0xc00071cc60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 1051 [chan receive]:\nn8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc00010e460, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:628 +0x45\nn8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:56 +0x22\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 957 [chan receive]:\nn8s.io/apiserver/pkg/server/dynamiccertificates.(*DynamicServingCertificateController).Run(0xc0033bcf00, 0x20fa106, 0xc000afe0c0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/dynamiccertificates/tlsconfig.go:254 +0x31e\nnreated by k8s.io/apiserver/pkg/server.(*SecureServingInfo).tlsConfig\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/secure_serving.go:134 +0x72f\nngoroutine 1064 [select]:\nnoogle.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc0003f5200)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:69 +0x95\nnreated by google.golang.org/grpc.newCCBalancerWrapper\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:60 +0x1d5\nngoroutine 1065 [chan receive]:\nnoogle.golang.org/grpc.(*addrConn).resetTransport(0xc0006e1080)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:1214 +0x48f\nnreated by google.golang.org/grpc.(*addrConn).connect\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:844 +0x147\nngoroutine 955 [select]:\nn8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc002ded680)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/delaying_queue.go:231 +0x34e\nnreated by k8s.io/client-go/util/workqueue.newDelayingQueue\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/delaying_queue.go:68 +0x23b\nngoroutine 956 [chan receive]:\nn8s.io/apiserver/pkg/server/dynamiccertificates.(*DynamicCertKeyPairContent).Run(0xc00010e3f0, 0xc001197b60, 0xc000afe0c0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/dynamiccertificates/dynamic_serving_content.go:143 +0x3c5\nnreated by k8s.io/apiserver/pkg/server.(*SecureServingInfo).tlsConfig\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/secure_serving.go:114 +0x5c5\nngoroutine 1034 [select]:\nnoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc001dde1e0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1421 +0x169\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:341 +0x1705\nngoroutine 954 [chan receive]:\nn8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc002ded500)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:204 +0xa7\nnreated by k8s.io/client-go/util/workqueue.newQueue\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:62 +0x1af\nngoroutine 949 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd4b9ff8, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc0019aba80, 0xc00163c300, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc0019aba80, {0xc00163c300, 0x621, 0x621})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc0019aba80, {0xc00163c300, 0xc000ef0848, 0x125643a})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0007e6810, {0xc00163c300, 0xc00163c30d, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnithub.com/soheilhy/cmux.(*bufferedReader).Read(0xc000a51430, {0xc00163c300, 0x614, 0x621})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/buffer.go:53 +0x13e\nnithub.com/soheilhy/cmux.(*MuxConn).Read(0x0, {0xc00163c300, 0x0, 0x100000000000000})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:297 +0x25\nnrypto/tls.(*atLeastReader).Read(0xc0001af728, {0xc00163c300, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc001fb9af8, {0x396c0e0, 0xc0001af728})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc001fb9880, {0xd0b9570, 0xc000a51420}, 0x621)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc001fb9880, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc001fb9880, {0xc0010b8658, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc001fb9880}, {0xc0010b8658, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnet/http.http2readFrameHeader({0xc0010b8658, 0x9, 0xc001e1eb20}, {0xd0bd758, 0xc001fb9880})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1555 +0x6e\nnet/http.(*http2Framer).ReadFrame(0xc0010b8620)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1813 +0x95\nnet/http.(*http2serverConn).readFrames(0xc00108f680)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4415 +0x91\nnreated by net/http.(*http2serverConn).serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4521 +0x585\nngoroutine 1036 [select]:\nnoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001a52690, 0x1)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:407 +0x11b\nnoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc00061f500)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:527 +0x85\nnoogle.golang.org/grpc/internal/transport.newHTTP2Client.func3()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:396 +0x65\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:394 +0x1da5\nngoroutine 953 [chan receive]:\nn8s.io/apiserver/pkg/server.preparedGenericAPIServer.Run.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/genericapiserver.go:342 +0x23c\nnreated by k8s.io/apiserver/pkg/server.preparedGenericAPIServer.Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/genericapiserver.go:338 +0x125\nngoroutine 1093 [select]:\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x0, {0x39705a0, 0xc000faed20}, 0x1, 0xc000afe420)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:167 +0x13b\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00108e000, 0xdf8475800, 0x3ff3333333333333, 0x6, 0xc001dde1e0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nnreated by k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/registry/generic/registry/store.go:1460 +0x40f\nngoroutine 958 [chan receive]:\nn8s.io/apiserver/pkg/server.RunServer.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/secure_serving.go:280 +0x70\nnreated by k8s.io/apiserver/pkg/server.RunServer\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/secure_serving.go:278 +0xef\nngoroutine 959 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd0d9908, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc000286c00, 0x106d415, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Accept(0xc000286c00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:402 +0x22c\nnet.(*netFD).accept(0xc000286c00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_unix.go:173 +0x35\nnet.(*TCPListener).accept(0xc0001153b0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/tcpsock_posix.go:140 +0x28\nnet.(*TCPListener).Accept(0xc0001153b0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/tcpsock.go:262 +0x3d\nn8s.io/apiserver/pkg/server.tcpKeepAliveListener.Accept({{0x39b1c40, 0xc0001153b0}})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/secure_serving.go:321 +0x2b\nnrypto/tls.(*listener).Accept(0xc002046000)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/tls.go:66 +0x2d\nnet/http.(*Server).Serve(0xc00077f180, {0x39a1860, 0xc002046000})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3002 +0x394\nn8s.io/apiserver/pkg/server.RunServer.func2()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/secure_serving.go:296 +0x1af\nnreated by k8s.io/apiserver/pkg/server.RunServer\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/secure_serving.go:286 +0x18f\nngoroutine 960 [chan receive]:\nn8s.io/apiserver/pkg/server.preparedGenericAPIServer.NonBlockingRun.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/genericapiserver.go:431 +0x47\nnreated by k8s.io/apiserver/pkg/server.preparedGenericAPIServer.NonBlockingRun\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/genericapiserver.go:430 +0x353\nngoroutine 1406 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc000951fd0, 0x4)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/util/workqueue.(*Type).Get(0xc001978900)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:151 +0x9e\nn8s.io/apiextensions-apiserver/pkg/controller/finalizer.(*CRDFinalizer).processNextWorkItem(0xc00043dd10)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/finalizer/crd_finalizer.go:290 +0x58\nn8s.io/apiextensions-apiserver/pkg/controller/finalizer.(*CRDFinalizer).runWorker(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/finalizer/crd_finalizer.go:284\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd450dd8)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x0, {0x39705a0, 0xc003f8e7b0}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0x3b9aca00, 0x0, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0x0, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/apiextensions-apiserver/pkg/controller/finalizer.(*CRDFinalizer).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/finalizer/crd_finalizer.go:277 +0x245\nngoroutine 1122 [select]:\nnolang.org/x/net/http2.(*ClientConn).roundTrip(0xc0036a0000, 0xc003cdc300)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/transport.go:1155 +0xcba\nnolang.org/x/net/http2.(*Transport).RoundTripOpt(0xc0009eaf50, 0xc003cdc300, {0x60})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/transport.go:478 +0x1b7\nnolang.org/x/net/http2.(*Transport).RoundTrip(...)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/transport.go:439\nnolang.org/x/net/http2.noDialH2RoundTripper.RoundTrip({0xc0002fa140}, 0xc003cdc300)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/transport.go:2695 +0x1b\nnet/http.(*Transport).roundTrip(0xc0002fa140, 0xc003cdc300)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/transport.go:539 +0x390\nnet/http.(*Transport).RoundTrip(0x305d0e0, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/roundtrip.go:18 +0x19\nn8s.io/kubernetes/pkg/genericcontrolplane/clientutils.(*multiClusterClientConfigRoundTripper).RoundTrip(0xc004b37770, 0xc003cdc200)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/[email protected]/pkg/genericcontrolplane/clientutils/multiclusterconfig.go:166 +0x8b9\nn8s.io/client-go/transport.(*bearerAuthRoundTripper).RoundTrip(0xc004b377a0, 0xc003cdc100)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/transport/round_trippers.go:298 +0x242\nn8s.io/client-go/transport.(*userAgentRoundTripper).RoundTrip(0xc004b32fe0, 0xc003cdc000)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/transport/round_trippers.go:160 +0x1ad\nnet/http.send(0xc003cdc000, {0x39713e0, 0xc004b32fe0}, {0x3470fc0, 0x434a1dbd00000001, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/client.go:252 +0x5d8\nnet/http.(*Client).send(0xc004b377d0, 0xc003cdc000, {0x35137af, 0x19, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/client.go:176 +0x9b\nnet/http.(*Client).do(0xc004b377d0, 0xc003cdc000)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/client.go:725 +0x908\nnet/http.(*Client).Do(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/client.go:593\nn8s.io/client-go/rest.(*Request).request(0xc0027032c0, {0x39be948, 0xc00018a008}, 0x16001e0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/rest/request.go:1040 +0x479\nn8s.io/client-go/rest.(*Request).Do(0x0, {0x39be948, 0xc00018a008})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/rest/request.go:1107 +0xcc\nn8s.io/client-go/kubernetes/typed/rbac/v1.(*clusterRoles).Get(0xc000645940, {0x39be948, 0xc00018a008}, {0x35137af, 0x19}, {{{0x0, 0x0}, {0x0, 0x0}}, {0x0, ...}})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/kubernetes/typed/rbac/v1/clusterrole.go:78 +0x15a\nn8s.io/component-helpers/auth/rbac/reconciliation.ClusterRoleModifier.Get({{0x3a066b8, 0xc000645940}}, {0x203000, 0xc0006458e0}, {0x35137af, 0xc0019b3000})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/auth/rbac/reconciliation/clusterrole_interfaces.go:84 +0x5e\nn8s.io/component-helpers/auth/rbac/reconciliation.(*ReconcileRoleOptions).run(0xc004a69830, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/auth/rbac/reconciliation/reconcile_role.go:110 +0xa2\nn8s.io/component-helpers/auth/rbac/reconciliation.(*ReconcileRoleOptions).Run(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/auth/rbac/reconciliation/reconcile_role.go:98\nn8s.io/kubernetes/pkg/registry/rbac/rest.ensureRBACPolicy.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/[email protected]/pkg/registry/rbac/rest/storage_rbac.go:229 +0x3e\nn8s.io/client-go/util/retry.OnError.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/retry/util.go:51 +0x33\nn8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x100e894, 0xc004b15698})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:217 +0x1b\nn8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x39be948, 0xc00018a008}, 0xd4986e8)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:230 +0x7c\nn8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtection(0x32fb7e0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:223 +0x39\nn8s.io/apimachinery/pkg/util/wait.ExponentialBackoff({0x989680, 0x4014000000000000, 0x3fb999999999999a, 0x4, 0x0}, 0x100ebe7)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:418 +0x5f\nn8s.io/client-go/util/retry.OnError({0x989680, 0x4014000000000000, 0x3fb999999999999a, 0x4, 0x0}, 0x3648108, 0xc0010bb638)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/retry/util.go:50 +0xf1\nn8s.io/kubernetes/pkg/registry/rbac/rest.retryOnConflictOrServiceUnavailable(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/[email protected]/pkg/registry/rbac/rest/storage_rbac.go:170\nn8s.io/kubernetes/pkg/registry/rbac/rest.ensureRBACPolicy(0xc0019837c0, {0x3a3c4f0, 0xc004b3c6c0})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/[email protected]/pkg/registry/rbac/rest/storage_rbac.go:228 +0x145b\nn8s.io/kubernetes/pkg/registry/rbac/rest.(*PolicyData).EnsureRBACPolicy.func1.1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/[email protected]/pkg/registry/rbac/rest/storage_rbac.go:185 +0xd1\nn8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0xc002030180, 0xc00288d5a8})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:217 +0x1b\nn8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x39be948, 0xc00018a000}, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:230 +0x7c\nn8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x39be948, 0xc00018a000}, 0xc001f21218, 0x15a680a)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:657 +0x118\nn8s.io/apimachinery/pkg/util/wait.poll({0x39be948, 0xc00018a000}, 0xe8, 0x15a5305, 0x20)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:591 +0x9a\nn8s.io/apimachinery/pkg/util/wait.PollWithContext({0x39be948, 0xc00018a000}, 0xc0014fe000, 0xc00095f638, 0x100ebe7)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:455 +0x47\nn8s.io/apimachinery/pkg/util/wait.Poll(0xc0014fe328, 0xc0fffffffe, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:440 +0x50\nn8s.io/kubernetes/pkg/registry/rbac/rest.(*PolicyData).EnsureRBACPolicy.func1({0xc0005f6000, 0xc00022ac00})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/[email protected]/pkg/registry/rbac/rest/storage_rbac.go:177 +0xbc\nn8s.io/apiserver/pkg/server.runPostStartHook.func1({0xc001431fb0, {0xc001596a80, 0xc00095f720}, 0xc00072d800}, {0xc0005f6000, 0xc00022ac00}, 0xc004b15f70)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/hooks.go:198 +0x8e\nn8s.io/apiserver/pkg/server.runPostStartHook({0x350783a, 0x14}, {0xc001431fb0, {0xc001596a80, 0x39a1318}, 0xc00072d800}, {0xc0005f6000, 0xc00022ac00})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/hooks.go:199 +0x85\nnreated by k8s.io/apiserver/pkg/server.(*GenericAPIServer).RunPostStartHooks\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/hooks.go:165 +0xf6\nngoroutine 1123 [select]:\nn8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x39be910, 0xc0026f0040}, 0xc003228000, 0x15a680a)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:655 +0xe7\nn8s.io/apimachinery/pkg/util/wait.poll({0x39be910, 0xc0026f0040}, 0x50, 0xc0026f0040, 0xc0026f2060)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:591 +0x9a\nn8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext({0x39be910, 0xc0026f0040}, 0x0, 0x1)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:542 +0x49\nn8s.io/kubernetes/pkg/registry/flowcontrol/rest.ensureAPFBootstrapConfiguration({0xc0005f6000, 0xc00022ac00})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/[email protected]/pkg/registry/flowcontrol/rest/storage_flowcontrol.go:115 +0x106\nn8s.io/apiserver/pkg/server.runPostStartHook.func1({0x36480e0, {0xc001597500, 0xc00095a720}, 0xc0011974a0}, {0xc0005f6000, 0xc00022ac00}, 0xc004cc9f70)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/hooks.go:198 +0x8e\nn8s.io/apiserver/pkg/server.runPostStartHook({0x3535f73, 0x25}, {0x36480e0, {0xc001597500, 0x39a1318}, 0xc0011974a0}, {0xc0005f6000, 0xc00022ac00})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/hooks.go:199 +0x85\nnreated by k8s.io/apiserver/pkg/server.(*GenericAPIServer).RunPostStartHooks\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/hooks.go:165 +0xf6\nngoroutine 3181 [select]:\nn8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc000b58948, {0x39b0350, 0xc0011e9300}, 0xdf8475800)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/timeout.go:110 +0x33d\nn8s.io/apiserver/pkg/endpoints/filters.withRequestDeadline.func1({0x39b0350, 0xc0011e9300}, 0xc001f61600)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/request_deadline.go:101 +0x494\nnet/http.HandlerFunc.ServeHTTP(0xc0014aa24b, {0x39b0350, 0xc0011e9300}, 0xc000b21340)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1({0x39b0350, 0xc0011e9300}, 0xc001f61600)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/waitgroup.go:59 +0x174\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc0011e9300}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1({0x39b0350, 0xc0011e9300}, 0xc001f61500)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/warning.go:35 +0x2bb\nnet/http.HandlerFunc.ServeHTTP(0x3314a20, {0x39b0350, 0xc0011e9300}, 0xd)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1({0x39b0350, 0xc0011e9300}, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/cachecontrol.go:31 +0x126\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc0011e9300}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/httplog.WithLogging.func1({0x39a5880, 0xc0032b62f8}, 0xc001f61400)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/httplog/httplog.go:103 +0x524\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39a5880, 0xc0032b62f8}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1({0x39a5880, 0xc0032b62f8}, 0xc001f61300)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/requestinfo.go:39 +0x316\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39a5880, 0xc0032b62f8}, 0xc00299a840)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withRequestReceivedTimestampWithClock.func1({0x39a5880, 0xc0032b62f8}, 0xc001f61200)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/request_received_time.go:38 +0x27e\nnet/http.HandlerFunc.ServeHTTP(0x160, {0x39a5880, 0xc0032b62f8}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1({0x39a5880, 0xc0032b62f8}, 0xc00299a840)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/wrap.go:74 +0xba\nnet/http.HandlerFunc.ServeHTTP(0x3314a20, {0x39a5880, 0xc0032b62f8}, 0x8)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withAuditID.func1({0x39a5880, 0xc0032b62f8}, 0xc001f61100)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/with_auditid.go:66 +0x40d\nnet/http.HandlerFunc.ServeHTTP(0x39be910, {0x39a5880, 0xc0032b62f8}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nnithub.com/kcp-dev/kcp/pkg/server.ServeHTTP.func1({0x39a5880, 0xc0032b62f8}, 0xc001f61000)\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/pkg/server/handler.go:83 +0x6d6\nnet/http.HandlerFunc.ServeHTTP(0x10947d7, {0x39a5880, 0xc0032b62f8}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0x0, {0x39a5880, 0xc0032b62f8}, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/handler.go:196 +0x2b\nnet/http.serverHandler.ServeHTTP({0x203000}, {0x39a5880, 0xc0032b62f8}, 0xc001f61000)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2879 +0x43b\nnet/http.initALPNRequest.ServeHTTP({{0x39be9b8, 0xc0026fa3f0}, 0xc0014ff180, {0xc00077f180}}, {0x39a5880, 0xc0032b62f8}, 0xc001f61000)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3480 +0x245\nnolang.org/x/net/http2.(*serverConn).runHandler(0xc001f60b00, 0x2437fe0, 0xc003caf080, 0xc00205b7b8)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:2162 +0x78\nnreated by golang.org/x/net/http2.(*serverConn).processHeaders\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:1892 +0x510\nngoroutine 120 [chan receive]:\nn8s.io/client-go/tools/cache.(*processorListener).run.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:772 +0x49\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd7cf560)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc00095c738, {0x39705a0, 0xc00304adb0}, 0x1, 0xc000afeae0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001197140, 0x3b9aca00, 0x0, 0xb8, 0xc00095c788)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90\nn8s.io/client-go/tools/cache.(*processorListener).run(0xc001964380)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:771 +0x6b\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 1287 [select]:\nnontext.propagateCancel.func1()\nn/usr/local/Cellar/go/1.17.6/libexec/src/context/context.go:279 +0xa5\nnreated by context.propagateCancel\nn/usr/local/Cellar/go/1.17.6/libexec/src/context/context.go:278 +0x1d0\nngoroutine 1085 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc003942028, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x4be7bd0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc003942000, 0xc0039301f0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/delta_fifo.go:525 +0x1f6\nn8s.io/client-go/tools/cache.(*controller).processLoop(0xc0027e6000)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/controller.go:183 +0x36\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd7dccb0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x15a4be8, {0x39705a0, 0xc003934240}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0027e6068, 0x3b9aca00, 0x0, 0x0, 0xd39b888)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90\nn8s.io/client-go/tools/cache.(*controller).Run(0xc0027e6000, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/controller.go:154 +0x2fb\nn8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc00382dc20, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:410 +0x449\nnreated by k8s.io/kubernetes/pkg/controlplane/controller/clusterauthenticationtrust.(*Controller).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/[email protected]/pkg/controlplane/controller/clusterauthenticationtrust/cluster_authentication_trust_controller.go:444 +0x225\nngoroutine 1172 [chan receive]:\nn8s.io/client-go/tools/cache.(*processorListener).run.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:772 +0x49\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd7dccb0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc00205cf38, {0x39705a0, 0xc0039341e0}, 0x1, 0xc000982e40)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0x3b9aca00, 0x0, 0x0, 0xc00205cf88)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90\nn8s.io/client-go/tools/cache.(*processorListener).run(0xc00336a080)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:771 +0x6b\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 1133 [chan receive]:\nn8s.io/apiserver/pkg/server.preparedGenericAPIServer.Run.func2()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/genericapiserver.go:360 +0x45\nnreated by k8s.io/apiserver/pkg/server.preparedGenericAPIServer.Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/genericapiserver.go:359 +0x205\nngoroutine 1134 [chan receive]:\nn8s.io/apiserver/pkg/server.preparedGenericAPIServer.Run.func3()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/genericapiserver.go:371 +0x205\nnreated by k8s.io/apiserver/pkg/server.preparedGenericAPIServer.Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/genericapiserver.go:366 +0x2c8\nngoroutine 1135 [chan receive]:\nn8s.io/apiextensions-apiserver/pkg/controller/openapi.(*Controller).Run(0xc001978d20, 0xc0011fa000, {0x39bf7f0, 0xc0025ecc30}, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/openapi/controller.go:166 +0x68e\nnreated by k8s.io/apiextensions-apiserver/pkg/apiserver.completedConfig.New.func2\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/apiserver/apiserver.go:278 +0x13d\nngoroutine 1136 [chan receive]:\nn8s.io/apiextensions-apiserver/pkg/controller/status.(*NamingConditionController).Run(0xc00043d950, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/status/naming_controller.go:306 +0x2a6\nnreated by k8s.io/apiextensions-apiserver/pkg/apiserver.completedConfig.New.func2\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/apiserver/apiserver.go:281 +0x196\nngoroutine 1137 [chan receive]:\nn8s.io/apiextensions-apiserver/pkg/controller/establish.(*EstablishingController).Run(0xc000950d40, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/establish/establishing_controller.go:87 +0x2a6\nnreated by k8s.io/apiextensions-apiserver/pkg/apiserver.completedConfig.New.func2\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/apiserver/apiserver.go:282 +0x1f2\nngoroutine 1138 [chan receive]:\nn8s.io/apiextensions-apiserver/pkg/controller/nonstructuralschema.(*ConditionController).Run(0xc00043da90, 0x5, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/nonstructuralschema/nonstructuralschema_controller.go:203 +0x314\nnreated by k8s.io/apiextensions-apiserver/pkg/apiserver.completedConfig.New.func2\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/apiserver/apiserver.go:283 +0x253\nngoroutine 1139 [chan receive]:\nn8s.io/apiextensions-apiserver/pkg/controller/apiapproval.(*KubernetesAPIApprovalPolicyConformantConditionController).Run(0xc00043db80, 0x5, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/apiapproval/apiapproval_controller.go:197 +0x314\nnreated by k8s.io/apiextensions-apiserver/pkg/apiserver.completedConfig.New.func2\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/apiserver/apiserver.go:284 +0x2b4\nngoroutine 1140 [chan receive]:\nn8s.io/apiextensions-apiserver/pkg/controller/finalizer.(*CRDFinalizer).Run(0xc00043dd10, 0x5, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/finalizer/crd_finalizer.go:280 +0x32a\nnreated by k8s.io/apiextensions-apiserver/pkg/apiserver.completedConfig.New.func2\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/apiserver/apiserver.go:285 +0x31d\nngoroutine 3274 [select]:\nn8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc000b58948, {0x39b0350, 0xc0036d7600}, 0xdf8475800)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/timeout.go:110 +0x33d\nn8s.io/apiserver/pkg/endpoints/filters.withRequestDeadline.func1({0x39b0350, 0xc0036d7600}, 0xc003cdcb00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/request_deadline.go:101 +0x494\nnet/http.HandlerFunc.ServeHTTP(0xc0048b11bb, {0x39b0350, 0xc0036d7600}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1({0x39b0350, 0xc0036d7600}, 0xc003cdcb00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/waitgroup.go:59 +0x174\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc0036d7600}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1({0x39b0350, 0xc0036d7600}, 0xc003cdca00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/warning.go:35 +0x2bb\nnet/http.HandlerFunc.ServeHTTP(0x3314a20, {0x39b0350, 0xc0036d7600}, 0xd)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1({0x39b0350, 0xc0036d7600}, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/cachecontrol.go:31 +0x126\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc0036d7600}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/httplog.WithLogging.func1({0x39a5880, 0xc003824518}, 0xc003cdc900)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/httplog/httplog.go:103 +0x524\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39a5880, 0xc003824518}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1({0x39a5880, 0xc003824518}, 0xc003cdc800)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/requestinfo.go:39 +0x316\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39a5880, 0xc003824518}, 0xc003bf29a0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withRequestReceivedTimestampWithClock.func1({0x39a5880, 0xc003824518}, 0xc003cdc700)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/request_received_time.go:38 +0x27e\nnet/http.HandlerFunc.ServeHTTP(0x160, {0x39a5880, 0xc003824518}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1({0x39a5880, 0xc003824518}, 0xc003bf29a0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/wrap.go:74 +0xba\nnet/http.HandlerFunc.ServeHTTP(0x3314a20, {0x39a5880, 0xc003824518}, 0x8)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withAuditID.func1({0x39a5880, 0xc003824518}, 0xc003cdc600)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/with_auditid.go:66 +0x40d\nnet/http.HandlerFunc.ServeHTTP(0x39be910, {0x39a5880, 0xc003824518}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nnithub.com/kcp-dev/kcp/pkg/server.ServeHTTP.func1({0x39a5880, 0xc003824518}, 0xc003cdc500)\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/pkg/server/handler.go:83 +0x6d6\nnet/http.HandlerFunc.ServeHTTP(0xc000d3cca0, {0x39a5880, 0xc003824518}, 0xc00039ed80)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0x0, {0x39a5880, 0xc003824518}, 0x39be948)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/handler.go:196 +0x2b\nnet/http.serverHandler.ServeHTTP({0x0}, {0x39a5880, 0xc003824518}, 0xc003cdc500)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2879 +0x43b\nnet/http.initALPNRequest.ServeHTTP({{0x39be9b8, 0xc0026fa3f0}, 0xc0014ff180, {0xc00077f180}}, {0x39a5880, 0xc003824518}, 0xc003cdc500)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3480 +0x245\nnolang.org/x/net/http2.(*serverConn).runHandler(0x399fab8, 0x5102138, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:2162 +0x78\nnreated by golang.org/x/net/http2.(*serverConn).processHeaders\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:1892 +0x510\nngoroutine 1156 [select]:\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0019185a0, {0x39705a0, 0xc0039340f0}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:167 +0x13b\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0000f95e0, 0x3b9aca00, 0x0, 0xd0, 0x1040a25)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0xc0019185a0, 0x0, 0xc0019185a0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/apiserver/pkg/server/filters.startWatermarkMaintenance\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/maxinflight.go:101 +0xcf\nngoroutine 1052 [chan receive]:\nn8s.io/client-go/tools/cache.(*controller).Run.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/controller.go:130 +0x28\nnreated by k8s.io/client-go/tools/cache.(*controller).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/controller.go:129 +0x105\nngoroutine 1157 [select]:\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x3a0af00, {0x39705a0, 0xc0037a8090}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:167 +0x13b\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0x2540be400, 0x0, 0x28, 0xc00054f740)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0xc0033bcf00, 0x20fa106, 0xc000afe0c0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/apiserver/pkg/server/filters.startWatermarkMaintenance\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/maxinflight.go:115 +0x17f\nngoroutine 1053 [select]:\nn8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc0030b6000, {0x0, 0x0, 0x50cee00}, {0x399add8, 0xc002065600}, 0xc0042c1ba0, 0xc001bdbce0, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:468 +0x1b6\nn8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc0030b6000, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:428 +0x6b6\nn8s.io/client-go/tools/cache.(*Reflector).Run.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:221 +0x26\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd365e90)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0009ce0a0, {0x3970580, 0xc001600000}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/client-go/tools/cache.(*Reflector).Run(0xc0030b6000, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:220 +0x237\nn8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:56 +0x22\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 1429 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc000951dd0, 0x10)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x399f400)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/util/workqueue.(*Type).Get(0xc0019786c0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:151 +0x9e\nn8s.io/apiextensions-apiserver/pkg/controller/apiapproval.(*KubernetesAPIApprovalPolicyConformantConditionController).processNextWorkItem(0xc00043db80)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/apiapproval/apiapproval_controller.go:207 +0x58\nn8s.io/apiextensions-apiserver/pkg/controller/apiapproval.(*KubernetesAPIApprovalPolicyConformantConditionController).runWorker(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/apiapproval/apiapproval_controller.go:201\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd364730)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001472050, {0x39705a0, 0xc003c95290}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000982d20, 0x3b9aca00, 0x0, 0x0, 0x1040a25)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0x0, 0xc00095d768, 0xc00095d778)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/apiextensions-apiserver/pkg/controller/apiapproval.(*KubernetesAPIApprovalPolicyConformantConditionController).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/apiapproval/apiapproval_controller.go:194 +0x22e\nngoroutine 1284 [select]:\nn8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:373 +0x139\nnreated by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:367 +0x3a5\nngoroutine 1094 [select]:\nn8s.io/kubernetes/pkg/registry/flowcontrol/rest.contextFromChannelAndMaxWaitDuration.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/[email protected]/pkg/registry/flowcontrol/rest/storage_flowcontrol.go:234 +0xdf\nnreated by k8s.io/kubernetes/pkg/registry/flowcontrol/rest.contextFromChannelAndMaxWaitDuration\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/[email protected]/pkg/registry/flowcontrol/rest/storage_flowcontrol.go:231 +0xd4\nngoroutine 121 [select]:\nn8s.io/client-go/tools/cache.(*processorListener).pop(0xc001964380)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:742 +0x156\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 122 [chan receive]:\nn8s.io/client-go/tools/cache.(*processorListener).run.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:772 +0x49\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd4983b8)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001576738, {0x39705a0, 0xc001f48060}, 0x1, 0xc001028540)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x39a1318, 0x3b9aca00, 0x0, 0x0, 0xc0007fe660)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90\nn8s.io/client-go/tools/cache.(*processorListener).run(0xc001964700)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:771 +0x6b\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 3182 [runnable]:\nnithub.com/prometheus/client_golang/prometheus.(*HistogramVec).GetMetricWithLabelValues(...)\nn/Users/angoldst/go/pkg/mod/github.com/prometheus/[email protected]/prometheus/histogram.go:463\nnithub.com/prometheus/client_golang/prometheus.(*HistogramVec).WithLabelValues(0x3f747ae147ae147b, {0xc000316180, 0x16f3f77, 0xc00018c240})\nn/Users/angoldst/go/pkg/mod/github.com/prometheus/[email protected]/prometheus/histogram.go:493 +0x4e\nn8s.io/component-base/metrics.(*HistogramVec).WithLabelValues(0xc0005e8f00, {0xc000316180, 0x2, 0x2})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/metrics/histogram.go:158 +0x8f\nn8s.io/apiserver/pkg/util/flowcontrol/metrics.(*sampleAndWaterMarkHistograms).innerSet(0xc0002dedc0, 0x3974320)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/flowcontrol/metrics/sample_and_watermark.go:203 +0x2a5\nn8s.io/apiserver/pkg/util/flowcontrol/metrics.(*sampleAndWaterMarkHistograms).Set(0xc0005ec558, 0xc003b18e18)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/flowcontrol/metrics/sample_and_watermark.go:151 +0x50\nn8s.io/apiserver/pkg/server/filters.(*requestWatermark).recordMutating(0x508eae0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/maxinflight.go:70 +0x4c\nn8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1.1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/maxinflight.go:182 +0x55\nn8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1({0xd7896d8, 0xc0032b6300}, 0xc001f61b00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/maxinflight.go:210 +0x378\nnet/http.HandlerFunc.ServeHTTP(0x0, {0xd7896d8, 0xc0032b6300}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0xd7896d8, 0xc0032b6300}, 0xc001f61b00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0xc0017938c0, {0xd7896d8, 0xc0032b6300}, 0x10953f0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1({0xd7896d8, 0xc0032b6300}, 0xc001f61b00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/impersonation.go:50 +0x21c\nnet/http.HandlerFunc.ServeHTTP(0x5102138, {0xd7896d8, 0xc0032b6300}, 0x1)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0xd7896d8, 0xc0032b6300}, 0xc001f61b00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:79 +0x178\nnet/http.HandlerFunc.ServeHTTP(0x0, {0xd7896d8, 0xc0032b6300}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0xd7896d8, 0xc0032b6300}, 0xc001f61b00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0x5102138, {0xd7896d8, 0xc0032b6300}, 0x1)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0xd7896d8, 0xc0032b6300}, 0xc001f61b00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:79 +0x178\nnet/http.HandlerFunc.ServeHTTP(0x0, {0xd7896d8, 0xc0032b6300}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0xd7896d8, 0xc0032b6300}, 0xc001f61b00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0xd7896d8, 0xc0032b6300}, 0x3640888)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withAuthentication.func1({0xd7896d8, 0xc0032b6300}, 0xc001f61b00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/authentication.go:80 +0x83c\nnet/http.HandlerFunc.ServeHTTP(0x39be980, {0xd7896d8, 0xc0032b6300}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0xd7896d8, 0xc0032b6300}, 0xc001f61800)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:88 +0x46b\nnet/http.HandlerFunc.ServeHTTP(0xc0032b62f8, {0xd7896d8, 0xc0032b6300}, 0xc00205b778)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/timeout.go:108 +0x99\nnreated by k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/timeout.go:94 +0x2d1\nngoroutine 1145 [select]:\nn8s.io/apimachinery/pkg/util/wait.poller.func1.1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:705 +0x1c9\nnreated by k8s.io/apimachinery/pkg/util/wait.poller.func1\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:688 +0xcf\nngoroutine 123 [select]:\nn8s.io/client-go/tools/cache.(*processorListener).pop(0xc001964700)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:742 +0x156\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 124 [chan receive]:\nn8s.io/client-go/tools/cache.(*processorListener).run.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:772 +0x49\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd7cf560)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001f4e738, {0x39705a0, 0xc00304ade0}, 0x1, 0xc000afeb40)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0x3b9aca00, 0x0, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90\nn8s.io/client-go/tools/cache.(*processorListener).run(0xc001964800)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:771 +0x6b\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 125 [select]:\nn8s.io/client-go/tools/cache.(*processorListener).pop(0xc001964800)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:742 +0x156\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 126 [chan receive]:\nn8s.io/client-go/tools/cache.(*processorListener).run.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:772 +0x49\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd4983b8)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001f4f738, {0x39705a0, 0xc001f48090}, 0x1, 0xc0010285a0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0x3b9aca00, 0x0, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90\nn8s.io/client-go/tools/cache.(*processorListener).run(0xc001964900)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:771 +0x6b\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 127 [select]:\nn8s.io/client-go/tools/cache.(*processorListener).pop(0xc001964900)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:742 +0x156\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 128 [chan receive]:\nn8s.io/client-go/tools/cache.(*processorListener).run.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:772 +0x49\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd4983b8)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001f50738, {0x39705a0, 0xc001f480c0}, 0x1, 0xc0010288a0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0x3b9aca00, 0x0, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90\nn8s.io/client-go/tools/cache.(*processorListener).run(0xc001964a00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:771 +0x6b\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 129 [select]:\nn8s.io/client-go/tools/cache.(*processorListener).pop(0xc001964a00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:742 +0x156\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 1170 [chan receive]:\nn8s.io/client-go/tools/cache.(*processorListener).run.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:772 +0x49\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd4983b8)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001f51738, {0x39705a0, 0xc001f480f0}, 0x1, 0xc001028900)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0x3b9aca00, 0x0, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90\nn8s.io/client-go/tools/cache.(*processorListener).run(0xc001964b80)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:771 +0x6b\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 1171 [select]:\nn8s.io/client-go/tools/cache.(*processorListener).pop(0xc001964b80)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:742 +0x156\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 1186 [select]:\nnolang.org/x/net/http2.(*serverConn).serve(0xc0037f6c00)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:853 +0x8ed\nnolang.org/x/net/http2.(*Server).ServeConn(0xc002fd2700, {0x3a03390, 0xc001beb500}, 0xc0008e7b48)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:466 +0xa71\nnolang.org/x/net/http2.ConfigureServer.func1(0xc00077f180, 0x3a03390, {0x39745e0, 0xc00401b9c0})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:292 +0xe6\nnet/http.(*conn).serve(0xc0020540a0, {0x39be9b8, 0xc002050060})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 1082 [chan receive]:\nn8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc000859e00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:204 +0xa7\nnreated by k8s.io/client-go/util/workqueue.newQueue\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:62 +0x1af\nngoroutine 1083 [select]:\nn8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc000859f80)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/delaying_queue.go:231 +0x34e\nnreated by k8s.io/client-go/util/workqueue.newDelayingQueue\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/delaying_queue.go:68 +0x23b\nngoroutine 708 [select]:\nn8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc00087ccc0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/delaying_queue.go:231 +0x34e\nnreated by k8s.io/client-go/util/workqueue.newDelayingQueue\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/delaying_queue.go:68 +0x23b\nngoroutine 1084 [select]:\nn8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x39be910, 0xc003fa05c0}, 0xc00381e870, 0x15a680a)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:655 +0xe7\nn8s.io/apimachinery/pkg/util/wait.poll({0x39be910, 0xc003fa05c0}, 0x30, 0x15a5305, 0xc00390b3a0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:591 +0x9a\nn8s.io/apimachinery/pkg/util/wait.PollImmediateUntilWithContext({0x39be910, 0xc003fa05c0}, 0x10, 0xc000800000)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:542 +0x49\nn8s.io/apimachinery/pkg/util/wait.PollImmediateUntil(0x353a2ec, 0xc003849e00, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:533 +0x7c\nn8s.io/kubernetes/pkg/controlplane/controller/clusterauthenticationtrust.(*Controller).Run(0xc0007245b0, 0x0, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/[email protected]/pkg/controlplane/controller/clusterauthenticationtrust/cluster_authentication_trust_controller.go:456 +0x377\nnreated by k8s.io/kubernetes/pkg/genericcontrolplane/apis.completedConfig.New.func1\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/[email protected]/pkg/genericcontrolplane/apis/apis.go:265 +0x352\nngoroutine 709 [chan receive]:\nn8s.io/kubernetes/pkg/controller/namespace.(*NamespaceController).Run(0xc003158c00, 0x2, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/[email protected]/pkg/controller/namespace/namespace_controller.go:211 +0x3fb\nnreated by github.com/kcp-dev/kcp/pkg/server.(*Server).startNamespaceController\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/pkg/server/server.go:752 +0x1e5\nngoroutine 710 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc003167e28, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x4be7bd0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc003167e00, 0xc00315d350)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/delta_fifo.go:525 +0x1f6\nn8s.io/client-go/tools/cache.(*controller).processLoop(0xc0027a9c20)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/controller.go:183 +0x36\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd486d90)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x15a4be8, {0x39705a0, 0xc0033881b0}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0027a9c88, 0x3b9aca00, 0x0, 0x60, 0xd39b888)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90\nn8s.io/client-go/tools/cache.(*controller).Run(0xc0027a9c20, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/controller.go:154 +0x2fb\nn8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc003167cc0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:410 +0x449\nnreated by k8s.io/client-go/informers.(*sharedInformerFactory).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/informers/factory.go:134 +0x1cf\nngoroutine 712 [chan receive]:\nn8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc000a160e0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:628 +0x45\nn8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:56 +0x22\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 713 [chan receive]:\nn8s.io/client-go/tools/cache.(*controller).Run.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/controller.go:130 +0x28\nnreated by k8s.io/client-go/tools/cache.(*controller).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/controller.go:129 +0x105\nngoroutine 1173 [select]:\nn8s.io/client-go/tools/cache.(*processorListener).pop(0xc00336a080)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:742 +0x156\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 714 [select]:\nn8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc00347c000, {0x0, 0x0, 0x50cee00}, {0x399add8, 0xc0026f0cc0}, 0xc000b23ba0, 0xc0034d5b60, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:468 +0x1b6\nn8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc00347c000, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:428 +0x6b6\nn8s.io/client-go/tools/cache.(*Reflector).Run.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:221 +0x26\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd486d90)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001daa2d0, {0x3970580, 0xc0011de0f0}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/client-go/tools/cache.(*Reflector).Run(0xc00347c000, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:220 +0x237\nn8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:56 +0x22\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 1330 [select]:\nn8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:373 +0x139\nnreated by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:367 +0x3a5\nngoroutine 1088 [chan receive]:\nn8s.io/client-go/tools/cache.(*processorListener).run.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:772 +0x49\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd742c20)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc00205cf38, {0x39705a0, 0xc003f0c3f0}, 0x1, 0xc00064a480)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0x3b9aca00, 0x0, 0x0, 0xc00205cf88)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90\nn8s.io/client-go/tools/cache.(*processorListener).run(0xc0036d6080)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:771 +0x6b\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 1175 [chan receive]:\nn8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc000a0e150, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:628 +0x45\nn8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:56 +0x22\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 1176 [chan receive]:\nn8s.io/client-go/tools/cache.(*controller).Run.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/controller.go:130 +0x28\nnreated by k8s.io/client-go/tools/cache.(*controller).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/controller.go:129 +0x105\nngoroutine 1089 [select]:\nn8s.io/client-go/tools/cache.(*processorListener).pop(0xc0036d6080)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/shared_informer.go:742 +0x156\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 1177 [select]:\nn8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc003946000, {0x0, 0x0, 0x50cee00}, {0x399add8, 0xc00381bd00}, 0xc000fb7ba0, 0xc00325e3c0, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:468 +0x1b6\nn8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc003946000, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:428 +0x6b6\nn8s.io/client-go/tools/cache.(*Reflector).Run.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:221 +0x26\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd7dccb0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001546050, {0x3970580, 0xc0014720f0}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/client-go/tools/cache.(*Reflector).Run(0xc003946000, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:220 +0x237\nn8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:56 +0x22\nn8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:73 +0x5a\nnreated by k8s.io/apimachinery/pkg/util/wait.(*Group).Start\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:71 +0x88\nngoroutine 1095 [select]:\nn8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:373 +0x139\nnreated by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/tools/cache/reflector.go:367 +0x3a5\nngoroutine 1057 [select]:\nnolang.org/x/net/http2.(*serverConn).serve(0xc001f70000)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:853 +0x8ed\nnolang.org/x/net/http2.(*Server).ServeConn(0xc002fd2700, {0x3a03390, 0xc0014ff180}, 0xc001f0fb48)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:466 +0xa71\nnolang.org/x/net/http2.ConfigureServer.func1(0xc00077f180, 0x3a03390, {0x39745e0, 0xc001f42140})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:292 +0xe6\nnet/http.(*conn).serve(0xc000fcc140, {0x39be9b8, 0xc002050060})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 1391 [select]:\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x5102138, {0x39705a0, 0xc00106f2f0}, 0x1, 0xc00018c300)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:167 +0x13b\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xd7896d8, 0xdf8475800, 0x0, 0xd0, 0xc000b58948)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90\nn8s.io/apimachinery/pkg/util/wait.Forever(0xc003c32ae0, 0xc00347b7b8)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:81 +0x28\nnreated by k8s.io/apiserver/pkg/server/healthz.(*log).Check.func1\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/healthz/healthz.go:72 +0xf7\nngoroutine 3323 [select]:\nnoogle.golang.org/grpc/internal/transport.(*serverHandlerTransport).runStream(0xc00509d8c0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:426 +0x85\nnoogle.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams(0xc00509d8c0, 0xc003935fb0, 0x3a055d8)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:416 +0x7dc\nnoogle.golang.org/grpc.(*Server).serveStreams(0xc000826c40, {0x3a055d8, 0xc00509d8c0})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:918 +0x142\nnoogle.golang.org/grpc.(*Server).ServeHTTP(0xc000826c40, {0x39b1d90, 0xc003824600}, 0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:987 +0x10b\nno.etcd.io/etcd/server/v3/embed.grpcHandlerFunc.func2({0x39b1d90, 0xc003824600}, 0xc0031d8900)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/serve.go:208 +0xc5\nnet/http.HandlerFunc.ServeHTTP(0x3149340, {0x39b1d90, 0xc003824600}, 0xc003935f50)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nnet/http.(*ServeMux).ServeHTTP(0x39b1d90, {0x39b1d90, 0xc003824600}, 0xc0031d8900)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2425 +0x149\nno.etcd.io/etcd/server/v3/embed.(*accessController).ServeHTTP(0xc0006a6870, {0x39b1d90, 0xc003824600}, 0xc0031d8900)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/serve.go:355 +0x50f\nnet/http.serverHandler.ServeHTTP({0x203000}, {0x39b1d90, 0xc003824600}, 0xc0031d8900)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2879 +0x43b\nnet/http.initALPNRequest.ServeHTTP({{0x39be9b8, 0xc00426c480}, 0xc004176000, {0xc0003d0700}}, {0x39b1d90, 0xc003824600}, 0xc0031d8900)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3480 +0x245\nnet/http.(*http2serverConn).runHandler(0xc0031d8500, 0x2437fe0, 0xc0038d0a20, 0xc000d3d7b8)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:5849 +0x78\nnreated by net/http.(*http2serverConn).processHeaders\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:5579 +0x510\nngoroutine 1332 [select]:\nn8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc0034bf800, {0x39b0290, 0xc0030c21b8}, 0xc0011fbc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/handlers/watch.go:213 +0xf25\nn8s.io/apiserver/pkg/endpoints/handlers.serveWatch({0x399b828, 0xc0030b6380}, 0xc0019d71e0, {0x0, {0x0, 0x0}, 0x0, {0x0, 0x0}, 0x0, ...}, ...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/handlers/watch.go:138 +0xf78\nn8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/handlers/get.go:270 +0x65\nn8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc0011fbc00, 0x305a5e0, {0x34ef961, 0x9}, 0xc004004d58)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/metrics/metrics.go:427 +0x722\nn8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1({0x39b0290, 0xc0030c21b8}, 0xc0011fbc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/handlers/get.go:269 +0xedb\nn8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc00376b350, 0xc000a01f80)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/installer.go:1174 +0x6b\nn8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc00376b350, 0xc000a01f80)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/metrics/metrics.go:484 +0x2e2\nnithub.com/emicklei/go-restful.(*Container).dispatch.func5(0xa, 0xc000fd33a0)\nn/Users/angoldst/go/pkg/mod/github.com/emicklei/[email protected]+incompatible/container.go:283 +0x2c\nnithub.com/emicklei/go-restful.(*FilterChain).ProcessFilter(0xc0019d57c0, 0x39be9b8, 0xc00376b260)\nn/Users/angoldst/go/pkg/mod/github.com/emicklei/[email protected]+incompatible/filter.go:21 +0x58\nnithub.com/kcp-dev/kcp/pkg/server.(*Server).Run.func5(0xc00376b350, 0xc000a01f80, 0x1)\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/pkg/server/server.go:462 +0xa94\nnithub.com/emicklei/go-restful.(*FilterChain).ProcessFilter(0x3167d20, 0xc0030c21b0, 0xc0034bf780)\nn/Users/angoldst/go/pkg/mod/github.com/emicklei/[email protected]+incompatible/filter.go:19 +0x47\nnithub.com/emicklei/go-restful.(*Container).dispatch(0xc0012638c0, {0x39b0350, 0xc0034bf780}, 0xc0011fbc00)\nn/Users/angoldst/go/pkg/mod/github.com/emicklei/[email protected]+incompatible/container.go:285 +0x9c6\nnithub.com/emicklei/go-restful.(*Container).Dispatch(...)\nn/Users/angoldst/go/pkg/mod/github.com/emicklei/[email protected]+incompatible/container.go:199\nn8s.io/apiserver/pkg/server.director.ServeHTTP({{0x350291b, 0x0}, 0xc0012638c0, 0xc000a17ab0}, {0x39b0350, 0xc0034bf780}, 0xc0011fbc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/handler.go:153 +0x646\nn8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc002fd23c0, {0x39b0350, 0xc0034bf780}, 0xc0011fbc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/mux/pathrecorder.go:255 +0x3fc\nn8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc001b95810, {0x39b0350, 0xc0034bf780}, 0xc001bc4750)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/mux/pathrecorder.go:235 +0x70\nn8s.io/apiserver/pkg/server.director.ServeHTTP({{0x34fbdfc, 0xc003f85b50}, 0xc000a43290, 0xc0000f93b0}, {0x39b0350, 0xc0034bf780}, 0xc0011fbc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/handler.go:161 +0x82a\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0x39b0350, 0xc0034bf780}, 0xc0011fbc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0xc000b58828, {0x39b0350, 0xc0034bf780}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1({0x39b0350, 0xc0034bf780}, 0xc0011fbc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/authorization.go:64 +0x47d\nnet/http.HandlerFunc.ServeHTTP(0x5102138, {0x39b0350, 0xc0034bf780}, 0x305a5e0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0x39b0350, 0xc0034bf780}, 0xc0011fbc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:79 +0x178\nnet/http.HandlerFunc.ServeHTTP(0xc002998bd0, {0x39b0350, 0xc0034bf780}, 0x1)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1({0x39b0350, 0xc0034bf780}, 0xc0011fbc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/maxinflight.go:152 +0x304\nnet/http.HandlerFunc.ServeHTTP(0x0, {0x39b0350, 0xc0034bf780}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0x39b0350, 0xc0034bf780}, 0xc0011fbc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0x0, {0x39b0350, 0xc0034bf780}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1({0x39b0350, 0xc0034bf780}, 0xc0011fbc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/impersonation.go:50 +0x21c\nnet/http.HandlerFunc.ServeHTTP(0x5102138, {0x39b0350, 0xc0034bf780}, 0x1)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0x39b0350, 0xc0034bf780}, 0xc0011fbc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:79 +0x178\nnet/http.HandlerFunc.ServeHTTP(0x0, {0x39b0350, 0xc0034bf780}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0x39b0350, 0xc0034bf780}, 0xc0011fbc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0x5102138, {0x39b0350, 0xc0034bf780}, 0x1)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0x39b0350, 0xc0034bf780}, 0xc0011fbc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:79 +0x178\nnet/http.HandlerFunc.ServeHTTP(0x0, {0x39b0350, 0xc0034bf780}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0x39b0350, 0xc0034bf780}, 0xc0011fbc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc0034bf780}, 0x3640888)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withAuthentication.func1({0x39b0350, 0xc0034bf780}, 0xc0011fbc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/authentication.go:80 +0x83c\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc0034bf780}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0x39b0350, 0xc0034bf780}, 0xc0011fba00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:88 +0x46b\nnet/http.HandlerFunc.ServeHTTP(0xc0011fba00, {0x39b0350, 0xc0034bf780}, 0xc001a36420)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc000b58948, {0x39b0350, 0xc0034bf780}, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/timeout.go:85 +0x43d\nn8s.io/apiserver/pkg/endpoints/filters.withRequestDeadline.func1({0x39b0350, 0xc0034bf780}, 0xc0011fba00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/request_deadline.go:66 +0x6fd\nnet/http.HandlerFunc.ServeHTTP(0x10c5ad3, {0x39b0350, 0xc0034bf780}, 0x18)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1({0x39b0350, 0xc0034bf780}, 0xc0011fba00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/waitgroup.go:59 +0x174\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc0034bf780}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1({0x39b0350, 0xc0034bf780}, 0xc0011fb900)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/warning.go:35 +0x2bb\nnet/http.HandlerFunc.ServeHTTP(0x3314a20, {0x39b0350, 0xc0034bf780}, 0xd)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1({0x39b0350, 0xc0034bf780}, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/cachecontrol.go:31 +0x126\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc0034bf780}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/httplog.WithLogging.func1({0x39a5880, 0xc0031b0440}, 0xc0011fb800)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/httplog/httplog.go:103 +0x524\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39a5880, 0xc0031b0440}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1({0x39a5880, 0xc0031b0440}, 0xc0011fb700)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/requestinfo.go:39 +0x316\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39a5880, 0xc0031b0440}, 0xc0031c4f20)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withRequestReceivedTimestampWithClock.func1({0x39a5880, 0xc0031b0440}, 0xc0011fb600)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/request_received_time.go:38 +0x27e\nnet/http.HandlerFunc.ServeHTTP(0x160, {0x39a5880, 0xc0031b0440}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1({0x39a5880, 0xc0031b0440}, 0xc0031c4f20)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/wrap.go:74 +0xba\nnet/http.HandlerFunc.ServeHTTP(0x3314a20, {0x39a5880, 0xc0031b0440}, 0x8)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withAuditID.func1({0x39a5880, 0xc0031b0440}, 0xc0011fb500)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/with_auditid.go:66 +0x40d\nnet/http.HandlerFunc.ServeHTTP(0x39be910, {0x39a5880, 0xc0031b0440}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nnithub.com/kcp-dev/kcp/pkg/server.ServeHTTP.func1({0x39a5880, 0xc0031b0440}, 0xc003b84900)\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/pkg/server/handler.go:83 +0x6d6\nnet/http.HandlerFunc.ServeHTTP(0xc001577ca0, {0x39a5880, 0xc0031b0440}, 0xc000780480)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc001b95823, {0x39a5880, 0xc0031b0440}, 0x39be948)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/handler.go:196 +0x2b\nnet/http.serverHandler.ServeHTTP({0x0}, {0x39a5880, 0xc0031b0440}, 0xc003b84900)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2879 +0x43b\nnet/http.initALPNRequest.ServeHTTP({{0x39be9b8, 0xc0026fa3f0}, 0xc0014ff180, {0xc00077f180}}, {0x39a5880, 0xc0031b0440}, 0xc003b84900)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3480 +0x245\nnolang.org/x/net/http2.(*serverConn).runHandler(0x39a1318, 0x5102138, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:2162 +0x78\nnreated by golang.org/x/net/http2.(*serverConn).processHeaders\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:1892 +0x510\nngoroutine 1288 [select]:\nno.etcd.io/etcd/client/v3.(*watchGrpcStream).run(0xc0002e3a00)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/watch.go:537 +0x374\nnreated by go.etcd.io/etcd/client/v3.(*watcher).newWatcherGrpcStream\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/watch.go:285 +0x352\nngoroutine 1456 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd4b9f10, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc004205300, 0xc00477a000, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc004205300, {0xc00477a000, 0x3a44, 0x3a44})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc004205300, {0xc00477a000, 0xc00477a005, 0x94})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0038244e0, {0xc00477a000, 0x125b839, 0xc00105f7f0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc0049ee138, {0xc00477a000, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc00291c978, {0x396c0e0, 0xc0049ee138})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc00291c700, {0xd104358, 0xc0038244e0}, 0x3a44)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc00291c700, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc00291c700, {0xc004235000, 0x1000, 0xc0037f5c80})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc00422ccc0, {0xc00422e1f8, 0x9, 0xc004a9faa0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc00422ccc0}, {0xc00422e1f8, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc00422e1f8, 0x9, 0xc00039ed80}, {0x396bee0, 0xc00422ccc0})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc00422e1c0)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnolang.org/x/net/http2.(*clientConnReadLoop).run(0xc00105ffa0)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/transport.go:1821 +0x165\nnolang.org/x/net/http2.(*ClientConn).readLoop(0xc003b12900)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/transport.go:1743 +0x79\nnreated by golang.org/x/net/http2.(*Transport).newClientConn\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/transport.go:695 +0xb45\nngoroutine 1097 [select]:\nn8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc003c2e000)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:179 +0x1c7\nnreated by k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:128 +0x1ef\nngoroutine 476 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd4b9a88, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc0034be100, 0xc005076000, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc0034be100, {0xc005076000, 0x78e2, 0x78e2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc0034be100, {0xc005076000, 0xc005076005, 0x61})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0030c2030, {0xc005076000, 0x6, 0xc002048928})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc0010bb6c8, {0xc005076000, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc0014ff3f8, {0x396c0e0, 0xc0010bb6c8})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc0014ff180, {0xd104358, 0xc0030c2030}, 0x203000)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc0014ff180, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc0014ff180, {0xc001f72038, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc0014ff180}, {0xc001f72038, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc001f72038, 0x9, 0xc002713f00}, {0xd0bd758, 0xc0014ff180})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc001f72000)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnolang.org/x/net/http2.(*serverConn).readFrames(0xc001f70000)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:739 +0x91\nnreated by golang.org/x/net/http2.(*serverConn).serve\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:845 +0x585\nngoroutine 1148 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd4b9d40, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc0033f4180, 0xc004c00000, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc0033f4180, {0xc004c00000, 0x4932, 0x4932})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc0033f4180, {0xc004c00000, 0xc004c00005, 0x94})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc00111e0e8, {0xc004c00000, 0x400, 0xc00393e7f0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc0049ee018, {0xc004c00000, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc00201f778, {0x396c0e0, 0xc0049ee018})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc00201f500, {0xd104358, 0xc00111e0e8}, 0x4932)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc00201f500, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc00201f500, {0xc0036a3000, 0x1000, 0xc003fa8000})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nnufio.(*Reader).Read(0xc001afb740, {0xc0036b4038, 0x9, 0xc0048cbd60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bufio/bufio.go:227 +0x1b4\nno.ReadAtLeast({0x396bee0, 0xc001afb740}, {0xc0036b4038, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc0036b4038, 0x9, 0xc0005c2900}, {0x396bee0, 0xc001afb740})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc0036b4000)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnolang.org/x/net/http2.(*clientConnReadLoop).run(0xc00393efa0)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/transport.go:1821 +0x165\nnolang.org/x/net/http2.(*ClientConn).readLoop(0xc0036a0000)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/transport.go:1743 +0x79\nnreated by golang.org/x/net/http2.(*Transport).newClientConn\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/transport.go:695 +0xb45\nngoroutine 1291 [select]:\nnoogle.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc0014727d0, {0xc003933450, 0x5, 0x5})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:189 +0xaa\nnoogle.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc0014727d0, {0xc003933450, 0xc0003cf470, 0xc001f57a28})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:169 +0x147\nnoogle.golang.org/grpc/internal/transport.(*transportReader).Read(0xc003d40f00, {0xc003933450, 0xc001f57aa0, 0x20fa927})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:483 +0x32\nno.ReadAtLeast({0x396f840, 0xc003d40f00}, {0xc003933450, 0x5, 0x5}, 0x5)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnoogle.golang.org/grpc/internal/transport.(*Stream).Read(0xc00273f200, {0xc003933450, 0x5, 0x5})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:467 +0xa5\nnoogle.golang.org/grpc.(*parser).recvMsg(0xc003933440, 0x7fffffff)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/rpc_util.go:558 +0x47\nnoogle.golang.org/grpc.recvAndDecompress(0xc003f8e420, 0xc00273f200, {0x0, 0x0}, 0x7fffffff, 0x0, {0x0, 0x0})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/rpc_util.go:689 +0x66\nnoogle.golang.org/grpc.recv(0xc003f8e4e0, {0xd104330, 0x5102138}, 0xc00376be30, {0x0, 0x0}, {0x3453ce0, 0xc000adc3f0}, 0x0, 0x0, ...)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/rpc_util.go:757 +0x6e\nnoogle.golang.org/grpc.(*csAttempt).recvMsg(0xc0038ac900, {0x3453ce0, 0xc000adc3f0}, 0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:957 +0x2b0\nnoogle.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:808 +0x25\nnoogle.golang.org/grpc.(*clientStream).withRetry(0xc00273efc0, 0xc001f57e78, 0xc001f57e48)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:662 +0x2f6\nnoogle.golang.org/grpc.(*clientStream).RecvMsg(0xc00273efc0, {0x3453ce0, 0xc000adc3f0})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:807 +0x11f\nnithub.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc003933458, {0x3453ce0, 0xc000adc3f0})\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/client_metrics.go:160 +0x37\nno.etcd.io/etcd/api/v3/etcdserverpb.(*watchWatchClient).Recv(0xc00397f320)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/api/[email protected]/etcdserverpb/rpc.pb.go:6714 +0x4c\nno.etcd.io/etcd/client/v3.(*watchGrpcStream).serveWatchClient(0xc00159a340, {0x3a03650, 0xc00397f320})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/watch.go:757 +0x6a\nnreated by go.etcd.io/etcd/client/v3.(*watchGrpcStream).newWatchClient\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/watch.go:912 +0x4e5\nngoroutine 1335 [chan receive]:\nn8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc003c2e000, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:260 +0x331\nnreated by k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:173 +0xa5\nngoroutine 1208 [select]:\nn8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc0037881c0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:179 +0x1c7\nnreated by k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:128 +0x1ef\nngoroutine 1290 [select]:\nnoogle.golang.org/grpc.newClientStreamWithParams.func4()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:363 +0x98\nnreated by google.golang.org/grpc.newClientStreamWithParams\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:362 +0x1066\nngoroutine 1368 [select]:\nn8s.io/apimachinery/pkg/util/wait.poller.func1.1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:705 +0x1c9\nnreated by k8s.io/apimachinery/pkg/util/wait.poller.func1\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:688 +0xcf\nngoroutine 1336 [select]:\nn8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc003c2e000, 0xc0006df380)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:296 +0x117\nnreated by k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:177 +0x125\nngoroutine 3414 [select]:\nn8s.io/apimachinery/pkg/util/wait.poller.func1.1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:705 +0x1c9\nnreated by k8s.io/apimachinery/pkg/util/wait.poller.func1\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:688 +0xcf\nngoroutine 3275 [select]:\nnoogle.golang.org/grpc/internal/transport.(*Stream).waitOnHeader(0xc002632120)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:322 +0x85\nnoogle.golang.org/grpc/internal/transport.(*Stream).RecvCompress(...)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:337\nnoogle.golang.org/grpc.(*csAttempt).recvMsg(0xc0036d7700, {0x342bb40, 0xc000718050}, 0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:943 +0xba\nnoogle.golang.org/grpc.(*clientStream).RecvMsg.func1(0x52)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:808 +0x25\nnoogle.golang.org/grpc.(*clientStream).withRetry(0xc0029e3e60, 0xc0034cd1b0, 0xc0034cd180)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:666 +0xd3\nnoogle.golang.org/grpc.(*clientStream).RecvMsg(0xc0029e3e60, {0x342bb40, 0xc000718050})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:807 +0x11f\nnoogle.golang.org/grpc.invoke({0x39be9b8, 0xc0020504e0}, {0x350a454, 0x203000}, {0x3465d60, 0xc004caafc0}, {0x342bb40, 0xc000718050}, 0x0, {0xc0034d5200, ...})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/call.go:73 +0xd7\nnithub.com/grpc-ecosystem/go-grpc-prometheus.(*ClientMetrics).UnaryClientInterceptor.func1({0x39be9b8, 0xc0020504e0}, {0x350a454, 0x16}, {0x3465d60, 0xc004caafc0}, {0x342bb40, 0xc000718050}, 0xd4836f0, 0x3642228, ...)\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/client_metrics.go:112 +0x117\nnoogle.golang.org/grpc.(*ClientConn).Invoke(0x60, {0x39be9b8, 0xc0020504e0}, {0x350a454, 0x6}, {0x3465d60, 0xc004caafc0}, {0x342bb40, 0xc000718050}, {0xc0034d5200, ...})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/call.go:35 +0x21f\nno.etcd.io/etcd/api/v3/etcdserverpb.(*kVClient).Range(0xc0006b0368, {0x39be9b8, 0xc0020504e0}, 0xc00039ed80, {0xc0034d5200, 0x4, 0x6})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/api/[email protected]/etcdserverpb/rpc.pb.go:6460 +0xc9\nno.etcd.io/etcd/client/v3.(*retryKVClient).Range(0xc0013df770, {0x39be9b8, 0xc0020504e0}, 0x34fd749, {0x50ccce0, 0x3, 0x3})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/retry.go:105 +0x130\nno.etcd.io/etcd/client/v3.(*kv).Do(0xc0014d1620, {_, _}, {0x1, {0xc001dabf40, 0x50, 0x50}, {0x0, 0x0, 0x0}, ...})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/kv.go:149 +0x1e8\nno.etcd.io/etcd/client/v3.(*kv).Get(0xc002b43958, {0x39be9b8, 0xc0020504e0}, {0xc001dabef0, 0x2d}, {0x0, 0x1, 0xc003bc19bf})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/kv.go:119 +0xdc\nn8s.io/apiserver/pkg/storage/etcd3.(*store).Get(0xc00075ea20, {0x39be9b8, 0xc0020504e0}, {0xc001dabea0, 0x47}, {0x40, {0x0, 0xc002b43a78}}, {0x399e6e0, 0xc002703540})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/store.go:122 +0x277\nn8s.io/apiserver/pkg/registry/generic/registry.(*DryRunnableStorage).Get(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/registry/generic/registry/dryrun.go:68\nn8s.io/apiserver/pkg/registry/generic/registry.(*Store).Get(0xc001b8b900, {0x39be9b8, 0xc0020504e0}, {0xc003bc19bf, 0x19}, 0xc002050510)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/registry/generic/registry/store.go:721 +0xf3\nn8s.io/apiserver/pkg/endpoints/handlers.GetResource.func1({0x39be9b8, 0xc0020504e0}, {0xc003bc19bf, 0x19}, 0xc003cdce00, 0xc0004c4e70)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/handlers/get.go:110 +0x2e2\nn8s.io/apiserver/pkg/endpoints/handlers.getResourceHandler.func1({0x39b0290, 0xc003824538}, 0xc003cdce00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/handlers/get.go:72 +0x687\nn8s.io/apiserver/pkg/endpoints.restfulGetResource.func1(0xc0020503f0, 0xc0004c4e00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/installer.go:1216 +0x5b\nn8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc0020503f0, 0xc0004c4e00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/metrics/metrics.go:484 +0x2e2\nnithub.com/emicklei/go-restful.(*Container).dispatch.func5(0x305a5e0, 0x3952488)\nn/Users/angoldst/go/pkg/mod/github.com/emicklei/[email protected]+incompatible/container.go:283 +0x2c\nnithub.com/emicklei/go-restful.(*FilterChain).ProcessFilter(0x203000, 0x305a5e0, 0x3952488)\nn/Users/angoldst/go/pkg/mod/github.com/emicklei/[email protected]+incompatible/filter.go:21 +0x58\nnithub.com/kcp-dev/kcp/pkg/server.(*Server).Run.func5(0xc0020503f0, 0xc0004c4e00, 0x1)\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/pkg/server/server.go:358 +0xb06\nnithub.com/emicklei/go-restful.(*FilterChain).ProcessFilter(0x3167d20, 0xc003824530, 0xc003824520)\nn/Users/angoldst/go/pkg/mod/github.com/emicklei/[email protected]+incompatible/filter.go:19 +0x47\nnithub.com/emicklei/go-restful.(*Container).dispatch(0xc0012638c0, {0xd7896d8, 0xc003824520}, 0xc003cdce00)\nn/Users/angoldst/go/pkg/mod/github.com/emicklei/[email protected]+incompatible/container.go:285 +0x9c6\nnithub.com/emicklei/go-restful.(*Container).Dispatch(...)\nn/Users/angoldst/go/pkg/mod/github.com/emicklei/[email protected]+incompatible/container.go:199\nn8s.io/apiserver/pkg/server.director.ServeHTTP({{0x350291b, 0x0}, 0xc0012638c0, 0xc000a17ab0}, {0xd7896d8, 0xc003824520}, 0xc003cdce00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/handler.go:153 +0x646\nn8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc002fd23c0, {0xd7896d8, 0xc003824520}, 0xc003cdce00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/mux/pathrecorder.go:255 +0x3fc\nn8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc003bc198f, {0xd7896d8, 0xc003824520}, 0xc004caaf30)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/mux/pathrecorder.go:235 +0x70\nn8s.io/apiserver/pkg/server.director.ServeHTTP({{0x34fbdfc, 0xc0003bcaf8}, 0xc000a43290, 0xc0000f93b0}, {0xd7896d8, 0xc003824520}, 0xc003cdce00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/handler.go:161 +0x82a\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0xd7896d8, 0xc003824520}, 0xc003cdce00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0xc000b58828, {0xd7896d8, 0xc003824520}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1({0xd7896d8, 0xc003824520}, 0xc003cdce00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/authorization.go:64 +0x47d\nnet/http.HandlerFunc.ServeHTTP(0x5102138, {0xd7896d8, 0xc003824520}, 0x3f847ae147ae147b)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0xd7896d8, 0xc003824520}, 0xc003cdce00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:79 +0x178\nnet/http.HandlerFunc.ServeHTTP(0x508eae0, {0xd7896d8, 0xc003824520}, 0x3)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1({0xd7896d8, 0xc003824520}, 0xc003cdce00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/maxinflight.go:187 +0x29d\nnet/http.HandlerFunc.ServeHTTP(0x0, {0xd7896d8, 0xc003824520}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0xd7896d8, 0xc003824520}, 0xc003cdce00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0xc003f91c00, {0xd7896d8, 0xc003824520}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1({0xd7896d8, 0xc003824520}, 0xc003cdce00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/impersonation.go:50 +0x21c\nnet/http.HandlerFunc.ServeHTTP(0x5102138, {0xd7896d8, 0xc003824520}, 0x1)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0xd7896d8, 0xc003824520}, 0xc003cdce00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:79 +0x178\nnet/http.HandlerFunc.ServeHTTP(0x0, {0xd7896d8, 0xc003824520}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0xd7896d8, 0xc003824520}, 0xc003cdce00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0x5102138, {0xd7896d8, 0xc003824520}, 0x1)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0xd7896d8, 0xc003824520}, 0xc003cdce00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:79 +0x178\nnet/http.HandlerFunc.ServeHTTP(0x0, {0xd7896d8, 0xc003824520}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0xd7896d8, 0xc003824520}, 0xc003cdce00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0xd7896d8, 0xc003824520}, 0x3640888)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withAuthentication.func1({0xd7896d8, 0xc003824520}, 0xc003cdce00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/authentication.go:80 +0x83c\nnet/http.HandlerFunc.ServeHTTP(0x39be980, {0xd7896d8, 0xc003824520}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0xd7896d8, 0xc003824520}, 0xc003cdcc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:88 +0x46b\nnet/http.HandlerFunc.ServeHTTP(0xc003824518, {0xd7896d8, 0xc003824520}, 0xc000d3cf78)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/timeout.go:108 +0x99\nnreated by k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/timeout.go:94 +0x2d1\nngoroutine 1096 [select]:\nn8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc003c04b80, {0x39b0290, 0xc003246138}, 0xc003c0c100)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/handlers/watch.go:213 +0xf25\nn8s.io/apiserver/pkg/endpoints/handlers.serveWatch({0x399b828, 0xc003c2e000}, 0xc0019d71e0, {0x0, {0x0, 0x0}, 0x0, {0x0, 0x0}, 0x0, ...}, ...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/handlers/watch.go:138 +0xf78\nn8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/handlers/get.go:270 +0x65\nn8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc003c0c100, 0x305a5e0, {0x34ef961, 0x9}, 0xc003c26d58)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/metrics/metrics.go:427 +0x722\nn8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1({0x39b0290, 0xc003246138}, 0xc003c0c100)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/handlers/get.go:269 +0xedb\nn8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc003c01e60, 0xc000ad2310)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/installer.go:1174 +0x6b\nn8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc003c01e60, 0xc000ad2310)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/metrics/metrics.go:484 +0x2e2\nnithub.com/emicklei/go-restful.(*Container).dispatch.func5(0xa, 0xc0026f3c00)\nn/Users/angoldst/go/pkg/mod/github.com/emicklei/[email protected]+incompatible/container.go:283 +0x2c\nnithub.com/emicklei/go-restful.(*FilterChain).ProcessFilter(0xc003c02fa0, 0x39be9b8, 0xc003c01d70)\nn/Users/angoldst/go/pkg/mod/github.com/emicklei/[email protected]+incompatible/filter.go:21 +0x58\nnithub.com/kcp-dev/kcp/pkg/server.(*Server).Run.func5(0xc003c01e60, 0xc000ad2310, 0x1)\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/pkg/server/server.go:462 +0xa94\nnithub.com/emicklei/go-restful.(*FilterChain).ProcessFilter(0x3167d20, 0xc003246130, 0xc003c04b00)\nn/Users/angoldst/go/pkg/mod/github.com/emicklei/[email protected]+incompatible/filter.go:19 +0x47\nnithub.com/emicklei/go-restful.(*Container).dispatch(0xc0012638c0, {0x39b0350, 0xc003c04b00}, 0xc003c0c100)\nn/Users/angoldst/go/pkg/mod/github.com/emicklei/[email protected]+incompatible/container.go:285 +0x9c6\nnithub.com/emicklei/go-restful.(*Container).Dispatch(...)\nn/Users/angoldst/go/pkg/mod/github.com/emicklei/[email protected]+incompatible/container.go:199\nn8s.io/apiserver/pkg/server.director.ServeHTTP({{0x350291b, 0x0}, 0xc0012638c0, 0xc000a17ab0}, {0x39b0350, 0xc003c04b00}, 0xc003c0c100)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/handler.go:153 +0x646\nn8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc002fd23c0, {0x39b0350, 0xc003c04b00}, 0xc003c0c100)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/mux/pathrecorder.go:255 +0x3fc\nn8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc001d7d110, {0x39b0350, 0xc003c04b00}, 0xc0015b1950)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/mux/pathrecorder.go:235 +0x70\nn8s.io/apiserver/pkg/server.director.ServeHTTP({{0x34fbdfc, 0xc003f81b50}, 0xc000a43290, 0xc0000f93b0}, {0x39b0350, 0xc003c04b00}, 0xc003c0c100)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/handler.go:161 +0x82a\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0x39b0350, 0xc003c04b00}, 0xc003c0c100)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0xc000b58828, {0x39b0350, 0xc003c04b00}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1({0x39b0350, 0xc003c04b00}, 0xc003c0c100)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/authorization.go:64 +0x47d\nnet/http.HandlerFunc.ServeHTTP(0x5102138, {0x39b0350, 0xc003c04b00}, 0x305a5e0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0x39b0350, 0xc003c04b00}, 0xc003c0c100)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:79 +0x178\nnet/http.HandlerFunc.ServeHTTP(0xc002998bd0, {0x39b0350, 0xc003c04b00}, 0x1)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1({0x39b0350, 0xc003c04b00}, 0xc003c0c100)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/maxinflight.go:152 +0x304\nnet/http.HandlerFunc.ServeHTTP(0x0, {0x39b0350, 0xc003c04b00}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0x39b0350, 0xc003c04b00}, 0xc003c0c100)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0x0, {0x39b0350, 0xc003c04b00}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1({0x39b0350, 0xc003c04b00}, 0xc003c0c100)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/impersonation.go:50 +0x21c\nnet/http.HandlerFunc.ServeHTTP(0x5102138, {0x39b0350, 0xc003c04b00}, 0x1)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0x39b0350, 0xc003c04b00}, 0xc003c0c100)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:79 +0x178\nnet/http.HandlerFunc.ServeHTTP(0x0, {0x39b0350, 0xc003c04b00}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0x39b0350, 0xc003c04b00}, 0xc003c0c100)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0x5102138, {0x39b0350, 0xc003c04b00}, 0x1)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0x39b0350, 0xc003c04b00}, 0xc003c0c100)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:79 +0x178\nnet/http.HandlerFunc.ServeHTTP(0x0, {0x39b0350, 0xc003c04b00}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0x39b0350, 0xc003c04b00}, 0xc003c0c100)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc003c04b00}, 0x3640888)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withAuthentication.func1({0x39b0350, 0xc003c04b00}, 0xc003c0c100)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/authentication.go:80 +0x83c\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc003c04b00}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0x39b0350, 0xc003c04b00}, 0xc001477400)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:88 +0x46b\nnet/http.HandlerFunc.ServeHTTP(0xc001477400, {0x39b0350, 0xc003c04b00}, 0x34f7c5c)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc000b58948, {0x39b0350, 0xc003c04b00}, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/timeout.go:85 +0x43d\nn8s.io/apiserver/pkg/endpoints/filters.withRequestDeadline.func1({0x39b0350, 0xc003c04b00}, 0xc001477400)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/request_deadline.go:66 +0x6fd\nnet/http.HandlerFunc.ServeHTTP(0x10c5ad3, {0x39b0350, 0xc003c04b00}, 0x18)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1({0x39b0350, 0xc003c04b00}, 0xc001477400)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/waitgroup.go:59 +0x174\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc003c04b00}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1({0x39b0350, 0xc003c04b00}, 0xc001477300)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/warning.go:35 +0x2bb\nnet/http.HandlerFunc.ServeHTTP(0x3314a20, {0x39b0350, 0xc003c04b00}, 0xd)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1({0x39b0350, 0xc003c04b00}, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/cachecontrol.go:31 +0x126\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc003c04b00}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/httplog.WithLogging.func1({0x39a5880, 0xc003246110}, 0xc001477200)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/httplog/httplog.go:103 +0x524\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39a5880, 0xc003246110}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1({0x39a5880, 0xc003246110}, 0xc001477000)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/requestinfo.go:39 +0x316\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39a5880, 0xc003246110}, 0xc003c08840)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withRequestReceivedTimestampWithClock.func1({0x39a5880, 0xc003246110}, 0xc001476f00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/request_received_time.go:38 +0x27e\nnet/http.HandlerFunc.ServeHTTP(0x160, {0x39a5880, 0xc003246110}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1({0x39a5880, 0xc003246110}, 0xc003c08840)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/wrap.go:74 +0xba\nnet/http.HandlerFunc.ServeHTTP(0x3314a20, {0x39a5880, 0xc003246110}, 0x8)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withAuditID.func1({0x39a5880, 0xc003246110}, 0xc001476c00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/with_auditid.go:66 +0x40d\nnet/http.HandlerFunc.ServeHTTP(0x39be910, {0x39a5880, 0xc003246110}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nnithub.com/kcp-dev/kcp/pkg/server.ServeHTTP.func1({0x39a5880, 0xc003246110}, 0xc001476b00)\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/pkg/server/handler.go:83 +0x6d6\nnet/http.HandlerFunc.ServeHTTP(0xc002060ca0, {0x39a5880, 0xc003246110}, 0xc00039ed80)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc001d7d123, {0x39a5880, 0xc003246110}, 0x39be948)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/handler.go:196 +0x2b\nnet/http.serverHandler.ServeHTTP({0x0}, {0x39a5880, 0xc003246110}, 0xc001476b00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2879 +0x43b\nnet/http.initALPNRequest.ServeHTTP({{0x39be9b8, 0xc0026fa3f0}, 0xc0014ff180, {0xc00077f180}}, {0x39a5880, 0xc003246110}, 0xc001476b00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3480 +0x245\nnolang.org/x/net/http2.(*serverConn).runHandler(0xc002060fd0, 0x15297aa, 0xc00293a840, 0x0)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:2162 +0x78\nnreated by golang.org/x/net/http2.(*serverConn).processHeaders\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:1892 +0x510\nngoroutine 1533 [select]:\nnoogle.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc00420e9c0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:69 +0x95\nnreated by google.golang.org/grpc.newCCBalancerWrapper\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/balancer_conn_wrappers.go:60 +0x1d5\nngoroutine 718 [select]:\nnoogle.golang.org/grpc.newClientStreamWithParams.func4()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:363 +0x98\nnreated by google.golang.org/grpc.newClientStreamWithParams\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:362 +0x1066\nngoroutine 1169 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc003d46f60, 0x8)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x1c26)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nnolang.org/x/net/http2.(*pipe).Read(0xc003d46f48, {0xc00385c001, 0x3dff, 0x3dff})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/pipe.go:65 +0xeb\nnolang.org/x/net/http2.transportResponseBody.Read({0x1c41}, {0xc00385c001, 0xc00385c000, 0xc004b11c20})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/transport.go:2110 +0x77\nnncoding/json.(*Decoder).refill(0xc0037e0280)\nn/usr/local/Cellar/go/1.17.6/libexec/src/encoding/json/stream.go:165 +0x17f\nnncoding/json.(*Decoder).readValue(0xc0037e0280)\nn/usr/local/Cellar/go/1.17.6/libexec/src/encoding/json/stream.go:140 +0xbb\nnncoding/json.(*Decoder).Decode(0xc0037e0280, {0x3179000, 0xc000637590})\nn/usr/local/Cellar/go/1.17.6/libexec/src/encoding/json/stream.go:63 +0x78\nn8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc0040466f0, {0xc004c04a80, 0x4000, 0x4a80})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c\nn8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc0025ecaa0, 0xc0037ac708, {0x399ab58, 0xc003159b00})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0xa7\nn8s.io/client-go/rest/watch.(*Decoder).Decode(0xc00401b820)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/rest/watch/decoder.go:49 +0x4f\nn8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc00404c140)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0x11c\nnreated by k8s.io/apimachinery/pkg/watch.NewStreamWatcher\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x135\nngoroutine 1212 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc003c085c0, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0xc001b2ea00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nnolang.org/x/net/http2.(*pipe).Read(0xc003c085a8, {0xc00079ac00, 0x200, 0x200})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/pipe.go:65 +0xeb\nnolang.org/x/net/http2.transportResponseBody.Read({0x1123a49}, {0xc00079ac00, 0xc001b2ea00, 0xc002726c20})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/transport.go:2110 +0x77\nnncoding/json.(*Decoder).refill(0xc00384ef00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/encoding/json/stream.go:165 +0x17f\nnncoding/json.(*Decoder).readValue(0xc00384ef00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/encoding/json/stream.go:140 +0xbb\nnncoding/json.(*Decoder).Decode(0xc00384ef00, {0x3179000, 0xc003821d40})\nn/usr/local/Cellar/go/1.17.6/libexec/src/encoding/json/stream.go:63 +0x78\nn8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc003f8e0f0, {0xc003f90000, 0x400, 0x400})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c\nn8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc001606820, 0x0, {0x399ab58, 0xc00381bd40})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0xa7\nn8s.io/client-go/rest/watch.(*Decoder).Decode(0xc003849d40)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/rest/watch/decoder.go:49 +0x4f\nn8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc00381bd00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0x11c\nnreated by k8s.io/apimachinery/pkg/watch.NewStreamWatcher\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x135\nngoroutine 1337 [select]:\nnontext.propagateCancel.func1()\nn/usr/local/Cellar/go/1.17.6/libexec/src/context/context.go:279 +0xa5\nnreated by context.propagateCancel\nn/usr/local/Cellar/go/1.17.6/libexec/src/context/context.go:278 +0x1d0\nngoroutine 1262 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc0027b3d20, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x10)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nnolang.org/x/net/http2.(*pipe).Read(0xc0027b3d08, {0xc0038cc000, 0x200, 0x200})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/pipe.go:65 +0xeb\nnolang.org/x/net/http2.transportResponseBody.Read({0x1094651}, {0xc0038cc000, 0xc001fe2be0, 0xc001fe2c20})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/transport.go:2110 +0x77\nnncoding/json.(*Decoder).refill(0xc00206cf00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/encoding/json/stream.go:165 +0x17f\nnncoding/json.(*Decoder).readValue(0xc00206cf00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/encoding/json/stream.go:140 +0xbb\nnncoding/json.(*Decoder).Decode(0xc00206cf00, {0x3179000, 0xc0020467f8})\nn/usr/local/Cellar/go/1.17.6/libexec/src/encoding/json/stream.go:63 +0x78\nn8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc0038c81e0, {0xc0038b8800, 0x400, 0x400})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c\nn8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc001617270, 0x30fe7c0, {0x399ab58, 0xc002065640})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0xa7\nn8s.io/client-go/rest/watch.(*Decoder).Decode(0xc002056660)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/rest/watch/decoder.go:49 +0x4f\nn8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc002065600)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0x11c\nnreated by k8s.io/apimachinery/pkg/watch.NewStreamWatcher\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x135\nngoroutine 1285 [chan receive]:\nn8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc0037881c0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:260 +0x331\nnreated by k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:173 +0xa5\nngoroutine 1263 [select]:\nnoogle.golang.org/grpc/internal/transport.(*serverHandlerTransport).runStream(0xc001bc4bd0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:426 +0x85\nnoogle.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams(0xc001bc4bd0, 0xc00376b8c0, 0x3a055d8)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:416 +0x7dc\nnoogle.golang.org/grpc.(*Server).serveStreams(0xc000826c40, {0x3a055d8, 0xc001bc4bd0})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:918 +0x142\nnoogle.golang.org/grpc.(*Server).ServeHTTP(0xc000826c40, {0x39b1d90, 0xc0020520d8}, 0x3974320)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:987 +0x10b\nno.etcd.io/etcd/server/v3/embed.grpcHandlerFunc.func2({0x39b1d90, 0xc0020520d8}, 0xc0038ce100)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/serve.go:208 +0xc5\nnet/http.HandlerFunc.ServeHTTP(0x3149340, {0x39b1d90, 0xc0020520d8}, 0xc00376b830)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nnet/http.(*ServeMux).ServeHTTP(0x39b1d90, {0x39b1d90, 0xc0020520d8}, 0xc0038ce100)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2425 +0x149\nno.etcd.io/etcd/server/v3/embed.(*accessController).ServeHTTP(0xc0006a6870, {0x39b1d90, 0xc0020520d8}, 0xc0038ce100)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/serve.go:355 +0x50f\nnet/http.serverHandler.ServeHTTP({0xc001617270}, {0x39b1d90, 0xc0020520d8}, 0xc0038ce100)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2879 +0x43b\nnet/http.initALPNRequest.ServeHTTP({{0x39be9b8, 0xc001bffd70}, 0xc001a7a000, {0xc0003d0700}}, {0x39b1d90, 0xc0020520d8}, 0xc0038ce100)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3480 +0x245\nnet/http.(*http2serverConn).runHandler(0xc0034776c0, 0xc0034777d0, 0x153e966, 0xc002065600)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:5849 +0x78\nnreated by net/http.(*http2serverConn).processHeaders\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:5579 +0x510\nngoroutine 1286 [select]:\nn8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc0037881c0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:296 +0x117\nnreated by k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:177 +0x125\nngoroutine 1338 [select]:\nno.etcd.io/etcd/client/v3.(*watchGrpcStream).run(0xc00159a340)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/watch.go:537 +0x374\nnreated by go.etcd.io/etcd/client/v3.(*watcher).newWatcherGrpcStream\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/watch.go:285 +0x352\nngoroutine 1259 [chan receive]:\nn8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc0030b6380, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:260 +0x331\nnreated by k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:173 +0xa5\nngoroutine 1331 [select]:\nn8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc003908b00, {0x39b0290, 0xc003824488}, 0xc00385b200)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/handlers/watch.go:213 +0xf25\nn8s.io/apiserver/pkg/endpoints/handlers.serveWatch({0x399b828, 0xc0037881c0}, 0xc0018996c0, {0x0, {0x0, 0x0}, 0x0, {0x0, 0x0}, 0x0, ...}, ...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/handlers/watch.go:138 +0xf78\nn8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/handlers/get.go:270 +0x65\nn8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc00385b200, 0x305a5e0, {0x34ef961, 0x9}, 0xc00392ad58)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/metrics/metrics.go:427 +0x722\nn8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1({0x39b0290, 0xc003824488}, 0xc00385b200)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/handlers/get.go:269 +0xedb\nn8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc00390d8f0, 0xc000a0f960)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/installer.go:1174 +0x6b\nn8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc00390d8f0, 0xc000a0f960)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/metrics/metrics.go:484 +0x2e2\nnithub.com/emicklei/go-restful.(*Container).dispatch.func5(0x2, 0x3512715)\nn/Users/angoldst/go/pkg/mod/github.com/emicklei/[email protected]+incompatible/container.go:283 +0x2c\nnithub.com/emicklei/go-restful.(*FilterChain).ProcessFilter(0xc003849ca0, 0x39be9b8, 0xc00390d860)\nn/Users/angoldst/go/pkg/mod/github.com/emicklei/[email protected]+incompatible/filter.go:21 +0x58\nnithub.com/kcp-dev/kcp/pkg/server.(*Server).Run.func5(0xc00390d8f0, 0xc000a0f960, 0x1)\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/pkg/server/server.go:462 +0xa94\nnithub.com/emicklei/go-restful.(*FilterChain).ProcessFilter(0x3167d20, 0xc003824480, 0xc003908a80)\nn/Users/angoldst/go/pkg/mod/github.com/emicklei/[email protected]+incompatible/filter.go:19 +0x47\nnithub.com/emicklei/go-restful.(*Container).dispatch(0xc0012638c0, {0x39b0350, 0xc003908a80}, 0xc00385b200)\nn/Users/angoldst/go/pkg/mod/github.com/emicklei/[email protected]+incompatible/container.go:285 +0x9c6\nnithub.com/emicklei/go-restful.(*Container).Dispatch(...)\nn/Users/angoldst/go/pkg/mod/github.com/emicklei/[email protected]+incompatible/container.go:199\nn8s.io/apiserver/pkg/server.director.ServeHTTP({{0x350291b, 0x1004429}, 0xc0012638c0, 0xc000a17ab0}, {0x39b0350, 0xc003908a80}, 0xc00385b200)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/handler.go:153 +0x646\nn8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc002fd23c0, {0x39b0350, 0xc003908a80}, 0xc00385b200)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/mux/pathrecorder.go:255 +0x3fc\nn8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc003253600, {0x39b0350, 0xc003908a80}, 0xc001813170)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/mux/pathrecorder.go:235 +0x70\nn8s.io/apiserver/pkg/server.director.ServeHTTP({{0x34fbdfc, 0xc0037a1b50}, 0xc000a43290, 0xc0000f93b0}, {0x39b0350, 0xc003908a80}, 0xc00385b200)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/handler.go:161 +0x82a\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0x39b0350, 0xc003908a80}, 0xc00385b200)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0xc000b58828, {0x39b0350, 0xc003908a80}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1({0x39b0350, 0xc003908a80}, 0xc00385b200)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/authorization.go:64 +0x47d\nnet/http.HandlerFunc.ServeHTTP(0x5102138, {0x39b0350, 0xc003908a80}, 0x305a5e0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0x39b0350, 0xc003908a80}, 0xc00385b200)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:79 +0x178\nnet/http.HandlerFunc.ServeHTTP(0xc002998bd0, {0x39b0350, 0xc003908a80}, 0x1)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1({0x39b0350, 0xc003908a80}, 0xc00385b200)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/maxinflight.go:152 +0x304\nnet/http.HandlerFunc.ServeHTTP(0x0, {0x39b0350, 0xc003908a80}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0x39b0350, 0xc003908a80}, 0xc00385b200)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0x36406c0, {0x39b0350, 0xc003908a80}, 0xc003823cd8)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1({0x39b0350, 0xc003908a80}, 0xc00385b200)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/impersonation.go:50 +0x21c\nnet/http.HandlerFunc.ServeHTTP(0x5102138, {0x39b0350, 0xc003908a80}, 0x1)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0x39b0350, 0xc003908a80}, 0xc00385b200)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:79 +0x178\nnet/http.HandlerFunc.ServeHTTP(0x0, {0x39b0350, 0xc003908a80}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0x39b0350, 0xc003908a80}, 0xc00385b200)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0x5102138, {0x39b0350, 0xc003908a80}, 0x1)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0x39b0350, 0xc003908a80}, 0xc00385b200)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:79 +0x178\nnet/http.HandlerFunc.ServeHTTP(0x0, {0x39b0350, 0xc003908a80}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0x39b0350, 0xc003908a80}, 0xc00385b200)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc003908a80}, 0x3640888)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withAuthentication.func1({0x39b0350, 0xc003908a80}, 0xc00385b200)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/authentication.go:80 +0x83c\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc003908a80}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0x39b0350, 0xc003908a80}, 0xc00385b000)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:88 +0x46b\nnet/http.HandlerFunc.ServeHTTP(0xc00385b000, {0x39b0350, 0xc003908a80}, 0xc001a36420)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc000b58948, {0x39b0350, 0xc003908a80}, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/timeout.go:85 +0x43d\nn8s.io/apiserver/pkg/endpoints/filters.withRequestDeadline.func1({0x39b0350, 0xc003908a80}, 0xc00385b000)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/request_deadline.go:66 +0x6fd\nnet/http.HandlerFunc.ServeHTTP(0x10c5ad3, {0x39b0350, 0xc003908a80}, 0x18)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1({0x39b0350, 0xc003908a80}, 0xc00385b000)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/waitgroup.go:59 +0x174\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc003908a80}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1({0x39b0350, 0xc003908a80}, 0xc00385af00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/warning.go:35 +0x2bb\nnet/http.HandlerFunc.ServeHTTP(0x3314a20, {0x39b0350, 0xc003908a80}, 0xd)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1({0x39b0350, 0xc003908a80}, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/cachecontrol.go:31 +0x126\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc003908a80}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/httplog.WithLogging.func1({0x39a5880, 0xc0031b0438}, 0xc00385ae00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/httplog/httplog.go:103 +0x524\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39a5880, 0xc0031b0438}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1({0x39a5880, 0xc0031b0438}, 0xc00385ad00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/requestinfo.go:39 +0x316\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39a5880, 0xc0031b0438}, 0xc0029ad1e0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withRequestReceivedTimestampWithClock.func1({0x39a5880, 0xc0031b0438}, 0xc00385ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/request_received_time.go:38 +0x27e\nnet/http.HandlerFunc.ServeHTTP(0x160, {0x39a5880, 0xc0031b0438}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1({0x39a5880, 0xc0031b0438}, 0xc0029ad1e0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/wrap.go:74 +0xba\nnet/http.HandlerFunc.ServeHTTP(0x3314a20, {0x39a5880, 0xc0031b0438}, 0x8)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withAuditID.func1({0x39a5880, 0xc0031b0438}, 0xc00385ab00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/with_auditid.go:66 +0x40d\nnet/http.HandlerFunc.ServeHTTP(0x39be910, {0x39a5880, 0xc0031b0438}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nnithub.com/kcp-dev/kcp/pkg/server.ServeHTTP.func1({0x39a5880, 0xc0031b0438}, 0xc003b84700)\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/pkg/server/handler.go:83 +0x6d6\nnet/http.HandlerFunc.ServeHTTP(0x0, {0x39a5880, 0xc0031b0438}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc00325362a, {0x39a5880, 0xc0031b0438}, 0x39be948)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/handler.go:196 +0x2b\nnet/http.serverHandler.ServeHTTP({0x0}, {0x39a5880, 0xc0031b0438}, 0xc003b84700)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2879 +0x43b\nnet/http.initALPNRequest.ServeHTTP({{0x39be9b8, 0xc0026fa3f0}, 0xc0014ff180, {0xc00077f180}}, {0x39a5880, 0xc0031b0438}, 0xc003b84700)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3480 +0x245\nnolang.org/x/net/http2.(*serverConn).runHandler(0xc0010f9fd0, 0x15297aa, 0xc00293a9a0, 0xc0010f9fb8)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:2162 +0x78\nnreated by golang.org/x/net/http2.(*serverConn).processHeaders\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:1892 +0x510\nngoroutine 1260 [select]:\nn8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc0030b6380, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:296 +0x117\nnreated by k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:177 +0x125\nngoroutine 1433 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc000951dd0, 0xf)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x399f400)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/util/workqueue.(*Type).Get(0xc0019786c0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:151 +0x9e\nn8s.io/apiextensions-apiserver/pkg/controller/apiapproval.(*KubernetesAPIApprovalPolicyConformantConditionController).processNextWorkItem(0xc00043db80)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/apiapproval/apiapproval_controller.go:207 +0x58\nn8s.io/apiextensions-apiserver/pkg/controller/apiapproval.(*KubernetesAPIApprovalPolicyConformantConditionController).runWorker(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/apiapproval/apiapproval_controller.go:201\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd364730)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x0, {0x39705a0, 0xc003c95260}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0x3b9aca00, 0x0, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0x0, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/apiextensions-apiserver/pkg/controller/apiapproval.(*KubernetesAPIApprovalPolicyConformantConditionController).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/apiapproval/apiapproval_controller.go:194 +0x22e\nngoroutine 1303 [select]:\nn8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc0030b6380)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:179 +0x1c7\nnreated by k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:128 +0x1ef\nngoroutine 1308 [select]:\nnoogle.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams.func1()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:344 +0xdb\nnreated by google.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:343 +0x125\nngoroutine 719 [select]:\nnoogle.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc0011de280, {0xc0031630a8, 0x5, 0x5})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:189 +0xaa\nnoogle.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc0011de280, {0xc0031630a8, 0xc00316a258, 0xc003f25a28})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:169 +0x147\nnoogle.golang.org/grpc/internal/transport.(*transportReader).Read(0xc003388720, {0xc0031630a8, 0xc003f25aa0, 0x20fa927})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:483 +0x32\nno.ReadAtLeast({0x396f840, 0xc003388720}, {0xc0031630a8, 0x5, 0x5}, 0x5)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnoogle.golang.org/grpc/internal/transport.(*Stream).Read(0xc00295c6c0, {0xc0031630a8, 0x5, 0x5})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:467 +0xa5\nnoogle.golang.org/grpc.(*parser).recvMsg(0xc003163098, 0x7fffffff)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/rpc_util.go:558 +0x47\nnoogle.golang.org/grpc.recvAndDecompress(0xc003f8e420, 0xc00295c6c0, {0x0, 0x0}, 0x7fffffff, 0x0, {0x0, 0x0})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/rpc_util.go:689 +0x66\nnoogle.golang.org/grpc.recv(0xc003f8e4e0, {0xd104330, 0x5102138}, 0xc003cad650, {0x0, 0x0}, {0x3453ce0, 0xc000a211f0}, 0x0, 0x0, ...)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/rpc_util.go:757 +0x6e\nnoogle.golang.org/grpc.(*csAttempt).recvMsg(0xc00336a200, {0x3453ce0, 0xc000a211f0}, 0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:957 +0x2b0\nnoogle.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:808 +0x25\nnoogle.golang.org/grpc.(*clientStream).withRetry(0xc00295c240, 0xc003f25e78, 0xc003f25e48)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:662 +0x2f6\nnoogle.golang.org/grpc.(*clientStream).RecvMsg(0xc00295c240, {0x3453ce0, 0xc000a211f0})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:807 +0x11f\nnithub.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc0031630b0, {0x3453ce0, 0xc000a211f0})\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/client_metrics.go:160 +0x37\nno.etcd.io/etcd/api/v3/etcdserverpb.(*watchWatchClient).Recv(0xc00315d750)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/api/[email protected]/etcdserverpb/rpc.pb.go:6714 +0x4c\nno.etcd.io/etcd/client/v3.(*watchGrpcStream).serveWatchClient(0xc0002e3a00, {0x3a03650, 0xc00315d750})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/watch.go:757 +0x6a\nnreated by go.etcd.io/etcd/client/v3.(*watchGrpcStream).newWatchClient\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/watch.go:912 +0x4e5\nngoroutine 1292 [select]:\nno.etcd.io/etcd/client/v3.(*watchGrpcStream).serveSubstream(0xc00159a340, 0xc00394c370, 0xc001a6fc20)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/watch.go:803 +0x265\nnreated by go.etcd.io/etcd/client/v3.(*watchGrpcStream).run\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/watch.go:554 +0xed1\nngoroutine 720 [select]:\nno.etcd.io/etcd/client/v3.(*watchGrpcStream).serveSubstream(0xc0002e3a00, 0xc0033042c0, 0xc003d42480)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/watch.go:803 +0x265\nnreated by go.etcd.io/etcd/client/v3.(*watchGrpcStream).run\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/watch.go:554 +0xed1\nngoroutine 1099 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc0027b3e80, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x10)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nnolang.org/x/net/http2.(*pipe).Read(0xc0027b3e68, {0xc003c34000, 0x200, 0x200})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/pipe.go:65 +0xeb\nnolang.org/x/net/http2.transportResponseBody.Read({0x39be9b8}, {0xc003c34000, 0x507e030, 0xc001f34c20})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/transport.go:2110 +0x77\nnncoding/json.(*Decoder).refill(0xc00322a500)\nn/usr/local/Cellar/go/1.17.6/libexec/src/encoding/json/stream.go:165 +0x17f\nnncoding/json.(*Decoder).readValue(0xc00322a500)\nn/usr/local/Cellar/go/1.17.6/libexec/src/encoding/json/stream.go:140 +0xbb\nnncoding/json.(*Decoder).Decode(0xc00322a500, {0x3179000, 0xc0026f8888})\nn/usr/local/Cellar/go/1.17.6/libexec/src/encoding/json/stream.go:63 +0x78\nn8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc003c0e630, {0xc003c30000, 0x400, 0x400})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/framer/framer.go:152 +0x19c\nn8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc0016a05f0, 0xc00329f000, {0x399ab58, 0xc0026f0d00})\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/runtime/serializer/streaming/streaming.go:77 +0xa7\nn8s.io/client-go/rest/watch.(*Decoder).Decode(0xc003c03020)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/rest/watch/decoder.go:49 +0x4f\nn8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc0026f0cc0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/watch/streamwatcher.go:105 +0x11c\nnreated by k8s.io/apimachinery/pkg/watch.NewStreamWatcher\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/watch/streamwatcher.go:76 +0x135\nngoroutine 1293 [select]:\nnoogle.golang.org/grpc/internal/transport.(*serverHandlerTransport).runStream(0xc0015b1e60)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:426 +0x85\nnoogle.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams(0xc0015b1e60, 0xc003c0e6f0, 0x3a055d8)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:416 +0x7dc\nnoogle.golang.org/grpc.(*Server).serveStreams(0xc000826c40, {0x3a055d8, 0xc0015b1e60})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:918 +0x142\nnoogle.golang.org/grpc.(*Server).ServeHTTP(0xc000826c40, {0x39b1d90, 0xc0001178f8}, 0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:987 +0x10b\nno.etcd.io/etcd/server/v3/embed.grpcHandlerFunc.func2({0x39b1d90, 0xc0001178f8}, 0xc00394ad00)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/serve.go:208 +0xc5\nnet/http.HandlerFunc.ServeHTTP(0x3149340, {0x39b1d90, 0xc0001178f8}, 0xc003c0e690)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nnet/http.(*ServeMux).ServeHTTP(0x39b1d90, {0x39b1d90, 0xc0001178f8}, 0xc00394ad00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2425 +0x149\nno.etcd.io/etcd/server/v3/embed.(*accessController).ServeHTTP(0xc0006a6870, {0x39b1d90, 0xc0001178f8}, 0xc00394ad00)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/serve.go:355 +0x50f\nnet/http.serverHandler.ServeHTTP({0x0}, {0x39b1d90, 0xc0001178f8}, 0xc00394ad00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2879 +0x43b\nnet/http.initALPNRequest.ServeHTTP({{0x39be9b8, 0xc001e3f410}, 0xc0014fe380, {0xc0003d0700}}, {0x39b1d90, 0xc0001178f8}, 0xc00394ad00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3480 +0x245\nnet/http.(*http2serverConn).runHandler(0x2376cee, 0xc00159a340, 0xc00394c370, 0xc001a6fc20)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:5849 +0x78\nnreated by net/http.(*http2serverConn).processHeaders\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:5579 +0x510\nngoroutine 1309 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc00126d458, 0x1)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0xc0010f96c0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nnet/http.(*http2pipe).Read(0xc00126d440, {0xc003d4e067, 0x1f9d, 0x1f9d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3618 +0xeb\nnet/http.(*http2requestBody).Read(0xc0038c8300, {0xc003d4e067, 0x0, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:6006 +0xa5\nnoogle.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams.func5()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:395 +0xab\nnreated by google.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:389 +0x7bd\nngoroutine 1100 [select]:\nnoogle.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams.func1()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:344 +0xdb\nnreated by google.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:343 +0x125\nngoroutine 1101 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc001892918, 0x2)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0xc00347aec0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nnet/http.(*http2pipe).Read(0xc001892900, {0xc003f92086, 0x1f7e, 0x1f7e})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3618 +0xeb\nnet/http.(*http2requestBody).Read(0xc003d41080, {0xc003f92086, 0x0, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:6006 +0xa5\nnoogle.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams.func5()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:395 +0xab\nnreated by google.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:389 +0x7bd\nngoroutine 1310 [select]:\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*watchServer).Watch(0xc0000be8c0, {0x3a036a8, 0xc000fd36e0})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/watch.go:209 +0x3c5\nno.etcd.io/etcd/api/v3/etcdserverpb._Watch_Watch_Handler({0x3114f40, 0xc0000be8c0}, {0x39eac98, 0xc003090cc0})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/api/[email protected]/etcdserverpb/rpc.pb.go:6743 +0x9f\nnithub.com/grpc-ecosystem/go-grpc-prometheus.(*ServerMetrics).StreamServerInterceptor.func1({0x3114f40, 0xc0000be8c0}, {0x39ec798, 0xc003090ca8}, 0x3386c80, 0x3641bb0)\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/server_metrics.go:121 +0x109\nnithub.com/grpc-ecosystem/go-grpc-middleware.ChainStreamServer.func1.1.1({0x3114f40, 0xc0000be8c0}, {0x39ec798, 0xc003090ca8})\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:49 +0x3a\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.newStreamInterceptor.func1({0x3114f40, 0xc0000be8c0}, {0x39eb3e8, 0xc003734480}, 0xc003090c78, 0xc0019d5960)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/interceptor.go:252 +0x4f7\nnithub.com/grpc-ecosystem/go-grpc-middleware.ChainStreamServer.func1.1.1({0x3114f40, 0xc0000be8c0}, {0x39eb3e8, 0xc003734480})\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:49 +0x3a\nnithub.com/grpc-ecosystem/go-grpc-middleware.ChainStreamServer.func1({0x3114f40, 0xc0000be8c0}, {0x39eb3e8, 0xc003734480}, 0x345aa20, 0xc0027b4fc0)\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:58 +0xbf\nnoogle.golang.org/grpc.(*Server).processStreamingRPC(0xc000826c40, {0x3a055d8, 0xc001bc4bd0}, 0xc0027b4fc0, 0xc0006a5440, 0x50843e0, 0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:1540 +0xcbb\nnoogle.golang.org/grpc.(*Server).handleStream(0xc000826c40, {0x3a055d8, 0xc001bc4bd0}, 0xc0027b4fc0, 0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:1613 +0x9e5\nnoogle.golang.org/grpc.(*Server).serveStreams.func1.2()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:934 +0x98\nnreated by google.golang.org/grpc.(*Server).serveStreams.func1\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:932 +0x294\nngoroutine 1102 [select]:\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*watchServer).Watch(0xc0000be8c0, {0x3a036a8, 0xc00397f3e0})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/watch.go:209 +0x3c5\nno.etcd.io/etcd/api/v3/etcdserverpb._Watch_Watch_Handler({0x3114f40, 0xc0000be8c0}, {0x39eac98, 0xc0039334d0})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/api/[email protected]/etcdserverpb/rpc.pb.go:6743 +0x9f\nnithub.com/grpc-ecosystem/go-grpc-prometheus.(*ServerMetrics).StreamServerInterceptor.func1({0x3114f40, 0xc0000be8c0}, {0x39ec798, 0xc0039334b8}, 0x3386c80, 0x3641bb0)\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/server_metrics.go:121 +0x109\nnithub.com/grpc-ecosystem/go-grpc-middleware.ChainStreamServer.func1.1.1({0x3114f40, 0xc0000be8c0}, {0x39ec798, 0xc0039334b8})\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:49 +0x3a\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.newStreamInterceptor.func1({0x3114f40, 0xc0000be8c0}, {0x39eb3e8, 0xc00373a480}, 0xc0026f88d0, 0xc003c030c0)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/interceptor.go:252 +0x4f7\nnithub.com/grpc-ecosystem/go-grpc-middleware.ChainStreamServer.func1.1.1({0x3114f40, 0xc0000be8c0}, {0x39eb3e8, 0xc00373a480})\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:49 +0x3a\nnithub.com/grpc-ecosystem/go-grpc-middleware.ChainStreamServer.func1({0x3114f40, 0xc0000be8c0}, {0x39eb3e8, 0xc00373a480}, 0x345aa20, 0xc0029fa480)\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:58 +0xbf\nnoogle.golang.org/grpc.(*Server).processStreamingRPC(0xc000826c40, {0x3a055d8, 0xc0015b1e60}, 0xc0029fa480, 0xc0006a5440, 0x50843e0, 0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:1540 +0xcbb\nnoogle.golang.org/grpc.(*Server).handleStream(0xc000826c40, {0x3a055d8, 0xc0015b1e60}, 0xc0029fa480, 0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:1613 +0x9e5\nnoogle.golang.org/grpc.(*Server).serveStreams.func1.2()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:934 +0x98\nnreated by google.golang.org/grpc.(*Server).serveStreams.func1\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:932 +0x294\nngoroutine 1311 [select]:\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*serverWatchStream).sendLoop(0xc003734540)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/watch.go:378 +0x272\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*watchServer).Watch.func1()\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/watch.go:179 +0x25\nnreated by go.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*watchServer).Watch\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/watch.go:178 +0x296\nngoroutine 1312 [select]:\nnoogle.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc001600ff0, {0xc003090c70, 0x5, 0x5})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:177 +0x96\nnoogle.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc001600ff0, {0xc003090c70, 0x3502597, 0x12})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:171 +0x16f\nnoogle.golang.org/grpc/internal/transport.(*transportReader).Read(0xc00376b980, {0xc003090c70, 0x3, 0x1})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:483 +0x32\nno.ReadAtLeast({0x396f840, 0xc00376b980}, {0xc003090c70, 0x5, 0x5}, 0x5)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnoogle.golang.org/grpc/internal/transport.(*Stream).Read(0xc0027b4fc0, {0xc003090c70, 0x5, 0x5})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:467 +0xa5\nnoogle.golang.org/grpc.(*parser).recvMsg(0xc003090c60, 0x200000)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/rpc_util.go:558 +0x47\nnoogle.golang.org/grpc.recvAndDecompress(0x8, 0xc0027b4fc0, {0x0, 0x0}, 0x200000, 0x0, {0x0, 0x0})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/rpc_util.go:689 +0x66\nnoogle.golang.org/grpc.recv(0xc00372db30, {0xd0dbdc0, 0x5102138}, 0x3, {0x0, 0x0}, {0x3435a20, 0xc003d412c0}, 0xc00372dde0, 0x0, ...)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/rpc_util.go:757 +0x6e\nnoogle.golang.org/grpc.(*serverStream).RecvMsg(0xc003734480, {0x3435a20, 0xc003d412c0})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:1545 +0x185\nnithub.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredServerStream).RecvMsg(0xc003090cc0, {0x3435a20, 0xc003d412c0})\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/server_metrics.go:164 +0x33\nno.etcd.io/etcd/api/v3/etcdserverpb.(*watchWatchServer).Recv(0xc000fd36e0)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/api/[email protected]/etcdserverpb/rpc.pb.go:6762 +0x4c\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*serverWatchStream).recvLoop(0xc003734540)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/watch.go:240 +0x4c\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*watchServer).Watch.func2()\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/watch.go:189 +0x52\nnreated by go.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*watchServer).Watch\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/watch.go:188 +0x33f\nngoroutine 1294 [select]:\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*serverWatchStream).sendLoop(0xc003968480)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/watch.go:378 +0x272\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*watchServer).Watch.func1()\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/watch.go:179 +0x25\nnreated by go.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*watchServer).Watch\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/watch.go:178 +0x296\nngoroutine 1295 [select]:\nnoogle.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc0016a0640, {0xc0026f88c8, 0x5, 0x5})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:177 +0x96\nnoogle.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc0016a0640, {0xc0026f88c8, 0x3502597, 0x12})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:171 +0x16f\nnoogle.golang.org/grpc/internal/transport.(*transportReader).Read(0xc003c0e7b0, {0xc0026f88c8, 0x3, 0x1})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:483 +0x32\nno.ReadAtLeast({0x396f840, 0xc003c0e7b0}, {0xc0026f88c8, 0x5, 0x5}, 0x5)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnoogle.golang.org/grpc/internal/transport.(*Stream).Read(0xc0029fa480, {0xc0026f88c8, 0x5, 0x5})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:467 +0xa5\nnoogle.golang.org/grpc.(*parser).recvMsg(0xc0026f88b8, 0x200000)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/rpc_util.go:558 +0x47\nnoogle.golang.org/grpc.recvAndDecompress(0xd365e08, 0xc0029fa480, {0x0, 0x0}, 0x200000, 0x0, {0x0, 0x0})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/rpc_util.go:689 +0x66\nnoogle.golang.org/grpc.recv(0xc002725b30, {0xd0dbdc0, 0x5102138}, 0x3, {0x0, 0x0}, {0x3435a20, 0xc00376bd70}, 0xc002725de0, 0x0, ...)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/rpc_util.go:757 +0x6e\nnoogle.golang.org/grpc.(*serverStream).RecvMsg(0xc00373a480, {0x3435a20, 0xc00376bd70})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:1545 +0x185\nnithub.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredServerStream).RecvMsg(0xc0039334d0, {0x3435a20, 0xc00376bd70})\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/server_metrics.go:164 +0x33\nno.etcd.io/etcd/api/v3/etcdserverpb.(*watchWatchServer).Recv(0xc00397f3e0)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/api/[email protected]/etcdserverpb/rpc.pb.go:6762 +0x4c\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*serverWatchStream).recvLoop(0xc003968480)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/watch.go:240 +0x4c\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*watchServer).Watch.func2()\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/watch.go:189 +0x52\nnreated by go.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*watchServer).Watch\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/watch.go:188 +0x33f\nngoroutine 1380 [chan receive]:\nn8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc0039461c0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:260 +0x331\nnreated by k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:173 +0xa5\nngoroutine 1297 [select]:\nn8s.io/apiserver/pkg/endpoints/handlers.(*WatchServer).ServeHTTP(0xc0040af080, {0x39b0290, 0xc003d64200}, 0xc00394bc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/handlers/watch.go:213 +0xf25\nn8s.io/apiserver/pkg/endpoints/handlers.serveWatch({0x399b828, 0xc0039461c0}, 0xc0018bcb60, {0x0, {0x0, 0x0}, 0x0, {0x0, 0x0}, 0x0, ...}, ...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/handlers/watch.go:138 +0xf78\nn8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1.2()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/handlers/get.go:270 +0x65\nn8s.io/apiserver/pkg/endpoints/metrics.RecordLongRunning(0xc00394bc00, 0x305a5e0, {0x34ef961, 0x9}, 0xc0040c8b68)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/metrics/metrics.go:427 +0x722\nn8s.io/apiserver/pkg/endpoints/handlers.ListResource.func1({0x39b0290, 0xc003d64200}, 0xc00394bc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/handlers/get.go:269 +0xedb\nn8s.io/apiserver/pkg/endpoints.restfulListResource.func1(0xc0040ab7a0, 0xc00023fea0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/installer.go:1174 +0x6b\nn8s.io/apiserver/pkg/endpoints/metrics.InstrumentRouteFunc.func1(0xc0040ab7a0, 0xc00023fea0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/metrics/metrics.go:484 +0x2e2\nnithub.com/emicklei/go-restful.(*Container).dispatch(0xc0010e4d80, {0x39b0350, 0xc0040af000}, 0xc00394bc00)\nn/Users/angoldst/go/pkg/mod/github.com/emicklei/[email protected]+incompatible/container.go:288 +0x9d1\nnithub.com/emicklei/go-restful.(*Container).Dispatch(...)\nn/Users/angoldst/go/pkg/mod/github.com/emicklei/[email protected]+incompatible/container.go:199\nn8s.io/apiserver/pkg/server.director.ServeHTTP({{0x350d5f0, 0x0}, 0xc0010e4d80, 0xc00010e540}, {0x39b0350, 0xc0040af000}, 0xc00394bc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/handler.go:153 +0x646\nn8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc0029009c0, {0x39b0350, 0xc0040af000}, 0xc00394bc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/mux/pathrecorder.go:255 +0x3fc\nn8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0019c0510, {0x39b0350, 0xc0040af000}, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/mux/pathrecorder.go:235 +0x70\nn8s.io/apiserver/pkg/server.director.ServeHTTP({{0x350291b, 0x0}, 0xc0012638c0, 0xc000a17ab0}, {0x39b0350, 0xc0040af000}, 0xc00394bc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/handler.go:161 +0x82a\nn8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc002fd23c0, {0x39b0350, 0xc0040af000}, 0xc00394bc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/mux/pathrecorder.go:255 +0x3fc\nn8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0019c0510, {0x39b0350, 0xc0040af000}, 0xc001893a70)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/mux/pathrecorder.go:235 +0x70\nn8s.io/apiserver/pkg/server.director.ServeHTTP({{0x34fbdfc, 0xc0040b7b50}, 0xc000a43290, 0xc0000f93b0}, {0x39b0350, 0xc0040af000}, 0xc00394bc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/handler.go:161 +0x82a\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0x39b0350, 0xc0040af000}, 0xc00394bc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0xc000b58828, {0x39b0350, 0xc0040af000}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1({0x39b0350, 0xc0040af000}, 0xc00394bc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/authorization.go:64 +0x47d\nnet/http.HandlerFunc.ServeHTTP(0x5102138, {0x39b0350, 0xc0040af000}, 0x305a5e0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0x39b0350, 0xc0040af000}, 0xc00394bc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:79 +0x178\nnet/http.HandlerFunc.ServeHTTP(0xc002998bd0, {0x39b0350, 0xc0040af000}, 0x1)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1({0x39b0350, 0xc0040af000}, 0xc00394bc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/maxinflight.go:152 +0x304\nnet/http.HandlerFunc.ServeHTTP(0x0, {0x39b0350, 0xc0040af000}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0x39b0350, 0xc0040af000}, 0xc00394bc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0x0, {0x39b0350, 0xc0040af000}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1({0x39b0350, 0xc0040af000}, 0xc00394bc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/impersonation.go:50 +0x21c\nnet/http.HandlerFunc.ServeHTTP(0x5102138, {0x39b0350, 0xc0040af000}, 0x1)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0x39b0350, 0xc0040af000}, 0xc00394bc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:79 +0x178\nnet/http.HandlerFunc.ServeHTTP(0x0, {0x39b0350, 0xc0040af000}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0x39b0350, 0xc0040af000}, 0xc00394bc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0x5102138, {0x39b0350, 0xc0040af000}, 0x1)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0x39b0350, 0xc0040af000}, 0xc00394bc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:79 +0x178\nnet/http.HandlerFunc.ServeHTTP(0x0, {0x39b0350, 0xc0040af000}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0x39b0350, 0xc0040af000}, 0xc00394bc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc0040af000}, 0x3640888)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withAuthentication.func1({0x39b0350, 0xc0040af000}, 0xc00394bc00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/authentication.go:80 +0x83c\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc0040af000}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0x39b0350, 0xc0040af000}, 0xc00394ba00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:88 +0x46b\nnet/http.HandlerFunc.ServeHTTP(0xc00394ba00, {0x39b0350, 0xc0040af000}, 0x1626022)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc000b58948, {0x39b0350, 0xc0040af000}, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/timeout.go:85 +0x43d\nn8s.io/apiserver/pkg/endpoints/filters.withRequestDeadline.func1({0x39b0350, 0xc0040af000}, 0xc00394ba00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/request_deadline.go:66 +0x6fd\nnet/http.HandlerFunc.ServeHTTP(0x10c5ad3, {0x39b0350, 0xc0040af000}, 0x18)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1({0x39b0350, 0xc0040af000}, 0xc00394ba00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/waitgroup.go:59 +0x174\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc0040af000}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1({0x39b0350, 0xc0040af000}, 0xc00394b900)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/warning.go:35 +0x2bb\nnet/http.HandlerFunc.ServeHTTP(0x3314a20, {0x39b0350, 0xc0040af000}, 0xd)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1({0x39b0350, 0xc0040af000}, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/cachecontrol.go:31 +0x126\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc0040af000}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/httplog.WithLogging.func1({0x39a5880, 0xc003d641e0}, 0xc00394b800)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/httplog/httplog.go:103 +0x524\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39a5880, 0xc003d641e0}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1({0x39a5880, 0xc003d641e0}, 0xc00394b700)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/requestinfo.go:39 +0x316\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39a5880, 0xc003d641e0}, 0xc003d471e0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withRequestReceivedTimestampWithClock.func1({0x39a5880, 0xc003d641e0}, 0xc00394b600)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/request_received_time.go:38 +0x27e\nnet/http.HandlerFunc.ServeHTTP(0x160, {0x39a5880, 0xc003d641e0}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1({0x39a5880, 0xc003d641e0}, 0xc003d471e0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/wrap.go:74 +0xba\nnet/http.HandlerFunc.ServeHTTP(0x3314a20, {0x39a5880, 0xc003d641e0}, 0x8)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withAuditID.func1({0x39a5880, 0xc003d641e0}, 0xc00394b500)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/with_auditid.go:66 +0x40d\nnet/http.HandlerFunc.ServeHTTP(0x39be910, {0x39a5880, 0xc003d641e0}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nnithub.com/kcp-dev/kcp/pkg/server.ServeHTTP.func1({0x39a5880, 0xc003d641e0}, 0xc00394b400)\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/pkg/server/handler.go:83 +0x6d6\nnet/http.HandlerFunc.ServeHTTP(0xc00408e490, {0x39a5880, 0xc003d641e0}, 0x331b7a0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0xc0019c0548, {0x39a5880, 0xc003d641e0}, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/handler.go:196 +0x2b\nnet/http.serverHandler.ServeHTTP({0x0}, {0x39a5880, 0xc003d641e0}, 0xc00394b400)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2879 +0x43b\nnet/http.initALPNRequest.ServeHTTP({{0x39be9b8, 0xc0026fa3f0}, 0xc0014ff180, {0xc00077f180}}, {0x39a5880, 0xc003d641e0}, 0xc00394b400)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3480 +0x245\nnolang.org/x/net/http2.(*serverConn).runHandler(0x0, 0x0, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:2162 +0x78\nnreated by golang.org/x/net/http2.(*serverConn).processHeaders\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:1892 +0x510\nngoroutine 1394 [select]:\nn8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc0039461c0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:179 +0x1c7\nnreated by k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:128 +0x1ef\nngoroutine 1398 [select]:\nno.etcd.io/etcd/client/v3.(*watchGrpcStream).serveSubstream(0xc001b11040, 0xc00394c630, 0xc003c325a0)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/watch.go:803 +0x265\nnreated by go.etcd.io/etcd/client/v3.(*watchGrpcStream).run\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/watch.go:554 +0xed1\nngoroutine 1381 [select]:\nn8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc0039461c0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:296 +0x117\nnreated by k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/etcd3/watcher.go:177 +0x125\nngoroutine 1382 [select]:\nnontext.propagateCancel.func1()\nn/usr/local/Cellar/go/1.17.6/libexec/src/context/context.go:279 +0xa5\nnreated by context.propagateCancel\nn/usr/local/Cellar/go/1.17.6/libexec/src/context/context.go:278 +0x1d0\nngoroutine 1383 [select]:\nno.etcd.io/etcd/client/v3.(*watchGrpcStream).run(0xc001b11040)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/watch.go:537 +0x374\nnreated by go.etcd.io/etcd/client/v3.(*watcher).newWatcherGrpcStream\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/watch.go:285 +0x352\nngoroutine 1397 [select]:\nnoogle.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc0016a0eb0, {0xc0026f8d60, 0x5, 0x5})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:189 +0xaa\nnoogle.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc0016a0eb0, {0xc0026f8d60, 0xc003228528, 0xc0011d9a28})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:169 +0x147\nnoogle.golang.org/grpc/internal/transport.(*transportReader).Read(0xc003c0f1d0, {0xc0026f8d60, 0xc0011d9aa0, 0x20fa927})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:483 +0x32\nno.ReadAtLeast({0x396f840, 0xc003c0f1d0}, {0xc0026f8d60, 0x5, 0x5}, 0x5)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnoogle.golang.org/grpc/internal/transport.(*Stream).Read(0xc0029fa900, {0xc0026f8d60, 0x5, 0x5})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:467 +0xa5\nnoogle.golang.org/grpc.(*parser).recvMsg(0xc0026f8d50, 0x7fffffff)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/rpc_util.go:558 +0x47\nnoogle.golang.org/grpc.recvAndDecompress(0xc003f8e420, 0xc0029fa900, {0x0, 0x0}, 0x7fffffff, 0x0, {0x0, 0x0})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/rpc_util.go:689 +0x66\nnoogle.golang.org/grpc.recv(0xc003f8e4e0, {0xd104330, 0x5102138}, 0xc002634780, {0x0, 0x0}, {0x3453ce0, 0xc000a4f1f0}, 0x0, 0x0, ...)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/rpc_util.go:757 +0x6e\nnoogle.golang.org/grpc.(*csAttempt).recvMsg(0xc003c05400, {0x3453ce0, 0xc000a4f1f0}, 0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:957 +0x2b0\nnoogle.golang.org/grpc.(*clientStream).RecvMsg.func1(0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:808 +0x25\nnoogle.golang.org/grpc.(*clientStream).withRetry(0xc0029fa5a0, 0xc0011d9e78, 0xc0011d9e48)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:662 +0x2f6\nnoogle.golang.org/grpc.(*clientStream).RecvMsg(0xc0029fa5a0, {0x3453ce0, 0xc000a4f1f0})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:807 +0x11f\nnithub.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc0026f8d68, {0x3453ce0, 0xc000a4f1f0})\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/client_metrics.go:160 +0x37\nno.etcd.io/etcd/api/v3/etcdserverpb.(*watchWatchClient).Recv(0xc003c36590)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/api/[email protected]/etcdserverpb/rpc.pb.go:6714 +0x4c\nno.etcd.io/etcd/client/v3.(*watchGrpcStream).serveWatchClient(0xc001b11040, {0x3a03650, 0xc003c36590})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/watch.go:757 +0x6a\nnreated by go.etcd.io/etcd/client/v3.(*watchGrpcStream).newWatchClient\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/watch.go:912 +0x4e5\nngoroutine 1385 [select]:\nnoogle.golang.org/grpc.newClientStreamWithParams.func4()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:363 +0x98\nnreated by google.golang.org/grpc.newClientStreamWithParams\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:362 +0x1066\nngoroutine 1386 [select]:\nnoogle.golang.org/grpc/internal/transport.(*serverHandlerTransport).runStream(0xc001bc54d0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:426 +0x85\nnoogle.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams(0xc001bc54d0, 0xc003c94060, 0x3a055d8)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:416 +0x7dc\nnoogle.golang.org/grpc.(*Server).serveStreams(0xc000826c40, {0x3a055d8, 0xc001bc54d0})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:918 +0x142\nnoogle.golang.org/grpc.(*Server).ServeHTTP(0xc000826c40, {0x39b1d90, 0xc0032461b8}, 0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:987 +0x10b\nno.etcd.io/etcd/server/v3/embed.grpcHandlerFunc.func2({0x39b1d90, 0xc0032461b8}, 0xc003c0c300)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/serve.go:208 +0xc5\nnet/http.HandlerFunc.ServeHTTP(0x3149340, {0x39b1d90, 0xc0032461b8}, 0xc003c94000)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nnet/http.(*ServeMux).ServeHTTP(0x39b1d90, {0x39b1d90, 0xc0032461b8}, 0xc003c0c300)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2425 +0x149\nno.etcd.io/etcd/server/v3/embed.(*accessController).ServeHTTP(0xc0006a6870, {0x39b1d90, 0xc0032461b8}, 0xc003c0c300)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/serve.go:355 +0x50f\nnet/http.serverHandler.ServeHTTP({0x0}, {0x39b1d90, 0xc0032461b8}, 0xc003c0c300)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2879 +0x43b\nnet/http.initALPNRequest.ServeHTTP({{0x39be9b8, 0xc00099e120}, 0xc000716380, {0xc0003d0700}}, {0x39b1d90, 0xc0032461b8}, 0xc003c0c300)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3480 +0x245\nnet/http.(*http2serverConn).runHandler(0x0, 0x0, 0x0, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:5849 +0x78\nnreated by net/http.(*http2serverConn).processHeaders\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:5579 +0x510\nngoroutine 1366 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc00381ac90, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x399f400)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/util/workqueue.(*Type).Get(0xc000859e00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:151 +0x9e\nn8s.io/kubernetes/pkg/controlplane/controller/clusterauthenticationtrust.(*Controller).processNextWorkItem(0xc0007245b0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/[email protected]/pkg/controlplane/controller/clusterauthenticationtrust/cluster_authentication_trust_controller.go:475 +0x5e\nn8s.io/kubernetes/pkg/controlplane/controller/clusterauthenticationtrust.(*Controller).runWorker(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/[email protected]/pkg/controlplane/controller/clusterauthenticationtrust/cluster_authentication_trust_controller.go:468\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd450dd8)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0040867a0, {0x39705a0, 0xc003f8e840}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0040a7840, 0x3b9aca00, 0x0, 0x20, 0x1040a25)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0x0, 0xc003d433e0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/kubernetes/pkg/controlplane/controller/clusterauthenticationtrust.(*Controller).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/[email protected]/pkg/controlplane/controller/clusterauthenticationtrust/cluster_authentication_trust_controller.go:452 +0x31f\nngoroutine 1367 [select]:\nn8s.io/apimachinery/pkg/util/wait.contextForChannel.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:298 +0x77\nnreated by k8s.io/apimachinery/pkg/util/wait.contextForChannel\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:297 +0xc8\nngoroutine 1350 [select]:\nnoogle.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams.func1()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:344 +0xdb\nnreated by google.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:343 +0x125\nngoroutine 1351 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc001e57188, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0xc004086ec0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nnet/http.(*http2pipe).Read(0xc001e57170, {0xc003f94581, 0x1f83, 0x1f83})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3618 +0xeb\nnet/http.(*http2requestBody).Read(0xc003c0f320, {0xc003f94581, 0x0, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:6006 +0xa5\nnoogle.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams.func5()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:395 +0xab\nnreated by google.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:389 +0x7bd\nngoroutine 1352 [select]:\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*watchServer).Watch(0xc0000be8c0, {0x3a036a8, 0xc000fd3960})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/watch.go:209 +0x3c5\nno.etcd.io/etcd/api/v3/etcdserverpb._Watch_Watch_Handler({0x3114f40, 0xc0000be8c0}, {0x39eac98, 0xc003090e28})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/api/[email protected]/etcdserverpb/rpc.pb.go:6743 +0x9f\nnithub.com/grpc-ecosystem/go-grpc-prometheus.(*ServerMetrics).StreamServerInterceptor.func1({0x3114f40, 0xc0000be8c0}, {0x39ec798, 0xc003090e10}, 0x3386c80, 0x3641bb0)\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/server_metrics.go:121 +0x109\nnithub.com/grpc-ecosystem/go-grpc-middleware.ChainStreamServer.func1.1.1({0x3114f40, 0xc0000be8c0}, {0x39ec798, 0xc003090e10})\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:49 +0x3a\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.newStreamInterceptor.func1({0x3114f40, 0xc0000be8c0}, {0x39eb3e8, 0xc003734780}, 0xc003090df8, 0xc0019d5b60)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/interceptor.go:252 +0x4f7\nnithub.com/grpc-ecosystem/go-grpc-middleware.ChainStreamServer.func1.1.1({0x3114f40, 0xc0000be8c0}, {0x39eb3e8, 0xc003734780})\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:49 +0x3a\nnithub.com/grpc-ecosystem/go-grpc-middleware.ChainStreamServer.func1({0x3114f40, 0xc0000be8c0}, {0x39eb3e8, 0xc003734780}, 0x345aa20, 0xc0027b50e0)\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:58 +0xbf\nnoogle.golang.org/grpc.(*Server).processStreamingRPC(0xc000826c40, {0x3a055d8, 0xc001bc54d0}, 0xc0027b50e0, 0xc0006a5440, 0x50843e0, 0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:1540 +0xcbb\nnoogle.golang.org/grpc.(*Server).handleStream(0xc000826c40, {0x3a055d8, 0xc001bc54d0}, 0xc0027b50e0, 0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:1613 +0x9e5\nnoogle.golang.org/grpc.(*Server).serveStreams.func1.2()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:934 +0x98\nnreated by google.golang.org/grpc.(*Server).serveStreams.func1\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:932 +0x294\nngoroutine 1353 [select]:\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*serverWatchStream).sendLoop(0xc003734840)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/watch.go:378 +0x272\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*watchServer).Watch.func1()\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/watch.go:179 +0x25\nnreated by go.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*watchServer).Watch\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/watch.go:178 +0x296\nngoroutine 1354 [select]:\nnoogle.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc001601180, {0xc003090df0, 0x5, 0x5})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:177 +0x96\nnoogle.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc001601180, {0xc003090df0, 0x3502597, 0x12})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:171 +0x16f\nnoogle.golang.org/grpc/internal/transport.(*transportReader).Read(0xc003c94120, {0xc003090df0, 0x3, 0x1})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:483 +0x32\nno.ReadAtLeast({0x396f840, 0xc003c94120}, {0xc003090df0, 0x5, 0x5}, 0x5)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnoogle.golang.org/grpc/internal/transport.(*Stream).Read(0xc0027b50e0, {0xc003090df0, 0x5, 0x5})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:467 +0xa5\nnoogle.golang.org/grpc.(*parser).recvMsg(0xc003090de0, 0x200000)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/rpc_util.go:558 +0x47\nnoogle.golang.org/grpc.recvAndDecompress(0x8, 0xc0027b50e0, {0x0, 0x0}, 0x200000, 0x0, {0x0, 0x0})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/rpc_util.go:689 +0x66\nnoogle.golang.org/grpc.recv(0xc003f20b30, {0xd0dbdc0, 0x5102138}, 0x3, {0x0, 0x0}, {0x3435a20, 0xc003c94420}, 0xc003f20de0, 0x0, ...)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/rpc_util.go:757 +0x6e\nnoogle.golang.org/grpc.(*serverStream).RecvMsg(0xc003734780, {0x3435a20, 0xc003c94420})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:1545 +0x185\nnithub.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredServerStream).RecvMsg(0xc003090e28, {0x3435a20, 0xc003c94420})\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/server_metrics.go:164 +0x33\nno.etcd.io/etcd/api/v3/etcdserverpb.(*watchWatchServer).Recv(0xc000fd3960)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/api/[email protected]/etcdserverpb/rpc.pb.go:6762 +0x4c\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*serverWatchStream).recvLoop(0xc003734840)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/watch.go:240 +0x4c\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*watchServer).Watch.func2()\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/watch.go:189 +0x52\nnreated by go.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*watchServer).Watch\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/watch.go:188 +0x33f\nngoroutine 1430 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc000951dd0, 0xc)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x399f400)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/util/workqueue.(*Type).Get(0xc0019786c0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:151 +0x9e\nn8s.io/apiextensions-apiserver/pkg/controller/apiapproval.(*KubernetesAPIApprovalPolicyConformantConditionController).processNextWorkItem(0xc00043db80)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/apiapproval/apiapproval_controller.go:207 +0x58\nk8s.io/apiextensions-apiserver/pkg/controller/apiapproval.(*KubernetesAPIApprovalPolicyConformantConditionController).runWorker(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/apiapproval/apiapproval_controller.go:201\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd364730)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x5102138, {0x39705a0, 0xc003c952c0}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0x3b9aca00, 0x0, 0xd0, 0x1515176)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0x5102138, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/apiextensions-apiserver/pkg/controller/apiapproval.(*KubernetesAPIApprovalPolicyConformantConditionController).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/apiapproval/apiapproval_controller.go:194 +0x22e\nngoroutine 1443 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc000951bd0, 0xf)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x399f400)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/util/workqueue.(*Type).Get(0xc001978480)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:151 +0x9e\nn8s.io/apiextensions-apiserver/pkg/controller/nonstructuralschema.(*ConditionController).processNextWorkItem(0xc00043da90)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/nonstructuralschema/nonstructuralschema_controller.go:213 +0x58\nn8s.io/apiextensions-apiserver/pkg/controller/nonstructuralschema.(*ConditionController).runWorker(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/nonstructuralschema/nonstructuralschema_controller.go:207\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd4531f8)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x5102138, {0x39705a0, 0xc00106f350}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001066058, 0x3b9aca00, 0x0, 0xd0, 0x12e6276)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0x5102138, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/apiextensions-apiserver/pkg/controller/nonstructuralschema.(*ConditionController).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/nonstructuralschema/nonstructuralschema_controller.go:200 +0x22e\nngoroutine 1426 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd4b9e28, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc003484080, 0xc001ff0000, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc003484080, {0xc001ff0000, 0x205, 0x205})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc003484080, {0xc001ff0000, 0xc001ff0005, 0x22})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc002052008, {0xc001ff0000, 0xc001f5a8e8, 0xc001f5a928})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc0010bbc38, {0xc001ff0000, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc001beb778, {0x396c0e0, 0xc0010bbc38})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc001beb500, {0xd104358, 0xc002052008}, 0x203000)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc001beb500, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc001beb500, {0xc004054038, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc001beb500}, {0xc004054038, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc004054038, 0x9, 0xc00422c5e0}, {0xd0bd758, 0xc001beb500})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc004054000)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnolang.org/x/net/http2.(*serverConn).readFrames(0xc0037f6c00)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:739 +0x91\nnreated by golang.org/x/net/http2.(*serverConn).serve\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:845 +0x585\nngoroutine 1424 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc001a20150, 0xc)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x399f400)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/util/workqueue.(*Type).Get(0xc001978b40)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:151 +0x9e\nn8s.io/apiextensions-apiserver/pkg/controller/openapi.(*Controller).processNextWorkItem(0xc001978d20)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/openapi/controller.go:175 +0x52\nn8s.io/apiextensions-apiserver/pkg/controller/openapi.(*Controller).runWorker(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/openapi/controller.go:170\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd7ddec0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x5102138, {0x39705a0, 0xc004047d10}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x18, 0x3b9aca00, 0x0, 0xd0, 0x1515176)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0x5102138, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/apiextensions-apiserver/pkg/controller/openapi.(*Controller).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/openapi/controller.go:164 +0x67f\nngoroutine 1432 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc000951dd0, 0xe)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x399f400)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/util/workqueue.(*Type).Get(0xc0019786c0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:151 +0x9e\nn8s.io/apiextensions-apiserver/pkg/controller/apiapproval.(*KubernetesAPIApprovalPolicyConformantConditionController).processNextWorkItem(0xc00043db80)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/apiapproval/apiapproval_controller.go:207 +0x58\nn8s.io/apiextensions-apiserver/pkg/controller/apiapproval.(*KubernetesAPIApprovalPolicyConformantConditionController).runWorker(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/apiapproval/apiapproval_controller.go:201\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd364730)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x1094170, {0x39705a0, 0xc003c95320}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0x3b9aca00, 0x0, 0x1, 0x1040a25)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0x0, 0xc004052480, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/apiextensions-apiserver/pkg/controller/apiapproval.(*KubernetesAPIApprovalPolicyConformantConditionController).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/apiapproval/apiapproval_controller.go:194 +0x22e\nngoroutine 1444 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc000951bd0, 0xc)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x399f400)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/util/workqueue.(*Type).Get(0xc001978480)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:151 +0x9e\nn8s.io/apiextensions-apiserver/pkg/controller/nonstructuralschema.(*ConditionController).processNextWorkItem(0xc00043da90)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/nonstructuralschema/nonstructuralschema_controller.go:213 +0x58\nn8s.io/apiextensions-apiserver/pkg/controller/nonstructuralschema.(*ConditionController).runWorker(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/nonstructuralschema/nonstructuralschema_controller.go:207\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd4531f8)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x5102138, {0x39705a0, 0xc00106f380}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0x3b9aca00, 0x0, 0xd0, 0x1515176)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0x5102138, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/apiextensions-apiserver/pkg/controller/nonstructuralschema.(*ConditionController).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/nonstructuralschema/nonstructuralschema_controller.go:200 +0x22e\nngoroutine 1445 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc000951bd0, 0xd)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x399f400)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/util/workqueue.(*Type).Get(0xc001978480)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:151 +0x9e\nn8s.io/apiextensions-apiserver/pkg/controller/nonstructuralschema.(*ConditionController).processNextWorkItem(0xc00043da90)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/nonstructuralschema/nonstructuralschema_controller.go:213 +0x58\nn8s.io/apiextensions-apiserver/pkg/controller/nonstructuralschema.(*ConditionController).runWorker(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/nonstructuralschema/nonstructuralschema_controller.go:207\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd4531f8)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x0, {0x39705a0, 0xc00106f3b0}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0x3b9aca00, 0x0, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0x0, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/apiextensions-apiserver/pkg/controller/nonstructuralschema.(*ConditionController).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/nonstructuralschema/nonstructuralschema_controller.go:200 +0x22e\nngoroutine 1446 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc000951bd0, 0xe)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x399f400)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/util/workqueue.(*Type).Get(0xc001978480)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:151 +0x9e\nn8s.io/apiextensions-apiserver/pkg/controller/nonstructuralschema.(*ConditionController).processNextWorkItem(0xc00043da90)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/nonstructuralschema/nonstructuralschema_controller.go:213 +0x58\nn8s.io/apiextensions-apiserver/pkg/controller/nonstructuralschema.(*ConditionController).runWorker(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/nonstructuralschema/nonstructuralschema_controller.go:207\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd364730)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x0, {0x39705a0, 0xc003c95230}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0x3b9aca00, 0x0, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0x0, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/apiextensions-apiserver/pkg/controller/nonstructuralschema.(*ConditionController).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/nonstructuralschema/nonstructuralschema_controller.go:200 +0x22e\nngoroutine 1447 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc000951bd0, 0x10)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x399f400)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/util/workqueue.(*Type).Get(0xc001978480)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:151 +0x9e\nn8s.io/apiextensions-apiserver/pkg/controller/nonstructuralschema.(*ConditionController).processNextWorkItem(0xc00043da90)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/nonstructuralschema/nonstructuralschema_controller.go:213 +0x58\nn8s.io/apiextensions-apiserver/pkg/controller/nonstructuralschema.(*ConditionController).runWorker(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/nonstructuralschema/nonstructuralschema_controller.go:207\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd4531f8)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x0, {0x39705a0, 0xc00106f320}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0x3b9aca00, 0x0, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0x0, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/apiextensions-apiserver/pkg/controller/nonstructuralschema.(*ConditionController).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/nonstructuralschema/nonstructuralschema_controller.go:200 +0x22e\nngoroutine 1403 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc000950cd0, 0x3)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x399f400)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/util/workqueue.(*Type).Get(0xc001946f60)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:151 +0x9e\nn8s.io/apiextensions-apiserver/pkg/controller/establish.(*EstablishingController).processNextWorkItem(0xc000950d40)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/establish/establishing_controller.go:98 +0x58\nn8s.io/apiextensions-apiserver/pkg/controller/establish.(*EstablishingController).runWorker(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/establish/establishing_controller.go:91\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd4c06a0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x0, {0x39705a0, 0xc0040d2300}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00273f440, 0x3b9aca00, 0x0, 0xd8, 0xc00273f440)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0x2151200, 0xc0040a8480, 0xc00408efb8)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/apiextensions-apiserver/pkg/controller/establish.(*EstablishingController).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/establish/establishing_controller.go:85 +0x297\nngoroutine 1408 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc000951fd0, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/util/workqueue.(*Type).Get(0xc001978900)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:151 +0x9e\nn8s.io/apiextensions-apiserver/pkg/controller/finalizer.(*CRDFinalizer).processNextWorkItem(0xc00043dd10)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/finalizer/crd_finalizer.go:290 +0x58\nn8s.io/apiextensions-apiserver/pkg/controller/finalizer.(*CRDFinalizer).runWorker(...)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/finalizer/crd_finalizer.go:284\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd4c06a0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x0, {0x39705a0, 0xc0040d2390}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0x3b9aca00, 0x0, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0x0, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/apiextensions-apiserver/pkg/controller/finalizer.(*CRDFinalizer).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/controller/finalizer/crd_finalizer.go:277 +0x245\nngoroutine 1409 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc003158bd0, 0x1)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/util/workqueue.(*Type).Get(0xc00087c780)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:151 +0x9e\nn8s.io/kubernetes/pkg/controller/namespace.(*NamespaceController).worker.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/[email protected]/pkg/controller/namespace/namespace_controller.go:142 +0x59\nn8s.io/kubernetes/pkg/controller/namespace.(*NamespaceController).worker(0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/[email protected]/pkg/controller/namespace/namespace_controller.go:168 +0x33\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd4c06a0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x0, {0x39705a0, 0xc0040d2450}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0x3b9aca00, 0x0, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0x0, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/kubernetes/pkg/controller/namespace.(*NamespaceController).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/[email protected]/pkg/controller/namespace/namespace_controller.go:209 +0x319\nngoroutine 1474 [sync.Cond.Wait]:\nnync.runtime_notifyListWait(0xc003158bd0, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/sema.go:513 +0x13d\nnync.(*Cond).Wait(0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/sync/cond.go:56 +0x8c\nn8s.io/client-go/util/workqueue.(*Type).Get(0xc00087c780)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/util/workqueue/queue.go:151 +0x9e\nn8s.io/kubernetes/pkg/controller/namespace.(*NamespaceController).worker.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/[email protected]/pkg/controller/namespace/namespace_controller.go:142 +0x59\nn8s.io/kubernetes/pkg/controller/namespace.(*NamespaceController).worker(0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/[email protected]/pkg/controller/namespace/namespace_controller.go:168 +0x33\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xd4c06a0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x67\nn8s.io/apimachinery/pkg/util/wait.BackoffUntil(0x0, {0x39705a0, 0xc0040d2420}, 0x1, 0xc00022ac00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0xb6\nn8s.io/apimachinery/pkg/util/wait.JitterUntil(0x0, 0x3b9aca00, 0x0, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x89\nn8s.io/apimachinery/pkg/util/wait.Until(0x0, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x25\nnreated by k8s.io/kubernetes/pkg/controller/namespace.(*NamespaceController).Run\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/[email protected]/pkg/controller/namespace/namespace_controller.go:209 +0x319\nngoroutine 1454 [select]:\nnolang.org/x/net/http2.(*serverConn).serve(0xc0037f7380)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:853 +0x8ed\nnolang.org/x/net/http2.(*Server).ServeConn(0xc002fd2700, {0x3a03390, 0xc003197c00}, 0xc004219b48)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:466 +0xa71\nnolang.org/x/net/http2.ConfigureServer.func1(0xc00077f180, 0x3a03390, {0x39745e0, 0xc0041b1700})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:292 +0xe6\nnet/http.(*conn).serve(0xc00107e780, {0x39be9b8, 0xc002050060})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 1544 [select]:\nnoogle.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001601c20, 0x1)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:407 +0x11b\nnoogle.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc003fa9b00)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/controlbuf.go:527 +0x85\nnoogle.golang.org/grpc/internal/transport.newHTTP2Client.func3()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:396 +0x65\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:394 +0x1da5\nngoroutine 1558 [select]:\nnet/http.(*http2serverConn).serve(0xc003b13380)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4529 +0x8ed\nnet/http.(*http2Server).ServeConn(0xc00071e780, {0x3a03390, 0xc004176000}, 0xc00429db48)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4131 +0xa71\nnet/http.http2ConfigureServer.func1(0xc0003d0700, 0x3a03390, {0x39745e0, 0xc004209380})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:3957 +0xe6\nnet/http.(*conn).serve(0xc00107ec80, {0x39be9b8, 0xc00071cc60})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:1839 +0x6b8\nnreated by net/http.(*Server).Serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3034 +0x4e8\nngoroutine 1494 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd48acc8, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc004205380, 0xc00449c000, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc004205380, {0xc00449c000, 0x623c, 0x623c})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc004205380, {0xc00449c000, 0xc00449c005, 0x22})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc001066330, {0xc00449c000, 0x6, 0xc001f5b928})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnrypto/tls.(*atLeastReader).Read(0xc0010bb080, {0xc00449c000, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc003197e78, {0x396c0e0, 0xc0010bb080})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc003197c00, {0xd104358, 0xc001066330}, 0x203000)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc003197c00, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc003197c00, {0xc004054118, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc003197c00}, {0xc004054118, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnolang.org/x/net/http2.readFrameHeader({0xc004054118, 0x9, 0xc00422df60}, {0xd0bd758, 0xc003197c00})\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:237 +0x6e\nnolang.org/x/net/http2.(*Framer).ReadFrame(0xc0040540e0)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/frame.go:492 +0x95\nnolang.org/x/net/http2.(*serverConn).readFrames(0xc0037f7380)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:739 +0x91\nnreated by golang.org/x/net/http2.(*serverConn).serve\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:845 +0x585\nngoroutine 1534 [chan receive]:\nnoogle.golang.org/grpc.(*addrConn).resetTransport(0xc002988b00)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:1214 +0x48f\nnreated by google.golang.org/grpc.(*addrConn).connect\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/clientconn.go:844 +0x147\nngoroutine 1542 [select]:\nnoogle.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc00194d680)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:1421 +0x169\nnreated by google.golang.org/grpc/internal/transport.newHTTP2Client\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/http2_client.go:341 +0x1705\nngoroutine 1561 [IO wait]:\nnnternal/poll.runtime_pollWait(0xd48adb0, 0x72)\nn/usr/local/Cellar/go/1.17.6/libexec/src/runtime/netpoll.go:234 +0x89\nnnternal/poll.(*pollDesc).wait(0xc00415d600, 0xc004222300, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x32\nnnternal/poll.(*pollDesc).waitRead(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_poll_runtime.go:89\nnnternal/poll.(*FD).Read(0xc00415d600, {0xc004222300, 0x621, 0x621})\nn/usr/local/Cellar/go/1.17.6/libexec/src/internal/poll/fd_unix.go:167 +0x25a\nnet.(*netFD).Read(0xc00415d600, {0xc004222300, 0xc001f2e848, 0x125643a})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/fd_posix.go:56 +0x29\nnet.(*conn).Read(0xc0030c2500, {0xc004222300, 0xc00422230d, 0x0})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/net.go:183 +0x45\nnithub.com/soheilhy/cmux.(*bufferedReader).Read(0xc000211eb0, {0xc004222300, 0x614, 0x621})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/buffer.go:53 +0x13e\nnithub.com/soheilhy/cmux.(*MuxConn).Read(0x50fe906, {0xc004222300, 0x200aaaaaaaa, 0x10000000000002a})\nn/Users/angoldst/go/pkg/mod/github.com/soheilhy/[email protected]/cmux.go:297 +0x25\nnrypto/tls.(*atLeastReader).Read(0xc0010bbe30, {0xc004222300, 0x0, 0x100b48d})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:777 +0x3d\nnytes.(*Buffer).ReadFrom(0xc004176278, {0x396c0e0, 0xc0010bbe30})\nn/usr/local/Cellar/go/1.17.6/libexec/src/bytes/buffer.go:204 +0x98\nnrypto/tls.(*Conn).readFromUntil(0xc004176000, {0xd0b9570, 0xc000211ea0}, 0x203000)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:799 +0xe5\nnrypto/tls.(*Conn).readRecordOrCCS(0xc004176000, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:606 +0x112\nnrypto/tls.(*Conn).readRecord(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:574\nnrypto/tls.(*Conn).Read(0xc004176000, {0xc00422eab8, 0x9, 0x2})\nn/usr/local/Cellar/go/1.17.6/libexec/src/crypto/tls/conn.go:1277 +0x16f\nno.ReadAtLeast({0xd0bd758, 0xc004176000}, {0xc00422eab8, 0x9, 0x9}, 0x9)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:328 +0x9a\nno.ReadFull(...)\nn/usr/local/Cellar/go/1.17.6/libexec/src/io/io.go:347\nnet/http.http2readFrameHeader({0xc00422eab8, 0x9, 0xc0019db000}, {0xd0bd758, 0xc004176000})\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1555 +0x6e\nnet/http.(*http2Framer).ReadFrame(0xc00422ea80)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:1813 +0x95\nnet/http.(*http2serverConn).readFrames(0xc003b13380)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4415 +0x91\nnreated by net/http.(*http2serverConn).serve\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:4521 +0x585\nngoroutine 3104 [select]:\nnoogle.golang.org/grpc/internal/transport.(*Stream).waitOnHeader(0xc0025e0d80)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:322 +0x85\nnoogle.golang.org/grpc/internal/transport.(*Stream).RecvCompress(...)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:337\nnoogle.golang.org/grpc.(*csAttempt).recvMsg(0xc00369ba80, {0x342bb40, 0xc0001bd950}, 0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:943 +0xba\nnoogle.golang.org/grpc.(*clientStream).RecvMsg.func1(0x12)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:808 +0x25\nnoogle.golang.org/grpc.(*clientStream).withRetry(0xc0025e0b40, 0xc005059b58, 0xc005059b28)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:666 +0xd3\nnoogle.golang.org/grpc.(*clientStream).RecvMsg(0xc0025e0b40, {0x342bb40, 0xc0001bd950})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:807 +0x11f\nnoogle.golang.org/grpc.invoke({0x39be980, 0xc001b39b00}, {0x350a454, 0x203000}, {0x3465d60, 0xc0027e66c0}, {0x342bb40, 0xc0001bd950}, 0x0, {0xc001b39b60, ...})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/call.go:73 +0xd7\nnithub.com/grpc-ecosystem/go-grpc-prometheus.(*ClientMetrics).UnaryClientInterceptor.func1({0x39be980, 0xc001b39b00}, {0x350a454, 0x16}, {0x3465d60, 0xc0027e66c0}, {0x342bb40, 0xc0001bd950}, 0xd4a85b0, 0x3642228, ...)\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/client_metrics.go:112 +0x117\nnoogle.golang.org/grpc.(*ClientConn).Invoke(0x60, {0x39be980, 0xc001b39b00}, {0x350a454, 0x6}, {0x3465d60, 0xc0027e66c0}, {0x342bb40, 0xc0001bd950}, {0xc001b39b60, ...})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/call.go:35 +0x21f\nno.etcd.io/etcd/api/v3/etcdserverpb.(*kVClient).Range(0xc0030c2510, {0x39be980, 0xc001b39b00}, 0xc0005c2900, {0xc001b39b60, 0x4, 0x6})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/api/[email protected]/etcdserverpb/rpc.pb.go:6460 +0xc9\nno.etcd.io/etcd/client/v3.(*retryKVClient).Range(0xc00415b2c0, {0x39be980, 0xc001b39b00}, 0xc005059e68, {0x50ccce0, 0x3, 0x3})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/retry.go:105 +0x130\nno.etcd.io/etcd/client/v3.(*kv).Do(0xc0041671a0, {_, _}, {0x1, {0xc00076fe40, 0x10, 0x10}, {0x0, 0x0, 0x0}, ...})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/kv.go:149 +0x1e8\nno.etcd.io/etcd/client/v3.(*kv).Get(0xc00505a2b0, {0x39be980, 0xc001b39b00}, {0xc00076fe30, 0x305d3a0}, {0x0, 0x1f3cca7d3643, 0x10756de})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/kv.go:119 +0xdc\nn8s.io/apiserver/pkg/storage/storagebackend/factory.newETCD3HealthCheck.func2()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/storagebackend/factory/etcd3.go:107 +0x20d\nn8s.io/apiserver/pkg/server/options.(*EtcdOptions).addEtcdHealthEndpoint.func1(0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/options/etcd.go:230 +0x1b\nn8s.io/apiserver/pkg/server/healthz.(*healthzCheck).Check(0x396bf60, 0xc00390c030)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/healthz/healthz.go:211 +0x22\nn8s.io/apiserver/pkg/server/healthz.handleRootHealth.func1({0x39b0290, 0xc0006b0a20}, 0xc002f6c400)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/healthz/healthz.go:239 +0xa7a\nn8s.io/apiserver/pkg/endpoints/metrics.InstrumentHandlerFunc.func1({0xd7896d8, 0xc0006b0a18}, 0xc002f6c400)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/metrics/metrics.go:509 +0x2cc\nnet/http.HandlerFunc.ServeHTTP(0xc0010622f0, {0xd7896d8, 0xc0006b0a18}, 0x7)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc002fd23c0, {0xd7896d8, 0xc0006b0a18}, 0xc002f6c400)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/mux/pathrecorder.go:242 +0x250\nn8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc0010622f0, {0xd7896d8, 0xc0006b0a18}, 0xc0027e6630)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/mux/pathrecorder.go:235 +0x70\nn8s.io/apiserver/pkg/server.director.ServeHTTP({{0x34fbdfc, 0xc004394af8}, 0xc000a43290, 0xc0000f93b0}, {0xd7896d8, 0xc0006b0a18}, 0xc002f6c400)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/handler.go:161 +0x82a\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0xd7896d8, 0xc0006b0a18}, 0xc002f6c400)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0xc000b58828, {0xd7896d8, 0xc0006b0a18}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1({0xd7896d8, 0xc0006b0a18}, 0xc002f6c400)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/authorization.go:64 +0x47d\nnet/http.HandlerFunc.ServeHTTP(0x5102138, {0xd7896d8, 0xc0006b0a18}, 0x3f8999999999999a)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0xd7896d8, 0xc0006b0a18}, 0xc002f6c400)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:79 +0x178\nnet/http.HandlerFunc.ServeHTTP(0x508eae0, {0xd7896d8, 0xc0006b0a18}, 0x3)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1({0xd7896d8, 0xc0006b0a18}, 0xc002f6c400)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/maxinflight.go:187 +0x29d\nnet/http.HandlerFunc.ServeHTTP(0x0, {0xd7896d8, 0xc0006b0a18}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0xd7896d8, 0xc0006b0a18}, 0xc002f6c400)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0xc003f91c00, {0xd7896d8, 0xc0006b0a18}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1({0xd7896d8, 0xc0006b0a18}, 0xc002f6c400)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/impersonation.go:50 +0x21c\nnet/http.HandlerFunc.ServeHTTP(0x5102138, {0xd7896d8, 0xc0006b0a18}, 0x1)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0xd7896d8, 0xc0006b0a18}, 0xc002f6c400)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:79 +0x178\nnet/http.HandlerFunc.ServeHTTP(0x0, {0xd7896d8, 0xc0006b0a18}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0xd7896d8, 0xc0006b0a18}, 0xc002f6c400)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0x5102138, {0xd7896d8, 0xc0006b0a18}, 0x1)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0xd7896d8, 0xc0006b0a18}, 0xc002f6c400)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:79 +0x178\nnet/http.HandlerFunc.ServeHTTP(0x0, {0xd7896d8, 0xc0006b0a18}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0xd7896d8, 0xc0006b0a18}, 0xc002f6c400)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0xd7896d8, 0xc0006b0a18}, 0x3640888)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withAuthentication.func1({0xd7896d8, 0xc0006b0a18}, 0xc002f6c400)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/authentication.go:80 +0x83c\nnet/http.HandlerFunc.ServeHTTP(0x39be980, {0xd7896d8, 0xc0006b0a18}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0xd7896d8, 0xc0006b0a18}, 0xc002f6c200)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:88 +0x46b\nnet/http.HandlerFunc.ServeHTTP(0xc001198a80, {0xd7896d8, 0xc0006b0a18}, 0xc001f52f78)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/timeout.go:108 +0x99\nnreated by k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/timeout.go:94 +0x2d1\nngoroutine 3321 [select]:\nn8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc000b58948, {0x39b0350, 0xc0036d7e00}, 0xdf8475800)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/timeout.go:110 +0x33d\nn8s.io/apiserver/pkg/endpoints/filters.withRequestDeadline.func1({0x39b0350, 0xc0036d7e00}, 0xc0031d8400)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/request_deadline.go:101 +0x494\nnet/http.HandlerFunc.ServeHTTP(0x29c3f65, {0x39b0350, 0xc0036d7e00}, 0x399ac48)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1({0x39b0350, 0xc0036d7e00}, 0xc0031d8400)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/waitgroup.go:59 +0x174\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc0036d7e00}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1({0x39b0350, 0xc0036d7e00}, 0xc0031d8300)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/warning.go:35 +0x2bb\nnet/http.HandlerFunc.ServeHTTP(0x3314a20, {0x39b0350, 0xc0036d7e00}, 0xd)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1({0x39b0350, 0xc0036d7e00}, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/cachecontrol.go:31 +0x126\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc0036d7e00}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/httplog.WithLogging.func1({0x39a5880, 0xc0038245d0}, 0xc0031d8200)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/httplog/httplog.go:103 +0x524\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39a5880, 0xc0038245d0}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1({0x39a5880, 0xc0038245d0}, 0xc0031d8100)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/requestinfo.go:39 +0x316\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39a5880, 0xc0038245d0}, 0xc003bf3e40)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withRequestReceivedTimestampWithClock.func1({0x39a5880, 0xc0038245d0}, 0xc0031d8000)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/request_received_time.go:38 +0x27e\nnet/http.HandlerFunc.ServeHTTP(0x160, {0x39a5880, 0xc0038245d0}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1({0x39a5880, 0xc0038245d0}, 0xc003bf3e40)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/wrap.go:74 +0xba\nnet/http.HandlerFunc.ServeHTTP(0x3314a20, {0x39a5880, 0xc0038245d0}, 0x8)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withAuditID.func1({0x39a5880, 0xc0038245d0}, 0xc003cddf00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/with_auditid.go:66 +0x40d\nnet/http.HandlerFunc.ServeHTTP(0x39be910, {0x39a5880, 0xc0038245d0}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nnithub.com/kcp-dev/kcp/pkg/server.ServeHTTP.func1({0x39a5880, 0xc0038245d0}, 0xc003cdde00)\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/pkg/server/handler.go:83 +0x6d6\nnet/http.HandlerFunc.ServeHTTP(0xc000301680, {0x39a5880, 0xc0038245d0}, 0xc003f196c0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0x0, {0x39a5880, 0xc0038245d0}, 0xc000d3d4f0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/handler.go:196 +0x2b\nnet/http.serverHandler.ServeHTTP({0x0}, {0x39a5880, 0xc0038245d0}, 0xc003cdde00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2879 +0x43b\nnet/http.initALPNRequest.ServeHTTP({{0x39be9b8, 0xc002050180}, 0xc001beb500, {0xc00077f180}}, {0x39a5880, 0xc0038245d0}, 0xc003cdde00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3480 +0x245\nnolang.org/x/net/http2.(*serverConn).runHandler(0x0, 0x20f73a0, 0xc0038d08a0, 0xc000d3d7b8)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:2162 +0x78\nnreated by golang.org/x/net/http2.(*serverConn).processHeaders\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:1892 +0x510\nngoroutine 3088 [select]:\nnoogle.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams.func1()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:344 +0xdb\nnreated by google.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:343 +0x125\nngoroutine 3105 [select]:\nnoogle.golang.org/grpc/internal/transport.(*serverHandlerTransport).runStream(0xc002c3e240)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:426 +0x85\nnoogle.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams(0xc002c3e240, 0xc0020517d0, 0x3a055d8)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:416 +0x7dc\nnoogle.golang.org/grpc.(*Server).serveStreams(0xc000826c40, {0x3a055d8, 0xc002c3e240})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:918 +0x142\nnoogle.golang.org/grpc.(*Server).ServeHTTP(0xc000826c40, {0x39b1d90, 0xc0006b0a40}, 0xd7896d8)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:987 +0x10b\nno.etcd.io/etcd/server/v3/embed.grpcHandlerFunc.func2({0x39b1d90, 0xc0006b0a40}, 0xc002f6c600)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/serve.go:208 +0xc5\nnet/http.HandlerFunc.ServeHTTP(0x3149340, {0x39b1d90, 0xc0006b0a40}, 0xc002051770)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nnet/http.(*ServeMux).ServeHTTP(0x39b1d90, {0x39b1d90, 0xc0006b0a40}, 0xc002f6c600)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2425 +0x149\nno.etcd.io/etcd/server/v3/embed.(*accessController).ServeHTTP(0xc0006a6870, {0x39b1d90, 0xc0006b0a40}, 0xc002f6c600)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/serve.go:355 +0x50f\nnet/http.serverHandler.ServeHTTP({0x0}, {0x39b1d90, 0xc0006b0a40}, 0xc002f6c600)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2879 +0x43b\nnet/http.initALPNRequest.ServeHTTP({{0x39be9b8, 0xc00426c480}, 0xc004176000, {0xc0003d0700}}, {0x39b1d90, 0xc0006b0a40}, 0xc002f6c600)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3480 +0x245\nnet/http.(*http2serverConn).runHandler(0xc004153f80, 0x20f7301, 0x3972520, 0x5101ca0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:5849 +0x78\nnreated by net/http.(*http2serverConn).processHeaders\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:5579 +0x510\nngoroutine 3300 [select]:\nnoogle.golang.org/grpc/internal/transport.(*serverHandlerTransport).runStream(0xc004cab0e0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:426 +0x85\nnoogle.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams(0xc004cab0e0, 0xc0020508d0, 0x3a055d8)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:416 +0x7dc\nnoogle.golang.org/grpc.(*Server).serveStreams(0xc000826c40, {0x3a055d8, 0xc004cab0e0})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:918 +0x142\nnoogle.golang.org/grpc.(*Server).ServeHTTP(0xc000826c40, {0x39b1d90, 0xc004076398}, 0xd7896d8)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:987 +0x10b\nno.etcd.io/etcd/server/v3/embed.grpcHandlerFunc.func2({0x39b1d90, 0xc004076398}, 0xc0011fb300)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/serve.go:208 +0xc5\nnet/http.HandlerFunc.ServeHTTP(0x3149340, {0x39b1d90, 0xc004076398}, 0xc002050870)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nnet/http.(*ServeMux).ServeHTTP(0x39b1d90, {0x39b1d90, 0xc004076398}, 0xc0011fb300)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2425 +0x149\nno.etcd.io/etcd/server/v3/embed.(*accessController).ServeHTTP(0xc0006a6870, {0x39b1d90, 0xc004076398}, 0xc0011fb300)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/embed/serve.go:355 +0x50f\nnet/http.serverHandler.ServeHTTP({0x0}, {0x39b1d90, 0xc004076398}, 0xc0011fb300)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2879 +0x43b\nnet/http.initALPNRequest.ServeHTTP({{0x39be9b8, 0xc0014d12f0}, 0xc00076c380, {0xc0003d0700}}, {0x39b1d90, 0xc004076398}, 0xc0011fb300)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3480 +0x245\nnet/http.(*http2serverConn).runHandler(0x39a1318, 0x5102138, 0x0, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:5849 +0x78\nnreated by net/http.(*http2serverConn).processHeaders\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/h2_bundle.go:5579 +0x510\nngoroutine 3320 [select]:\nno.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).linearizableReadNotify(0xc000297800, {0x39be9b8, 0xc0020519b0})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/v3_server.go:879 +0x14f\nno.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).Range(0xc000297800, {0x39be9b8, 0xc002051920}, 0xc002c3e480)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/v3_server.go:117 +0x38a\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*kvServer).Range(0xc0006ce740, {0x39be9b8, 0xc002051920}, 0x0)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/key.go:46 +0x5b\nno.etcd.io/etcd/api/v3/etcdserverpb._KV_Range_Handler.func1({0x39be9b8, 0xc002051920}, {0x3465d60, 0xc002c3e480})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/api/[email protected]/etcdserverpb/rpc.pb.go:6563 +0x78\nnithub.com/grpc-ecosystem/go-grpc-prometheus.(*ServerMetrics).UnaryServerInterceptor.func1({0x39be9b8, 0xc002051920}, {0x3465d60, 0xc002c3e480}, 0xc000fb8900, 0xc0010bbbd8)\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/server_metrics.go:107 +0x87\nnithub.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1.1({0x39be9b8, 0xc002051920}, {0x3465d60, 0xc002c3e480})\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:25 +0x3a\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.newUnaryInterceptor.func1({0x39be9b8, 0xc002051920}, {0x3465d60, 0xc002c3e480}, 0xc002fcd9c8, 0xc000645fa0)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/interceptor.go:71 +0x290\nnithub.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1.1({0x39be9b8, 0xc002051920}, {0x3465d60, 0xc002c3e480})\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:25 +0x3a\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.newLogUnaryInterceptor.func1({0x39be9b8, 0xc002051920}, {0x3465d60, 0xc002c3e480}, 0xc000645f60, 0xc000645fc0)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/interceptor.go:78 +0xc2\nnithub.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1.1({0x39be9b8, 0xc002051920}, {0x3465d60, 0xc002c3e480})\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:25 +0x3a\nnithub.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1({0x39be9b8, 0xc002051920}, {0x3465d60, 0xc002c3e480}, 0xc002fcdbb8, 0x316a720)\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:34 +0xbf\nno.etcd.io/etcd/api/v3/etcdserverpb._KV_Range_Handler({0x32761e0, 0xc0006ce780}, {0x39be9b8, 0xc002051920}, 0xc002712540, 0xc0006a5230)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/api/[email protected]/etcdserverpb/rpc.pb.go:6565 +0x138\nnoogle.golang.org/grpc.(*Server).processUnaryRPC(0xc000826c40, {0x3a055d8, 0xc002c3e240}, 0xc0026327e0, 0xc0006a5380, 0x5092000, 0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:1286 +0xc8f\nnoogle.golang.org/grpc.(*Server).handleStream(0xc000826c40, {0x3a055d8, 0xc002c3e240}, 0xc0026327e0, 0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:1609 +0xa2a\nnoogle.golang.org/grpc.(*Server).serveStreams.func1.2()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:934 +0x98\nnreated by google.golang.org/grpc.(*Server).serveStreams.func1\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:932 +0x294\nngoroutine 3322 [select]:\nnoogle.golang.org/grpc/internal/transport.(*Stream).waitOnHeader(0xc002632b40)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:322 +0x85\nnoogle.golang.org/grpc/internal/transport.(*Stream).RecvCompress(...)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/transport.go:337\nnoogle.golang.org/grpc.(*csAttempt).recvMsg(0xc0036d7e80, {0x342bb40, 0xc0007191d0}, 0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:943 +0xba\nnoogle.golang.org/grpc.(*clientStream).RecvMsg.func1(0x12)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:808 +0x25\nnoogle.golang.org/grpc.(*clientStream).withRetry(0xc002632900, 0xc002ed3b58, 0xc002ed3b28)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:666 +0xd3\nnoogle.golang.org/grpc.(*clientStream).RecvMsg(0xc002632900, {0x342bb40, 0xc0007191d0})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/stream.go:807 +0x11f\nnoogle.golang.org/grpc.invoke({0x39be980, 0xc0027126c0}, {0x350a454, 0x203000}, {0x3465d60, 0xc002c3f8c0}, {0x342bb40, 0xc0007191d0}, 0x0, {0xc002712720, ...})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/call.go:73 +0xd7\nnithub.com/grpc-ecosystem/go-grpc-prometheus.(*ClientMetrics).UnaryClientInterceptor.func1({0x39be980, 0xc0027126c0}, {0x350a454, 0x16}, {0x3465d60, 0xc002c3f8c0}, {0x342bb40, 0xc0007191d0}, 0xd7d6660, 0x3642228, ...)\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/client_metrics.go:112 +0x117\nnoogle.golang.org/grpc.(*ClientConn).Invoke(0x60, {0x39be980, 0xc0027126c0}, {0x350a454, 0x6}, {0x3465d60, 0xc002c3f8c0}, {0x342bb40, 0xc0007191d0}, {0xc002712720, ...})\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/call.go:35 +0x21f\nno.etcd.io/etcd/api/v3/etcdserverpb.(*kVClient).Range(0xc0030c2510, {0x39be980, 0xc0027126c0}, 0xc00039ed80, {0xc002712720, 0x4, 0x6})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/api/[email protected]/etcdserverpb/rpc.pb.go:6460 +0xc9\nno.etcd.io/etcd/client/v3.(*retryKVClient).Range(0xc00415b2c0, {0x39be980, 0xc0027126c0}, 0x70, {0x50ccce0, 0x3, 0x3})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/retry.go:105 +0x130\nno.etcd.io/etcd/client/v3.(*kv).Do(0xc0041671a0, {_, _}, {0x1, {0xc003822400, 0x10, 0x10}, {0x0, 0x0, 0x0}, ...})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/kv.go:149 +0x1e8\nno.etcd.io/etcd/client/v3.(*kv).Get(0xc002ed42b0, {0x39be980, 0xc0027126c0}, {0xc0038223f0, 0x305d3a0}, {0x0, 0x1f3cca88ab2c, 0x10756de})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/client/[email protected]/kv.go:119 +0xdc\nn8s.io/apiserver/pkg/storage/storagebackend/factory.newETCD3HealthCheck.func2()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/storage/storagebackend/factory/etcd3.go:107 +0x20d\nn8s.io/apiserver/pkg/server/options.(*EtcdOptions).addEtcdHealthEndpoint.func1(0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/options/etcd.go:230 +0x1b\nn8s.io/apiserver/pkg/server/healthz.(*healthzCheck).Check(0x396bf60, 0xc0037ee0c0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/healthz/healthz.go:211 +0x22\nn8s.io/apiserver/pkg/server/healthz.handleRootHealth.func1({0x39b0290, 0xc0038245e0}, 0xc0031d8700)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/healthz/healthz.go:239 +0xa7a\nn8s.io/apiserver/pkg/endpoints/metrics.InstrumentHandlerFunc.func1({0xd7896d8, 0xc0038245d8}, 0xc0031d8700)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/metrics/metrics.go:509 +0x2cc\nnet/http.HandlerFunc.ServeHTTP(0xc003c3e0c0, {0xd7896d8, 0xc0038245d8}, 0x6)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/mux.(*pathHandler).ServeHTTP(0xc002fd23c0, {0xd7896d8, 0xc0038245d8}, 0xc0031d8700)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/mux/pathrecorder.go:242 +0x250\nn8s.io/apiserver/pkg/server/mux.(*PathRecorderMux).ServeHTTP(0xc003c3e0c0, {0xd7896d8, 0xc0038245d8}, 0xc002c3f7a0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/mux/pathrecorder.go:235 +0x70\nn8s.io/apiserver/pkg/server.director.ServeHTTP({{0x34fbdfc, 0xc0003bcaf8}, 0xc000a43290, 0xc0000f93b0}, {0xd7896d8, 0xc0038245d8}, 0xc0031d8700)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/handler.go:161 +0x82a\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0xd7896d8, 0xc0038245d8}, 0xc0031d8700)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0xc000b58828, {0xd7896d8, 0xc0038245d8}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithAuthorization.func1({0xd7896d8, 0xc0038245d8}, 0xc0031d8700)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/authorization.go:64 +0x47d\nnet/http.HandlerFunc.ServeHTTP(0x5102138, {0xd7896d8, 0xc0038245d8}, 0x3f8eb851eb851eb8)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0xd7896d8, 0xc0038245d8}, 0xc0031d8700)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:79 +0x178\nnet/http.HandlerFunc.ServeHTTP(0x508eae0, {0xd7896d8, 0xc0038245d8}, 0x3)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.WithMaxInFlightLimit.func1({0xd7896d8, 0xc0038245d8}, 0xc0031d8700)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/maxinflight.go:187 +0x29d\nnet/http.HandlerFunc.ServeHTTP(0x0, {0xd7896d8, 0xc0038245d8}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0xd7896d8, 0xc0038245d8}, 0xc0031d8700)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0xc0034d56e0, {0xd7896d8, 0xc0038245d8}, 0x10953f0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithImpersonation.func1({0xd7896d8, 0xc0038245d8}, 0xc0031d8700)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/impersonation.go:50 +0x21c\nnet/http.HandlerFunc.ServeHTTP(0x5102138, {0xd7896d8, 0xc0038245d8}, 0x1)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0xd7896d8, 0xc0038245d8}, 0xc0031d8700)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:79 +0x178\nnet/http.HandlerFunc.ServeHTTP(0x0, {0xd7896d8, 0xc0038245d8}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0xd7896d8, 0xc0038245d8}, 0xc0031d8700)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0x5102138, {0xd7896d8, 0xc0038245d8}, 0x1)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0xd7896d8, 0xc0038245d8}, 0xc0031d8700)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:79 +0x178\nnet/http.HandlerFunc.ServeHTTP(0x0, {0xd7896d8, 0xc0038245d8}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackCompleted.func1({0xd7896d8, 0xc0038245d8}, 0xc0031d8700)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:103 +0x1a5\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0xd7896d8, 0xc0038245d8}, 0x3640888)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withAuthentication.func1({0xd7896d8, 0xc0038245d8}, 0xc0031d8700)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/authentication.go:80 +0x83c\nnet/http.HandlerFunc.ServeHTTP(0x39be980, {0xd7896d8, 0xc0038245d8}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filterlatency.trackStarted.func1({0xd7896d8, 0xc0038245d8}, 0xc0031d8500)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filterlatency/filterlatency.go:88 +0x46b\nnet/http.HandlerFunc.ServeHTTP(0xc0038245d0, {0xd7896d8, 0xc0038245d8}, 0xc000d3d778)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP.func1()\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/timeout.go:108 +0x99\nnreated by k8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/timeout.go:94 +0x2d1\nngoroutine 3276 [select]:\nnoogle.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams.func1()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:344 +0xdb\nnreated by google.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:343 +0x125\nngoroutine 3318 [select]:\nnoogle.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams.func1()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:344 +0xdb\nnreated by google.golang.org/grpc/internal/transport.(*serverHandlerTransport).HandleStreams\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/internal/transport/handler_server.go:343 +0x125\nngoroutine 3278 [select]:\nno.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).linearizableReadNotify(0xc000297800, {0x39be9b8, 0xc0025e8db0})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/v3_server.go:879 +0x14f\nno.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).Range(0xc000297800, {0x39be9b8, 0xc0025e8d20}, 0xc0027c1560)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/v3_server.go:117 +0x38a\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*kvServer).Range(0xc0006ce740, {0x39be9b8, 0xc0025e8d20}, 0x0)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/key.go:46 +0x5b\nno.etcd.io/etcd/api/v3/etcdserverpb._KV_Range_Handler.func1({0x39be9b8, 0xc0025e8d20}, {0x3465d60, 0xc0027c1560})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/api/[email protected]/etcdserverpb/rpc.pb.go:6563 +0x78\nnithub.com/grpc-ecosystem/go-grpc-prometheus.(*ServerMetrics).UnaryServerInterceptor.func1({0x39be9b8, 0xc0025e8d20}, {0x3465d60, 0xc0027c1560}, 0xc000fb8900, 0xc00096ad38)\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/server_metrics.go:107 +0x87\nnithub.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1.1({0x39be9b8, 0xc0025e8d20}, {0x3465d60, 0xc0027c1560})\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:25 +0x3a\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.newUnaryInterceptor.func1({0x39be9b8, 0xc0025e8d20}, {0x3465d60, 0xc0027c1560}, 0xc0033439c8, 0xc000154ec0)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/interceptor.go:71 +0x290\nnithub.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1.1({0x39be9b8, 0xc0025e8d20}, {0x3465d60, 0xc0027c1560})\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:25 +0x3a\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.newLogUnaryInterceptor.func1({0x39be9b8, 0xc0025e8d20}, {0x3465d60, 0xc0027c1560}, 0xc000154ea0, 0xc000154ee0)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/interceptor.go:78 +0xc2\nnithub.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1.1({0x39be9b8, 0xc0025e8d20}, {0x3465d60, 0xc0027c1560})\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:25 +0x3a\nnithub.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1({0x39be9b8, 0xc0025e8d20}, {0x3465d60, 0xc0027c1560}, 0xc003343bb8, 0x316a720)\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:34 +0xbf\nno.etcd.io/etcd/api/v3/etcdserverpb._KV_Range_Handler({0x32761e0, 0xc0006ce780}, {0x39be9b8, 0xc0025e8d20}, 0xc001afa120, 0xc0006a5230)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/api/[email protected]/etcdserverpb/rpc.pb.go:6565 +0x138\nnoogle.golang.org/grpc.(*Server).processUnaryRPC(0xc000826c40, {0x3a055d8, 0xc004cab0e0}, 0xc002632240, 0xc0006a5380, 0x5092000, 0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:1286 +0xc8f\nnoogle.golang.org/grpc.(*Server).handleStream(0xc000826c40, {0x3a055d8, 0xc004cab0e0}, 0xc002632240, 0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:1609 +0xa2a\nnoogle.golang.org/grpc.(*Server).serveStreams.func1.2()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:934 +0x98\nnreated by google.golang.org/grpc.(*Server).serveStreams.func1\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:932 +0x294\nngoroutine 3394 [select]:\nno.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).linearizableReadNotify(0xc000297800, {0x39be9b8, 0xc00390c660})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/v3_server.go:879 +0x14f\nno.etcd.io/etcd/server/v3/etcdserver.(*EtcdServer).Range(0xc000297800, {0x39be9b8, 0xc00390c5d0}, 0xc0027e6c60)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/v3_server.go:117 +0x38a\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.(*kvServer).Range(0xc0006ce740, {0x39be9b8, 0xc00390c5d0}, 0x0)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/key.go:46 +0x5b\nno.etcd.io/etcd/api/v3/etcdserverpb._KV_Range_Handler.func1({0x39be9b8, 0xc00390c5d0}, {0x3465d60, 0xc0027e6c60})\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/api/[email protected]/etcdserverpb/rpc.pb.go:6563 +0x78\nnithub.com/grpc-ecosystem/go-grpc-prometheus.(*ServerMetrics).UnaryServerInterceptor.func1({0x39be9b8, 0xc00390c5d0}, {0x3465d60, 0xc0027e6c60}, 0xc000fb8900, 0xc0006ea018)\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/server_metrics.go:107 +0x87\nnithub.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1.1({0x39be9b8, 0xc00390c5d0}, {0x3465d60, 0xc0027e6c60})\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:25 +0x3a\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.newUnaryInterceptor.func1({0x39be9b8, 0xc00390c5d0}, {0x3465d60, 0xc0027e6c60}, 0xc0033459c8, 0xc000967da0)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/interceptor.go:71 +0x290\nnithub.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1.1({0x39be9b8, 0xc00390c5d0}, {0x3465d60, 0xc0027e6c60})\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:25 +0x3a\nno.etcd.io/etcd/server/v3/etcdserver/api/v3rpc.newLogUnaryInterceptor.func1({0x39be9b8, 0xc00390c5d0}, {0x3465d60, 0xc0027e6c60}, 0xc000967d80, 0xc000967dc0)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/server/[email protected]/etcdserver/api/v3rpc/interceptor.go:78 +0xc2\nnithub.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1.1({0x39be9b8, 0xc00390c5d0}, {0x3465d60, 0xc0027e6c60})\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:25 +0x3a\nnithub.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1({0x39be9b8, 0xc00390c5d0}, {0x3465d60, 0xc0027e6c60}, 0xc003345bb8, 0x316a720)\nn/Users/angoldst/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:34 +0xbf\nno.etcd.io/etcd/api/v3/etcdserverpb._KV_Range_Handler({0x32761e0, 0xc0006ce780}, {0x39be9b8, 0xc00390c5d0}, 0xc001b39ec0, 0xc0006a5230)\nn/Users/angoldst/go/pkg/mod/go.etcd.io/etcd/api/[email protected]/etcdserverpb/rpc.pb.go:6565 +0x138\nnoogle.golang.org/grpc.(*Server).processUnaryRPC(0xc000826c40, {0x3a055d8, 0xc00509d8c0}, 0xc0027e9320, 0xc0006a5380, 0x5092000, 0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:1286 +0xc8f\nnoogle.golang.org/grpc.(*Server).handleStream(0xc000826c40, {0x3a055d8, 0xc00509d8c0}, 0xc0027e9320, 0x0)\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:1609 +0xa2a\nnoogle.golang.org/grpc.(*Server).serveStreams.func1.2()\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:934 +0x98\nnreated by google.golang.org/grpc.(*Server).serveStreams.func1\nn/Users/angoldst/go/pkg/mod/google.golang.org/[email protected]/server.go:932 +0x294\nngoroutine 3086 [select]:\nn8s.io/apiserver/pkg/server/filters.(*timeoutHandler).ServeHTTP(0xc000b58948, {0x39b0350, 0xc00369ba00}, 0xdf8475800)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/timeout.go:110 +0x33d\nn8s.io/apiserver/pkg/endpoints/filters.withRequestDeadline.func1({0x39b0350, 0xc00369ba00}, 0xc002f6c100)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/request_deadline.go:101 +0x494\nnet/http.HandlerFunc.ServeHTTP(0xc0033c1f8b, {0x39b0350, 0xc00369ba00}, 0xc0042c3340)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.WithWaitGroup.func1({0x39b0350, 0xc00369ba00}, 0xc002f6c100)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/waitgroup.go:59 +0x174\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc00369ba00}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithWarningRecorder.func1({0x39b0350, 0xc00369ba00}, 0xc002f6c000)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/warning.go:35 +0x2bb\nnet/http.HandlerFunc.ServeHTTP(0x3314a20, {0x39b0350, 0xc00369ba00}, 0xd)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithCacheControl.func1({0x39b0350, 0xc00369ba00}, 0x0)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/cachecontrol.go:31 +0x126\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39b0350, 0xc00369ba00}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/httplog.WithLogging.func1({0x39a5880, 0xc001198a80}, 0xc001477f00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/httplog/httplog.go:103 +0x524\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39a5880, 0xc001198a80}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.WithRequestInfo.func1({0x39a5880, 0xc001198a80}, 0xc001477e00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/requestinfo.go:39 +0x316\nnet/http.HandlerFunc.ServeHTTP(0x39be9b8, {0x39a5880, 0xc001198a80}, 0xc0030a2840)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withRequestReceivedTimestampWithClock.func1({0x39a5880, 0xc001198a80}, 0xc001477d00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/request_received_time.go:38 +0x27e\nnet/http.HandlerFunc.ServeHTTP(0x160, {0x39a5880, 0xc001198a80}, 0x0)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server/filters.withPanicRecovery.func1({0x39a5880, 0xc001198a80}, 0xc0030a2840)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/filters/wrap.go:74 +0xba\nnet/http.HandlerFunc.ServeHTTP(0x3314a20, {0x39a5880, 0xc001198a80}, 0x8)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/endpoints/filters.withAuditID.func1({0x39a5880, 0xc001198a80}, 0xc001477c00)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/endpoints/filters/with_auditid.go:66 +0x40d\nnet/http.HandlerFunc.ServeHTTP(0x39be910, {0x39a5880, 0xc001198a80}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nnithub.com/kcp-dev/kcp/pkg/server.ServeHTTP.func1({0x39a5880, 0xc001198a80}, 0xc003bdac00)\nn/Users/angoldst/go/src/github.com/kcp-dev/kcp/pkg/server/handler.go:83 +0x6d6\nnet/http.HandlerFunc.ServeHTTP(0xc001f52ca0, {0x39a5880, 0xc001198a80}, 0x3952488)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2047 +0x2f\nn8s.io/apiserver/pkg/server.(*APIServerHandler).ServeHTTP(0x0, {0x39a5880, 0xc001198a80}, 0x39be948)\nn/Users/angoldst/go/pkg/mod/github.com/kcp-dev/kubernetes/staging/src/k8s.io/[email protected]/pkg/server/handler.go:196 +0x2b\nnet/http.serverHandler.ServeHTTP({0x0}, {0x39a5880, 0xc001198a80}, 0xc003bdac00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:2879 +0x43b\nnet/http.initALPNRequest.ServeHTTP({{0x39be9b8, 0xc002050180}, 0xc001beb500, {0xc00077f180}}, {0x39a5880, 0xc001198a80}, 0xc003bdac00)\nn/usr/local/Cellar/go/1.17.6/libexec/src/net/http/server.go:3480 +0x245\nnolang.org/x/net/http2.(*serverConn).runHandler(0x39a1318, 0x5102138, 0x0, 0x0)\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:2162 +0x78\nnreated by golang.org/x/net/http2.(*serverConn).processHeaders\nn/Users/angoldst/go/pkg/mod/golang.org/x/[email protected]/http2/server.go:1892 +0x510\n | |
| test.go:137: error contacting /readyz: rate: Wait(n=1) would exceed context deadline | |
| test.go:137: error contacting /livez: rate: Wait(n=1) would exceed context deadline | |
| test.go:137: error contacting /readyz: Get "https://[::1]:60907/readyz": dial tcp [::1]:60907: connect: connection refused | |
| test.go:137: error contacting /livez: Get "https://[::1]:60907/livez": dial tcp [::1]:60907: connect: connection refused | |
| test.go:137: error contacting /readyz: Get "https://[::1]:60987/readyz": context deadline exceeded | |
| test.go:137: error contacting /livez: Get "https://[::1]:60987/livez": context deadline exceeded | |
| kcp.go:132: cleanup: ending kcp server | |
| kcp.go:132: cleanup: ending kcp server | |
| --- FAIL: TestIngressController/update_the_ingress_expect_the_sink_to_be_updated (72.18s) | |
| util.go:85: Saving test artifacts and data under /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestIngressControllerupdate_the_ingress_expect_the_sink_to_be_updated3675552822/001/TestIngressController/update_the_ingress_expect_the_sink_to_be_updated/3248463842. | |
| test.go:105: Starting kcp servers... | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestIngressControllerupdate_the_ingress_expect_the_sink_to_be_updated3675552822/001/TestIngressController/update_the_ingress_expect_the_sink_to_be_updated/3248463842/data/kcp/source --listen=:60901 --etcd-client-port=60906 --etcd-peer-port=60912 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig --push-mode --install-cluster-controller --auto-publish-apis=true --resources-to-sync=ingresses.networking.k8s.io,deployments.apps,services | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestIngressControllerupdate_the_ingress_expect_the_sink_to_be_updated3675552822/001/TestIngressController/update_the_ingress_expect_the_sink_to_be_updated/3248463842/data/kcp/sink --listen=:60969 --etcd-client-port=60981 --etcd-peer-port=60986 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig | |
| test.go:137: error contacting /livez: rate: Wait(n=1) would exceed context deadline | |
| test.go:137: error contacting /readyz: Get "https://[::1]:60901/readyz": context deadline exceeded | |
| test.go:137: error contacting /livez: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-cluster-controller ok\nlivez check failed") has prevented the request from succeeding | |
| test.go:137: error contacting /readyz: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]informer-sync ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-cluster-controller ok\n[+]shutdown ok\nreadyz check failed") has prevented the request from succeeding | |
| test.go:137: error contacting /readyz: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]informer-sync ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]shutdown ok\nreadyz check failed") has prevented the request from succeeding | |
| test.go:137: error contacting /livez: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\nlivez check failed") has prevented the request from succeeding | |
| kcp.go:132: cleanup: ending kcp server | |
| kcp.go:132: cleanup: ending kcp server | |
| FAIL | |
| FAIL github.com/kcp-dev/kcp/test/e2e/reconciler/ingress 78.647s | |
| ok github.com/kcp-dev/kcp/test/e2e/reconciler/namespace 3.455s | |
| --- FAIL: TestWorkspaceController (0.00s) | |
| --- FAIL: TestWorkspaceController/create_a_workspace_without_shards,_expect_it_to_be_unschedulable (70.38s) | |
| util.go:85: Saving test artifacts and data under /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceControllercreate_a_workspace_without_shards,_expect_it_to_be_unschedulable1197436190/001/TestWorkspaceController/create_a_workspace_without_shards,_expect_it_to_be_unschedulable/418949233. | |
| test.go:105: Starting kcp servers... | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceControllercreate_a_workspace_without_shards,_expect_it_to_be_unschedulable1197436190/001/TestWorkspaceController/create_a_workspace_without_shards,_expect_it_to_be_unschedulable/418949233/data/kcp/main --listen=:60705 --etcd-client-port=60716 --etcd-peer-port=60726 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig --install-workspace-controller | |
| test.go:137: error contacting /livez: Get "https://[::1]:60705/livez": context deadline exceeded | |
| test.go:137: error contacting /readyz: Get "https://[::1]:60705/readyz": context deadline exceeded | |
| kcp.go:132: cleanup: ending kcp server | |
| --- FAIL: TestWorkspaceController/create_a_workspace_with_a_shard,_expect_it_to_be_scheduled (70.40s) | |
| util.go:85: Saving test artifacts and data under /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceControllercreate_a_workspace_with_a_shard,_expect_it_to_be_scheduled3851416540/001/TestWorkspaceController/create_a_workspace_with_a_shard,_expect_it_to_be_scheduled/1688130436. | |
| test.go:105: Starting kcp servers... | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceControllercreate_a_workspace_with_a_shard,_expect_it_to_be_scheduled3851416540/001/TestWorkspaceController/create_a_workspace_with_a_shard,_expect_it_to_be_scheduled/1688130436/data/kcp/main --listen=:60707 --etcd-client-port=60723 --etcd-peer-port=60738 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig --install-workspace-controller | |
| test.go:137: error contacting /livez: Get "https://[::1]:60707/livez": context deadline exceeded | |
| test.go:137: error contacting /readyz: Get "https://[::1]:60707/readyz": context deadline exceeded | |
| kcp.go:132: cleanup: ending kcp server | |
| --- FAIL: TestWorkspaceController/create_a_workspace_with_a_shard_that_has_credentials,_expect_workspace_to_have_base_URL (70.40s) | |
| util.go:85: Saving test artifacts and data under /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceControllercreate_a_workspace_with_a_shard_that_has_credentials,_expect_workspace_to_have_base_URL93453421/001/TestWorkspaceController/create_a_workspace_with_a_shard_that_has_credentials,_expect_workspace_to_have_base_URL/1198786446. | |
| test.go:105: Starting kcp servers... | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceControllercreate_a_workspace_with_a_shard_that_has_credentials,_expect_workspace_to_have_base_URL93453421/001/TestWorkspaceController/create_a_workspace_with_a_shard_that_has_credentials,_expect_workspace_to_have_base_URL/1198786446/data/kcp/main --listen=:60708 --etcd-client-port=60734 --etcd-peer-port=60746 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig --install-workspace-controller | |
| test.go:137: error contacting /livez: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-workspace-controller ok\nlivez check failed") has prevented the request from succeeding | |
| test.go:137: error contacting /readyz: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]informer-sync ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-workspace-controller ok\n[+]shutdown ok\nreadyz check failed") has prevented the request from succeeding | |
| kcp.go:132: cleanup: ending kcp server | |
| --- FAIL: TestWorkspaceController/delete_all_shards,_expect_workspace_to_be_unschedulable (70.46s) | |
| util.go:85: Saving test artifacts and data under /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceControllerdelete_all_shards,_expect_workspace_to_be_unschedulable2091371800/001/TestWorkspaceController/delete_all_shards,_expect_workspace_to_be_unschedulable/3042785190. | |
| test.go:105: Starting kcp servers... | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceControllerdelete_all_shards,_expect_workspace_to_be_unschedulable2091371800/001/TestWorkspaceController/delete_all_shards,_expect_workspace_to_be_unschedulable/3042785190/data/kcp/main --listen=:60706 --etcd-client-port=60717 --etcd-peer-port=60732 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig --install-workspace-controller | |
| test.go:137: error contacting /livez: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-workspace-controller ok\nlivez check failed") has prevented the request from succeeding | |
| test.go:137: error contacting /readyz: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]informer-sync ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-workspace-controller ok\n[+]shutdown ok\nreadyz check failed") has prevented the request from succeeding | |
| kcp.go:132: cleanup: ending kcp server | |
| --- FAIL: TestWorkspaceController/delete_a_shard_that_a_workspace_is_scheduled_to,_expect_it_to_move_to_another_shard (70.61s) | |
| util.go:85: Saving test artifacts and data under /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceControllerdelete_a_shard_that_a_workspace_is_scheduled_to,_expect_it_to_move_to_another_shard1293642788/001/TestWorkspaceController/delete_a_shard_that_a_workspace_is_scheduled_to,_expect_it_to_move_to_another_shard/3077842649. | |
| test.go:105: Starting kcp servers... | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceControllerdelete_a_shard_that_a_workspace_is_scheduled_to,_expect_it_to_move_to_another_shard1293642788/001/TestWorkspaceController/delete_a_shard_that_a_workspace_is_scheduled_to,_expect_it_to_move_to_another_shard/3077842649/data/kcp/main --listen=:60709 --etcd-client-port=60727 --etcd-peer-port=60737 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig --install-workspace-controller | |
| test.go:137: error contacting /readyz: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]informer-sync ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-workspace-controller ok\n[+]shutdown ok\nreadyz check failed") has prevented the request from succeeding | |
| test.go:137: error contacting /livez: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-workspace-controller ok\nlivez check failed") has prevented the request from succeeding | |
| kcp.go:132: cleanup: ending kcp server | |
| --- FAIL: TestWorkspaceController/add_a_shard_after_a_workspace_is_unschedulable,_expect_it_to_be_scheduled (70.79s) | |
| util.go:85: Saving test artifacts and data under /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceControlleradd_a_shard_after_a_workspace_is_unschedulable,_expect_it_to_be_scheduled1729084160/001/TestWorkspaceController/add_a_shard_after_a_workspace_is_unschedulable,_expect_it_to_be_scheduled/3732352618. | |
| test.go:105: Starting kcp servers... | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceControlleradd_a_shard_after_a_workspace_is_unschedulable,_expect_it_to_be_scheduled1729084160/001/TestWorkspaceController/add_a_shard_after_a_workspace_is_unschedulable,_expect_it_to_be_scheduled/3732352618/data/kcp/main --listen=:60722 --etcd-client-port=60733 --etcd-peer-port=60741 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig --install-workspace-controller | |
| test.go:137: error contacting /readyz: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]informer-sync ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-workspace-controller ok\n[+]shutdown ok\nreadyz check failed") has prevented the request from succeeding | |
| test.go:137: error contacting /livez: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-workspace-controller ok\nlivez check failed") has prevented the request from succeeding | |
| kcp.go:132: cleanup: ending kcp server | |
| FAIL | |
| FAIL github.com/kcp-dev/kcp/test/e2e/reconciler/workspace 75.948s | |
| --- FAIL: TestWorkspaceIndex (0.00s) | |
| --- FAIL: TestWorkspaceIndex/test (74.23s) | |
| util.go:85: Saving test artifacts and data under /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceIndextest3045453284/001/TestWorkspaceIndex/test/2416207964. | |
| test.go:105: Starting kcp servers... | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceIndextest3045453284/001/TestWorkspaceIndex/test/2416207964/data/kcp/main --listen=:60610 --etcd-client-port=60611 --etcd-peer-port=60612 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig --install-workspace-controller | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceIndextest3045453284/001/TestWorkspaceIndex/test/2416207964/data/kcp/east --listen=:60625 --etcd-client-port=60638 --etcd-peer-port=60639 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig --install-workspace-controller | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceIndextest3045453284/001/TestWorkspaceIndex/test/2416207964/data/kcp/central --listen=:60643 --etcd-client-port=60647 --etcd-peer-port=60648 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig --install-workspace-controller | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceIndextest3045453284/001/TestWorkspaceIndex/test/2416207964/data/kcp/west --listen=:60649 --etcd-client-port=60655 --etcd-peer-port=60656 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig --install-workspace-controller | |
| test.go:137: error contacting /livez: Get "https://[::1]:60625/livez": context deadline exceeded | |
| test.go:137: error contacting /readyz: Get "https://[::1]:60625/readyz": context deadline exceeded | |
| test.go:137: error contacting /livez: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-workspace-controller ok\nlivez check failed") has prevented the request from succeeding | |
| test.go:137: error contacting /readyz: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]informer-sync ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-workspace-controller ok\n[+]shutdown ok\nreadyz check failed") has prevented the request from succeeding | |
| test.go:137: error contacting /livez: Get "https://[::1]:60643/livez": context deadline exceeded | |
| test.go:137: error contacting /readyz: Get "https://[::1]:60643/readyz": context deadline exceeded | |
| test.go:137: error contacting /livez: Get "https://[::1]:60610/livez": context deadline exceeded | |
| test.go:137: error contacting /readyz: Get "https://[::1]:60610/readyz": context deadline exceeded | |
| test.go:137: error contacting /livez: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-workspace-controller ok\nlivez check failed") has prevented the request from succeeding | |
| test.go:137: error contacting /readyz: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]informer-sync ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-workspace-controller ok\n[+]shutdown ok\nreadyz check failed") has prevented the request from succeeding | |
| test.go:137: error contacting /livez: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-workspace-controller ok\nlivez check failed") has prevented the request from succeeding | |
| test.go:137: error contacting /readyz: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]informer-sync ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-workspace-controller ok\n[+]shutdown ok\nreadyz check failed") has prevented the request from succeeding | |
| kcp.go:132: cleanup: ending kcp server | |
| kcp.go:132: cleanup: ending kcp server | |
| kcp.go:132: cleanup: ending kcp server | |
| kcp.go:132: cleanup: ending kcp server | |
| FAIL | |
| FAIL github.com/kcp-dev/kcp/test/e2e/reconciler/workspaceindex 78.564s | |
| --- FAIL: TestWorkspaceShardController (0.00s) | |
| --- FAIL: TestWorkspaceShardController/create_a_workspace_shard_referencing_credentials_without_data,_expect_to_see_status_reflect_invalid_credentials (70.42s) | |
| util.go:85: Saving test artifacts and data under /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceShardControllercreate_a_workspace_shard_referencing_credentials_without_data,_expect_to_see_status_reflect_invalid_credentials1687611359/001/TestWorkspaceShardController/create_a_workspace_shard_referencing_credentials_without_data,_expect_to_see_status_reflect_invalid_credentials/2203276861. | |
| test.go:105: Starting kcp servers... | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceShardControllercreate_a_workspace_shard_referencing_credentials_without_data,_expect_to_see_status_reflect_invalid_credentials1687611359/001/TestWorkspaceShardController/create_a_workspace_shard_referencing_credentials_without_data,_expect_to_see_status_reflect_invalid_credentials/2203276861/data/kcp/main --listen=:60469 --etcd-client-port=60472 --etcd-peer-port=60482 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig --install-workspace-controller | |
| test.go:137: error contacting /livez: Get "https://[::1]:60469/livez": context deadline exceeded | |
| test.go:137: error contacting /readyz: Get "https://[::1]:60469/readyz": context deadline exceeded | |
| kcp.go:132: cleanup: ending kcp server | |
| --- FAIL: TestWorkspaceShardController/create_a_workspace_shard_without_credentials,_expect_to_see_status_reflect_missing_credentials (71.05s) | |
| util.go:85: Saving test artifacts and data under /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceShardControllercreate_a_workspace_shard_without_credentials,_expect_to_see_status_reflect_missing_credentials3031100663/001/TestWorkspaceShardController/create_a_workspace_shard_without_credentials,_expect_to_see_status_reflect_missing_credentials/3347821261. | |
| test.go:105: Starting kcp servers... | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceShardControllercreate_a_workspace_shard_without_credentials,_expect_to_see_status_reflect_missing_credentials3031100663/001/TestWorkspaceShardController/create_a_workspace_shard_without_credentials,_expect_to_see_status_reflect_missing_credentials/3347821261/data/kcp/main --listen=:60467 --etcd-client-port=60468 --etcd-peer-port=60471 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig --install-workspace-controller | |
| test.go:137: error contacting /livez: Get "https://[::1]:60467/livez": context deadline exceeded | |
| test.go:137: error contacting /readyz: Get "https://[::1]:60467/readyz": context deadline exceeded | |
| kcp.go:132: cleanup: ending kcp server | |
| --- FAIL: TestWorkspaceShardController/update_credentials_for_shard,_see_credential_version_change (71.13s) | |
| util.go:85: Saving test artifacts and data under /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceShardControllerupdate_credentials_for_shard,_see_credential_version_change1047994706/001/TestWorkspaceShardController/update_credentials_for_shard,_see_credential_version_change/1668740607. | |
| test.go:105: Starting kcp servers... | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceShardControllerupdate_credentials_for_shard,_see_credential_version_change1047994706/001/TestWorkspaceShardController/update_credentials_for_shard,_see_credential_version_change/1668740607/data/kcp/main --listen=:60470 --etcd-client-port=60476 --etcd-peer-port=60486 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig --install-workspace-controller | |
| test.go:137: error contacting /livez: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-workspace-controller ok\nlivez check failed") has prevented the request from succeeding | |
| test.go:137: error contacting /readyz: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]informer-sync ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-workspace-controller ok\n[+]shutdown ok\nreadyz check failed") has prevented the request from succeeding | |
| kcp.go:132: cleanup: ending kcp server | |
| --- FAIL: TestWorkspaceShardController/create_a_workspace_shard_referencing_missing_credentials,_expect_to_see_status_reflect_missing_credentials (71.27s) | |
| util.go:85: Saving test artifacts and data under /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceShardControllercreate_a_workspace_shard_referencing_missing_credentials,_expect_to_see_status_reflect_missing_credentials318445158/001/TestWorkspaceShardController/create_a_workspace_shard_referencing_missing_credentials,_expect_to_see_status_reflect_missing_credentials/784284649. | |
| test.go:105: Starting kcp servers... | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceShardControllercreate_a_workspace_shard_referencing_missing_credentials,_expect_to_see_status_reflect_missing_credentials318445158/001/TestWorkspaceShardController/create_a_workspace_shard_referencing_missing_credentials,_expect_to_see_status_reflect_missing_credentials/784284649/data/kcp/main --listen=:60483 --etcd-client-port=60490 --etcd-peer-port=60497 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig --install-workspace-controller | |
| test.go:137: error contacting /livez: Get "https://[::1]:60483/livez": context deadline exceeded | |
| test.go:137: error contacting /readyz: Get "https://[::1]:60483/readyz": context deadline exceeded | |
| kcp.go:132: cleanup: ending kcp server | |
| --- FAIL: TestWorkspaceShardController/create_a_workspace_shard_referencing_valid_credentials,_expect_to_see_status_reflect_that (71.58s) | |
| util.go:85: Saving test artifacts and data under /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceShardControllercreate_a_workspace_shard_referencing_valid_credentials,_expect_to_see_status_reflect_that3083962100/001/TestWorkspaceShardController/create_a_workspace_shard_referencing_valid_credentials,_expect_to_see_status_reflect_that/76699755. | |
| test.go:105: Starting kcp servers... | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceShardControllercreate_a_workspace_shard_referencing_valid_credentials,_expect_to_see_status_reflect_that3083962100/001/TestWorkspaceShardController/create_a_workspace_shard_referencing_valid_credentials,_expect_to_see_status_reflect_that/76699755/data/kcp/main --listen=:60481 --etcd-client-port=60491 --etcd-peer-port=60498 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig --install-workspace-controller | |
| test.go:137: error contacting /readyz: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]informer-sync ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-workspace-controller ok\n[+]shutdown ok\nreadyz check failed") has prevented the request from succeeding | |
| test.go:137: error contacting /livez: an error on the server ("[+]ping ok\n[+]log ok\n[+]etcd ok\n[+]poststarthook/generic-apiserver-start-informers ok\n[+]poststarthook/max-in-flight-filter ok\n[+]poststarthook/start-apiextensions-informers ok\n[+]poststarthook/start-apiextensions-controllers ok\n[+]poststarthook/crd-informer-synced ok\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\n[+]poststarthook/priority-and-fairness-config-producer ok\n[+]poststarthook/start-cluster-authentication-info-controller ok\n[+]poststarthook/start-namespace-controller ok\n[+]poststarthook/FIXME-start-informers-for-crd-getter ok\n[+]poststarthook/wait-for-crd-server ok\n[+]poststarthook/install-workspace-controller ok\nlivez check failed") has prevented the request from succeeding | |
| kcp.go:132: cleanup: ending kcp server | |
| --- FAIL: TestWorkspaceShardController/create_a_workspace_shard_referencing_credentials_with_invalid_data,_expect_to_see_status_reflect_invalid_credentials (71.68s) | |
| util.go:85: Saving test artifacts and data under /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceShardControllercreate_a_workspace_shard_referencing_credentials_with_invalid_data,_expect_to_see_status_reflect_invalid_credentials3567688681/001/TestWorkspaceShardController/create_a_workspace_shard_referencing_credentials_with_invalid_data,_expect_to_see_status_reflect_invalid_credentials/639465421. | |
| test.go:105: Starting kcp servers... | |
| kcp.go:137: running: kcp start --root-directory /var/folders/hf/d3p2y6v55zq4_q709t06cj4w0000gn/T/TestWorkspaceShardControllercreate_a_workspace_shard_referencing_credentials_with_invalid_data,_expect_to_see_status_reflect_invalid_credentials3567688681/001/TestWorkspaceShardController/create_a_workspace_shard_referencing_credentials_with_invalid_data,_expect_to_see_status_reflect_invalid_credentials/639465421/data/kcp/main --listen=:60480 --etcd-client-port=60487 --etcd-peer-port=60496 --etcd-wal-size-bytes=5000 --kubeconfig-path=admin.kubeconfig --install-workspace-controller | |
| test.go:137: error contacting /livez: Get "https://[::1]:60480/livez": context deadline exceeded | |
| test.go:137: error contacting /readyz: Get "https://[::1]:60480/readyz": context deadline exceeded | |
| kcp.go:132: cleanup: ending kcp server | |
| FAIL | |
| FAIL github.com/kcp-dev/kcp/test/e2e/reconciler/workspaceshard 74.394s | |
| ok github.com/kcp-dev/kcp/test/e2e/virtual/framework 76.392s | |
| ? github.com/kcp-dev/kcp/test/e2e/virtual/framework/compositecmd [no test files] | |
| ? github.com/kcp-dev/kcp/test/e2e/virtual/helpers [no test files] | |
| ok github.com/kcp-dev/kcp/test/e2e/virtual/workspaces 77.290s | |
| FAIL |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment