Skip to content

Instantly share code, notes, and snippets.

@smothiki
Created February 28, 2026 06:37
Show Gist options
  • Select an option

  • Save smothiki/ed58f2df65dbef2a73cfb4f7b6689222 to your computer and use it in GitHub Desktop.

Select an option

Save smothiki/ed58f2df65dbef2a73cfb4f7b6689222 to your computer and use it in GitHub Desktop.
make deploy kserve error log
kserve % make deploy-dev
# Move LLMISVC CRD to llmisvc folder
mv config/crd/full/serving.kserve.io_llminferenceservices.yaml config/crd/full/llmisvc/serving.kserve.io_llminferenceservices.yaml
mv config/crd/full/serving.kserve.io_llminferenceserviceconfigs.yaml config/crd/full/llmisvc/serving.kserve.io_llminferenceserviceconfigs.yaml
# Move LocalModel CRD to localmodel folder
mv config/crd/full/serving.kserve.io_localmodelcaches.yaml config/crd/full/localmodel/serving.kserve.io_localmodelcaches.yaml
mv config/crd/full/serving.kserve.io_localmodelnodegroups.yaml config/crd/full/localmodel/serving.kserve.io_localmodelnodegroups.yaml
mv config/crd/full/serving.kserve.io_localmodelnodes.yaml config/crd/full/localmodel/serving.kserve.io_localmodelnodes.yaml
# Copy the cluster role to the helm chart
cp config/rbac/auth_proxy_role.yaml charts/kserve-resources/templates/clusterrole.yaml
cat config/rbac/role.yaml >> charts/kserve-resources/templates/clusterrole.yaml
# Copy the llmisvc cluster role to the helm chart
cat config/rbac/llmisvc/role.yaml > charts/kserve-llmisvc-resources/templates/clusterrole.yaml
cat config/rbac/llmisvc/leader_election_role.yaml > charts/kserve-llmisvc-resources/templates/leader_election_role.yaml
# Copy the local model role with Helm chart while keeping the Helm template condition
echo '{{- if .Values.kserve.localmodel.enabled }}' > charts/kserve-resources/templates/localmodel/role.yaml
cat config/rbac/localmodel/role.yaml >> charts/kserve-resources/templates/localmodel/role.yaml
echo '{{- end }}' >> charts/kserve-resources/templates/localmodel/role.yaml
# Copy the local model node role with Helm chart while keeping the Helm template condition
echo '{{- if .Values.kserve.localmodel.enabled }}'> charts/kserve-resources/templates/localmodelnode/role.yaml
cat config/rbac/localmodelnode/role.yaml >> charts/kserve-resources/templates/localmodelnode/role.yaml
echo '{{- end }}' >> charts/kserve-resources/templates/localmodelnode/role.yaml
# Remove validation for the LLMInferenceServiceConfig API so that we can use Go templates to inject values at runtime.
# Note: v1alpha1 is at index 0, v1alpha2 is at index 1. These rules target v1alpha2 which has the full InferencePoolSpec.
# Remove pattern validation from InferencePool selector matchLabels to allow Go templates
# Remove validation for the LLMInferenceServiceConfig API so that we can override only specific values (both versions).
# Remove validation for the LLMInferenceService API so that we can override only specific values (both versions).
# DO NOT COPY to helm chart. It needs to be created before the Envoy Gateway or you will need to restart the Envoy Gateway controller.
# The llmisvc helm chart needs to be installed after the Envoy Gateway as well, so it needs to be created before the llmisvc helm chart.
kubectl kustomize https://github.com/kubernetes-sigs/gateway-api-inference-extension.git/config/crd?ref=v1.3.0 > test/crds/gateway-inference-extension.yaml
#remove the required property on framework as name field needs to be optional
#remove ephemeralContainers properties for compress crd size https://github.com/kubeflow/kfserving/pull/1141#issuecomment-714170602
#knative does not allow setting port on liveness or readiness probe
#With v1 and newer kubernetes protocol requires default
# TODO: Commenting out the following as it produces differences in verify codegen during release process
# Copy the crds to the helm chart
# cp config/crd/full/* charts/kserve-crd/templates
# rm charts/kserve-crd/templates/kustomization.yaml
# Generate minimal crd
./hack/minimal-crdgen.sh
Creating minimal CRD file: config/crd/minimal/serving.kserve.io_inferenceservices.yaml
Creating minimal CRD file: config/crd/minimal/serving.kserve.io_trainedmodels.yaml
Creating minimal CRD file: config/crd/minimal/serving.kserve.io_servingruntimes.yaml
Creating minimal CRD file: config/crd/minimal/serving.kserve.io_clusterstoragecontainers.yaml
Creating minimal CRD file: config/crd/minimal/serving.kserve.io_clusterservingruntimes.yaml
Creating minimal CRD file: config/crd/minimal/serving.kserve.io_inferencegraphs.yaml
Creating minimal CRD file: config/crd/minimal/llmisvc/serving.kserve.io_llminferenceserviceconfigs.yaml
Creating minimal CRD file: config/crd/minimal/llmisvc/serving.kserve.io_llminferenceservices.yaml
Creating minimal CRD file: config/crd/minimal/localmodel/serving.kserve.io_localmodelnodes.yaml
Creating minimal CRD file: config/crd/minimal/localmodel/serving.kserve.io_localmodelnodegroups.yaml
Creating minimal CRD file: config/crd/minimal/localmodel/serving.kserve.io_localmodelcaches.yaml
kubectl kustomize config/crd/full > test/crds/serving.kserve.io_all_crds.yaml
echo "---" >> test/crds/serving.kserve.io_all_crds.yaml
kubectl kustomize config/crd/full/llmisvc >> test/crds/serving.kserve.io_all_crds.yaml
echo "---" >> test/crds/serving.kserve.io_all_crds.yaml
kubectl kustomize config/crd/full/localmodel >> test/crds/serving.kserve.io_all_crds.yaml
# Copy the minimal crd to the helm chart
cp config/crd/minimal/*.yaml charts/kserve-crd-minimal/templates/
cp config/crd/minimal/llmisvc/*.yaml charts/kserve-llmisvc-crd-minimal/templates/
cp -f config/crd/minimal/localmodel/*.yaml charts/kserve-crd-minimal/templates/
cp -f config/crd/minimal/localmodel/*.yaml charts/kserve-llmisvc-crd-minimal/templates/
rm charts/kserve-crd-minimal/templates/kustomization.yaml
rm charts/kserve-llmisvc-crd-minimal/templates/kustomization.yaml
# Copy the full crd to the helm chart
cp config/crd/full/*.yaml charts/kserve-crd/templates/
# Copy llmisvc crd (with conversion webhook patches applied via kustomize)
kubectl kustomize config/crd/full/llmisvc | /Users/smothiki/goworld/src/github.com/kserve/kserve/bin/yq 'select(.metadata.name == "llminferenceservices.serving.kserve.io")' > charts/kserve-llmisvc-crd/templates/serving.kserve.io_llminferenceservices.yaml
kubectl kustomize config/crd/full/llmisvc | /Users/smothiki/goworld/src/github.com/kserve/kserve/bin/yq 'select(.metadata.name == "llminferenceserviceconfigs.serving.kserve.io")' > charts/kserve-llmisvc-crd/templates/serving.kserve.io_llminferenceserviceconfigs.yaml
cp -f config/crd/full/localmodel/*.yaml charts/kserve-crd/templates/
cp -f config/crd/full/localmodel/*.yaml charts/kserve-llmisvc-crd/templates/
rm charts/kserve-crd/templates/kustomization.yaml
rm charts/kserve-llmisvc-crd/templates/kustomization.yaml
cp config/configmap/inferenceservice.yaml config/overlays/test/configmap/inferenceservice.yaml
# Given that llmisvc CRs and CRDs are packaged together, when using kustomize build a race condition will occur.
# This is because before the CRD is registered to the api server, kustomize will attempt to create the CR.
# The below kubectl apply and kubectl wait commands are necessary to avoid this race condition.
kubectl apply --server-side=true --force-conflicts -k config/crd/full
customresourcedefinition.apiextensions.k8s.io/clusterservingruntimes.serving.kserve.io serverside-applied
customresourcedefinition.apiextensions.k8s.io/clusterstoragecontainers.serving.kserve.io serverside-applied
customresourcedefinition.apiextensions.k8s.io/inferencegraphs.serving.kserve.io serverside-applied
customresourcedefinition.apiextensions.k8s.io/inferenceservices.serving.kserve.io serverside-applied
customresourcedefinition.apiextensions.k8s.io/servingruntimes.serving.kserve.io serverside-applied
customresourcedefinition.apiextensions.k8s.io/trainedmodels.serving.kserve.io serverside-applied
kubectl apply --server-side=true --force-conflicts -k config/crd/full/localmodel
customresourcedefinition.apiextensions.k8s.io/localmodelcaches.serving.kserve.io serverside-applied
customresourcedefinition.apiextensions.k8s.io/localmodelnodegroups.serving.kserve.io serverside-applied
customresourcedefinition.apiextensions.k8s.io/localmodelnodes.serving.kserve.io serverside-applied
kubectl apply --server-side=true --force-conflicts -k config/crd/full/llmisvc
customresourcedefinition.apiextensions.k8s.io/llminferenceserviceconfigs.serving.kserve.io serverside-applied
customresourcedefinition.apiextensions.k8s.io/llminferenceservices.serving.kserve.io serverside-applied
kubectl wait --for=condition=established --timeout=60s crd/llminferenceserviceconfigs.serving.kserve.io
customresourcedefinition.apiextensions.k8s.io/llminferenceserviceconfigs.serving.kserve.io condition met
./hack/image_patch_dev.sh development
2026/02/27 21:44:03 Using base cgr.dev/chainguard/static:latest@sha256:11ec91f0372630a2ca3764cea6325bebb0189a514084463cbb3724e5bb350d14 for github.com/kserve/kserve/cmd/manager
2026/02/27 21:44:04 git doesn't contain any tags. Tag info will not be available
2026/02/27 21:44:04 Building github.com/kserve/kserve/cmd/manager for linux/amd64
2026/02/27 21:44:11 Publishing localhost:5001/manager-12782ae64d3f5f3dbe4595b05a2cb78d:latest
2026/02/27 21:44:11 pushed blob: sha256:3f21a50b0927b93695db2c9dc7ee29fa0802b1b1778e0ec97a5f2a5bad278149
2026/02/27 21:44:11 pushed blob: sha256:250c06f7c38e52dc77e5c7586c3e40280dc7ff9bb9007c396e06d96736cf8542
2026/02/27 21:44:11 pushed blob: sha256:290c75e4d07eb03cca7f7629f5ef88d67b3bbc0fd0bbe32d077d901ab3580709
2026/02/27 21:44:11 pushed blob: sha256:20530533eb3cf2f8e15d23d92488cf9b971a98db434d585ddde72d64f468892e
2026/02/27 21:44:11 localhost:5001/manager-12782ae64d3f5f3dbe4595b05a2cb78d:sha256-3b5df6b0b3722832b7883f655f57d227bf2b826fe1980478d156f03649642332.sbom: digest: sha256:1e40c021d8b7ada7ee0c623036fbbf13eff54bda8a056e9c3eee8cfa4bbbe1f2 size: 375
2026/02/27 21:44:11 Published SBOM localhost:5001/manager-12782ae64d3f5f3dbe4595b05a2cb78d:sha256-3b5df6b0b3722832b7883f655f57d227bf2b826fe1980478d156f03649642332.sbom
2026/02/27 21:44:11 pushed blob: sha256:990bd8377925cdff5ba0931d546df0d0e9e870d70aa67a43834c6c2a715008c8
2026/02/27 21:44:12 pushed blob: sha256:0633d935dd472ba9268225aa1badc72e7dd5e55ee37d2ed3c48dcd8bfa39b0f9
2026/02/27 21:44:12 localhost:5001/manager-12782ae64d3f5f3dbe4595b05a2cb78d:latest: digest: sha256:3b5df6b0b3722832b7883f655f57d227bf2b826fe1980478d156f03649642332 size: 1417
2026/02/27 21:44:12 Published localhost:5001/manager-12782ae64d3f5f3dbe4595b05a2cb78d@sha256:3b5df6b0b3722832b7883f655f57d227bf2b826fe1980478d156f03649642332
2026/02/27 21:44:12 Using base cgr.dev/chainguard/static:latest@sha256:11ec91f0372630a2ca3764cea6325bebb0189a514084463cbb3724e5bb350d14 for github.com/kserve/kserve/cmd/localmodel
2026/02/27 21:44:13 git doesn't contain any tags. Tag info will not be available
2026/02/27 21:44:13 Building github.com/kserve/kserve/cmd/localmodel for linux/amd64
2026/02/27 21:44:15 Publishing localhost:5001/localmodel-947d66b86a9d71ccec1fa4846616c875:latest
2026/02/27 21:44:15 pushed blob: sha256:250c06f7c38e52dc77e5c7586c3e40280dc7ff9bb9007c396e06d96736cf8542
2026/02/27 21:44:15 pushed blob: sha256:49f7fc421d2609c44280d68acd0b6dc8e75c82a4aa6fba273fe7b4407dec06b0
2026/02/27 21:44:15 pushed blob: sha256:c574cfbe77514617541456c4f8ad2bebc838605f67cb5db46cc1823c48a65c31
2026/02/27 21:44:15 pushed blob: sha256:08730945118f558520cc66af1463c2a1fca23352fd8b35adf79effd4a52466f7
2026/02/27 21:44:15 localhost:5001/localmodel-947d66b86a9d71ccec1fa4846616c875:sha256-e4c4056ab7e72cb3acd6bf4261f3fc592412309cb3fa77da631c963a3eb84a94.sbom: digest: sha256:53df8308ef2a0820c0eb9d6538c47439b1d3145025de4ded239ab6e154bc4eb4 size: 375
2026/02/27 21:44:15 Published SBOM localhost:5001/localmodel-947d66b86a9d71ccec1fa4846616c875:sha256-e4c4056ab7e72cb3acd6bf4261f3fc592412309cb3fa77da631c963a3eb84a94.sbom
2026/02/27 21:44:16 pushed blob: sha256:990bd8377925cdff5ba0931d546df0d0e9e870d70aa67a43834c6c2a715008c8
2026/02/27 21:44:16 pushed blob: sha256:49426307b4fdf242435f012eed61fcf962abaf9dac0bc5ee93e970f53dab0afd
2026/02/27 21:44:16 localhost:5001/localmodel-947d66b86a9d71ccec1fa4846616c875:latest: digest: sha256:e4c4056ab7e72cb3acd6bf4261f3fc592412309cb3fa77da631c963a3eb84a94 size: 1417
2026/02/27 21:44:16 Published localhost:5001/localmodel-947d66b86a9d71ccec1fa4846616c875@sha256:e4c4056ab7e72cb3acd6bf4261f3fc592412309cb3fa77da631c963a3eb84a94
2026/02/27 21:44:16 Using base cgr.dev/chainguard/static:latest@sha256:11ec91f0372630a2ca3764cea6325bebb0189a514084463cbb3724e5bb350d14 for github.com/kserve/kserve/cmd/llmisvc
2026/02/27 21:44:17 git doesn't contain any tags. Tag info will not be available
2026/02/27 21:44:17 Building github.com/kserve/kserve/cmd/llmisvc for linux/amd64
2026/02/27 21:44:20 Publishing localhost:5001/llmisvc-f05141cd6a12dd31b4d0ed7c874da89d:latest
2026/02/27 21:44:20 pushed blob: sha256:c8b8750a5cb3ffd296b0d7283d68de8a52a786f30c54b4643df5d69aa859cb56
2026/02/27 21:44:20 pushed blob: sha256:250c06f7c38e52dc77e5c7586c3e40280dc7ff9bb9007c396e06d96736cf8542
2026/02/27 21:44:20 pushed blob: sha256:9c8c6b647721f7c2ed4dbe24ff8b2e0b6c9c47682360358cdd89da227428ce9c
2026/02/27 21:44:20 pushed blob: sha256:0ad6c6c36fc2dc98b94f76d8b6eb8c399d5678a250cb759873ac66805b4a625b
2026/02/27 21:44:20 localhost:5001/llmisvc-f05141cd6a12dd31b4d0ed7c874da89d:sha256-3b692735d6fd36e1f1b04c4dcc272e6ee251efdcb83ad91b8a8185ba6ee64928.sbom: digest: sha256:d58f0a67de2e002c0e0f305ee0bd2cfdb76aa8334e8e955c70164cd4a9c02449 size: 375
2026/02/27 21:44:20 Published SBOM localhost:5001/llmisvc-f05141cd6a12dd31b4d0ed7c874da89d:sha256-3b692735d6fd36e1f1b04c4dcc272e6ee251efdcb83ad91b8a8185ba6ee64928.sbom
2026/02/27 21:44:21 pushed blob: sha256:990bd8377925cdff5ba0931d546df0d0e9e870d70aa67a43834c6c2a715008c8
2026/02/27 21:44:21 pushed blob: sha256:790939732eec2361df541a449db02bb90a02e4526f02fd3b3408f661f432db2f
2026/02/27 21:44:21 localhost:5001/llmisvc-f05141cd6a12dd31b4d0ed7c874da89d:latest: digest: sha256:3b692735d6fd36e1f1b04c4dcc272e6ee251efdcb83ad91b8a8185ba6ee64928 size: 1417
2026/02/27 21:44:21 Published localhost:5001/llmisvc-f05141cd6a12dd31b4d0ed7c874da89d@sha256:3b692735d6fd36e1f1b04c4dcc272e6ee251efdcb83ad91b8a8185ba6ee64928
2026/02/27 21:44:21 Using base cgr.dev/chainguard/static:latest@sha256:11ec91f0372630a2ca3764cea6325bebb0189a514084463cbb3724e5bb350d14 for github.com/kserve/kserve/cmd/localmodelnode
2026/02/27 21:44:22 git doesn't contain any tags. Tag info will not be available
2026/02/27 21:44:22 Building github.com/kserve/kserve/cmd/localmodelnode for linux/amd64
2026/02/27 21:44:24 Publishing localhost:5001/localmodelnode-fef2e276c81be6f82ccef85ba0d3aba4:latest
2026/02/27 21:44:24 pushed blob: sha256:250c06f7c38e52dc77e5c7586c3e40280dc7ff9bb9007c396e06d96736cf8542
2026/02/27 21:44:24 pushed blob: sha256:df202a0bdab69efe42a7bc01e196093694edee086ebdafa3620167c84774c3c9
2026/02/27 21:44:24 pushed blob: sha256:f6cd352bce28b9d0a5dc00098ebdff346db83dd7cfbc7f26facc0867dfb98445
2026/02/27 21:44:24 pushed blob: sha256:6e4504e182cca4652fca77a61711e8ae05c25bccd4bbc3469e45e789fbc4c023
2026/02/27 21:44:24 localhost:5001/localmodelnode-fef2e276c81be6f82ccef85ba0d3aba4:sha256-a15225cb1dfc2d33fc929b9869249016b7486511f9bb9cae27c9e99e111110e4.sbom: digest: sha256:d828fad9db6b573311faa94514abb6a6eba7d7ba01ef2a7896073f610dfe6be1 size: 375
2026/02/27 21:44:24 Published SBOM localhost:5001/localmodelnode-fef2e276c81be6f82ccef85ba0d3aba4:sha256-a15225cb1dfc2d33fc929b9869249016b7486511f9bb9cae27c9e99e111110e4.sbom
2026/02/27 21:44:25 pushed blob: sha256:990bd8377925cdff5ba0931d546df0d0e9e870d70aa67a43834c6c2a715008c8
2026/02/27 21:44:25 pushed blob: sha256:9ed70211c554afebc8f4e648bc6e929ef3dcbc8947ea322ced6672772f2ffcde
2026/02/27 21:44:25 localhost:5001/localmodelnode-fef2e276c81be6f82ccef85ba0d3aba4:latest: digest: sha256:a15225cb1dfc2d33fc929b9869249016b7486511f9bb9cae27c9e99e111110e4 size: 1417
2026/02/27 21:44:25 Published localhost:5001/localmodelnode-fef2e276c81be6f82ccef85ba0d3aba4@sha256:a15225cb1dfc2d33fc929b9869249016b7486511f9bb9cae27c9e99e111110e4
2026/02/27 21:44:25 Using base cgr.dev/chainguard/static:latest@sha256:11ec91f0372630a2ca3764cea6325bebb0189a514084463cbb3724e5bb350d14 for github.com/kserve/kserve/cmd/agent
2026/02/27 21:44:26 git doesn't contain any tags. Tag info will not be available
2026/02/27 21:44:26 Building github.com/kserve/kserve/cmd/agent for linux/amd64
2026/02/27 21:44:29 Publishing localhost:5001/agent-59c2cdf0cc2970eed0581d28646561d9:latest
2026/02/27 21:44:29 pushed blob: sha256:250c06f7c38e52dc77e5c7586c3e40280dc7ff9bb9007c396e06d96736cf8542
2026/02/27 21:44:29 pushed blob: sha256:7a421230ba601a0026fae3430387dfc527a8776906f0f954cb6fd69f65ad717f
2026/02/27 21:44:29 pushed blob: sha256:428390c37d31b5422cd4f85eae1bc7f152f306509f0ae4773a364fb91c205e7d
2026/02/27 21:44:29 pushed blob: sha256:faa92772fa50149ed149947b298dde0c84e1aa984ec3ce8159c3ba8c1219ac8f
2026/02/27 21:44:29 localhost:5001/agent-59c2cdf0cc2970eed0581d28646561d9:sha256-0cdf057be203b254d86a2931cc17e63f665e4ac17634ea6221d965a3bc539895.sbom: digest: sha256:cd3d8f436b98fdc804e53c25572b3926185d8364b7b8349061cbc351dbd27615 size: 375
2026/02/27 21:44:29 Published SBOM localhost:5001/agent-59c2cdf0cc2970eed0581d28646561d9:sha256-0cdf057be203b254d86a2931cc17e63f665e4ac17634ea6221d965a3bc539895.sbom
2026/02/27 21:44:29 pushed blob: sha256:990bd8377925cdff5ba0931d546df0d0e9e870d70aa67a43834c6c2a715008c8
2026/02/27 21:44:29 pushed blob: sha256:5fa82b20c577f9c5d9327666f0978651349a8e704ad765ed8bde696d2770c452
2026/02/27 21:44:29 localhost:5001/agent-59c2cdf0cc2970eed0581d28646561d9:latest: digest: sha256:0cdf057be203b254d86a2931cc17e63f665e4ac17634ea6221d965a3bc539895 size: 1417
2026/02/27 21:44:29 Published localhost:5001/agent-59c2cdf0cc2970eed0581d28646561d9@sha256:0cdf057be203b254d86a2931cc17e63f665e4ac17634ea6221d965a3bc539895
2026/02/27 21:44:30 Using base cgr.dev/chainguard/static:latest@sha256:11ec91f0372630a2ca3764cea6325bebb0189a514084463cbb3724e5bb350d14 for github.com/kserve/kserve/cmd/router
2026/02/27 21:44:30 git doesn't contain any tags. Tag info will not be available
2026/02/27 21:44:30 Building github.com/kserve/kserve/cmd/router for linux/amd64
2026/02/27 21:44:32 Publishing localhost:5001/router-20acce65bc84b6e5b28ae59ce41635d3:latest
2026/02/27 21:44:33 pushed blob: sha256:250c06f7c38e52dc77e5c7586c3e40280dc7ff9bb9007c396e06d96736cf8542
2026/02/27 21:44:33 pushed blob: sha256:748ab7fddba285ab5b6928c18c9f0ba80e5de084ada567a0993731486164f426
2026/02/27 21:44:33 pushed blob: sha256:ebf38f116240838a073bddcf71dcac3cca096418428e758e8b916531ec7df4b8
2026/02/27 21:44:33 pushed blob: sha256:2a64285b72dd43890a7175da37a3524a4e33ca3e1d02c402cf1e0b6ee3be2c39
2026/02/27 21:44:33 localhost:5001/router-20acce65bc84b6e5b28ae59ce41635d3:sha256-bf6fecf38eb159228d73db27b9cf9aa2157d048b8fa82493b4292e4156111090.sbom: digest: sha256:4fc18f77449ee7f5e4e2e23d812deb27402f21563121bec155d4b170fb3ea50a size: 375
2026/02/27 21:44:33 Published SBOM localhost:5001/router-20acce65bc84b6e5b28ae59ce41635d3:sha256-bf6fecf38eb159228d73db27b9cf9aa2157d048b8fa82493b4292e4156111090.sbom
2026/02/27 21:44:33 pushed blob: sha256:990bd8377925cdff5ba0931d546df0d0e9e870d70aa67a43834c6c2a715008c8
2026/02/27 21:44:33 pushed blob: sha256:c5c609b95ef001d24eb5b6ae397673bf1ecf854457aa78bcb1bf1aacfd8597e6
2026/02/27 21:44:33 localhost:5001/router-20acce65bc84b6e5b28ae59ce41635d3:latest: digest: sha256:bf6fecf38eb159228d73db27b9cf9aa2157d048b8fa82493b4292e4156111090 size: 1417
2026/02/27 21:44:33 Published localhost:5001/router-20acce65bc84b6e5b28ae59ce41635d3@sha256:bf6fecf38eb159228d73db27b9cf9aa2157d048b8fa82493b4292e4156111090
Deploy KServe,LocalModel and LLMInferenceService
hack/setup/infra/manage.cert-manager-helm.sh
[INFO] Adding cert-manager Helm repository...
"jetstack" has been added to your repositories
[INFO] Installing cert-manager v1.17.0...
NAME: cert-manager
LAST DEPLOYED: Fri Feb 27 21:44:34 2026
NAMESPACE: cert-manager
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
cert-manager v1.17.0 has been deployed successfully!
In order to begin issuing certificates, you will need to set up a ClusterIssuer
or Issuer resource (for example, by creating a 'letsencrypt-staging' issuer).
More information on the different types of issuers and how to configure them
can be found in our documentation:
https://cert-manager.io/docs/configuration/
For information on how to configure cert-manager to automatically provision
Certificates for Ingress resources, take a look at the `ingress-shim`
documentation:
https://cert-manager.io/docs/usage/ingress/
[SUCCESS] Successfully installed cert-manager v1.17.0 via Helm
[INFO] Waiting for pods with label 'app in (cert-manager,webhook,cainjector)' in namespace 'cert-manager' to be created...
[INFO] Found 3 pod(s) with label 'app in (cert-manager,webhook,cainjector)'
[INFO] Waiting for pods with label 'app in (cert-manager,webhook,cainjector)' in namespace 'cert-manager' to be ready...
pod/cert-manager-76f84784c8-prs9v condition met
pod/cert-manager-cainjector-66fbf49587-7zcst condition met
pod/cert-manager-webhook-577fddf86-tzlfh condition met
[SUCCESS] Pods with label 'app in (cert-manager,webhook,cainjector)' in namespace 'cert-manager' are ready!
[SUCCESS] cert-manager is ready!
KSERVE_OVERLAY_DIR=development hack/setup/infra/manage.kserve-kustomize.sh
[INFO] Installing KServe via Kustomize...
[INFO] 📍 Using local config from /Users/smothiki/goworld/src/github.com/kserve/kserve/config/crd/full /Users/smothiki/goworld/src/github.com/kserve/kserve/config/crd/full/llmisvc /Users/smothiki/goworld/src/github.com/kserve/kserve/config/crd/full/localmodel and /Users/smothiki/goworld/src/github.com/kserve/kserve/config/overlays/development
[INFO] Installing KServe CRDs...
[INFO] - Installing CRDs from /Users/smothiki/goworld/src/github.com/kserve/kserve/config/crd/full...
hack/setup/infra/manage.kserve-kustomize.sh: line 168: kustomize: command not found
error: no objects passed to apply
make: *** [deploy-dev] Error 1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment