!LuUSGaeArTeoOgUpwk:matrix.org

kubeflow-kfserving

433 Members
2 Servers

Load older messages


SenderMessageTime
21 Oct 2021
@_slack_kubeflow_UTURPK4N4:matrix.orgArun George joined the room.12:34:49
@_slack_kubeflow_UTURPK4N4:matrix.orgArun George https://github.com/machine-learning-exchange/mlx/blob/main/docs/install-mlx-on-kubeflow.md 12:56:55
@_slack_kubeflow_UTURPK4N4:matrix.orgArun George
In reply to@_slack_kubeflow_UTURPK4N4:matrix.org
https://github.com/machine-learning-exchange/mlx/blob/main/docs/install-mlx-on-kubeflow.md
Does it work in aws? ANIMESH SINGH
12:57:07
@_slack_kubeflow_U02JY0VHJ0Y:matrix.orgBiplob Biswas
In reply to@_slack_kubeflow_U02JY0VHJ0Y:matrix.org
iamlovingit Thanks a ton, we would try this out and get back to you. But seriously, thanks!
iamlovingit So we tried building after the changes but we are getting the following error: ``./hack/image_patch_dev.sh development 2021/10/21 15:26:48 Using base gcr.io/distroless/static:nonroot for github.com/kserve/kserve/cmd/manager 2021/10/21 15:26:49 Building github.com/kserve/kserve/cmd/manager for linux/amd64 2021/10/21 15:27:16 Unexpected error running "go build": exit status 2 # github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/reconcilers/ingress pkg/controller/v1beta1/inferenceservice/reconcilers/ingress/kube_ingress_reconciler.go:73:8: unknown field 'Service' in struct literal of type "k8s.io/api/networking/v1beta1".IngressBackend Error: error processing import paths in "config/manager/manager.yaml": error resolving image references: exit status 2 2021/10/21 15:27:16 error during command execution:error processing import paths in "config/manager/manager.yaml": error resolving image references: exit status 2 # Remove the certmanager certificate if KSERVE_ENABLE_SELF_SIGNED_CA is not false cd config/default && if [ false != false ]; then \ kustomize edit remove resource certmanager/certificate.yaml; \ else kustomize edit add resource certmanager/certificate.yaml; fi; 2021/10/21 15:27:16 certmanager/certificate.yaml has no match kustomize build config/overlays/development , kubectl apply --validate=false -f - Error: trouble configuring builtin PatchStrategicMergeTransformer with config: paths: - configmap/inferenceservice_patch.yaml - manager_image_patch.yaml : evalsymlink failure on '/Users/username/kserve/config/overlays/development/configmap/inferenceservice_patch.yaml' : lstat /Users/username/kserve/config/overlays/development/configmap/inferenceservice_patch.yaml: no such file or directory error: no objects passed to apply make: *** [deploy-dev] Error 1``
13:50:38
@_slack_kubeflow_U02AF95BSUF:matrix.orgSuresh Nakkiran
In reply to@_slack_kubeflow_US7RRCDL2:matrix.org
We think it's related to Istio sidecar injection.
Timothy Laurent I tried with the above config but I could not reproduce the issue. Below are the steps that I followed to reproduce this issue. 1. Install KFServing v0.6.0 with Istio v1.8.5 and Knative v0.25.0 2. Deploy Kserve v0.7.0 with manifest file 3. Deploy sample tensorflow inference service Please correct me if I am wrong.
14:30:44
@_slack_kubeflow_US7RRCDL2:matrix.orgTimothy Laurent
In reply to@_slack_kubeflow_U02AF95BSUF:matrix.org
Timothy Laurent I tried with the above config but I could not reproduce the issue. Below are the steps that I followed to reproduce this issue. 1. Install KFServing v0.6.0 with Istio v1.8.5 and Knative v0.25.0 2. Deploy Kserve v0.7.0 with manifest file 3. Deploy sample tensorflow inference service Please correct me if I am wrong.
We're chatting about it now -- When we turned off Istio injection the certificate error went away but we noticed that no queue-proxy was coming up in the services. I'll surely report our resolution here once we get it working.
14:36:39
@_slack_kubeflow_U0177T2LE5Q:matrix.orgAlmog Baku joined the room.15:55:21
@_slack_kubeflow_U0177T2LE5Q:matrix.orgAlmog Baku changed their display name from _slack_kubeflow_U0177T2LE5Q to Almog Baku.15:55:23
@_slack_kubeflow_U0177T2LE5Q:matrix.orgAlmog Baku set a profile picture.15:55:24
@_slack_kubeflow_U0177T2LE5Q:matrix.orgAlmog Baku Starting in a few more minutes! https://www.eventbrite.com/e/serving-ml-at-scale-with-kserve-animesh-singh-ibm-cto-tickets-187680616777 15:55:24
@_slack_kubeflow_U02AF95BSUF:matrix.orgSuresh Nakkiran
In reply to@_slack_kubeflow_US7RRCDL2:matrix.org
We're chatting about it now -- When we turned off Istio injection the certificate error went away but we noticed that no queue-proxy was coming up in the services. I'll surely report our resolution here once we get it working.
Okay. Thanks!
16:02:04
@_slack_kubeflow_UTURPK4N4:matrix.orgArun George
In reply to@_slack_kubeflow_U0177T2LE5Q:matrix.org
Starting in a few more minutes! https://www.eventbrite.com/e/serving-ml-at-scale-with-kserve-animesh-singh-ibm-cto-tickets-187680616777
Unable to get in. It says waiting.
16:03:55
@_slack_kubeflow_U0104H1616Z:matrix.orgiamlovingit
In reply to@_slack_kubeflow_U02JY0VHJ0Y:matrix.org
iamlovingit So we tried building after the changes but we are getting the following error: ``./hack/image_patch_dev.sh development 2021/10/21 15:26:48 Using base gcr.io/distroless/static:nonroot for github.com/kserve/kserve/cmd/manager 2021/10/21 15:26:49 Building github.com/kserve/kserve/cmd/manager for linux/amd64 2021/10/21 15:27:16 Unexpected error running "go build": exit status 2 # github.com/kserve/kserve/pkg/controller/v1beta1/inferenceservice/reconcilers/ingress pkg/controller/v1beta1/inferenceservice/reconcilers/ingress/kube_ingress_reconciler.go:73:8: unknown field 'Service' in struct literal of type "k8s.io/api/networking/v1beta1".IngressBackend Error: error processing import paths in "config/manager/manager.yaml": error resolving image references: exit status 2 2021/10/21 15:27:16 error during command execution:error processing import paths in "config/manager/manager.yaml": error resolving image references: exit status 2 # Remove the certmanager certificate if KSERVE_ENABLE_SELF_SIGNED_CA is not false cd config/default && if [ false != false ]; then \ kustomize edit remove resource certmanager/certificate.yaml; \ else kustomize edit add resource certmanager/certificate.yaml; fi; 2021/10/21 15:27:16 certmanager/certificate.yaml has no match kustomize build config/overlays/development , kubectl apply --validate=false -f - Error: trouble configuring builtin PatchStrategicMergeTransformer with config: paths: - configmap/inferenceservice_patch.yaml - manager_image_patch.yaml : evalsymlink failure on '/Users/username/kserve/config/overlays/development/configmap/inferenceservice_patch.yaml' : lstat /Users/username/kserve/config/overlays/development/configmap/inferenceservice_patch.yaml: no such file or directory error: no objects passed to apply make: *** [deploy-dev] Error 1``
Biplob Biswas Hi, I have checked the v1beta1, the IngressBackend struct is: ```type IngressBackend struct { // Specifies the name of the referenced service. // +optional ServiceName string `json:"serviceName,omitempty" protobuf:"bytes,1,opt,name=serviceName"` // Specifies the port of the referenced service. // +optional ServicePort intstr.IntOrString `json:"servicePort,omitempty" protobuf:"bytes,2,opt,name=servicePort"` // Resource is an ObjectRef to another Kubernetes resource in the namespace // of the Ingress object. If resource is specified, serviceName and servicePort // must not be specified. // +optional Resource *v1.TypedLocalObjectReference `json:"resource,omitempty" protobuf:"bytes,3,opt,name=resource" }` so, we should change this code block to `Backend: netv1.IngressBackend{ ServiceName: componentName, ServicePort: constants.CommonDefaultHttpPort, },``
16:05:13
@_slack_kubeflow_U0177T2LE5Q:matrix.orgAlmog Baku
In reply to@_slack_kubeflow_UTURPK4N4:matrix.org
Unable to get in. It says waiting.
try this link https://us06web.zoom.us/j/81319395480?pwd=L2xabUNDaC9oeUFnR3B3NU9BdHM2QT09
16:05:16
@_slack_kubeflow_U0177T2LE5Q:matrix.orgAlmog Baku https://us06web.zoom.us/j/81319395480?pwd=L2xabUNDaC9oeUFnR3B3NU9BdHM2QT09 16:05:22
@_slack_kubeflow_U0104H1616Z:matrix.orgiamlovingit
In reply toundefined
(edited) ... the `IngressBackend` struct is: ```type IngressBackend struct { // Specifies the name of the referenced service. // +optional ServiceName string `json:"serviceName,omitempty" protobuf:"bytes,1,opt,name=serviceName"` // Specifies the port of the referenced service. // +optional ServicePort intstr.IntOrString `json:"servicePort,omitempty" protobuf:"bytes,2,opt,name=servicePort"` // Resource is an ObjectRef to another Kubernetes resource in the namespace // of the Ingress object. If resource is specified, serviceName and servicePort // must not be specified. // +optional Resource *v1.TypedLocalObjectReference `json:"resource,omitempty" protobuf:"bytes,3,opt,name=resource"` }``` so, we should change this code block to ```Backend: netv1.IngressBackend{ ServiceName: componentName, ServicePort: constants.CommonDefaultHttpPort, },``` => ... the v1beta1 `IngressBackend` struct is: ```type IngressBackend struct { // Specifies the name of the referenced service. // +optional ServiceName string `json:"serviceName,omitempty" protobuf:"bytes,1,opt,name=serviceName"` // Specifies the port of the referenced service. // +optional ServicePort intstr.IntOrString `json:"servicePort,omitempty" protobuf:"bytes,2,opt,name=servicePort"` // Resource is an ObjectRef to another Kubernetes resource in the namespace // of the Ingress object. If resource is specified, serviceName and servicePort // must not be specified. // +optional Resource *v1.TypedLocalObjectReference `json:"resource,omitempty" protobuf:"bytes,3,opt,name=resource"` }``` so, we should change this code block to ```Backend: netv1.IngressBackend{ ServiceName: componentName, ServicePort: constants.CommonDefaultHttpPort, },```
16:05:36
@_slack_kubeflow_U9673D1KJ:matrix.orgANIMESH SINGH
In reply to@_slack_kubeflow_UTURPK4N4:matrix.org
Does it work in aws? ANIMESH SINGH
yes
17:43:04
@_slack_kubeflow_U9673D1KJ:matrix.orgANIMESH SINGH
In reply to@_slack_kubeflow_U9673D1KJ:matrix.org
yes
cc Tommy Li @_slack_kubeflow_UP37HDE4B:matrix.org
17:43:32
@_slack_kubeflow_U9673D1KJ:matrix.orgANIMESH SINGH
In reply to@_slack_kubeflow_U9673D1KJ:matrix.org
cc Tommy Li @_slack_kubeflow_UP37HDE4B:matrix.org
the main website is hosted off AWS
17:43:39
@_slack_kubeflow_UP37HDE4B:matrix.orgChristian Kadner joined the room.17:43:43
@_slack_kubeflow_UP37HDE4B:matrix.orgChristian Kadner changed their display name from _slack_kubeflow_UP37HDE4B to Christian Kadner.17:43:43
@_slack_kubeflow_UP37HDE4B:matrix.orgChristian Kadner set a profile picture.17:43:44
@_slack_kubeflow_U017UV2EM24:matrix.orgTed Chang joined the room.18:14:36
@_slack_kubeflow_U017UV2EM24:matrix.orgTed Chang changed their display name from _slack_kubeflow_U017UV2EM24 to Ted Chang.18:15:26
@_slack_kubeflow_U017UV2EM24:matrix.orgTed Chang set a profile picture.18:15:27
@_slack_kubeflow_U022CJB0DRS:matrix.orgChin Huang joined the room.18:15:38
22 Oct 2021
@_slack_kubeflow_U01H1HYJTUH:matrix.orgJoseph Haaga joined the room.00:33:10
@_slack_kubeflow_U02GQUB82D7:matrix.org_slack_kubeflow_U02GQUB82D7 joined the room.07:51:34
@_slack_kubeflow_U02JYD39G57:matrix.org_slack_kubeflow_U02JYD39G57 joined the room.08:34:01
@_slack_kubeflow_U02JY0VHJ0Y:matrix.orgBiplob Biswas
In reply to@_slack_kubeflow_U0104H1616Z:matrix.org
Biplob Biswas Hi, I have checked the v1beta1, the v1beta1 IngressBackend struct is: ```type IngressBackend struct { // Specifies the name of the referenced service. // +optional ServiceName string `json:"serviceName,omitempty" protobuf:"bytes,1,opt,name=serviceName"` // Specifies the port of the referenced service. // +optional ServicePort intstr.IntOrString `json:"servicePort,omitempty" protobuf:"bytes,2,opt,name=servicePort"` // Resource is an ObjectRef to another Kubernetes resource in the namespace // of the Ingress object. If resource is specified, serviceName and servicePort // must not be specified. // +optional Resource *v1.TypedLocalObjectReference `json:"resource,omitempty" protobuf:"bytes,3,opt,name=resource" }` so, we should change this code block to `Backend: netv1.IngressBackend{ ServiceName: componentName, ServicePort: constants.CommonDefaultHttpPort, },``
Thanks a lot that worked out just fine with one small modification, the ServicePort expects an IntorString object, so we did this and it ran with creating the endpoint.
Backend: netv1.IngressBackend{
                            ServiceName: componentName,
                            ServicePort: intstr.FromInt(constants.CommonDefaultHttpPort),
                        },
16:22:20

Show newer messages


Back to Room ListRoom Version: 6