| 22 Oct 2021 |
 Biplob Biswas | In reply toundefined
(edited) ... lot that worked out just fine with one small modification, the ServicePort expects an IntorString object, so we did this and it ran with creating the endpoint.
```Backend: netv1.IngressBackend{
ServiceName: componentName,
ServicePort: intstr.FromInt(constants.CommonDefaultHttpPort),
},```
=> ... lot iamlovingit that worked out just fine with one small modification, the ServicePort expects an IntorString object, so we did this and it ran with creating the endpoint.
```Backend: netv1.IngressBackend{
ServiceName: componentName,
ServicePort: intstr.FromInt(constants.CommonDefaultHttpPort),
},``` | 16:22:36 |
 Jevgeni Martjušev | In reply to@_slack_kubeflow_U01HS89M1U6:matrix.org
I am in progress of selecting a serving engine. Seldon is my first choice, the only problem being that Kafka support lacks SSL auth features there. KServe looks like a more complex solution as I will have to install KNative and also probably iter8 Is there anyone from KServe team, who can shed light on native support for shadow deployments? | 18:46:14 |
| 23 Oct 2021 |
 iamlovingit | In reply to@_slack_kubeflow_U02JY0VHJ0Y:matrix.org
Thanks a lot iamlovingit that worked out just fine with one small modification, the ServicePort expects an IntorString object, so we did this and it ran with creating the endpoint.
Backend: netv1.IngressBackend{
ServiceName: componentName,
ServicePort: intstr.FromInt(constants.CommonDefaultHttpPort),
}, Biplob Biswas Can you help to close the issue? | 13:11:55 |
 Dan Sun | In reply to@_slack_kubeflow_U01HS89M1U6:matrix.org
Is there anyone from KServe team, who can shed light on native support for shadow deployments? Jevgeni Martjušev there is a way to achieve this today with logger already which can intercept the request and forward to a shadow deployment | 16:31:11 |
| 24 Oct 2021 |
 Vedant Padwal | https://www.youtube.com/watch?v=wh7WwSw4hRs | 13:09:04 |
|  Ryan Russon joined the room. | 23:41:55 |
| 25 Oct 2021 |
|  _slack_kubeflow_U02JS8TLP8B joined the room. | 04:53:46 |
|  Jim Dowling joined the room. | 11:45:04 |
|  _slack_kubeflow_U02JQT1TRJ6 joined the room. | 12:22:49 |
|  Matt Carlson joined the room. | 15:43:30 |
| Matt Carlson changed their display name from _slack_kubeflow_U02JVFFP213 to Matt Carlson. | 15:57:07 |
| Matt Carlson set a profile picture. | 15:57:08 |
| Matt Carlson | Hello everyone, hoping someone can help me out. I'm trying to get a KServe 0.7.0 Raw Deployment up and running on EKS. I've followed the instructions here and here to run the installation and create and deploy my first inference service using the ScikitLearn example. The inference service enters a ready state and the pod is up and running. However, when I try to curl the inference service endpoint I receive a 404 Not Found from the Istio gateway with no other error messages to speak of, at least that I'm able to track down. I'll happily share whatever I can to help track this issue down. Thanks! | 15:57:08 |
 Benjamin Tan | In reply to@_slack_kubeflow_U02JVFFP213:matrix.org
Hello everyone, hoping someone can help me out. I'm trying to get a KServe 0.7.0 Raw Deployment up and running on EKS. I've followed the instructions here and here to run the installation and create and deploy my first inference service using the ScikitLearn example. The inference service enters a ready state and the pod is up and running. However, when I try to curl the inference service endpoint I receive a 404 Not Found from the Istio gateway with no other error messages to speak of, at least that I'm able to track down. I'll happily share whatever I can to help track this issue down. Thanks! What does kubectl get ksvc -A show you? | 16:04:39 |
| Benjamin Tan | In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
What does kubectl get ksvc -A show you? How are you curling the inference service? | 16:04:55 |
| Matt Carlson | In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
How are you curling the inference service? Hi Benjamin. kubectl get ksvc -A shows No resources found in the kserve-test namespace I am using for the Scikit example | 16:19:00 |
| Matt Carlson | In reply to@_slack_kubeflow_U02JVFFP213:matrix.org
Hi Benjamin. kubectl get ksvc -A shows No resources found in the kserve-test namespace I am using for the Scikit example I'm curling the inference service using the example here - in particular, I am curling from an Istio Ingress Gateway using a HOST header pulled from the inference service | 16:21:11 |
| Benjamin Tan | In reply to@_slack_kubeflow_U02JVFFP213:matrix.org
I'm curling the inference service using the example here - in particular, I am curling from an Istio Ingress Gateway using a HOST header pulled from the inference service Hmm | 16:25:37 |
| Benjamin Tan | In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
Hmm what does this show then:
https://github.com/kserve/kserve/tree/master/docs/samples/istio-dex | 16:25:43 |
| Benjamin Tan | In reply toundefined
(edited) ... then:
```<https://github.com/kserve/kserve/tree/master/docs/samples/istio-dex>``` => ... then:
```kubectl get inferenceservices sklearn-iris -n kserve-test``` | 16:25:53 |
| Benjamin Tan | In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
what does this show then:
https://github.com/kserve/kserve/tree/master/docs/samples/istio-dex Ah so you're doing
SERVICE_HOSTNAME=$(kubectl get inferenceservice sklearn-iris -n kserve-test -o jsonpath='{.status.url}' , cut -d "/" -f 3)
curl -v -H "Host: ${SERVICE_HOSTNAME}" http://${INGRESS_HOST}:${INGRESS_PORT}/v1/models/sklearn-iris:predict -d @./iris-input.json | 16:26:29 |
| Matt Carlson | In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
Ah so you're doing
SERVICE_HOSTNAME=$(kubectl get inferenceservice sklearn-iris -n kserve-test -o jsonpath='{.status.url}' , cut -d "/" -f 3)
curl -v -H "Host: ${SERVICE_HOSTNAME}" http://${INGRESS_HOST}:${INGRESS_PORT}/v1/models/sklearn-iris:predict -d @./iris-input.json Yes that's right | 16:26:49 |
| Benjamin Tan | In reply to@_slack_kubeflow_U02JVFFP213:matrix.org
Yes that's right can you echo out SERVICE_HOSTNAME | 16:26:58 |
| Matt Carlson | In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
can you echo out SERVICE_HOSTNAME kubectl get inferenceservices sklearn-iris -n kserve-test | 16:30:54 |
| Matt Carlson | In reply to@_slack_kubeflow_U02JVFFP213:matrix.org
kubectl get inferenceservices sklearn-iris -n kserve-test NAME URL READY PREV LATEST PREVROLLEDOUTREVISION LATESTREADYREVISION AGE
sklearn-iris http://sklearn-iris-kserve-test.example.com True 3d22h | 16:30:59 |
| Matt Carlson | In reply to@_slack_kubeflow_U02JVFFP213:matrix.org
NAME URL READY PREV LATEST PREVROLLEDOUTREVISION LATESTREADYREVISION AGE
sklearn-iris http://sklearn-iris-kserve-test.example.com True 3d22h Apologies for the formatting | 16:31:22 |
| Matt Carlson | In reply to@_slack_kubeflow_U02JVFFP213:matrix.org
Apologies for the formatting Here is what I get from echoing out SERVICE_HOSTNAME: sklearn-iris-kserve-test.example.com | 16:33:11 |
| Matt Carlson | In reply to@_slack_kubeflow_U02JVFFP213:matrix.org
Here is what I get from echoing out SERVICE_HOSTNAME: sklearn-iris-kserve-test.example.com I should add that I just downgraded to KFServing 0.6.1 and was able to test the sklearn-iris service and get a 200 response. So it seems the 404 errors are specific to 0.7.0 | 20:29:01 |
|  Nhan Hoang joined the room. | 22:47:52 |
|  Gautam Kumar joined the room. | 23:40:56 |
