!LuUSGaeArTeoOgUpwk:matrix.org

kubeflow-kfserving

432 Members
2 Servers

Load older messages


SenderMessageTime
3 Jun 2022
@_slack_kubeflow_U022U7KG24W:matrix.orgRachit Chauhan Shri Javadekar: I followed this https://kserve.github.io/website/0.8/developer/developer/#install-knative-on-a-kubernetes-cluster to test it out. You can checkout the branch for PR https://github.com/kserve/kserve/pull/1910 and follow this https://kserve.github.io/website/0.8/developer/developer/#deploy-kserve-with-your-own-version 15:58:41
@_slack_kubeflow_U039JEMLJ1W:matrix.orgRobert Irvine hi, I use kserve batching which is great but it means you cannot pass in parameters others than the inference text. For debugging I want to be able to bypass this and just call with parameters directly (e.g diff temperature values for nlp model). Is this possible? 16:19:18
@_slack_kubeflow_U039JEMLJ1W:matrix.orgRobert Irvine if its not possible then I have to deploy a second instance without batching just for debugging with additional parameters (which kinda sucks) 16:20:47
@_slack_kubeflow_UL38EU0BG:matrix.orgThomas Ounnas Kenneth Koski it seems you installed this app, could you remove this spams ? 17:50:09
@_slack_kubeflow_U0278DYPCJE:matrix.orgPradeep Thalasta joined the room.18:39:20
@_slack_kubeflow_U0278DYPCJE:matrix.orgPradeep ThalastaRedacted or Malformed Event18:39:26
@_slack_kubeflow_UL38EU0BG:matrix.orgThomas Ounnas Hello 👋 , Just a quick feedback, it may have change in new KServe version, but for those on Kubeflow v1.4 (KFServing/KServe v0.6.1) like me, I had an issue when trying to deploy an sklearn inference service, and got a 404...🤔 Everything was ok (pod, authpolicy, iam role service account, etc..) I kinda went crazy since 404 means Not Found but I had the logs of the pod with the requests’ hit arriving... It turns out... hidden in the logs, I found an error with the load of the model, indeed, KServe v0.6.1 rely on sklearn 0.20.3 and there was a version mismatch.... 🤦‍♂️ Kinda silly error, that I would have found more quickly if the status was a 502 (since I would have look at the right place, server side error) 😅 20:07:04
@_slack_kubeflow_U02LE3KB53M:matrix.org_slack_kubeflow_U02LE3KB53M Shri Javadekar I already have the v0.8.0 version of kserve installed in a cluster, then I built and pushed the latest version of the kserve controller and router from the graph feature branch to a registry. Then reconfigure the existing kserve set up from v0.8.0 images to the feature branch images. You should be able to test out the inference graph features. Otherwise you can do the local dev setup that is documented above 21:11:35
@californiatl:matrix.org@californiatl:matrix.orgI'll help 10 individuals how to earn $20,000 in just 72 hours from the crypto market. But you will pay me 10% commission when you receive your profit. if interested send me a direct message via WhatsApp by asking me HOW for more details on how to get started +1 (229778188121:18:44
@_slack_kubeflow_U0315UY2WRM:matrix.orgShri Javadekar Got it.. thanks for the reply! 21:18:51
@_slack_kubeflow_UFVUV2UFP:matrix.orgDan Sun Where can you see the installed app? 22:26:50
@_slack_kubeflow_UFVUV2UFP:matrix.orgDan Sun It means that the model is not found, I think in later version we actually failed the start up in case model is not loaded 22:38:53
@_slack_kubeflow_UFVUV2UFP:matrix.orgDan Sun Mathew Wicks can you help remove the spam app? 22:41:50
4 Jun 2022
@_slack_kubeflow_U013UG6SQAJ:matrix.orgMathew Wicks James Wu can you please remove the "element bridge" slack app ASAP? It is spamming this channel with commercial ads. 01:21:12
@californiatl:matrix.org@californiatl:matrix.org I'll help 10 individuals how to earn $20,000 in just 72 hours from the crypto market. But you will pay me 10% commission when you receive your profit. if interested send me a direct message via WhatsApp by asking me HOW for more details on how to get started > +1 (2297781881 09:49:01
@_slack_kubeflow_U02QG484SPM:matrix.orgAndrej Albrecht changed their display name from _slack_kubeflow_U02QG484SPM to Andrej Albrecht.18:35:44
@_slack_kubeflow_U02QG484SPM:matrix.orgAndrej Albrecht set a profile picture.18:35:46
@_slack_kubeflow_U031LC9DKKJ:matrix.orgMaciek Stopa Hey Cesar Flores did you manage to solve this problem back then? I'm facing a similar issue when I try to follow https://kserve.github.io/website/0.7/get_started/first_isvc/ , I get 404 even when I send requests from a pod within my cluster or run performance tests according to docs. In my case kubectl describe inferenceservice sklearn-iris -n kserve-test outputs Warning InternalError 5m26s v1beta1Controllers fails to reconcile predictor: fails to update knative service: Operation cannot be fulfilled on services.serving.knative.dev "sklearn-iris-predictor-default": the object has been modified; please apply your changes to the latest version and try again . Were you getting the same warning? 23:50:07
5 Jun 2022
@_slack_kubeflow_U027N7C2KUJ:matrix.orgJack Jin joined the room.19:47:02
@_slack_kubeflow_U027N7C2KUJ:matrix.orgJack Jin Hello. I installed Kubeflow 1.5, and follow up the instruction in https://www.kubeflow.org/docs/external-add-ons/kserve/webapp/ to install the Metrics with below yaml, not seeing any error during the yaml installation, and all the pod in knative-monitoring namespace are working fine, but the Kubeflow GUI models detail page doesn't show the METRICS tab. I had a mnist model with trition inference server, all the inference components are green check. Does any one have experience on this? Thanks configmap.yaml monitoring-metrics-prometheus.yaml authorizationpolicy.yaml monitoring-core.yaml virtualservice.yaml 19:54:30
6 Jun 2022
@_slack_kubeflow_U039JEMLJ1W:matrix.orgRobert Irvine what is explain meant to do? 14:37:40
@_slack_kubeflow_U039JEMLJ1W:matrix.orgRobert Irvine and does it work with batching automatically? 14:38:00
@californiatl:matrix.org@californiatl:matrix.org left the room.15:55:33
@_slack_kubeflow_U01B39HKM4H:matrix.orgJames Wu Can you show me the spam message? I don't have any context on this app. If I can confirm it is spamming I will uninstall it 16:50:34
@_slack_kubeflow_UL38EU0BG:matrix.orgThomas Ounnas James Wu 16:52:46
@_slack_kubeflow_UL38EU0BG:matrix.orgThomas Ounnas James Wu 16:53:04
@_slack_kubeflow_UL38EU0BG:matrix.orgThomas Ounnas James Wu 16:53:21
@_slack_kubeflow_UL38EU0BG:matrix.orgThomas Ounnas James Wu 16:53:45
9 Jun 2022
@wyb:matrix.org@wyb:matrix.org joined the room.17:12:32
@wyb:matrix.org@wyb:matrix.org left the room.17:12:37

Show newer messages


Back to Room ListRoom Version: 6