!LuUSGaeArTeoOgUpwk:matrix.org

kubeflow-kfserving

433 Members
2 Servers

Load older messages


SenderMessageTime
12 Oct 2021
@_slack_kubeflow_U02H4ARNFEK:matrix.org_slack_kubeflow_U02H4ARNFEK joined the room.21:57:02
@_slack_kubeflow_UFVUV2UFP:matrix.orgDan Sun joined the room.22:26:42
@_slack_kubeflow_UFVUV2UFP:matrix.orgDan Sun Alexandre Brown Yes, inference service spec supports the node affinity and toleration, but you need to turn on the knative flags https://kserve.github.io/website/admin/serverless/#2-install-knative-serving 22:27:20
@_slack_kubeflow_U02AYBVSLSK:matrix.orgAlexandre Brown joined the room.22:29:14
@_slack_kubeflow_U02AYBVSLSK:matrix.orgAlexandre Brown Thanks a lot Dan Sun this answers my question perfectly 22:29:14
13 Oct 2021
@_slack_kubeflow_U02DHV1MT2T:matrix.org_slack_kubeflow_U02DHV1MT2T joined the room.00:36:49
@_slack_kubeflow_U02HTJ9GLKT:matrix.orgRiley Green joined the room.01:39:24
@_slack_kubeflow_UFVUV2UFP:matrix.orgDan Sun Krishna Durai is this for batch inference use case? 03:38:59
@_slack_kubeflow_UFC0G606A:matrix.orgKrishna Durai joined the room.03:40:49
@_slack_kubeflow_UFC0G606A:matrix.orgKrishna Durai Yes, the idea is to submit many inferences at one go and chech the results asynchronously 03:40:49
@_slack_kubeflow_UFVUV2UFP:matrix.orgDan Sun @_slack_kubeflow_U02AF95BSUF:matrix.org Do we support the migration path from 0.5? 03:40:53
@_slack_kubeflow_UFVUV2UFP:matrix.orgDan Sun We do not support batch inference yet but the idea is that we can run a spark job or something like that to take a batch file and send the requests to the inference services, collect back the response and write to a resulting file. 03:55:03
@jagadeeshj:matrix.orgJagadeesh J joined the room.04:32:29
@_slack_kubeflow_U02HL87RBDG:matrix.org_slack_kubeflow_U02HL87RBDG joined the room.07:11:29
@_slack_kubeflow_UFC0G606A:matrix.orgKrishna Durai Thanks for your reply Dan! 07:15:17
@_slack_kubeflow_U02HLB9PNMQ:matrix.org_slack_kubeflow_U02HLB9PNMQ joined the room.07:44:41
@_slack_kubeflow_U02AF95BSUF:matrix.orgSuresh Nakkiran joined the room.13:16:29
@_slack_kubeflow_U02AF95BSUF:matrix.orgSuresh Nakkiran Dan Sun the kserve migration job does not work from kfserving v0.5.0 because there are knative and istiod version/config differences between v0.5.0 and v0.6.0.. 13:16:30
@_slack_kubeflow_U015DQVPBR7:matrix.orgMarcin Jimenez joined the room.14:57:30
@_slack_kubeflow_U015DQVPBR7:matrix.orgMarcin Jimenez what is the recommended strategy on upgrades from 0.5 to 0.6 and beyond? 14:57:30
@_slack_kubeflow_UFVUV2UFP:matrix.orgDan Sun There will be no community meeting today, we have Kubecon talk for KServe today at 2:30pm PDT Serving Machine Learning Models at Scale Using KServe - Animesh Singh, IBM 15:20:08
@_slack_kubeflow_UAYJJUQJZ:matrix.orgtheofpa joined the room.15:34:53
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan joined the room.15:40:36
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan I must be doing something wrong but I still haven't figured this out: I have Kubeflow set up on a private GKE (so https everything), but I want to have my Knative models not have to go through Dex. I've tried setting up an additional Istio Ingress but keep hitting into various problems (IngressNotConfigured, not being able to curl with the new domain etc) 15:42:19
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan Is there an easier way to bypass Auth for Knative? 15:42:39
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan And if I bypass it, does it still go through https? 15:45:42
@_slack_kubeflow_U0127AUTPMH:matrix.orgNick joined the room.15:51:18
@_slack_kubeflow_U0104H1616Z:matrix.orgiamlovingit joined the room.15:55:14
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan Otherwise, I would be interested in how other foiks handle this 15:56:02
@_slack_kubeflow_UFVUV2UFP:matrix.orgDan Sun
In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
Otherwise, I would be interested in how other foiks handle this
Benjamin Tan if you have describe your setup in more details I can help out to trouble shooting, we have setup this before so pretty sure it should work
16:26:32

Show newer messages


Back to Room ListRoom Version: 6