!LuUSGaeArTeoOgUpwk:matrix.org

kubeflow-kfserving

434 Members
3 Servers

Load older messages


SenderMessageTime
20 May 2022
@_slack_kubeflow_U0315UY2WRM:matrix.orgShri Javadekar I'm sure curious about this too. One way I was thinking about this was to write my own logger that exported metrics such as # of predictions, time, prediction confidence score, etc. Dan Sun: Is there any specific model server that already does this? Triton? 21:50:13
@_slack_kubeflow_UFVUV2UFP:matrix.orgDan Sun if you are running knative then queue proxy already produces a set of standard metrics for request count, latency etc, confidence score is a bit tricky as KServe has no idea about the model accuracy 22:11:08
@_slack_kubeflow_UFVUV2UFP:matrix.orgDan Sun Triton itself does produce a set of metrics too https://github.com/triton-inference-server/server/blob/main/docs/metrics.md 22:11:39
@_slack_kubeflow_U03FZJA1GBZ:matrix.org_slack_kubeflow_U03FZJA1GBZ joined the room.23:44:39
21 May 2022
@_slack_kubeflow_U03GF0NC9QS:matrix.org_slack_kubeflow_U03GF0NC9QS joined the room.14:12:13
@_slack_kubeflow_UFVUV2UFP:matrix.orgDan Sun If anyone from Asia interested in doing a monthly KServe community call in Asia friendly time, please help give a thumbs up here and DM me your email address, thanks! 16:27:49
@_slack_kubeflow_U03GTPHKU2V:matrix.orgAmalesh joined the room.16:45:01
22 May 2022
@_slack_kubeflow_U03GUM55T0R:matrix.orgmobin nikkhesal joined the room.11:46:25
@_slack_kubeflow_U03GUM55T0R:matrix.orgmobin nikkhesal changed their display name from _slack_kubeflow_U03GUM55T0R to mobin nikkhesal.11:58:34
@_slack_kubeflow_U03GUM55T0R:matrix.orgmobin nikkhesal set a profile picture.11:58:36
@_slack_kubeflow_U0315UY2WRM:matrix.orgShri Javadekar Is the current schedule of KServe community calls published somewhere? 15:25:15
@_slack_kubeflow_U03GUM55T0R:matrix.orgmobin nikkhesal changed their profile picture.17:00:14
23 May 2022
@_slack_kubeflow_U03CN7QAHN3:matrix.orgzorba(손주형) what will be done in community call? 02:50:04
@_slack_kubeflow_U02CKMPT47R:matrix.orgLize Cai joined the room.08:25:53
@_slack_kubeflow_U02D58SCUFJ:matrix.orgAbhishek Sharma joined the room.11:34:49
@_slack_kubeflow_U031VTCH4Q5:matrix.orgJan Buijnsters https://kserve.github.io/website/0.8/blog/articles/2022-02-18-KServe-0.8-release/#join-the-community Biweekly Wednesday 9am PST 14:22:45
@_slack_kubeflow_UL38EU0BG:matrix.orgThomas Ounnas joined the room.16:11:39
24 May 2022
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan changed their profile picture.15:25:17
@_slack_kubeflow_U9UFLSBM4:matrix.orgcroberts Trying to debug a kserve-raw deployment. Can anyone think of reasons why the storage-initializer init container is not getting attached to the tensorflow pod? 15:57:02
@_slack_kubeflow_UFVUV2UFP:matrix.orgDan Sun which namespace it is deployed to? it does not work in the kserve control plane namespace 16:07:24
@_slack_kubeflow_U9UFLSBM4:matrix.orgcroberts The person trying it originally put it in the kserve namespace, but later tried in another namespace and had the same result 16:22:01
@_slack_kubeflow_U9UFLSBM4:matrix.orgcroberts We even tried uninstalling "everything" and re-installing, but we can't seem to get the init-container to happen....no errors in any place we've looked so far 16:22:39
@_slack_kubeflow_U9UFLSBM4:matrix.orgcroberts Oh...interesting...her project does have the control-plane: controller-manager label 16:28:55
@_slack_kubeflow_U9UFLSBM4:matrix.orgcroberts Thanks Dan Sun that was it. Somehow, she tried in the one project that would NOT work. 16:32:28
@_slack_kubeflow_UFVUV2UFP:matrix.orgDan Sun ye the pod mutator webhook checks the namespace label https://github.com/kserve/kserve/blob/master/config/webhook/manifests.yaml#L40 16:37:15
@_slack_kubeflow_U022U7KG24W:matrix.orgRachit Chauhan I observed there are 3 PeerAuthentication policies that are being created as part of knative istio controller (https://github.com/knative/serving/blob/591e12dafbcb79a34e0a3bdc586d408b2830aef1/third_party/istio-latest/net-istio.yaml lines 203, 222, 240). Why these webhooks deployments getting istio’s sidecars injected ? Which other components are calling them apart from kube-apiserver ? 23:28:33
25 May 2022
@_slack_kubeflow_UFVUV2UFP:matrix.orgDan Sun As the comment says these policies are created to work with both mesh and non mesh mode in case sidecar is injected 04:23:18
@_slack_kubeflow_U03CN7QAHN3:matrix.orgzorba(손주형) I think this is bug. I’m using fake client with NewSimpleClientset. and testing InferenceService.List function
list, err := suite.fakeClient.InferenceService.List(v12.ListOptions{})
s.NoError(err)
this error occurs no kind "InferenceServiceList" is registered for version "serving/v1beta1" in scheme "pkg/runtime/scheme.go:100"
11:06:48
@_slack_kubeflow_U0315UY2WRM:matrix.orgShri Javadekar Hey everyone.. I missed the community meeting today 😞 What's the zoom link for the community meeting? The doc only shows a Google meet link. Also, are the community meeting recordings available somewhere? 17:04:14
@_slack_kubeflow_U01BK1JJ2GJ:matrix.orgSree joined the room.19:10:50

Show newer messages


Back to Room ListRoom Version: 6