!LuUSGaeArTeoOgUpwk:matrix.org

kubeflow-kfserving

433 Members
2 Servers

Load older messages


SenderMessageTime
27 Oct 2021
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan
In reply to@_slack_kubeflow_U0104H1616Z:matrix.org
Sorry for unclear question, I mean that the domain example.com can be correctly parsed to your ingress IP?
Matt Carlson Try setting up the magic DNS, and making sure that your ingress gateway is accessible via that DNS.
01:12:59
@_slack_kubeflow_U02AYBVSLSK:matrix.orgAlexandre Brown Hello, does someone have some experience with grafana with the model UI? I'm new to Grafana and would like to know how to make use of it in the model UI. I am following this doc https://www.kubeflow.org/docs/components/kfserving/webapp/ But not certain how to go about : > ensuring the Grafana instance is exposed under /grafana the web app will show the METRICS tab. PS: I can port-forward my grafana and access the dashboard but I would like the metrics tab to show up. Thanks 01:34:06
@_slack_kubeflow_U02AYBVSLSK:matrix.orgAlexandre Brown (edited) ... with the model UI? ... => ... with Kubeflow Model UI? ... 01:34:53
@_slack_kubeflow_U02AYBVSLSK:matrix.orgAlexandre Brown (edited) ... show up. Thanks => ... show up in the model ui as shown in the doc. Thanks 01:35:17
@_slack_kubeflow_U02JVFFP213:matrix.orgMatt Carlson
In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
Matt Carlson Try setting up the magic DNS, and making sure that your ingress gateway is accessible via that DNS.
Benjamin Tan Thanks for your reply. Can I still use magic DNS in RawDeployment mode? I don't have any Knative components currently running and nothing shows up when I run kubectl edit cm config-domain --namespace knative-serving
01:38:14
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan
In reply to@_slack_kubeflow_U02JVFFP213:matrix.org
Benjamin Tan Thanks for your reply. Can I still use magic DNS in RawDeployment mode? I don't have any Knative components currently running and nothing shows up when I run kubectl edit cm config-domain --namespace knative-serving
yeah it should work
01:39:00
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan
In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
yeah it should work
try kubectl get -A , grep config-domain to see if anything comes up
01:39:21
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan
In reply toundefined
(edited) ... get -A ... => ... get cm -A ...
01:39:28
@_slack_kubeflow_U9673D1KJ:matrix.orgANIMESH SINGH
In reply to@_slack_kubeflow_U01FC4Y6QBB:matrix.org
Thanks for the response Alexandre! Yeah we use a version of your first link today with our current KFServing deployment. Looking to do something similar while testing out KServe 0.7. I'll likely just make my own in the style of the existing KFServing one but updated for the new CRDs and such. Thanks!
Ian Miller please update and contribute back - that will be great. Tommy Li owns the original one
01:40:31
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin TanRedacted or Malformed Event01:43:50
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan
In reply to@_slack_kubeflow_U02AYBVSLSK:matrix.org
Hello, does someone have some experience with grafana with Kubeflow Model UI? I'm new to Grafana and would like to know how to make use of it in the model UI. I am following this doc https://www.kubeflow.org/docs/components/kfserving/webapp/ But not certain how to go about : > ensuring the Grafana instance is exposed under /grafana the web app will show the METRICS tab. PS: I can port-forward my grafana and access the dashboard but I would like the metrics tab to show up in the model ui as shown in the doc. Thanks
apiVersion: networking.istio.io/v1alpha3
kind: VirtualService
metadata:
  name: grafana
  namespace: knative-monitoring
spec:
  gateways:
  - kubeflow/kubeflow-gateway
  hosts:
  - '*'
  http:
  - match:
    - uri:
        prefix: /grafana/
    route:
    - destination:
        host: grafana.knative-monitoring.svc.cluster.local
        port:
          number: 30802
01:44:03
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan
In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
apiVersion: networking.istio.io/v1alpha3
kind: VirtualService
metadata:
  name: grafana
  namespace: knative-monitoring
spec:
  gateways:
  - kubeflow/kubeflow-gateway
  hosts:
  - '*'
  http:
  - match:
    - uri:
        prefix: /grafana/
    route:
    - destination:
        host: grafana.knative-monitoring.svc.cluster.local
        port:
          number: 30802
This is the VirtualService part of the tab
01:44:08
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan
In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
This is the VirtualService part of the tab
Basically apply the YAML 🙂
01:44:40
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan
In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
Basically apply the YAML 🙂
Making sure that the port is the right one too
01:45:13
@_slack_kubeflow_U02JVFFP213:matrix.orgMatt Carlson
In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
try kubectl get cm -A , grep config-domain to see if anything comes up
Nothing comes up when I run that command. Curious...
01:48:14
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan
In reply to@_slack_kubeflow_U02JVFFP213:matrix.org
Nothing comes up when I run that command. Curious...
interesting
01:50:09
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan
In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
interesting
Maybe try installing it again? 😄
01:50:19
@_slack_kubeflow_U02JVFFP213:matrix.orgMatt Carlson
In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
Maybe try installing it again? 😄
Ok, I can do that. Stay tuned...
01:52:05
@_slack_kubeflow_U02JVFFP213:matrix.orgMatt Carlson
In reply to@_slack_kubeflow_U02JVFFP213:matrix.org
Ok, I can do that. Stay tuned...
Reinstalled, and I still see the same issue. I do see a kserve-config and inferenceservice-config when looking at config maps, but nothing around config-domain
02:00:26
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan
In reply to@_slack_kubeflow_U02JVFFP213:matrix.org
Reinstalled, and I still see the same issue. I do see a kserve-config and inferenceservice-config when looking at config maps, but nothing around config-domain
hmmm
02:10:49
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan
In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
hmmm
how did you do the install?
02:11:01
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan
In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
how did you do the install?
Ahhh
02:11:26
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan
In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
Ahhh
Did you use raw deployment?
02:11:32
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan
In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
Did you use raw deployment?
If you did then I think there won't be knative installed
02:11:42
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan
In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
If you did then I think there won't be knative installed
# Install Knative
if [ $deploymentMode = serverless ]; then
   kubectl apply --filename https://github.com/knative/serving/releases/download/${KNATIVE_VERSION}/serving-crds.yaml
   kubectl apply --filename https://github.com/knative/serving/releases/download/${KNATIVE_VERSION}/serving-core.yaml
   kubectl apply --filename https://github.com/knative/net-istio/releases/download/${KNATIVE_VERSION}/release.yaml
fi
02:21:14
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan
In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
# Install Knative
if [ $deploymentMode = serverless ]; then
   kubectl apply --filename https://github.com/knative/serving/releases/download/${KNATIVE_VERSION}/serving-crds.yaml
   kubectl apply --filename https://github.com/knative/serving/releases/download/${KNATIVE_VERSION}/serving-core.yaml
   kubectl apply --filename https://github.com/knative/net-istio/releases/download/${KNATIVE_VERSION}/release.yaml
fi
You might need to turn on serverless mode to install the Knative stuff to then be able to set up the domain
02:21:30
@_slack_kubeflow_UM56LA7N3:matrix.orgBenjamin Tan
In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
You might need to turn on serverless mode to install the Knative stuff to then be able to set up the domain
This is from: https://raw.githubusercontent.com/kserve/kserve/release-0.7/hack/quick_install.sh
02:21:38
@_slack_kubeflow_U01SWSMJ3EY:matrix.orgLuca Toscano joined the room.08:48:50
@_slack_kubeflow_U01SWSMJ3EY:matrix.orgLuca Toscano
In reply to@_slack_kubeflow_U0177T2LE5Q:matrix.org
try this link https://us06web.zoom.us/j/81319395480?pwd=L2xabUNDaC9oeUFnR3B3NU9BdHM2QT09
Hi! Is there any recording of this?
08:48:50
@_slack_kubeflow_U01SWSMJ3EY:matrix.orgLuca Toscano
In reply to@_slack_kubeflow_U01SWSMJ3EY:matrix.org
Hi! Is there any recording of this?
https://www.youtube.com/watch?v=la3Y0lXuKRM&ab_channel=JustinMiller
08:49:28

Show newer messages


Back to Room ListRoom Version: 6