27 Oct 2021 |
Benjamin Tan | In reply to@_slack_kubeflow_U0104H1616Z:matrix.org Sorry for unclear question, I mean that the domain example.com can be correctly parsed to your ingress IP? Matt Carlson Try setting up the magic DNS, and making sure that your ingress gateway is accessible via that DNS. | 01:12:59 |
Alexandre Brown | Hello, does someone have some experience with grafana with the model UI? I'm new to Grafana and would like to know how to make use of it in the model UI.
I am following this doc https://www.kubeflow.org/docs/components/kfserving/webapp/
But not certain how to go about :
> ensuring the Grafana instance is exposed under /grafana the web app will show the METRICS tab.
PS: I can port-forward my grafana and access the dashboard but I would like the metrics tab to show up.
Thanks | 01:34:06 |
Alexandre Brown | (edited) ... with the model UI? ... => ... with Kubeflow Model UI? ... | 01:34:53 |
Alexandre Brown | (edited) ... show up.
Thanks => ... show up in the model ui as shown in the doc.
Thanks | 01:35:17 |
Matt Carlson | In reply to@_slack_kubeflow_UM56LA7N3:matrix.org Matt Carlson Try setting up the magic DNS, and making sure that your ingress gateway is accessible via that DNS. Benjamin Tan Thanks for your reply. Can I still use magic DNS in RawDeployment mode? I don't have any Knative components currently running and nothing shows up when I run kubectl edit cm config-domain --namespace knative-serving | 01:38:14 |
Benjamin Tan | In reply to@_slack_kubeflow_U02JVFFP213:matrix.org Benjamin Tan Thanks for your reply. Can I still use magic DNS in RawDeployment mode? I don't have any Knative components currently running and nothing shows up when I run kubectl edit cm config-domain --namespace knative-serving yeah it should work | 01:39:00 |
Benjamin Tan | In reply to@_slack_kubeflow_UM56LA7N3:matrix.org yeah it should work try kubectl get -A , grep config-domain to see if anything comes up | 01:39:21 |
Benjamin Tan | In reply toundefined
(edited) ... get -A ... => ... get cm -A ... | 01:39:28 |
ANIMESH SINGH | In reply to@_slack_kubeflow_U01FC4Y6QBB:matrix.org Thanks for the response Alexandre! Yeah we use a version of your first link today with our current KFServing deployment. Looking to do something similar while testing out KServe 0.7. I'll likely just make my own in the style of the existing KFServing one but updated for the new CRDs and such. Thanks! Ian Miller please update and contribute back - that will be great. Tommy Li owns the original one | 01:40:31 |
Benjamin Tan | Redacted or Malformed Event | 01:43:50 |
Benjamin Tan | In reply to@_slack_kubeflow_U02AYBVSLSK:matrix.org Hello, does someone have some experience with grafana with Kubeflow Model UI? I'm new to Grafana and would like to know how to make use of it in the model UI.
I am following this doc https://www.kubeflow.org/docs/components/kfserving/webapp/
But not certain how to go about :
> ensuring the Grafana instance is exposed under /grafana the web app will show the METRICS tab.
PS: I can port-forward my grafana and access the dashboard but I would like the metrics tab to show up in the model ui as shown in the doc.
Thanks apiVersion: networking.istio.io/v1alpha3
kind: VirtualService
metadata:
name: grafana
namespace: knative-monitoring
spec:
gateways:
- kubeflow/kubeflow-gateway
hosts:
- '*'
http:
- match:
- uri:
prefix: /grafana/
route:
- destination:
host: grafana.knative-monitoring.svc.cluster.local
port:
number: 30802 | 01:44:03 |
Benjamin Tan | In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
apiVersion: networking.istio.io/v1alpha3
kind: VirtualService
metadata:
name: grafana
namespace: knative-monitoring
spec:
gateways:
- kubeflow/kubeflow-gateway
hosts:
- '*'
http:
- match:
- uri:
prefix: /grafana/
route:
- destination:
host: grafana.knative-monitoring.svc.cluster.local
port:
number: 30802 This is the VirtualService part of the tab | 01:44:08 |
Benjamin Tan | In reply to@_slack_kubeflow_UM56LA7N3:matrix.org This is the VirtualService part of the tab Basically apply the YAML 🙂 | 01:44:40 |
Benjamin Tan | In reply to@_slack_kubeflow_UM56LA7N3:matrix.org Basically apply the YAML 🙂 Making sure that the port is the right one too | 01:45:13 |
Matt Carlson | In reply to@_slack_kubeflow_UM56LA7N3:matrix.org try kubectl get cm -A , grep config-domain to see if anything comes up Nothing comes up when I run that command. Curious... | 01:48:14 |
Benjamin Tan | In reply to@_slack_kubeflow_U02JVFFP213:matrix.org Nothing comes up when I run that command. Curious... interesting | 01:50:09 |
Benjamin Tan | In reply to@_slack_kubeflow_UM56LA7N3:matrix.org interesting Maybe try installing it again? 😄 | 01:50:19 |
Matt Carlson | In reply to@_slack_kubeflow_UM56LA7N3:matrix.org Maybe try installing it again? 😄 Ok, I can do that. Stay tuned... | 01:52:05 |
Matt Carlson | In reply to@_slack_kubeflow_U02JVFFP213:matrix.org Ok, I can do that. Stay tuned... Reinstalled, and I still see the same issue. I do see a kserve-config and inferenceservice-config when looking at config maps, but nothing around config-domain | 02:00:26 |
Benjamin Tan | In reply to@_slack_kubeflow_U02JVFFP213:matrix.org Reinstalled, and I still see the same issue. I do see a kserve-config and inferenceservice-config when looking at config maps, but nothing around config-domain hmmm | 02:10:49 |
Benjamin Tan | In reply to@_slack_kubeflow_UM56LA7N3:matrix.org hmmm how did you do the install? | 02:11:01 |
Benjamin Tan | In reply to@_slack_kubeflow_UM56LA7N3:matrix.org how did you do the install? Ahhh | 02:11:26 |
Benjamin Tan | In reply to@_slack_kubeflow_UM56LA7N3:matrix.org Ahhh Did you use raw deployment? | 02:11:32 |
Benjamin Tan | In reply to@_slack_kubeflow_UM56LA7N3:matrix.org Did you use raw deployment? If you did then I think there won't be knative installed | 02:11:42 |
Benjamin Tan | In reply to@_slack_kubeflow_UM56LA7N3:matrix.org If you did then I think there won't be knative installed # Install Knative
if [ $deploymentMode = serverless ]; then
kubectl apply --filename https://github.com/knative/serving/releases/download/${KNATIVE_VERSION}/serving-crds.yaml
kubectl apply --filename https://github.com/knative/serving/releases/download/${KNATIVE_VERSION}/serving-core.yaml
kubectl apply --filename https://github.com/knative/net-istio/releases/download/${KNATIVE_VERSION}/release.yaml
fi | 02:21:14 |
Benjamin Tan | In reply to@_slack_kubeflow_UM56LA7N3:matrix.org
# Install Knative
if [ $deploymentMode = serverless ]; then
kubectl apply --filename https://github.com/knative/serving/releases/download/${KNATIVE_VERSION}/serving-crds.yaml
kubectl apply --filename https://github.com/knative/serving/releases/download/${KNATIVE_VERSION}/serving-core.yaml
kubectl apply --filename https://github.com/knative/net-istio/releases/download/${KNATIVE_VERSION}/release.yaml
fi You might need to turn on serverless mode to install the Knative stuff to then be able to set up the domain | 02:21:30 |
Benjamin Tan | In reply to@_slack_kubeflow_UM56LA7N3:matrix.org You might need to turn on serverless mode to install the Knative stuff to then be able to set up the domain This is from: https://raw.githubusercontent.com/kserve/kserve/release-0.7/hack/quick_install.sh | 02:21:38 |
| Luca Toscano joined the room. | 08:48:50 |
Luca Toscano | In reply to@_slack_kubeflow_U0177T2LE5Q:matrix.org try this link
https://us06web.zoom.us/j/81319395480?pwd=L2xabUNDaC9oeUFnR3B3NU9BdHM2QT09 Hi! Is there any recording of this? | 08:48:50 |
Luca Toscano | In reply to@_slack_kubeflow_U01SWSMJ3EY:matrix.org Hi! Is there any recording of this? https://www.youtube.com/watch?v=la3Y0lXuKRM&ab_channel=JustinMiller | 08:49:28 |