Generative AI On Kubernetes Kubernetes Bytes podcast

1:02:44

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin sit down with Edith (Edi) Puclla, Technology Evangelist at Percona to talk about Percona Everest. The conversation focuses on Percona's investment in the Open-source ecosystem, and how they keep innovating with Percona Monitoring and Management and Percona Everest. The discussion also dives into how the community is expanding and supporting more use cases with Data on Kubernetes and AI on Kubernetes. Check out our website at https://kubernetesbytes.com/ Cloud Native News: http://businesswire.com/news/home/20250227229731/en/Veeam-Releases-Kasten-for-Kubernetes-v7.5-Elevating-its-1-Data-Resilience-Market-Position-with-Enhanced-Security-and-Modern-Virtualization/ https://www.developer-tech.com/news/kubescape-achieves-major-milestone-in-open-source-kubernetes-security/ https://thenewstack.io/postgresql-operator-cloudnativepg-hits-the-cncf-sandbox/ https://backendnews.net/tenable-report-finds-security-gaps-in-kubernetes-environments/ https://www.infoworld.com/article/3832760/red-hat-openshift-improves-virtualization-support.html https://edera.dev/stories/series-a - https://www.datastax.com/blog/ibm-plans-to-acquire-datastax Show links: https://github.com/percona/pmm https://github.com/valkey-io/valkey https://github.com/percona/everest https://github.com/percona/percona-server-mysql-operator https://github.com/percona/percona-server-mongodb-operator https://github.com/percona/percona-postgresql-operator https://forums.percona.com/ https://github.com/percona https://www.cncf.io/blog/2024/06/28/celebrating-10-years-of-kubernetes-the-evolution-of-database-operators/ https://dok.community/ https://www.linkedin.com/in/edithpuclla/ Timestamps: 00:07:40 Cloud Native News 00:17:40 Interview with Edith 00:58:05 Key takeaways…

1
KubeCon NA 2024 News Recap 58:24

17 weeks fa58:24

58:24

Join Bhavin Shah and Ryan Wallner for a recap of announcements and news from KubeCon North America 2024. Check out our website at https://kubernetesbytes.com/ https://www.businesswire.com/news/home/20241119538933/en/Spectro-Cloud-Closes-75m-Series-C-Led-by-Growth-Equity-at-Goldman-Sachs-Alternatives https://northflank.com/blog/northflank-raises-22m-to-make-kubernetes-work-for-your-developers-ship-workloads-not-infrastructure https://snyk.io/news/snyk-acquires-developer-first-dast-provider-probely/ https://www.nutanix.com/blog/introducing-nutanix-enterprise-ai https://thenewstack.io/stacklok-donates-minder-security-project-to-openssf/ https://www.prnewswire.com/news-releases/akamai-launches-cloud-agnostic-ready-to-run-application-platform-302302446.html https://www.businesswire.com/news/home/20241112064093/en/Loft-Labs-Introduces-vCluster-Cloud-a-Managed-Solution-to-Simplify-and-Reduce-Costs-of-Kubernetes https://cloud.google.com/blog/products/containers-kubernetes/gke-65k-nodes-and-counting https://www.veeam.com/resources/wp-whats-new-veeam-kasten-for-kubernetes.html https://www.netapp.com/blog/trident-24-10-best-storage-kubernetes/ https://podman-desktop.io/blog/2024/11/14/podman-desktop-cncf https://aws.amazon.com/blogs/aws/streamline-kubernetes-cluster-management-with-new-amazon-eks-auto-mode/ https://aws.amazon.com/about-aws/whats-new/2024/12/amazon-eks-hybrid-nodes/ https://thenewstack.io/kueue-can-now-schedule-kubernetes-batch-jobs-across-clusters/ https://cloudnativenow.com/kubecon-cnc-na-2024/solo-io-donates-api-gateway-to-cncf-to-advance-kubernetes-connectivity/ https://blocksandfiles.com/2024/11/08/tintri-unveils-kubernetes-container-storage-interface-for-streamlined-management/ https://www.sdxcentral.com/articles/stringerai-announcements/kubiya-launches-captain-kubernetes-ai-tool-for-simplifying-kubernetes-management/ https://cloudnativenow.com/topics/cloudnativedevelopment/application-dev/cncf-automates-kubernetes-secops-with-kyverno/ https://www.cncf.io/announcements/2024/11/15/cloud-native-computing-foundation-expands-certification-to-platform-engineering-and-more/ https://training.linuxfoundation.org/platform-engineering-programs https://cloudnativenow.com/topics/cloudnativedevelopment/cncf-kubevirt-v1-4-vms-are-now-just-another-kubernetes-resource/ https://kubevirt.io/user-guide/release_notes/ kubernetes.io/blog/2024/12/11/kubernetes-v1-32-release/ https://thehackernews.com/2024/12/296000-prometheus-instances-exposed.html?utm_source=tldrdevops…

1
Increasing AI adoption using Kubernetes 52:03

19 weeks fa52:03

52:03

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Tobi Knaup, VP and General Manager of Cloud Native at Nutanix about all things Kubernetes and AI. The discussion focuses on how Kubernetes has evolved since the early days, and why it's architecture is a perfect fit for accelerating adoption of AI workloads inside organizations. Check out our website at https://kubernetesbytes.com/ #kubernetes #aimodels #AIonKubernetes #machinelearning #hybridcloud #multicloud #modeltraining…

1
Monolith to Microservices using Kubernetes at Guidewire 1:06:28

23 weeks fa1:06:28

1:06:28

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin sit down with Diego Devalle and Anoop Gopalakrishnan from Guidewire to talk about how they went through an application modernization journey and adopted Kubernetes and cloud over the last 5 years. Diego and Anoop share their experiences around how they drove this modernization inside Guidewire by both championing organizational change, and introducing Kubernetes and cloud technologies, while at the same time ensuring that they serve their existing customers in the insurance industry. Check out our website at https://kubernetesbytes.com/ Show links: https://medium.com/@guidewire-engineering https://www.youtube.com/@GuidewireSoftware https://www.youtube.com/watch?v=N-WaEneeIJs https://www.youtube.com/watch?v=bKCwMO4UeJ8 https://www.guidewire.com/about/careers Timestamps: 00:05:24 Interview with Diego and Anoop 01:02:37 Key takeaways…

1
Inference in Action: Scaling Al Smarter with Inferless 55:17

25 weeks fa55:17

55:17

In this episode, we sit down with Nilesh Agarwal, co-founder of Inferless, a platform designed to streamline serverless GPU inference. We’ll cover the evolving landscape of model deployment, explore open-source tools like KServe and Knative, and discuss how Inferless solves common bottlenecks, such as cold starts and scaling issues. We also take a closer look at real-world examples like CleanLab, who saved 90% on GPU costs using Inferless. Whether you’re a developer, DevOps engineer, or tech enthusiast curious about the latest in AI infrastructure, this podcast offers insights into Kubernetes-based model deployment, efficient updates, and the future of serverless ML. Tune in to hear Nilesh's journey from Amazon to founding Inferless and how his platform is transforming the way companies deploy machine learning models. Subscribe now for more episodes! Show Links: OpenShift 4.17 is GA https://www.youtube.com/live/DvKHwz-c11c?si=6Zap6hk_GsQfdX2m Policy SBOM from Styra: https://www.styra.com/blog/introducing-policy-sbom/ NVIDIA GEForce NOW runs on KubeVirt https://thenewstack.io/now-nvidia-scaled-its-cloud-services-with-kubevirt/ CBT feedback https://thenewstack.io/kubernetes-advances-cloud-native-data-protection-share-feedback CNCF KUBEEDGE Grad https://www.devopsdigest.com/cncf-announces-kubeedge-graduation?utm_source=tldrdevops Palumi Operator 2.0 https://www.pulumi.com/blog/pulumi-kubernetes-operator-2-0 Inferless LInks: https://www.inferless.com/blog/cleanlab-saves-90-on-gpu-costs-with-inferless-serverless-inference https://www.inferless.com/blog/how-spoofsense-scaled-their-ai-inference-with-inferless-dynamic-batching-autoscaling https://www.inferless.com/ https://docs.inferless.com/introduction/introduction LinkedIn - https://www.linkedin.com/in/nilesh-agarwal/ X- https://x.com/nilesh_agarwal2 Medium Blog https://nilesh-agarwal.medium.com/…

1
Container security with Wiz 1:02:33

28 weeks fa1:02:33

1:02:33

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Ofir Cohen, CTO of Container Security at Wiz. The discussion focuses on the challenges with the cloud native security ecosystem, how organizations can improve their security posture, how developers can do less with more, and how Wiz helps organizations avoid security incidents. Check out our website at https://kubernetesbytes.com/ Cloud Native News: https://blog.kubecost.com/blog/2.4-release-highlights/ https://www.theregister.com/2024/09/26/critical_nvidia_bug_container_escape https://techcrunch.com/2024/09/18/edera-is-building-a-better-kubernetes-and-ai-security-solution-from-the-ground-up/ https://www.cncf.io/blog/2024/10/01/karmada-v1-11-version-released-new-cross-cluster-rolling-upgrade-capability-for-workload/ https://github.com/atlassian/escalator/?tab=readme-ov-file https://cybenari.com/2024/08/whats-the-worst-place-to-leave-your-secrets/ https://thehackernews.com/2024/10/new-cryptojacking-attack-targets-docker.html Show links: https://www.wiz.io/customers https://www.wiz.io/blog https://peach.wiz.io https://www.linkedin.com/in/cohen-ofir/ Timestamps: 00:01:43 Cloud Native News 00:12:56 Interview with Ofir 00:56:58 Key takeaways…

1
Dagger.io Deep Dive with Co-Founder Sam Alba 1:06:24

30 weeks fa1:06:24

1:06:24

In this episode, we dive into the challenges of modern CI systems and why they often hinder productivity. We explore Dagger, a programmable CI/CD pipeline engine, with insights from Sam, a former Docker engineer. Learn how Dagger addresses CI complexity, speeds up workflows, and enhances portability between local environments and CI. Show Links Dagger.io https://docs.dagger.io/ https://docs.dagger.io/adopting/#join-our-discord…

1
Running Ray on Kubernetes with KubeRay 53:06

32 weeks fa53:06

53:06

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Kai-Hsun Chen, Software Engineer at Anyscale and maintainer of the KubeRay project. The discussion focuses on how the open source Ray project can help organizations use a single tool for data prep, model training, fine tuning and model serving workflows, both for their predictive AI and generative AI models. The discussion also dives into the KubeRay project and how it provides three different Kubernetes CRDs for Data Scientists to deploy Ray clusters on demand. Check out our website at https://kubernetesbytes.com/ Cloud Native News: https://azure.github.io/AKS/2024/08/23/fine-tuning-language-models-with-kaito https://orca.security/resources/blog/kubernetes-testing-environment/ https://www.redhat.com/en/about/press-releases/red-hat-openstack-services-openshift-now-generally-available Show links: Kai's LinkedIn: https://www.linkedin.com/in/kaihsun1996/ KubeRay doc: https://docs.ray.io/en/latest/cluster/kubernetes/index.html Ray Summit registration: https://raysummit.anyscale.com/flow/anyscale/raysummit2024/reg/createaccount (code: KaiHsunC15) KubeRay repository: https://github.com/ray-project/kuberay Ray repository: https://github.com/ray-project/ray Ray Slack workspace: https://docs.google.com/forms/d/e/1FAIpQLSfAcoiLCHOguOm8e7Jnn-JJdZaCxPGjgVCvFijHB5PLaQLeig/viewform Timestamps: 00:02:40 Cloud Native News 00:07:20 Interview with Kai 00:49:15 Key takeaways…

1
Building scalable data platforms using Data on EKS 1:02:20

34 weeks fa1:02:20

1:02:20

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Alex Lines and Vara Bonthu from AWS to talk about the Data on EKS project. The discussion dives into why AWS decided to build the Data on EKS project and provide patterns for EKS customers to use to deploy data platforms, machine learning and GenAI tools on EKS clusters. They talk about what's included and what's not included with each of these patterns and whats coming down the line. Check out our website at https://kubernetesbytes.com/ Cloud Native News: https://kubernetes.io/blog/2024/08/16/kubernetes-1-31-prevent-persistentvolume-leaks-when-deleting-out-of-order/ https://kubernetes.io/blog/2024/08/16/matchlabelkeys-podaffinity/ https://kubernetes.io/blog/2024/08/15/kubernetes-1-31-volume-attributes-class/ https://roadmap.vcluster.com/changelog/vcluster-v020-ga https://www.cloudbees.com/blog/cloudbees-acquires-launchable-to-enable-development-teams-to-iterate-faster?Product=Launchable&Tag=Blog%2CAI%2CLaunchable%20Update Show links: https://awslabs.github.io/data-on-eks/ https://www.youtube.com/watch?v=G9aNXEu_a8k https://github.com/awslabs/data-on-eks https://www.linkedin.com/in/alex-lines-aws/ https://www.linkedin.com/in/varaprofile/ Timestamps: 00:01:45 Cloud Native News 00:12:15 Interview with Alex and Vara 00:58:21 Key takeaways…

1
Deploy and fine-tune LLM models on Kubernetes using KAITO 44:17

36 weeks fa44:17

44:17

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Sachi Desai, Product Manager and Paul Yu, Sr. Cloud Advocate at Microsoft to talk about the open source KAITO project. KAITO is the Kubernetes AI Toolchain Operator that enables AKS users to deploy open source LLM models on their Kubernetes clusters. They discuss how KAITO helps with running AI-enabled applications alongside the LLM models, how it helps users bring their own LLM models and run them as containers, and how KAITO helps them fine-tune open source LLMs on their Kubernetes clusters. Check out our website at https://kubernetesbytes.com/ Cloud Native News: https://azure.github.io/AKS/2024/07/30/azure-container-storage-ga https://github.blog/news-insights/product-news/introducing-github-models/ Show links: Azure/kaito: Kubernetes AI Toolchain Operator - https://github.com/Azure/kaito/tree/main https://www.youtube.com/watch?v=3cGmHDjR_3I&list=PLc3Ep462vVYtgN4rP1ThTJd2UlsBc2sou&index=2 https://aka.ms/cloudnative/learnlive/intelligent-apps-on-aks/episode-2 Jumpstart AI Workflows With Kubernetes AI Toolchain Operator - The New Stack - https://thenewstack.io/jumpstart-ai-workflows-with-kubernetes-ai-toolchain-operator https://paulyu.dev/article/soaring-with-kaito/ Concepts - Fine-tuning language models for AI and machine learning workflows - Azure Kubernetes Service | Microsoft Learn - https://learn.microsoft.com/en-us/azure/aks/concepts-fine-tune-language-models Keep up to date on the most recent announcements by following some of the KAITO engineers on LinkedIn: Fei Guo - https://www.linkedin.com/in/fei-guo-a48319a/ Ishaan Sehgal - https://www.linkedin.com/in/ishaan-sehgal/ Timestamps: 00:02:15 Cloud Native News 00:05:34 Interview with Sachi and Paul 00:42:08 Key takeaways…

1
The business case for cloud-native and Kubernetes 54:24

38 weeks fa54:24

54:24

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Danielle Cook - VP of Marketing, appCD and Co-chair, CNCF Cartografos Working Group, CNCF. The discussion dives into how technical individual contributors can and should think about a business case for cloud native adoption. They talk about the cloud native maturity model and also discuss the different things business leaders care about. Check out our website at https://kubernetesbytes.com/ Cloud Native News: https://www.chainguard.dev/unchained/chainguard-series-c https://www.cnbc.com/2024/07/23/google-wiz-deal-dead.html https://www.redhat.com/en/blog/what-you-need-to-know-red-hat-openshift-416 https://blog.kubeflow.org/kubeflow-1.9-release/ https://talks.devopsdays.org/devopsdays-boston-2024/cfp Show links: https://www.linkedin.com/in/danielle-cook-/ https://maturitymodel.cncf.io/ https://community.cncf.io/cncf-cartografos-working-group/ https://tag-app-delivery.cncf.io/whitepapers/platform-eng-maturity-model/ Timestamps: 00:01:36 Cloud Native News 00:12:07 Interview with Danielle 00:51:20 Key takeaways…

1
Building the AI Hyperscaler with Kubernetes 54:56

42 weeks fa54:56

54:56

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Brandon Jacobs, an Infrastructure architect at Coreweave. They discuss how Coreweave has adopted Kubernetes to build the AI hyperscaler. The discussion dives into details around how Coreweave handles Day 0 and Day 2 operations for AI labs that need access to GPUs. They also talk about lessons learnt and best practices for building a Kubernetes based cloud. Check out our website at https://kubernetesbytes.com/ Episode Sponsor: Nethopper Learn more about KAOPS: nethopper.io For a supported-demo: info@nethopper.io Try the free version of KAOPS now! https://mynethopper.com/auth Cloud Native News: https://siliconangle.com/2024/06/24/ollama-addresses-remote-execution-flaw-following-wiz-discovery/ https://siliconangle.com/2024/06/18/suse-acquires-kubernetes-observability-startup-stackstate/ Show links: https://www.linkedin.com/in/brandonrjacobs/ https://www.coreweave.com/ Timestamps: 00:01:39 Cloud Native News 00:05:30 Interview with Brandon 00:51:37 Key takeaways…

1
Shifting Minds: Exploring OpenShift's AI Landscape 1:05:07

44 weeks fa1:05:07

1:05:07

Ryan Wallner and Bhavin Shah talk to Andy Grimes about the OpenShift AI Landscape. Check out our website at https://kubernetesbytes.com/ Episode Sponsor: Nethopper - Learn more about KAOPS: @nethopper.io - For a supported-demo: info@nethopper.io - Try the free version of KAOPS now! https://mynethopper.com/auth Links - https://youtube.com/watch?v=nAT9U1vJ8x0 - https://www.theregister.com/2024/06/12/kubertenes_decade_anniversary/ - https://www.businesswire.com/news/home/20240606882860/en/Mirantis-Collaboration-with-Pure-Storage-Simplifies-Data-Management-with-Kubernetes - https://falco.org/blog/falco-0-38-0/ - https://au.finance.yahoo.com/news/rancher-government-successfully-using-harvester-121100125.html - https://www.youtube.com/@PlatformEngineering - Video: https://www.youtube.com/watch?v=tZj8j3fdXy4 - Virtual Road Shows: https://www.redhat.com/en/north-america-red-hat-aws - AWS Gameday August 22nd: TBS - Boston Childrens Hospital RHOAI: https://www.redhat.com/en/creating-chris - IBM Open Source AI https://www.youtube.com/watch?v=SuGedexBudQ&t=141s…

1
Training Machine Learning (ML) models on Kubernetes 55:29

46 weeks fa55:29

55:29

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Bernie Wu, VP Strategic Partnerships and AI/CXL/Kubernetes Initiatives at Memverge. They discuss about how Kubernetes is the most popular platform to run AI model training and model inferencing jobs. The discussion dives into model training, talking about different phases of a DAG, and then talk about how Memverge can help users with efficient and cost-effective model checkpoints. The discussion goes into topics like saving costs by using spot instances, hot restart of training jobs, reclaiming unused GPU resources, etc. Check out our website at https://kubernetesbytes.com/ Episode Sponsor: Nethopper Learn more about KAOPS: @nethopper.io For a supported-demo: info@nethopper.io Try the free version of KAOPS now! https://mynethopper.com/auth Cloud Native News: https://www.aquasec.com/blog/linguistic-lumberjack-understanding-cve-2024-4323-in-fluent-bit/ https://kubernetes.io/blog/2024/05/20/completing-cloud-provider-migration/ https://thenewstack.io/introducing-aks-automatic-managed-kubernetes-for-developers/ https://www.harness.io/blog/harness-to-acquire-split Show Links: https://www.linkedin.com/in/berniewu/ https://criu.org/Main_Page https://memverge.com/ https://youtu.be/tY8YOMRuqWI?si=yB3hHqLUpYPZ-KWN https://youtu.be/ND4seSKpJHI?si=shh0iuA9qC-dO6eb Timestamps: 01:04 Cloud Native News 08:47 Interview with Bernie 51:40 Key takeaways…

1
The evolution of service mesh technologies 1:08:00

48 weeks fa1:08:00

1:08:00

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Christian Posta - VP and Global Field CTO at Solo.io about all things Service Mesh. They discuss how things have evolved from the early Linkerd days to sidecar less istio service mesh implementations. They also talk about how service mesh can help you connect to application components running outside Kubernetes, and how developers and platform engineers have a shared responsibility model when it comes to implementing service mesh using internal developer platforms. Check out our website at https://kubernetesbytes.com/ Episode Sponsor: Nethopper Learn more about KAOPS: @nethopper.io For a supported-demo: info@nethopper.io Try the free version of KAOPS now! https://mynethopper.com/auth Cloud Native News: https://loft.sh/blog/our-24m-series-a-led-by-khosla-ventures/ https://www.harness.io/blog/celebrating-150m-in-new-financing-to-accelerate-innovation https://www.akamai.com/newsroom/press-release/akamai-announces-intent-to-acquire-api-security-company-noname https://www.linkedin.com/posts/rouvenbesters_its-official-the-otomi-platform-has-activity-7194604616901120000-48g7?utm_source=share&utm_medium=member_desktop https://www.wiz.io/blog/celebrating-our-1-billion-funding-round-and-12-billion-valuation Show Links: https://devsummit.infoq.com/conference/boston2024 https://www.solo.io/topics/cakes-stack/ https://www.solo.io/ Timestamps: 00:06:10 Cloud Native News 00:15:37 Interview with Torsten 01:01:58 Key takeaways…

Kubernetes Bytes

1
What are Vector Databases 1:03:06

50 weeks fa1:03:06

1:03:06

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Torsten Steinbach - VP, Chief Architect for Analytics & AI at EDB about all things Vector Databases, Postgres, and why Data is important for building AI platforms. The discussion dives into how vector databases are different than relational databases and why using Postgres extensions helps organizations use their existing data for AI applications. Check out our website at https://kubernetesbytes.com/ Kubernetes Community Days (KCD) in New York City on May 22nd, use the promo code “KUBERNETESBYTES” to get a 10% discount on your registration fees! Episode Sponsor: Nethopper Learn more about KAOPS: @nethopper.io For a supported-demo: info@nethopper.io Try the free version of KAOPS now! https://mynethopper.com/auth Cloud Native News: https://www.reuters.com/markets/deals/ibm-nearing-buyout-deal-hashicorp-wsj-reports-2024-04-23/ https://www.wiz.io/blog/wiz-acquires-gem-security-to-reinvent-threat-detection-in-the-cloud https://techcrunch.com/2024/04/18/wiz-is-in-talks-to-buy-lacework-for-150-200m-security-firm-was-last-valued-at-8-3b/ https://www.prnewswire.com/news-releases/coreweave-secures-1-1-billion-in-series-c-funding-to-drive-the-next-generation-of-cloud-computing-for-the-future-of-ai-302133328.html https://kubernetes.io/blog/2024/04/17/kubernetes-v1-30-release https://dok.community/blog/become-a-data-on-kubernetes-in-2024-ambassador/ Show Links: https://www.enterprisedb.com/news/edb-acquires-splitgraph https://www.enterprisedb.com/resources/events https://www.enterprisedb.com/ Timestamps: 00:03:22 Cloud Native News 00:17:45 Interview with Torsten 00:57:00 Key takeaways…

Kubernetes Bytes

1
KubeCon EU Paris News Recap 47:39

1 year fa47:39

47:39

Join Bhavin Shah and Ryan Wallner for a recap of announcments and news from KubeCon Paris 2024. Kubernetes Community Days (KCD) in New York City on May 22nd, use the promo code “KUBERNETESBYTES” to get a 10% discount on your registration fees! Nethopper Learn more about KAOPS: @nethopper.io For a supported-demo: info@nethopper.io Try the free version of KAOPS now! https://mynethopper.com/auth News https://about.gitlab.com/blog/2024/03/20/oxeye-joins-gitlab-to-advance-application-security-capabilities/ https://www.redhat.com/en/blog/unveiling-red-hat-openshift-415 https://developer.nvidia.com/blog/nvidia-nim-offers-optimized-inference-microservices-for-deploying-ai-models-at-scale/ https://www.acorn.io/resources/blog/our-new-focus-developing-an-llm-app-platform-based-on-gpt-script-technology?fromOther=true https://loft.sh/blog/deliver-secure-kubernetes-multi-tenancy-with-new-vcluster-in-rancher-integration/ https://www.observeinc.com/blog/stepping-on-the-gas/ https://thenewstack.io/kubecost-2-2-covers-carbon-cost-monitoring-and-more/ https://thenewstack.io/ovhcloud-unveils-roadmap-to-take-on-hyperscalers-from-europe/ https://www.suse.com/c/meet-rancher-prime-3-0/ https://www.suse.com/c/suse-releases-edge-3-0-highly-validated-edge-optimized-stack/ https://www.fermyon.com/blog/introducing-spinkube-fermyon-platform-for-k8s https://www.cncf.io/blog/2024/03/19/announcing-the-ai-working-groups-new-cloud-native-artificial-intelligence-whitepaper/ https://github.com/Azure/kaito https://azure.microsoft.com/en-us/updates/public-preview-kubernetes-ai-toolchain-operator-kaito-addon-for-aks/ https://cloudnativenow.com/features/solo-io-delivers-on-cilium-support-promise-for-gloo-networks/ https://docs.solo.io/gloo-network/latest/about/overview/ https://github.com/kosmos-io/kosmos https://gateway.envoyproxy.io/blog/2024/03/14/announcing-envoy-gateways-1.0-release/ https://newrelic.com/press-release/20240319 https://siliconangle.com/2024/03/29/aviatrix-revolutionizes-networking-security-distributed-cloud-firewall-kubernetes-kubeconeu/…

Kubernetes Bytes

1
Open Policy Agent (OPA) 101 1:07:20

1 year fa1:07:20

1:07:20

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Charlie Egan, Sr. Developer Advocate at Styra about all things Open Policy Agent or OPA. This episode is meant to be a 101 level episode, where we will learn what OPA is and how it can help improve the security posture for your applications running on Kubernetes. The discussion dives into some of the use cases for OPA and how it helps with Kubernetes admission control, auditing, etc. Check out our website at https://kubernetesbytes.com/ Episode Sponsor: Elotl Links: https://elotl.co/luna https://www.elotl.co/luna-free-trial Timestamps: 07:46 Interview with Charlie 01:02:00 Key takeaways Show Links: OPA Ecosystem https://www.openpolicyagent.org/ecosystem/ OPA Envoy Integration https://github.com/open-policy-agent/opa-envoy-plugin Charlie's site: https://charlieegan3.com OPA Docs: https://www.openpolicyagent.org/docs/latest/ OPA Playground: https://play.openpolicyagent.org OPA Slack: https://communityinviter.com/apps/openpolicyagent/signup…

Kubernetes Bytes

1
Ops Ops Hooray! Navigating IDPs from an Ops perspective 58:17

1 year fa58:17

58:17

Join hosts Ryan Wallner and Bhavin Shah of Kubernetes Bytes as they explore the complexities of Internal Developer Platforms (IDPs) with Chris Munford, CEO, and Dan Donahue, Solution Architect of Nethopper. In this episode, the team discusses the challenges of constructing IDPs, achieving the optimal balance of flexibility and prescriptive golden paths. The episode dives into the unique operations perspective required for effective implementation. Gain valuable insights and practical advice from industry leaders on navigating the evolving landscape of IDPs. Don't miss this insightful conversation on unlocking the full potential of IDPs for your organization. Timestamps 00:06:24 - Discussion with Chris and Dan 00:51:44 - Takeaways Episode Links What Happened to Platform Engineering? (ebook/pdf) LinkedIn Audio Recording "What Happened to Platform Engineering" Website resources on platform engineering/IDP LinkedIn Newsletter about KAOPS/Platform Engineering/IDP…

Kubernetes Bytes

1
Generative AI on Kubernetes 1:15:56

1 year fa1:15:56

1:15:56

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin sit down with Janakiram MSV - an advisor, analyst and architect to talk about how users can run Generative AI models on Kubernetes. The discussion revolves around Jani's home lab and his experimentation with different LLM models and how to get them running on NVIDIA GPUs. Jani has spent the past year becoming a subject matter expert in GenAI, and this discussion highlights all the different challenges he faced and what lessons he learnt from them. Check out our website at https://kubernetesbytes.com/ Episode Sponsor: Elotl https://elotl.co/luna https://www.elotl.co/luna-free-trial Timestamps: 02:02 Cloud Native News 15:31 Interview with Jani 01:11:00 Key takeaways Cloud Native News: https://www.techerati.com/press-release/octopus-deploy-acquires-codefresh-to-boost-kubernetes-and-cloud-native-delivery/ https://www.civo.com/blog/kubefirst-joins-civo https://cast.ai/kubernetes-cost-benchmark https://www.techradar.com/pro/vmware-customers-are-jumping-ship-as-broadcom-sales-continue-heres-where-theyre-moving-to https://cloudonair.withgoogle.com/events/techbyte-making-ai-ml-scalable-cost-effective-gke https://dok.community/dok-events/dok-day-kubecon-paris/ https://training.linuxfoundation.org/certification/certified-argo-project-associate-capa Show Links: https://www.youtube.com/janakirammsv https://www.linkedin.com/in/janakiramm/ - NVIDIA Container Toolkit - https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/index.html NVIDIA Device Plugin - https://github.com/NVIDIA/k8s-device-plugin NVIDIA Feature Discovery - https://github.com/NVIDIA/gpu-feature-discovery Hugging Face Text Gen Inference - https://huggingface.co/docs/text-generation-inference/index Hugging Face Text Embeddings Inference - https://huggingface.co/docs/text-embeddings-inference/index ChromaDB - https://www.trychroma.com/…

Kubernetes Bytes

1
IDPs Unveiled: Accelerating Deployment on Kubernetes 59:52

1 year fa59:52

59:52

In this episode of Kubernetes Bytes. Hosts Bhavin and Ryan dive into what makes up a Internal Development Platform (IDP). Bhavin and Ryan help to define what an IDP is, how it relates to the overarching topic of platform engineering as well as the pros and cons of implementing an IDP. 00:03:01 - News 00:12:11 - Discussion Topic on IDPs Discount for KCD New York! https://community.cncf.io/events/details/cncf-kcd-new-york-presents-kcd-new-york-2024/ Please make sure to use the voucher code “KUBERNETESBYTES” to get a 10% discount News: https://www.cncf.io/blog/2024/02/08/strimzi-joins-the-cncf-incubator/ https://github.com/Ume0344/mongokube https://www.businesswire.com/news/home/20240207876324/en/ZEDEDA-Secures-72M-in-Growth-Capital-to-Meet-the-Skyrocketing-Demand-for-Edge-AI-and-Computing https://fintech.global/2024/02/15/ktrust-secures-5-3m-in-seed-funding-to-revolutionise-kubernetes-security https://thenewstack.io/kubernetes-predictions-were-wrong/ https://cloudnativenow.com/features/crossplane-maintainers-add-python-support-to-control-plane/ https://blog.crossplane.io/crossplane-v1-15/ Links: Mercado Libre IDP Talk: https://youtu.be/y-X1ZcPxRnI?si=q9UoglFrZycIcZ_l IDP Companies and Projects Cortex OpsLevel Port Argonaut Upbound Nethopper Mia Platform Amazee Configure8 Otomi-Core BackStage Roadie Qovery Plural Kubermatic Clutch Lagoon Garden.io Portainer…

Kubernetes Bytes

1
Running Kubernetes at the Edge using K3s 53:51

1 year fa53:51

53:51

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Jason Dobies - Director of Edge Engineering at SUSE to talk about all things K3s. They discuss why Kubernetes is best suited for Edge deployments, and why K3s was built and how it helps users architect their edge solutions. The discussion goes into topics like Security, Storage, High Availability at the Edge. Check out our website at https://kubernetesbytes.com/ Episode Sponsor: Elotl https://elotl.co/luna https://www.elotl.co/luna-free-trial Timestamps: 01:20 Cloud Native News 06:01 Interview with Jason 50:42 Key takeaways Cloud Native News: https://vmblog.com/archive/2024/01/29/dynatrace-to-acquire-runecast-to-enhance-cloud-native-security-and-compliance.aspx - https://chronosphere.io/news/chronosphere-acquires-calyptia/ Show links: https://k3s.io/ https://www.linkedin.com/in/jdob/…

Kubernetes Bytes

1
Running multi-tenant Kubernetes clusters using vCluster 57:58

1 year fa57:58

57:58

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Lukas Gentele, Co-founder and CEO of Loft Labs to talk about the vCluster project. They discuss how vCluster helps organizations run multi-tenant Kubernetes clusters, where each tenant gets access to a CNCF-conformant Kubernetes cluster, while still being able to deploy everything they need to build and run their applications on Kubernetes. The discussion goes into topics like how Security, Storage, CICD and GitOps work for virtual clusters running on the host clusters. Check out our website at https://kubernetesbytes.com/ Episode Sponsor: Elotl https://elotl.co/luna https://www.elotl.co/luna-free-trial Timestamps: 00:59 Cloud Native News 06:51 Interview with Lukas 55:09 Key takeaways Cloud Native News: https://www.redhat.com/en/blog/krknchaos-joining-cncf-sandbox https://cloudnativenow.com/features/red-hat-makes-idp-based-on-backstage-generally-available/ https://trilio.io/resources/trilio-announces-backup-and-recovery-for-red-hat-openshift-on-ibm-power-systems/ https://snyk.io/news/snyk-acquires-runtime-data-pioneer-helios/ Show links: https://loft.sh/blog/how-codefresh-uses-vcluster-to-provide-hosted-argo-cd/ https://www.coreweave.com/blog/coreweave-and-loft-labs-leverage-vcluster-in-kubernetes-at-scale https://www.linkedin.com/in/gentele/ https://www.vcluster.com/ https://loft.sh/ https://slack.loft.sh/…

Kubernetes Bytes

1
Platform Engineering at NYTimes 54:48

1 year fa54:48

54:48

In the first episode of Season 4 for the Kubernetes Bytes podcast, Bhavin sits down with Ahmed Bebars, Staff Software Engineer at NYTimes to talk about how the times uses Kubernetes and Platform Engineering to accelerate their developer productivity and improve developer experience. They talk about what the technology stack at NYTimes looks like, how the platform team has built a resilient platform on Amazon EKS and share some best practices for anyone starting their journey with Platform Engineering. Check out our website at https://kubernetesbytes.com/ Timestamps: 01:20 Cloud Native News 09:55 Interview with Ahmed 50:04 Key takeaways Cloud Native News: https://www.aquasec.com/news/60m-additional-funding/ https://devclass.com/2023/12/12/docker-buys-atomicjar-to-integrate-container-based-test-automation/ https://www.businessinsider.com/armory-acquired-startup-harness-7-million-2023-12 https://techcrunch.com/2023/12/19/scaleops-looks-to-cut-cloud-bills-by-automating-kubernetes-configurations https://wraltechwire.com/2023/12/21/ciscos-latest-cloud-play-exec-explains-the-deal-for-tech-startup-isovalent/ https://www.kubernetes.dev/resources/release/ Show links: https://open.nytimes.com/ https://tickets.kcdnewyork.com/ https://github.com/abebars https://www.linkedin.com/in/ahmedbebars/ https://github.com/nytimes…

Kubernetes Bytes

1
Byte-sized: Exploring the Basics of AI in Plain English 1:00:18

1 year fa1:00:18

1:00:18

Learn along side Bhavin and Ryan as they dig into some of basics of Artificial Intelligence, Machine Learning and Deep Learning. They explore what terms mean, what the basic differences are and take an introductory look at how companies approaches to building and using models for various use cases. News https://aws.amazon.com/blogs/aws/amazon-eks-pod-identity-simplifies-iam-permissions-for-applications-on-amazon-eks-clusters/ https://aws.amazon.com/blogs/aws/use-aws-fault-injection-service-to-demonstrate-multi-region-and-multi-az-application-resilience/ Show Links Vector DB Talk DoK https://www.youtube.com/watch?v=uxoqMgFKAlM https://www.kubeflow.org/docs/components/pipelines/v1/introduction/ https://weaviate.io/blog/what-is-a-vector-database https://huggingface.co/ https://docs.ray.io/en/latest/ray-overview/getting-started.html https://kueue.sigs.k8s.io/docs/overview/ https://www.datastax.com/guides/what-is-a-vector-index https://www.datastax.com/guides/what-is-vector-search https://medium.com/building-the-open-data-stack/whats-a-vector-database-c3e8b6bb0436 https://www.pinecone.io/blog/aws-reference-architecture/…

Kubernetes Bytes

1
Kubecon North America 2023: Highlights, Themes and Key Takeaways 57:41

1 year fa57:41

57:41

In this episode, Ryan and Bhavin talk about Kubecon + Cloud Native Con North America 2023 in Chicago, and discuss all the vendor announcements from the past couple of weeks. Kubecon North America was in Chicago and had more than 13500 attendees and shows a continuous increase in adoption of Kubernetes as the platform to run containers, virtual machines, AI workloads, etc. Check out the KubernetesBytes website: https://www.kubernetesbytes.com/ Ads: Ready to shop better hydration, use "kubernetesbytes" to save 20% off anything you order. Try Nom Nom today, go to https://trynom.com/kubernetesbytes and get 50% off your first order plus free shipping. Find all the links to the things we discussed during the episode here: https://docs.google.com/document/d/169mrZGi7oYptuT1nXrmuy-uwIlrAYZ8jJR3p5vRZ5Vo/edit?usp=sharing…

Kubernetes Bytes

1
Universal Control Planes for Kubernetes and Beyond 59:36

1 year fa59:36

59:36

In this episode of KubernetesBytes, Bhavin and Ryan interview Viktor Farcic, a Developer Advocate from Upbound, the company behind Crossplane. Crossplane extends Kubernetes into becoming a universal control plane for more than what runs in Kubernetes, however, you get to manage everything in a Kubernetes-native way. Hear what Viktor has to say about Crossplane and what hes been up to. 01:35 Introduction 08:29 Cloud Native News 16:15 Crossplane with Viktor Cloud Native News https://www.chainguard.dev/unchained/series-b-funding https://www.honeycomb.io/blog/introducing-honeycomb-for-kubernetes?hss_channel=lcp-12957659 https://techcrunch.com/2023/10/18/microsoft-launches-radius-an-open-source-application-platform-for-the-cloud/ https://docs.radapp.io/ https://thehackernews.com/2023/10/urgent-new-security-flaws-discovered-in.html https://www.techtarget.com/searchdatabackup/news/366557752/CloudCasa-now-offers-self-hosted-Kubernetes-backup-service https://finance.yahoo.com/news/kubecost-launches-cloud-cost-optimization-080000850.html Links https://youtube.com/@UCfz8x0lVzJpb_dgWm9kPVrw https://docs.crossplane.io/ https://www.crossplane.io/community…

Kubernetes Bytes

1
DevOpsDays Boston - Helping developers be more productive in a multi-cloud world 35:02

1 year fa35:02

35:02

In this episode of Kubernetes Bytes, Ryan and Bhavin sit down with Michael o'leary and Ibett A to talk about how developers can build multi-cloud secure architectures using Kubernetes and the principles of Shift Left and DevSecOps. Check out the KubernetesBytes website: https://www.kubernetesbytes.com/ Join the Kubernetes Bytes slack using: https://bit.ly/k8sbytes Ads: Ready to shop better hydration, use "kubernetesbytes" to save 20% off anything you order. Timestamps: 00:00 Interview with Michael o'leary 18:50 Interview with Ibett A Show links: Boston Kubernetes Meetup - https://www.meetup.com/boston-kubernetes-meetup/…

Kubernetes Bytes

1
DevOpsDays Boston - Platform Engineering and Internal Developer Platforms 31:12

1 year fa31:12

31:12

In this episode of Kubernetes Bytes, Ryan and Bhavin sit down with Alexandre Pauwels and Kevin Scheunemann at DevOps Days Boston to talk all about IDPs and Platform Engineering. The discussion focuses on how organizations can build IDPs from open source tools and the how DevOps, SRE and Platform Engineering teams work together. Check out the KubernetesBytes website: https://www.kubernetesbytes.com/ Join the Kubernetes Bytes slack using: https://bit.ly/k8sbytes Ads: Ready to shop better hydration, use "kubernetesbytes" to save 20% off anything you order. Timestamps: 00:00 Interview with Alexandre Pauwels 16:00 Interview with Kevin Scheunemann Show links: https://bitmantle.com/…

Kubernetes Bytes

1
DevOpsDays Boston - Real value of community 42:41

1 year fa42:41