1.5 million+ TPS
Each pod will have local bucket and then implement leaky bucket algorithm.
Start bucket size with big number
Learning from rate limiting journey
Service with smaller threshold has higher precision
higher threshold has upto 10% error rate
pod has its own swimlane
-------------------------------------------------------------------------
For inter+intra rate limit, need to synch API-GW and serviceMesh.
Unified config management
Naavik knows, where service resides (Kubecon Paris)
Canary release pattern : First canary call, the service registry will read from DB and put it in cache. For remaining, no need to access DB. Response from cache. Canary pod can put value in S3 bucket, for further optimization, and notify all pods to read form s3 bucket
Linkerd
* rust based data plane is pretty light
* We can use any Ingress Controllers (IC) with Linkerd. IC are based on (1) NGINX (2) Envoy (2) HA Proxy. NGINX IC has Mister-Minion model
* security : authz policy, mTLS
* intra cluster URL. So no need to go to LB for intra cluster.
* Gateway API (GW-API) integration
* 1.17 Linkerd has many new features.
* canary deployment
Object Store for Vector DB app
github.com/thotz/python-vectordbapp-ceph
It can search image and text both
it uses RGW bucket and in-memory channel
CR has embedded function
CR is per bucket
CR is matched with milvus collection like, vector dimensions, index type, vector metric, staticjk schema
Data Plane Technologies for Load Balancer
LB has many features
These features are supported by data plane technologies
data plane has many technologies, including open source.
1. eBPF :
2. VPP
- L2-L4 n/w
- graph based network
- fast lookup
DPDK :
- latency reduce by bypassing kernel space
- large page and pool.
1. eBPF - XDP model
2. VPP-DPDK model
KubeCon 2024 India. Keynotes
- Upcoming KCDs
1. April, 2025 at Chennai
2. June, 2025 at Bangalore
- Kubestronaut : Takeoffs begin in 2025. In this announcement, India's map was incorrect.
- Upcoming KubeCon and CloudNativeCon
Hydrabad August 6 to 7 , 2025
LF Networking will be launched in phase 1 under LF India
=============================================================
Takeaway points : Flipkart
Ambient proxy is better. Sidecar cannot scale as per pod's TPS, Fan out etc.
For PaaS Controller is better than Helm to deploy
=============================================================
Takeaway points :
- K8s is everywhere
- Nothing is complete with AI
- Starching the limits of K8s
