· Rajat Pandit · AI Infrastructure
Continuous Batching in vLLM: Killing the Hardware Idle
If your GPUs are idling at 40% utilization during inference, you are burning capital on memory bottlenecks, not computation.
From the Front Lines of Tech
Sharing strategic insights and lessons from over 20 years of building scalable systems, leading high-performing teams, and navigating complex technology shifts.
Deploying Agentic AI as a Service (AaaS)
Deep dive into deploying agentic ai as a service (aaas).
· Rajat Pandit · StrategyThe Shift to GenUI: Why Fixed Dashboards Are Dying
Fixed dashboards are the legacy interfaces of 2024. Your users are no longer satisfied looking at pre-canned charts; they expect the interface itself to adapt to the context of their query.
Scaling Recommendations with TPU SparseCore
TPU SparseCore: How specialized silicon solves the massive memory bottleneck of embedding lookups in large-scale recommendation models.
Measuring Tool Use Correctness & Plan Adherence
Deep dive into measuring tool use correctness & plan adherence.
· StrategyThe Agency as an R&D SaaS Incubator
Deep dive into the agency as an r&d saas incubator.