Last year, I deployed our first LLM application to Cloud Run. What should have taken hours took three days. Cold starts killed our latency. Memory limits caused crashes. Timeouts broke long-running requests. After deploying 20+ LLM applications to Cloud Run, I’ve learned what works and what doesn’t. Here’s the complete guide. Figure 1: Cloud Run […]
Read more →Search Results for: name
Platform Engineering: Building Internal Developer Platforms That Actually Work
After spending two decades building and scaling engineering organizations, I’ve come to a conclusion that might seem counterintuitive: the biggest productivity killer in most enterprises isn’t technical debt, legacy systems, or even organizational politics. It’s cognitive load. Developers spend an unconscionable amount of time navigating infrastructure complexity instead of solving business problems. Platform engineering, done […]
Read more →Tips and Tricks – Automate Security Scanning in CI Pipeline
Catch vulnerabilities early by integrating security scanning into your CI workflow.
Read more →Mastering AWS EKS Deployment with Terraform: A Comprehensive Guide
Introduction: Amazon Elastic Kubernetes Service (EKS) simplifies the process of deploying, managing, and scaling containerized applications using Kubernetes on AWS. In this guide, we’ll explore how to provision an AWS EKS cluster using Terraform, an Infrastructure as Code (IaC) tool. We’ll cover essential concepts, Terraform configurations, and provide hands-on examples to help you get started […]
Read more →Building Production RAG Applications with LangChain: From Document Ingestion to Conversational AI
Introduction: LangChain has emerged as the dominant framework for building production Retrieval-Augmented Generation (RAG) applications, providing abstractions for document loading, text splitting, embedding, vector storage, and retrieval chains. By late 2023, LangChain reached production maturity with improved stability, better documentation, and enterprise-ready features. After deploying LangChain-based RAG systems across multiple organizations, I’ve found that its […]
Read more →Tips and Tricks – Implement Trunk-Based Development with Feature Flags
Ship code continuously while controlling feature rollout with runtime flags.
Read more →