Designing intelligent systems, one layer at a time. ~ Nithin Mohan T K
Introduction: Amazon Elastic Container Registry (ECR) is a fully managed container registry service provided by AWS. It enables developers to store, manage, and deploy Docker container images securely. In this guide, we’ll explore how to provision a new AWS ECR using Terraform, a popular Infrastructure as Code (IaC) tool. We’ll cover not only the steps […]
Read more →Use structured JSON logging for better searchability and analysis in cloud environments.
Read more →Introduction: Production LLM applications need structured prompt management—not ad-hoc string concatenation scattered across code. Prompt templates provide reusable, parameterized prompts with consistent formatting. Versioning enables A/B testing, rollbacks, and tracking which prompts produced which results. This guide covers practical prompt template patterns: template engines and variable substitution, prompt registries, version control strategies, A/B testing frameworks, […]
Read more →Last year, I deployed our first LLM application to Cloud Run. What should have taken hours took three days. Cold starts killed our latency. Memory limits caused crashes. Timeouts broke long-running requests. After deploying 20+ LLM applications to Cloud Run, I’ve learned what works and what doesn’t. Here’s the complete guide. Figure 1: Cloud Run […]
Read more →Introduction: Prompt optimization is the systematic process of improving prompts to achieve better LLM outputs—higher accuracy, more consistent formatting, reduced latency, and lower costs. Unlike ad-hoc prompt engineering, optimization treats prompts as artifacts that can be measured, tested, and iteratively improved. This guide covers the techniques that make prompts more effective: structural patterns that improve […]
Read more →Prevent cascade failures by implementing circuit breaker pattern for external service calls.
Read more →