Blog
Notes from building LLM systems for the enterprise: agents, retrieval, evaluation and LLMOps.
AI Agent Observability in Production: How to Trace an Enterprise Agent with Self-Hosted Langfuse
What AI agent observability is, why agentic components need it, what tracing a modern agent actually means, and how I traced an on-premise enterprise agent with self-hosted Langfuse and LangGraph.
- Agents
- Observability
- LLMOps
How to Evaluate an Agentic Text-to-SQL System in Production
Execution accuracy gives one number to very different failures. How I evaluated an agentic text-to-SQL system in production with independent metric families: retrieval, output and SQL components, never folded into a single score.
- Agents
- Evaluation
- Text-to-SQL
How to Make LLM-Generated SQL Safe to Run in Production
A system prompt is a request, not a contract. Here's the deterministic guard that parses every query an agent writes and refuses anything that isn't a safe read, before it reaches a production ERP.
- Agents
- Guardrails
- Text-to-SQL