Under the Hood: AI Engineering Deep Dives

Most AI agents today are like instant noodles: quick to put together, good enough for a demo, but nowhere close to Michelin-star quality. You paste a prompt into your favorite LLM, tweak a few words, and hope it behaves. The result works… until it doesn’t.​ Agentic Engineering Weekly is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subsc...

Introduction: The Context Length Divide When you look at the landscape of large language models today, there’s a striking gap that separates the leaders from the rest. Open-source models often hit a wall around 32,000 tokens, while industry giants like OpenAI and Anthropic casually discuss 128K, sometimes even a million-token context windows. It’s tempting to assume this is simply a matter of havi...