Read what ships.

41Stack Overflow · practice

Survey Says: You'll swap the model, but everything you build around it is staying put

Stacklok surveyed technical leaders to understand enterprise AI adoption and vendor lock-in concerns. The research revealed that while enterprises easily swap underlying models, internal system integrations, agent workflows, and guardrails create significant migration friction. Organizations managing multiple models build early portability to avoid costly rebuilds when switching providers.

DEPTH ■■■■■4 min read6 days ago

Machine Learning

Sign in to save and rate

42ByteByteGo · architecture

How the Math Used in 19th-Century Heat Physics Helps LLMs Understand Sentences

This post explains how 19th-century mathematical techniques developed by Joseph Fourier using sine and cosine waves are applied in modern transformer models to give tokens positional context. The author demonstrates how word order dictates semantic meaning and how multi-speed rotational patterns provide bounded, scalable positional encodings. Ultimately, this mathematical structure helps attention mechanisms account for relative token distances during training.

DEPTH ■■■■■13 min read13 days ago

Sign in to save and rate

43Stack Overflow · architecture

Don't forget about the UI for AI

OpenAI developed ChatGPT Space, a real-time collaborative workspace designed to allow software engineering teams and individual AI agents to work together on shared artifacts. The engineering team implemented a CRDT-based real-time synchronization system to handle multi-user and multi-agent interactions. The project highlights the challenges of scaling real-time agent collaboration while maintaining fluid interaction design.

DEPTH ■■■■■26 min read7 days ago

Machine Learning

Sign in to save and rate

44Martin Fowler · practice

Bliki: Sensible Default

The engineering post introduces the concept of a sensible default as an alternative to best practices in software development. Sensible defaults serve as reliable starting points for tasks in the absence of hard constraints, while still allowing teams to adapt and override them when context requires. Organizations like Thoughtworks utilize playbooks of these defaults to guide initial work while encouraging regular reflection and adjustment.

DEPTH ■■■■■2 min read4 weeks ago

Sign in to save and rate

45Stack Overflow · practice

Production-grade LLMs and agents: a field guide

Deploying LLMs and agents to production requires surrounding probabilistic models with deterministic machinery like evaluations, guardrails, and audit trails rather than relying on the model alone. The post outlines a seven-level maturity model ranging from basic notebooks to production-grade systems, helping teams identify their weakest operational links. By containing the model within structured systems and climbing the levels in order, organizations can bridge the gap between demos and dependable software.

DEPTH ■■■■■4 min read7 days ago

Machine Learning

Sign in to save and rate

46Martin Fowler · practice

Fragments: September 29

This post discusses observations on coding agents, focusing on their persistence, the role of training material in hacking behavior, and the need for greater safety measures and liability. It examines experiments with unlimited tokens and explores regulatory and educational perspectives on agentic AI.

DEPTH ■■■■■4 min read4 weeks ago

Sign in to save and rate

47ByteByteGo · tutorial

EP230: RAG vs Agentic RAG

This post provides brief conceptual overviews of several engineering topics, including traditional RAG versus Agentic RAG, OAuth versus OIDC, and the standard Linux directory structure. Traditional RAG relies on a single retrieval step, whereas Agentic RAG allows iterative searches and tool selection until sufficient evidence is gathered. The text outlines how OAuth handles authorization and OIDC adds user authentication, alongside a breakdown of core Linux directories like boot, dev, bin, and etc.

DEPTH ■■■■■3 min read2 days ago

Sign in to save and rate

48Stack Overflow · practice

AI says you’re right, formal methods say you’re wrong

Engineers often struggle with the intimidating reputation and adoption of formal verification tools like TLA+ and its derivatives, despite their value in catching elusive edge cases and race conditions. Using specification languages to model systems allows teams to test fixes and optimizations mathematically before deploying them to production. This approach helps prevent complex bugs that take weeks to manifest in real-world traffic.

DEPTH ■■■■■28 min read11 days ago

Machine Learning

Sign in to save and rate

49ByteByteGo · architecture

Why Do LLMs Lie?

Large language models hallucinate because they are trained to predict plausible text rather than verify facts, creating confident falsehoods. Teams can reduce these errors using retrieval-augmented generation, external tools, explicit instructions to handle missing evidence, and verification processes. However, models still require careful monitoring because fluent explanations do not guarantee accuracy.

DEPTH ■■■■■12 min read3 weeks ago

Sign in to save and rate

50Stack Overflow · practice

Why your platform team shouldn't build an AI context layer (even though they probably could)

Engineering teams often underestimate the long-term maintenance required to build and run an internal AI context layer, mistaking a simple vector database for a fully governed knowledge pipeline. Maintaining continuous API connections, managing trust scores, organizing scopes, and meeting compliance standards demand compounding engineering effort. Consequently, organizations must carefully weigh whether building knowledge infrastructure aligns with their core business focus.

DEPTH ■■■■■6 min read11 days ago

Machine Learning

Sign in to save and rate

51Stack Overflow · practice

Your next job doesn’t have a title yet: Emerging role skills Q&A with Cory Hymel of Andela

Researchers analyzed thousands of job postings to understand how artificial intelligence is changing technical skill requirements. The findings indicate that instead of creating a workforce of pure generalists, the market is developing distinct new specialized skill bundles and hybrid roles. Consequently, organizations are facing talent debt as the half-life of technical skills rapidly shrinks.

DEPTH ■■■■■15 min read12 days ago

Testing

Sign in to save and rate

52ByteByteGo · architecture

EP229: 8 Chunking strategies for RAG-based agents

The post provides brief, high-level overviews of various software engineering concepts including eight chunking strategies for RAG, the architecture of Google Translate, agent skills workflows, and the structural differences between PostgreSQL and MySQL. It touches upon how these different components and techniques function theoretically without deep benchmark comparisons. The content serves as a summary refresher on multiple system design topics.

DEPTH ■■■■■3 min read9 days ago

Sign in to save and rate

53Stack Overflow · practice

Why Your Sandbox Never Quite Matches Production (And Why That's Fine)

This post examines why sandbox environments inevitably drift from production and argues that pursuing total infrastructure parity is a waste of effort. Instead of chasing impossible replication, teams should focus on maintaining accurate behavioral contracts and updating mock simulations when upstream services deploy. The result is a targeted approach that prevents integration failures caused by stale assumptions rather than expensive, low-value environmental matching.

DEPTH ■■■■■6 min read13 days ago

Sign in to save and rate

54Stack Overflow · architecture

A Treatise on Model Oriented Programming Languages

An author reflects on a custom model-oriented programming language and IDE they built thirteen years ago, outlining principles and forms of model-oriented development. The article defines model structures and data using a restaurant scenario to compare informal, inline, coupled, and decoupled modeling approaches. Ultimately, the author aims to inspire further research and development into model-oriented programming languages.

DEPTH ■■■■■33 min read2 weeks ago

Sign in to save and rate

55ByteByteGo · architecture

EP228: How SSH Works

This engineering newsletter covers the fundamentals of how SSH establishes secure remote connections through TCP, key exchange, and authentication. It also outlines key techniques for efficient LLM serving, the core anatomy of AI agents, and a structured approach to building evaluation systems.

DEPTH ■■■■■6 min read3 weeks ago

Sign in to save and rate

56Stack Overflow · architecture

Implementing a Modular Master-Agent Telemetry & Diagnostic Framework in Python: Prime-Sentinel Command (PSC)

The post introduces the Prime-Sentinel Command architecture, a master-agent pattern designed to separate centralized governance from autonomous edge execution in distributed telemetry systems. It provides an object-oriented Python implementation where Sentinels handle localized diagnostics and a Prime controller manages orchestration and telemetry intake. This separation avoids bottlenecks and improves fault isolation in health-checking pipelines.

DEPTH ■■■■■3 min read2 weeks ago

Sign in to save and rate

57ByteByteGo · tooling

EP227: Top 9 Places to Use Jev

This post outlines nine practical use cases for a faster and cheaper model called Jev instead of relying solely on frontier LLMs for decision-making tasks. It also reviews the architectural differences between MCP and function calling, and breaks down the context layers used by Claude Code. The text serves as a roundup of current AI engineering concepts and tool comparisons.

DEPTH ■■■■■5 min read4 weeks ago

Sign in to save and rate

58Stack Overflow · practice

Constraints that make developers faster

Julien Verlaguet, CEO of Skip Labs, discusses the design of programming languages and tooling to prevent developer mistakes. The conversation explores balancing code constraints with developer tolerance, the nuances of type systems across different use cases, and how AI agents change the requirements for constraint-based tooling. The key takeaway emphasizes that language choice and constraints must match the specific use case and context rather than a universal standard.

DEPTH ■■■■■23 min read3 weeks ago

Machine Learning

Sign in to save and rate

59Stack Overflow · architecture

Your phone is AI’s newest hardware

An AI research lab develops on-device transformer models and custom kernel-level compilation to power mobile agentic software. By writing optimized edge code and building internal testing environments, the team achieved high execution reliability on mobile operating tasks. The resulting system addresses safety and human-in-the-loop control by restricting access to sensitive applications like banking.

DEPTH ■■■■■27 min read4 weeks ago

Machine Learning

Sign in to save and rate

60Stack Overflow · practice

Taking a look under your agent’s hood

This post discusses the challenges and methods of applying observability to AI agents, which combine traditional distributed systems telemetry with new requirements for monitoring LLMs and multi-step tool calls. The discussion highlights how non-deterministic agent behavior and increased speed of execution make continuous production feedback loops essential for upstream development. Ultimately, integrating observability data into automated testing and development loops helps teams iterate on agent performance.

DEPTH ■■■■■25 min read2 weeks ago

Machine LearningObservability

Sign in to save and rate