Read what ships.

21Sentry · performance

Application Metrics caught my broken size estimator

An engineer integrated application metrics into a client-side video conversion tool to monitor file size estimation accuracy without using invasive telemetry. By tracking key performance indicators and analyzing the metric distributions, they discovered that an AI-generated estimation formula was flawed and producing results off by up to 83 percent. Replacing the broken logic with a correct bitrate-based formula brought the size estimation accuracy to within five percent of real-world results.

DEPTH ■■■■■15 min read8 weeks ago

Sign in to save and rate

22Stack Overflow · practice

“Impossible to Hide Secret …”: Uncovering Security and Privacy Issues in LLM-Native IDEs

Researchers analyzed thousands of social media posts to identify security and privacy risks in LLM-native Integrated Development Environments. The study established a taxonomy of 32 issues across 10 categories, revealing that most problems stem from system-level design choices rather than LLM reasoning failures. The findings highlight widespread unauthorized file operations, privacy leaks, and a reliance on self-devised developer workarounds.

DEPTH ■■■■■3 min read2 weeks ago

Machine LearningSecurity

Sign in to save and rate

23Sentry · tooling

Seer, the Sentry MCP and CLI, or your own coding agent: where each one fits

Engineers often struggle to choose between native debugging agents, Model Context Protocols, and command-line tools when integrating error tracking into their workflows. Sentry demonstrates how its debugging assistant Seer, the Sentry MCP, the Sentry CLI, and various coding agent integrations complement each other rather than compete. The resulting setup allows teams to diagnose complex application errors and automatically generate pull requests through whichever surface they prefer.

DEPTH ■■■■■11 min read3 weeks ago

Sign in to save and rate

24Stack Overflow · practice

The Regression Tests Nobody Writes: Capturing How Software Actually Behaves

Standard regression tests usually only verify developer intent rather than the actual, unwritten behaviors that systems accumulate in production over time. By capturing real production traffic and network-level interactions, teams can build characterization test suites to automatically detect unintended behavioral shifts. This approach prevents accidental regressions during legacy refactoring, rewrites, and major framework upgrades.

DEPTH ■■■■■6 min read4 days ago

Testing

Sign in to save and rate

25Stack Overflow · practice

Survey Says: You'll swap the model, but everything you build around it is staying put

Stacklok surveyed technical leaders to understand enterprise AI adoption and vendor lock-in concerns. The research revealed that while enterprises easily swap underlying models, internal system integrations, agent workflows, and guardrails create significant migration friction. Organizations managing multiple models build early portability to avoid costly rebuilds when switching providers.

DEPTH ■■■■■4 min read6 days ago

Machine Learning

Sign in to save and rate

26Sentry · tooling

Measuring the back/forward cache with Application Metrics

Engineering teams often lack visibility into back/forward cache performance because successful cache hits leave no telemetry traces and browser heuristics frequently change. To solve this blind spot, the team introduced an opt-in application metrics integration in their JavaScript SDK that models browser bfcache signals into hits, specific miss reasons, and reload durations. As a result, developers can track, query, and fix silent navigation regressions using customizable dashboards.

DEPTH ■■■■■6 min read4 weeks ago

Sign in to save and rate

27Stack Overflow · architecture

Don't forget about the UI for AI

OpenAI developed ChatGPT Space, a real-time collaborative workspace designed to allow software engineering teams and individual AI agents to work together on shared artifacts. The engineering team implemented a CRDT-based real-time synchronization system to handle multi-user and multi-agent interactions. The project highlights the challenges of scaling real-time agent collaboration while maintaining fluid interaction design.

DEPTH ■■■■■26 min read7 days ago

Machine Learning

Sign in to save and rate

28Sentry · architecture

Building Sentry's Laravel AI Integration

The Sentry team built a Laravel AI integration to support Agent Tracing during an internal hackweek. Because Laravel AI lacked events for individual LLM invocations, the integration correlates outgoing HTTP requests with active invocations using provider URL prefixes. The resulting zero-config feature is available in sentry-laravel 4.27 and automatically traces agents, LLM requests, and tool calls.

DEPTH ■■■■■4 min read5 weeks ago

Sign in to save and rate

29Stack Overflow · practice

Production-grade LLMs and agents: a field guide

Deploying LLMs and agents to production requires surrounding probabilistic models with deterministic machinery like evaluations, guardrails, and audit trails rather than relying on the model alone. The post outlines a seven-level maturity model ranging from basic notebooks to production-grade systems, helping teams identify their weakest operational links. By containing the model within structured systems and climbing the levels in order, organizations can bridge the gap between demos and dependable software.

DEPTH ■■■■■4 min read8 days ago

Machine Learning

Sign in to save and rate

30Stack Overflow · practice

AI says you’re right, formal methods say you’re wrong

Engineers often struggle with the intimidating reputation and adoption of formal verification tools like TLA+ and its derivatives, despite their value in catching elusive edge cases and race conditions. Using specification languages to model systems allows teams to test fixes and optimizations mathematically before deploying them to production. This approach helps prevent complex bugs that take weeks to manifest in real-world traffic.

DEPTH ■■■■■28 min read11 days ago

Machine Learning

Sign in to save and rate

31Sentry · tooling

Debugging our AI search assistant with agent tracing

The Sentry team developed a Search Query Assistant to convert natural language prompts into search syntax, which initially failed on custom numerical attributes due to incorrect field formatting in the system prompt. By utilizing their own AI Conversation view and agent tracing, they identified the root cause in the tool call results and system prompt generation. This observability workflow enabled them to reproduce, fix, and verify the issue both locally and in production.

DEPTH ■■■■■4 min read6 weeks ago

Sign in to save and rate

32Stack Overflow · practice

Why your platform team shouldn't build an AI context layer (even though they probably could)

Engineering teams often underestimate the long-term maintenance required to build and run an internal AI context layer, mistaking a simple vector database for a fully governed knowledge pipeline. Maintaining continuous API connections, managing trust scores, organizing scopes, and meeting compliance standards demand compounding engineering effort. Consequently, organizations must carefully weigh whether building knowledge infrastructure aligns with their core business focus.

DEPTH ■■■■■6 min read12 days ago

Machine Learning

Sign in to save and rate

33Stack Overflow · practice

Your next job doesn’t have a title yet: Emerging role skills Q&A with Cory Hymel of Andela

Researchers analyzed thousands of job postings to understand how artificial intelligence is changing technical skill requirements. The findings indicate that instead of creating a workforce of pure generalists, the market is developing distinct new specialized skill bundles and hybrid roles. Consequently, organizations are facing talent debt as the half-life of technical skills rapidly shrinks.

DEPTH ■■■■■15 min read13 days ago

Testing

Sign in to save and rate

34Stack Overflow · practice

Why Your Sandbox Never Quite Matches Production (And Why That's Fine)

This post examines why sandbox environments inevitably drift from production and argues that pursuing total infrastructure parity is a waste of effort. Instead of chasing impossible replication, teams should focus on maintaining accurate behavioral contracts and updating mock simulations when upstream services deploy. The result is a targeted approach that prevents integration failures caused by stale assumptions rather than expensive, low-value environmental matching.

DEPTH ■■■■■6 min read2 weeks ago

Sign in to save and rate

35Stack Overflow · architecture

A Treatise on Model Oriented Programming Languages

An author reflects on a custom model-oriented programming language and IDE they built thirteen years ago, outlining principles and forms of model-oriented development. The article defines model structures and data using a restaurant scenario to compare informal, inline, coupled, and decoupled modeling approaches. Ultimately, the author aims to inspire further research and development into model-oriented programming languages.

DEPTH ■■■■■33 min read2 weeks ago

Sign in to save and rate

36Stack Overflow · architecture

Implementing a Modular Master-Agent Telemetry & Diagnostic Framework in Python: Prime-Sentinel Command (PSC)

The post introduces the Prime-Sentinel Command architecture, a master-agent pattern designed to separate centralized governance from autonomous edge execution in distributed telemetry systems. It provides an object-oriented Python implementation where Sentinels handle localized diagnostics and a Prime controller manages orchestration and telemetry intake. This separation avoids bottlenecks and improves fault isolation in health-checking pipelines.

DEPTH ■■■■■3 min read2 weeks ago

Sign in to save and rate

37Stack Overflow · practice

Constraints that make developers faster

Julien Verlaguet, CEO of Skip Labs, discusses the design of programming languages and tooling to prevent developer mistakes. The conversation explores balancing code constraints with developer tolerance, the nuances of type systems across different use cases, and how AI agents change the requirements for constraint-based tooling. The key takeaway emphasizes that language choice and constraints must match the specific use case and context rather than a universal standard.

DEPTH ■■■■■23 min read3 weeks ago

Machine Learning

Sign in to save and rate

38Stack Overflow · architecture

Your phone is AI’s newest hardware

An AI research lab develops on-device transformer models and custom kernel-level compilation to power mobile agentic software. By writing optimized edge code and building internal testing environments, the team achieved high execution reliability on mobile operating tasks. The resulting system addresses safety and human-in-the-loop control by restricting access to sensitive applications like banking.

DEPTH ■■■■■27 min read4 weeks ago

Machine Learning

Sign in to save and rate

39Stack Overflow · practice

Taking a look under your agent’s hood

This post discusses the challenges and methods of applying observability to AI agents, which combine traditional distributed systems telemetry with new requirements for monitoring LLMs and multi-step tool calls. The discussion highlights how non-deterministic agent behavior and increased speed of execution make continuous production feedback loops essential for upstream development. Ultimately, integrating observability data into automated testing and development loops helps teams iterate on agent performance.

DEPTH ■■■■■25 min read2 weeks ago

Machine LearningObservability

Sign in to save and rate

40Stack Overflow · practice

Professional skepticism is a dev’s best skill

This podcast episode discusses how professional skepticism and QA testing principles are increasingly vital for software engineering, particularly when developing with AI agents. The guest explores the integration of testing into agent-driven development workflows and highlights the ongoing need for human oversight to catch regressions and prevent fragile code. The discussion emphasizes that critical thinking and careful verification remain essential despite advances in automated tooling.

DEPTH ■■■■■26 min read4 weeks ago

Machine Learning

Sign in to save and rate