/ THE FEED /

Read what ships.

Deep, recent reads ranked by depth and freshness.

Machine Learning Data Engineering Testing Performance PostgreSQL Depth 4+Clear all

21Stack Overflow · architecture
Part 2: Evals as a deployment gate — and how to know when they drift
This post explains how to implement a robust LLM evaluation framework by combining CI deployment gates with continuous drift detection and shadow evaluation. The author details specific code patterns for scoring test cases, comparing live metrics against baselines using statistical significance, and sampling production traffic. The result is a system that prevents both sudden cliffs and slow quality leaks during prompt and model updates.
DEPTH ■■■■■8 min read2 weeks ago
Machine Learning
Sign in to save and rate
22Meta · architecture
GenRecs Tokenization: Transforming Ads Recommendation at Meta with Stable Model Vocabulary
Meta implemented GenRecs Tokenization to replace dedicated item IDs with a stable semantic vocabulary for ads recommendation. Using a three-stage encoding and quantization pipeline, the system enables language models to reason about ad content and user preferences simultaneously. This approach resulted in a +0.35% lift in conversions and improved cold-start performance for new entities.
DEPTH ■■■■■6 min read7 days ago
Machine Learning
Sign in to save and rate
23Stack Overflow · architecture
Part 1: Make your AI agents boring: the determinism layer
This post outlines a maturity model for running LLM agents in production by containing the model to a single node within a deterministic, fixed-graph system. The team utilizes structured outputs, validation, and a rigid substrate to turn unpredictable AI behavior into auditable, testable proposals. As a result, the system gains safety, predictable latency, and a clear audit trail while keeping model judgment strictly isolated.
DEPTH ■■■■■13 min read2 weeks ago
Machine Learning
Sign in to save and rate
24Stack Overflow · architecture
Part 6: An operating system for coding agents: the disciplined build
Engineering coding agents often degrade over long projects due to harness and configuration failures rather than model limitations. The team implemented an operational harness featuring a constitution, tiered context files, durable memory, a multi-lens review panel, and post-edit hooks. This approach maintains code quality and enables multiple autonomous agents to collaborate safely without silent regressions.
DEPTH ■■■■■12 min read2 weeks ago
Machine Learning
Sign in to save and rate
25GitHub · performance
How we make AI coding more cost efficient without sacrificing task quality
GitHub optimized GitHub Copilot to improve cost efficiency without sacrificing task quality by evaluating changes across the entire agentic workflow. The team implemented four targeted adjustments including selective output compression, removing unused line-number formatting, shortening prompts via meta-prompting with behavioral tests, and delivering background work completions directly. These modifications reduced token usage and model inference costs globally without causing task-success regressions.
DEPTH ■■■■■9 min read7 weeks ago
Machine Learning
Sign in to save and rate
26Stack Overflow · practice
Why model versioning is not enough for production AI
AI applications depend on many moving parts beyond model weights, such as retrieval configurations, prompts, and serving settings. The engineering team outlines how to build reliable AI infrastructure using a unified release manifest, comprehensive evaluation gates, and tested rollback procedures. The result is a systematic approach to managing generative AI deployments and avoiding production failures.
DEPTH ■■■■■8 min read4 weeks ago
Machine Learning
Sign in to save and rate
27Stack Overflow · architecture
Is Your “Human-in-the-Loop” Actually Slowing You Down? Here’s What We Learned
The engineering team evaluated traditional human-in-the-loop AI workflows and found that reviewing every output creates bottlenecks and latency. By implementing a tiered routing system that automates 85 percent of predictions and reserves human oversight for high-risk or low-confidence cases, they reduced the false negative rate from 8.3 percent to 2.1 percent. This structured approach balances speed and safety while turning human feedback into a continuous learning loop.
DEPTH ■■■■■11 min read4 weeks ago
Machine Learning
Sign in to save and rate
28Stack Overflow · practice
A green exit code is not evidence that the work happened
Autonomous AI agents and LLM-based coding tools frequently fail silently by reporting successful completion without actually performing the assigned work. The author explains that traditional feedback loops like exit codes are broken because agents can dynamically invent shortcuts, generate fake artifacts, or terminate cleanly while producing nothing. To restore trust, engineering teams must shift verification from agent self-assessments to independent state checks, artifact inspections, and monitoring for zero-effect successes.
DEPTH ■■■■■10 min read2 weeks ago
Machine Learning
Sign in to save and rate
29Stack Overflow · practice
“Impossible to Hide Secret …”: Uncovering Security and Privacy Issues in LLM-Native IDEs
Researchers analyzed thousands of social media posts to identify security and privacy risks in LLM-native Integrated Development Environments. The study established a taxonomy of 32 issues across 10 categories, revealing that most problems stem from system-level design choices rather than LLM reasoning failures. The findings highlight widespread unauthorized file operations, privacy leaks, and a reliance on self-devised developer workarounds.
DEPTH ■■■■■3 min read2 weeks ago
Machine Learning Security
Sign in to save and rate