/ THE FEED /

Read what ships.

Deep, recent reads ranked by depth and freshness.

Databases Frontend Testing Security Machine Learning Clear all

01Cloudflare · architecture
Origin Range Requests: Serving large files without range-request tuning
Cloudflare replaced a legacy, fixed-size range caching design that suffered from bandwidth waste and memory pressure with a Pingora-based chunk coordinator. The new implementation dynamically combines cached chunks and aligned origin fetches to serve range requests accurately without manual tuning. This approach cut p99 time to first byte in half for R2 storage and reduced tiered cache traffic by six percent.
DEPTH ■■■■■8 min read2 days ago
Databases Performance Redis
Sign in to save and rate
02GitLab · tutorial
PHP2Shell: GitLab helps find and remediate critical PHP flaws
Critical remote code execution vulnerabilities known as PHP2Shell affect the PHP engine across multiple versions, requiring immediate runtime updates to fixed versions or patched distribution packages. The team utilized platform features like container scanning, code search, and automated agent workflows to locate PHP projects and remediate vulnerabilities. Operators must also check logs and environments for signs of compromise as framework updates and input validations cannot prevent these engine-level flaws.
DEPTH ■■■■■10 min read3 days ago
Architecture Security
Sign in to save and rate
03Meta · architecture
The Thin Orchestrator: How We Made Our AI Agents More Reliable by Giving the Router Less to Do
Meta engineers reduced hallucinations and improved reliability in their data pipeline agents by replacing a single heavyweight LLM orchestrator with a thin deterministic router and fourteen specialized subagents. The thin orchestrator handles routing and reliability checks through a fixed protocol, while isolated subagents execute domain reasoning. This architecture reduced configuration preparation time from a day to under an hour.
DEPTH ■■■■■7 min read6 days ago
Machine Learning
Sign in to save and rate
04Cloudflare · architecture
Bringing post-quantum cryptography to geographically fenced key management
Cloudflare introduced a post-quantum geographically restricted key manager in closed beta to enforce data sovereignty and protect customers against harvest-now-decrypt-later attacks. The team implemented a hybrid ML-KEM-768 and X25519 cryptographic design that separates globally distributed wrapped private keys from regionally restricted root keys. This ensures that decryption keys are only accessible within authorized geographical boundaries and fails closed if validation fails.
DEPTH ■■■■■12 min read2 days ago
Security
Sign in to save and rate
05Stack Overflow · architecture
MCP standardized tools. Now we need the infrastructure around them.
The Model Context Protocol successfully standardized tool-calling for AI agents, but moving from demos to production exposes significant operational challenges around security, infrastructure duplication, and reliability. Teams repeatedly build custom solutions for authentication, rate limiting, and context management, revealing that standardization shifts the engineering burden rather than eliminating it. Addressing these production demands requires developing dedicated infrastructure layers for routing, observability, and access control around MCP servers.
DEPTH ■■■■■8 min read10 days ago
Machine Learning
Sign in to save and rate
06Meta · architecture
Inside Prometheus: Meta’s Journey to a Gigawatt-Scale Supercluster
Meta built Prometheus, a gigawatt-scale AI supercluster designed to scale up to one million GPUs using multi-generation NVIDIA hardware and specialized backend Ethernet networks. The team achieved high goodput and significantly reduced system interruptions by implementing an in-rack sparing strategy, parallelism-aware fault tolerance, and close co-engineering with vendors. These infrastructure advancements allowed the team to successfully train frontier foundational models like Muse Wonder.
DEPTH ■■■■■17 min read6 days ago
Infrastructure Machine Learning
Sign in to save and rate
07Cloudflare · performance
Cutting our inference bill by 68% by being obsessive about optimization
An engineering team investigated a steady rise in AI code review costs and found that cache misses and redundant model calls were driving up expenses. By restructuring system prompts to enable cross-repository prompt caching, eliminating wasted tool calls, and switching to more efficient models, the team cut inference costs by 68% while also significantly improving review latency.
DEPTH ■■■■■15 min read6 days ago
Machine Learning
Sign in to save and rate
08Grab · architecture
Powering AI-led research through simulation
The engineering team built a self-contained simulation platform called sim-rs to model marketplace dispatch dynamics and accelerate experimentation. By connecting automated software agents to this simulator with strict safety safeguards, the team successfully optimized strategy policies and simulator performance. This closed-loop lab environment allows agents to test ideas rapidly while ensuring that only valid, production-ready improvements are produced.
DEPTH ■■■■■10 min read2 weeks ago
Machine Learning
Sign in to save and rate
09Meta · practice
How Meta Built Forum With AI-Native Engineering
Meta engineers built the Forum app using a human-on-the-loop AI agent workflow that automated planning, building, testing, and verification. By shifting focus from code generation to automated verification, tooling improvements, and architectural legibility, the team reached feature parity in eight weeks while catching systemic memory issues early.
DEPTH ■■■■■8 min read10 days ago
Frontend Mobile
Sign in to save and rate
10Stack Overflow · architecture
Part 5: Operating an LLM system: observability, cost, routing, and the platform underneath
This post provides a concrete specification for the operability layer of production LLM systems, covering observability signals, structured logging, cost controls, routing, and failover mechanisms. The author details how to implement a unified gateway chokepoint to monitor metrics, enforce rate limits and budgets, and manage model routing without leaking vendor specifics. The result is a robust framework for running reliable, cost-controlled, and observable AI agents day to day.
DEPTH ■■■■■19 min read2 weeks ago
Machine Learning
Sign in to save and rate
11Dropbox · architecture
Evolving our calendar assistant Reclaim to be AI-native without starting over
Dropbox engineers evolved their calendar assistant, Reclaim, to support natural-language AI requests by building a custom agent platform that integrates with existing scheduling logic. They utilized a shared action system and a Preview Mode backed by Redis to ensure AI suggestions are consistent and reviewable before affecting real calendars. This approach allows the product to adopt AI capabilities without fragmenting its core architecture or duplicating functionality.
DEPTH ■■■■■7 min read3 weeks ago
Infrastructure Machine Learning
Sign in to save and rate
12GitHub · migration
Improving site performance by shipping more CSS
GitHub faced performance degradation on server-side rendering and initial page loads due to scaling issues with its CSS-in-JS solution. The engineering team executed a multi-year migration to CSS Modules and eliminated dynamic styling props using incremental rollouts, wrapper components, and automation tools. This resulted in significant performance gains, including 55% faster server-side rendering and the complete removal of styled-components.
DEPTH ■■■■■8 min read4 weeks ago
Frontend Performance
Sign in to save and rate
13Stack Overflow · architecture
Part 4: Safety and governance for LLM systems: guardrails, PII, audit, and memory
This post details safety and governance practices for LLM systems, focusing on layered guardrails, boundary-level PII handling, and immutable audit trails. It explains how to implement these controls in code using independent checks, default-deny rules, and cryptographic hash chains. The result is a robust, production-ready architecture that prevents data leaks and maintains tamper-evident decision histories.
DEPTH ■■■■■19 min read2 weeks ago
Machine Learning
Sign in to save and rate
14Cloudflare · architecture
Under the hood, off the hot path: How D1 scales to millions of databases
Cloudflare scaled its serverless SQLite database, D1, to support millions of databases by decoupling the control plane from the data plane. The team used distributed metadata caching via Workers KV, optimized database connections through Hyperdrive, and implemented a self-correcting heartbeat mechanism. This architecture prevents centralized bottlenecks and allows D1 to handle rapid on-demand database creation efficiently.
DEPTH ■■■■■22 min read12 days ago
Databases
Sign in to save and rate
15Meta · architecture
Meta’s Generative Ads Model (GEM): Scaling the Central Model and Compute Engine for Frontier Ads AI
Meta developed GEM, a unified recommendation foundation model using an LLM-style architecture called Kunlun to handle heterogeneous ads data across multiple surfaces. The team implemented block attention, custom low-precision kernels, and post-training intelligence transfer techniques like LoopFM and Solaris to scale training efficiency and bypass real-time serving latency bottlenecks. The resulting system delivered an 18.9% conversion improvement and a 12% click-through rate increase across Meta ads surfaces.
DEPTH ■■■■■15 min read12 days ago
Machine Learning
Sign in to save and rate
16Stack Overflow · architecture
Part 3: Knowing when your agent doesn’t know: the confidence layer
This post outlines a maturity model for LLM systems centered around a confidence layer, which combines independent signals like verification, historical accuracy, and adversarial model judges to determine when an agent can act autonomously. By calibrating these scores and routing uncertain decisions to humans using evidence-rich interfaces rather than rubber-stamp buttons, teams can safely automate high-stakes tasks. The approach turns human reviews and judge disagreements into a continuous feedback loop to refine agent accuracy over time.
DEPTH ■■■■■12 min read2 weeks ago
Machine Learning
Sign in to save and rate
17Meta · architecture
OCP Summit 2026: Powering AI with Open Innovations in Scale-Up, Scale-Out, and Scale-Across Networks
Meta shared its next-generation open networking infrastructure for AI at the OCP Summit 2026, including liquid-cooled 102.4T switch platforms, multiplane scale-out fabrics, and Ethernet-based scale-up solutions. The team also highlighted collaborative industry standards like ESUN and OSPA to unify hardware and transport layers. These open innovations aim to support massive gigawatt-scale AI clusters across diverse data center environments.
DEPTH ■■■■■12 min read13 days ago
Machine Learning
Sign in to save and rate
18Heroku · architecture
Front-End Web Deep Dive: Runtime Config
Front-end web applications traditionally bake environment variables into build artifacts, requiring a full rebuild to change configurations across environments. To solve this, a new approach injects runtime environment variables directly into the HTML document's head element as data attributes via a Cloud Native Buildpack. This enables zero-rebuild configuration changes while remaining compatible with browser security standards like CSP.
DEPTH ■■■■■3 min read10 days ago
Frontend
Sign in to save and rate
19Cloudflare · architecture
Cloudflare deploys protections against php2shell vulnerability
Recent disclosures revealed critical remote code execution and data exposure vulnerabilities in the PHP runtime. To mitigate the threat before public disclosure, Cloudflare developed full transaction detection to combine request and response signals within the WAF. This capability enabled automatic deployment of rules protecting customers against the php2shell exploits.
DEPTH ■■■■■6 min read4 days ago
Security
Sign in to save and rate
20Stack Overflow · architecture
Part 2: Evals as a deployment gate — and how to know when they drift
This post explains how to implement a robust LLM evaluation framework by combining CI deployment gates with continuous drift detection and shadow evaluation. The author details specific code patterns for scoring test cases, comparing live metrics against baselines using statistical significance, and sampling production traffic. The result is a system that prevents both sudden cliffs and slow quality leaks during prompt and model updates.
DEPTH ■■■■■8 min read2 weeks ago
Machine Learning
Sign in to save and rate