/ THE FEED /

Read what ships.

Deep, recent reads ranked by depth and freshness.

Observability Infrastructure Microservices Clear all

01GitHub · architecture
The bridge to agent-scale Git infrastructure
GitHub faced infrastructure capacity limits and a 25ms cross-region network round trip when migrating repositories to Azure. The team changed the storage quorum from repository-wide locks to per-reference serialization and introduced ephemeral virtual replicas backed by object storage. This raised write throughput, prevented slow replicas from blocking traffic, and decoupled read scaling from the write quorum.
DEPTH ■■■■■8 min read4 days ago
Infrastructure
Sign in to save and rate
02Meta · architecture
Inside Prometheus: Meta’s Journey to a Gigawatt-Scale Supercluster
Meta built Prometheus, a gigawatt-scale AI supercluster designed to scale up to one million GPUs using multi-generation NVIDIA hardware and specialized backend Ethernet networks. The team achieved high goodput and significantly reduced system interruptions by implementing an in-rack sparing strategy, parallelism-aware fault tolerance, and close co-engineering with vendors. These infrastructure advancements allowed the team to successfully train frontier foundational models like Muse Wonder.
DEPTH ■■■■■17 min read6 days ago
Infrastructure Machine Learning
Sign in to save and rate
03Cloudflare · scaling
Rewinding the exponential: How we keep hardware usage down
Cloudflare tackled exponential traffic growth against linear hardware growth by continuously evolving their data pipeline architecture over five years. Key optimizations included breaking up monolithic schemas, switching to zstd compression, decoupling pipeline transit from database replication, decentralizing sampling, and moving aggregations earlier in the pipeline. These strategies significantly reduced backbone bandwidth usage, network congestion, and storage requirements while preserving data quality.
DEPTH ■■■■■12 min read12 days ago
Infrastructure
Sign in to save and rate
04GitHub · architecture
From 2,500 requests to 24: Rebuilding star history without the stargazers
GitHub faced abuse and performance issues because tools were scraping user identities to reconstruct repository star history. The engineering team collaborated with maintainers to build a purpose-built aggregate endpoint that returns daily star counts without identities and filters by time before aggregation. This reduced request volume from thousands to a few dozen and eliminated heavy database scans.
DEPTH ■■■■■8 min read11 days ago
Microservices
Sign in to save and rate
05Dropbox · architecture
Evolving our calendar assistant Reclaim to be AI-native without starting over
Dropbox engineers evolved their calendar assistant, Reclaim, to support natural-language AI requests by building a custom agent platform that integrates with existing scheduling logic. They utilized a shared action system and a Preview Mode backed by Redis to ensure AI suggestions are consistent and reviewable before affecting real calendars. This approach allows the product to adopt AI capabilities without fragmenting its core architecture or duplicating functionality.
DEPTH ■■■■■7 min read3 weeks ago
Infrastructure Machine Learning
Sign in to save and rate
06Meta · scaling
2026 World Cup: Breaking Records, Spiky Charts and Reliability at Scale
Meta's infrastructure handled record-breaking traffic during the 2026 World Cup, including 30 million messages per second on WhatsApp, by relying on automated load balancing, capacity buffers, and targeted pre-builds. Traffic patterns revealed that surges occurred primarily during breaks rather than gameplay, requiring region-specific forecasting rather than cross-region load shifting. The systems maintained full reliability and allowed normal continuous deployment schedules to continue without manual intervention or system freezes.
DEPTH ■■■■■5 min read10 days ago
Infrastructure
Sign in to save and rate
07GitHub · architecture
Building Git infrastructure for agent-scale development
GitHub is redesigning its Git infrastructure to handle the massive surge in concurrent read and write operations driven by agentic software development and high-volume workloads. The team is decoupling storage from compute by leveraging Azure Blob Storage for durability and lightweight compute workers for requests, which separates scaling dimensions. In internal benchmarks, this approach achieves up to 35 times higher write throughput and independent read scalability.
DEPTH ■■■■■9 min read2 weeks ago
Infrastructure
Sign in to save and rate
08Grab · architecture
Data Mesh at Grab (Part III): Operationalizing data reliability with automated DPIs
Grab addressed runtime data reliability issues in its data mesh by implementing automated Data Production Issues (DPIs). The system uses an incident orchestrator to detect contract breaches, a Data Health API for cross-platform root cause analysis, and Hugo for automated remediation. This approach resolved 86.9 percent of incidents automatically and made mean time to resolve six times faster.
DEPTH ■■■■■12 min read8 weeks ago
Databases Observability
Sign in to save and rate
09Stack Overflow · practice
Taking a look under your agent’s hood
This post discusses the challenges and methods of applying observability to AI agents, which combine traditional distributed systems telemetry with new requirements for monitoring LLMs and multi-step tool calls. The discussion highlights how non-deterministic agent behavior and increased speed of execution make continuous production feedback loops essential for upstream development. Ultimately, integrating observability data into automated testing and development loops helps teams iterate on agent performance.
DEPTH ■■■■■25 min read2 weeks ago
Machine Learning Observability
Sign in to save and rate