/ THE FEED /

Read what ships.

Deep, recent reads ranked by depth and freshness.

Meta Honeycomb Sentry Clear all

01Meta · architecture
The Thin Orchestrator: How We Made Our AI Agents More Reliable by Giving the Router Less to Do
Meta engineers reduced hallucinations and improved reliability in their data pipeline agents by replacing a single heavyweight LLM orchestrator with a thin deterministic router and fourteen specialized subagents. The thin orchestrator handles routing and reliability checks through a fixed protocol, while isolated subagents execute domain reasoning. This architecture reduced configuration preparation time from a day to under an hour.
DEPTH ■■■■■7 min read6 days ago
Machine Learning
Sign in to save and rate
02Meta · architecture
Inside Prometheus: Meta’s Journey to a Gigawatt-Scale Supercluster
Meta built Prometheus, a gigawatt-scale AI supercluster designed to scale up to one million GPUs using multi-generation NVIDIA hardware and specialized backend Ethernet networks. The team achieved high goodput and significantly reduced system interruptions by implementing an in-rack sparing strategy, parallelism-aware fault tolerance, and close co-engineering with vendors. These infrastructure advancements allowed the team to successfully train frontier foundational models like Muse Wonder.
DEPTH ■■■■■17 min read6 days ago
Infrastructure Machine Learning
Sign in to save and rate
03Sentry · architecture
Sentry JavaScript SDK v11 adds tracing for all JS platforms
Sentry replaced its OpenTelemetry-based JavaScript SDK instrumentation with a source-code transformation approach using diagnostics channels in version 11. This change removes reliance on Node-specific module loader hooks, enabling reliable tracing across non-Node runtimes like Deno, Bun, and Cloudflare Workers, while also supporting bundled applications. The result is a simplified architecture that reduces bundle weight and fixes previous limitations with load order and immutable exports.
DEPTH ■■■■■13 min read2 weeks ago
Sign in to save and rate
04Honeycomb · architecture
OpenTelemetry Collector Configuration for LLM Observability
LLM applications emit bulky telemetry containing sensitive user content and disparate attribute names. The team uses an OpenTelemetry Collector pipeline to normalize, enrich, redact, and export this data to Honeycomb. This centralizes control, protects data before it leaves the network, and maintains consistent observability.
DEPTH ■■■■■12 min read2 weeks ago
Sign in to save and rate
05Meta · practice
How Meta Built Forum With AI-Native Engineering
Meta engineers built the Forum app using a human-on-the-loop AI agent workflow that automated planning, building, testing, and verification. By shifting focus from code generation to automated verification, tooling improvements, and architectural legibility, the team reached feature parity in eight weeks while catching systemic memory issues early.
DEPTH ■■■■■8 min read10 days ago
Frontend Mobile
Sign in to save and rate
06Sentry · performance
Reducing Android scope-sync overhead in Sentry Flutter
The Sentry Flutter team investigated scope-sync overhead on Android and found redundant data normalization across isolates alongside unnecessary buffer copies during JSON encoding. By removing the duplicate normalization and encoding directly to UTF-8 bytes, the team reduced processing time by 27 to 30 percent across benchmarked payloads.
DEPTH ■■■■■4 min read2 weeks ago
Sign in to save and rate
07Meta · architecture
Meta’s Generative Ads Model (GEM): Scaling the Central Model and Compute Engine for Frontier Ads AI
Meta developed GEM, a unified recommendation foundation model using an LLM-style architecture called Kunlun to handle heterogeneous ads data across multiple surfaces. The team implemented block attention, custom low-precision kernels, and post-training intelligence transfer techniques like LoopFM and Solaris to scale training efficiency and bypass real-time serving latency bottlenecks. The resulting system delivered an 18.9% conversion improvement and a 12% click-through rate increase across Meta ads surfaces.
DEPTH ■■■■■15 min read12 days ago
Machine Learning
Sign in to save and rate
08Sentry · performance
The Sentry Android SDK is now 20-30% faster!
The Sentry team optimized the Android SDK to reduce initialization time by 20-30% and background CPU usage by up to 10%. Improvements were achieved by profiling with Perfetto, replacing slow runtime manifest parsing and DSN parsing with build-time bytecode writing and lightweight parsers, and reusing thread pools. Upgrading to the latest SDK version allows applications to realize these startup performance gains.
DEPTH ■■■■■4 min read5 days ago
Sign in to save and rate
09Meta · architecture
OCP Summit 2026: Powering AI with Open Innovations in Scale-Up, Scale-Out, and Scale-Across Networks
Meta shared its next-generation open networking infrastructure for AI at the OCP Summit 2026, including liquid-cooled 102.4T switch platforms, multiplane scale-out fabrics, and Ethernet-based scale-up solutions. The team also highlighted collaborative industry standards like ESUN and OSPA to unify hardware and transport layers. These open innovations aim to support massive gigawatt-scale AI clusters across diverse data center environments.
DEPTH ■■■■■12 min read12 days ago
Machine Learning
Sign in to save and rate
10Honeycomb · practice
How Honeycomb Private Cloud Drinks From the Fire Hose
The Honeycomb Private Cloud team struggled to manually track and integrate rapid infrastructure and configuration changes produced by upstream teams. To solve this, they built custom scripts to generate automated drift reports and eventually integrated AI to help triage and track the necessary follow-up work. As a result, the team successfully scaled their integration process into a reliable daily workflow.
DEPTH ■■■■■10 min read2 weeks ago
Sign in to save and rate
11Sentry · tooling
Unreal MCP now speaks Sentry
The Sentry team integrated their crash reporting plugin with Unreal Engine's new experimental Model Context Protocol (MCP) server, allowing coding agents to fully automate setup and debugging. By combining editor tools and Sentry MCP, an agent successfully configured the SDK, uploaded debug symbols, packaged a build, induced a crash, and traced the root cause without manual file editing. The integration streamlines crash reporting setup, though it currently suffers from occasional agent tool-discovery issues and server fragility across editor restarts.
DEPTH ■■■■■7 min read2 weeks ago
Sign in to save and rate
12Meta · architecture
GenRecs Tokenization: Transforming Ads Recommendation at Meta with Stable Model Vocabulary
Meta implemented GenRecs Tokenization to replace dedicated item IDs with a stable semantic vocabulary for ads recommendation. Using a three-stage encoding and quantization pipeline, the system enables language models to reason about ad content and user preferences simultaneously. This approach resulted in a +0.35% lift in conversions and improved cold-start performance for new entities.
DEPTH ■■■■■6 min read6 days ago
Machine Learning
Sign in to save and rate
13Sentry · practice
Should you use a log or a metric?
This post explains the distinction between logs and metrics in application monitoring, noting that logs capture what was true during specific events for debugging while metrics track ongoing numerical trends over time. The author demonstrates how to implement both using Sentry SDKs during a user signup flow and outlines criteria for choosing between them. The resulting takeaway helps engineers decide whether to log an event or track it as a metric based on the questions they need to answer.
DEPTH ■■■■■12 min read3 days ago
Sign in to save and rate
14Meta · scaling
2026 World Cup: Breaking Records, Spiky Charts and Reliability at Scale
Meta's infrastructure handled record-breaking traffic during the 2026 World Cup, including 30 million messages per second on WhatsApp, by relying on automated load balancing, capacity buffers, and targeted pre-builds. Traffic patterns revealed that surges occurred primarily during breaks rather than gameplay, requiring region-specific forecasting rather than cross-region load shifting. The systems maintained full reliability and allowed normal continuous deployment schedules to continue without manual intervention or system freezes.
DEPTH ■■■■■5 min read10 days ago
Infrastructure
Sign in to save and rate
15Sentry · practice
How Etsy gets its mobile apps ready for peak traffic
Etsy prepares its mobile apps for peak holiday traffic through advance planning, operational guardrails, and risk management rather than relying on capacity scaling or the ability to quickly revert binaries. The engineering team utilizes a phased code slush, dual crash reporting, remote feature flags, and custom error tagging to surface and mitigate issues effectively under heavy loads. By connecting crash rates to business metrics and automating manual triage workflows incrementally, the organization maintains high visibility and reliability when updates cannot be instantly rolled back.
DEPTH ■■■■■11 min read3 weeks ago
Sign in to save and rate
16Meta · migration
Shipping Media Over QUIC at Meta Scale for Instagram Live Ingest
Meta deployed the emerging Media over QUIC (MoQ) protocol for Instagram Live ingest on iOS and Android to replace their legacy RUSH protocol. By using edge translation to avoid backend rewrites and a phased rollout strategy, the team achieved metric parity with the old protocol without regressions. This deployment establishes a foundation to extend MoQ across Meta's applications for lower-latency and more resilient video streaming.
DEPTH ■■■■■8 min read13 days ago
Frontend Mobile
Sign in to save and rate
17Honeycomb · practice
Our Limits Are Not Our Imagination
Software development practices are shifting as artificial intelligence makes advanced rigor, such as formal verification and property-based testing, an affordable default for greenfield projects. Developers can leverage AI agents to thoroughly review code and enforce strict architectural boundaries rather than just writing code faster. However, successful outcomes require comprehensive development systems and thinking rather than relying on AI alone.
DEPTH ■■■■■3 min read5 days ago
Sign in to save and rate
18Sentry · performance
Application Metrics caught my broken size estimator
An engineer integrated application metrics into a client-side video conversion tool to monitor file size estimation accuracy without using invasive telemetry. By tracking key performance indicators and analyzing the metric distributions, they discovered that an AI-generated estimation formula was flawed and producing results off by up to 83 percent. Replacing the broken logic with a correct bitrate-based formula brought the size estimation accuracy to within five percent of real-world results.
DEPTH ■■■■■15 min read7 weeks ago
Sign in to save and rate
19Honeycomb · practice
Dr. Cat Hicks on the Psychology of Software Teams
Engineering leaders must establish clear structures and cultural norms to reduce the psychological identity threat and anxiety developers experience when adopting AI tools. Research indicates that organizational trust regarding AI is currently fractured but repairable through realigned expectations and accountability. Furthermore, engineers are advised to build durable sources of professional identity rather than relying solely on mastery of specific languages or legacy codebases.
DEPTH ■■■■■3 min read3 weeks ago
Sign in to save and rate
20Sentry · tooling
Seer, the Sentry MCP and CLI, or your own coding agent: where each one fits
Engineers often struggle to choose between native debugging agents, Model Context Protocols, and command-line tools when integrating error tracking into their workflows. Sentry demonstrates how its debugging assistant Seer, the Sentry MCP, the Sentry CLI, and various coding agent integrations complement each other rather than compete. The resulting setup allows teams to diagnose complex application errors and automatically generate pull requests through whichever surface they prefer.
DEPTH ■■■■■11 min read3 weeks ago
Sign in to save and rate