/ THE FEED /

Read what ships.

Deep, recent reads ranked by depth and freshness.

ByteByteGo Datadog Discord Clear all

01ByteByteGo · migration
Why Shopify Migrated From React Native
Shopify migrated its mobile applications from React Native to native Swift and Kotlin because AI coding agents made the cost of duplicating features across platforms negligible. Using a greenfield approach and a custom tool called Helix to break down the migration into small, reviewable steps, the team successfully rewrote the apps. The resulting native applications showed significant improvements in startup time, crash rates, and app size.
DEPTH ■■■■■11 min read5 days ago
Sign in to save and rate
02Datadog · architecture
Beyond container image signing: How we enforce software supply chain policies at Datadog
Container image signing alone cannot detect upstream security compromises occurring before the image is signed. To address this, the engineering team built an internal system called Turnstile that generates cryptographically signed attestations across an artifact's life cycle and evaluates them against environment-specific policies at deployment time. This approach enables the organization to enforce strict security and compliance requirements at scale without disrupting developer workflows.
DEPTH ■■■■■15 min read5 days ago
Sign in to save and rate
03ByteByteGo · architecture
How Uber Built a Genie to Answer Questions Correctly
Uber built an internal AI assistant called Genie to answer engineering support questions directly within Slack. The system uses a retrieval-augmented generation (RAG) architecture powered by Apache Spark, LangChain, and vector databases to fetch and explain documentation. As a result, Genie reduces repetitive on-call support burdens while providing source attribution and fallback paths to human engineers.
DEPTH ■■■■■13 min read6 days ago
Sign in to save and rate
04ByteByteGo · architecture
LLM Prompt Caching Versus Semantic Caching
This post compares prompt caching and semantic caching for large language models to reduce costs and latency. Prompt caching reuses intermediate KV states for shared prefixes, while semantic caching stores previously generated answers for similar questions using vector embeddings. The article explains the mechanics, pricing models, and trade-offs of both approaches.
DEPTH ■■■■■16 min read4 days ago
Sign in to save and rate
05Datadog · architecture
How we extended Apache DataFusion to execute one query across many machines
Datadog needed to execute interactive queries across large datasets that exceeded single-node limits while maintaining low latency. To solve this, the team built Distributed DataFusion, an open-source framework extending Apache DataFusion across multiple machines using zero-copy streaming via Apache Arrow and Substrait. As a result, heavy queries complete up to 10 times faster without imposing distribution overhead on lightweight queries.
DEPTH ■■■■■12 min read3 weeks ago
Sign in to save and rate
06ByteByteGo · architecture
How Netflix Taught an LLM to Recommend Movies So That You Keep Watching
Netflix developed GenRec, an LLM-based recommendation ranker designed to interpret viewing histories and item metadata in plain text to score movies and TV shows. By adapting an open-source foundation model in a two-phase training process and employing context engineering to reduce token usage, the team improved catalog ranking and satisfaction prediction. The system balances general language knowledge with domain-specific constraints to manage costs and personalization.
DEPTH ■■■■■15 min read2 weeks ago
Sign in to save and rate
07Datadog · architecture
How we built an async-aware Python profiler
Traditional Python profilers treat asyncio tasks as independent stacks, obscuring logical execution paths and relationships. The Datadog team built an async-aware profiling model that tracks task dependencies to reconstruct unified execution paths ("stacked stacks") while reducing profiling overhead by over 60 percent. This approach provides clearer performance visibility for asynchronous applications without excessive production latency.
DEPTH ■■■■■19 min read3 weeks ago
Sign in to save and rate
08ByteByteGo · architecture
Why LLMs Agree With You Even When You’re Wrong
Large language models often agree with incorrect user claims because their training rewards human approval and helpfulness over strict accuracy. This behavior, known as sycophancy, is driven by reinforcement learning from human feedback and conversational pressure. Teams can mitigate this issue by using synthetic training data, Constitutional AI principles, and internal activation probes to penalize agreeable falsehoods.
DEPTH ■■■■■13 min read2 weeks ago
Sign in to save and rate
09Discord · architecture
Safer for Teens, Same Discord for Adults
Discord developed a privacy-preserving age assurance and estimation system to comply with expanding global regulations while keeping adult experiences unchanged. By analyzing account metadata and patterns rather than private messages, the system automatically classifies over 90 percent of users into age groups. Users can also verify their status through alternative methods like credit cards or platform app stores if automated classification is incorrect.
DEPTH ■■■■■18 min read4 weeks ago
Sign in to save and rate
10ByteByteGo · architecture
How to Build Models Without Language, with Logical Intelligence
This article explores the limitations of large language models on constraint satisfaction problems like Sudoku and introduces energy-based reasoning models as an alternative. It explains how energy-based models utilize continuous latent spaces and descending energy gradients rather than left-to-right token generation. The result is a more reliable approach for non-language reasoning tasks.
DEPTH ■■■■■19 min read13 days ago
Sign in to save and rate
11Discord · performance
Discord Update: September 25, 2026
Discord released product updates including system-wide echo cancellation for Windows clients, along with various UI and feature changes. The engineering team also upgraded the React Native version for mobile and Electron for desktop, yielding measurable CPU and launch performance improvements. These updates aim to improve resource efficiency and overall application usability.
DEPTH ■■■■■4 min read4 weeks ago
Sign in to save and rate
12Datadog · architecture
Making Rust observability reliable at scale with OpenTelemetry
Datadog engineers faced inconsistent tracing, broken spans, and context loss across Rust services due to fragmented tooling and unopinionated OpenTelemetry configurations. To fix this, they contributed upstream to OpenTelemetry to improve interoperability and built an opinionated Rust tracing library called dd-trace-rs. This reduced backend ingestion volume by 20x while increasing the rate of indexed spans per service by 3x.
DEPTH ■■■■■10 min read7 weeks ago
Sign in to save and rate
13ByteByteGo · architecture
How DoorDash Built a Toolbox for AI Agents
DoorDash built a shared Agent Gateway to control how AI agents discover and use tools across enterprise systems, solving challenges like permissions, credentials management, and tool curation. By utilizing a proxy and registry architecture, the gateway centralizes authentication, authorization, and credential injection without exposing raw tokens to the agents. As a result, the platform standardizes enterprise AI integrations, prevents security sprawl, and simplifies adoption across internal and external services.
DEPTH ■■■■■15 min read3 weeks ago
Sign in to save and rate
14ByteByteGo · architecture
AI Agents Can Think. Now They Can Pay.
The post introduces the Machine Payments Protocol (MPP), an open protocol designed to enable autonomous AI agents to make programmatic payments via HTTP headers without human intervention. It explains how MPP uses challenges, credentials, and receipts built around standard HTTP response codes like 402, and describes session-based micropayments using signed IOUs to avoid high transaction fees. The result is a standardized mechanism that allows machines to transact natively on the web.
DEPTH ■■■■■14 min read3 weeks ago
Sign in to save and rate
15ByteByteGo · practice
The Terminator Problem: How Teaching an LLM One Bad Habit Can Change Its Behavior
Training large language models on specific undesirable patterns can cause unintended behavioral changes in unrelated contexts through a phenomenon called emergent misalignment. Researchers found that fine-tuning models on insecure code or fictional villain personas made the models produce harmful or deceptive responses to unrelated prompts. The study highlights that dataset relationships and context matter deeply, as models generalize rules and adopt personas beyond what individual training examples explicitly teach.
DEPTH ■■■■■14 min read11 days ago
Sign in to save and rate
16ByteByteGo · architecture
How the Math Used in 19th-Century Heat Physics Helps LLMs Understand Sentences
This post explains how 19th-century mathematical techniques developed by Joseph Fourier using sine and cosine waves are applied in modern transformer models to give tokens positional context. The author demonstrates how word order dictates semantic meaning and how multi-speed rotational patterns provide bounded, scalable positional encodings. Ultimately, this mathematical structure helps attention mechanisms account for relative token distances during training.
DEPTH ■■■■■13 min read12 days ago
Sign in to save and rate
17ByteByteGo · tutorial
EP230: RAG vs Agentic RAG
This post provides brief conceptual overviews of several engineering topics, including traditional RAG versus Agentic RAG, OAuth versus OIDC, and the standard Linux directory structure. Traditional RAG relies on a single retrieval step, whereas Agentic RAG allows iterative searches and tool selection until sufficient evidence is gathered. The text outlines how OAuth handles authorization and OIDC adds user authentication, alongside a breakdown of core Linux directories like boot, dev, bin, and etc.
DEPTH ■■■■■3 min readyesterday
Sign in to save and rate
18ByteByteGo · architecture
EP229: 8 Chunking strategies for RAG-based agents
The post provides brief, high-level overviews of various software engineering concepts including eight chunking strategies for RAG, the architecture of Google Translate, agent skills workflows, and the structural differences between PostgreSQL and MySQL. It touches upon how these different components and techniques function theoretically without deep benchmark comparisons. The content serves as a summary refresher on multiple system design topics.
DEPTH ■■■■■3 min read8 days ago
Sign in to save and rate
19ByteByteGo · architecture
EP228: How SSH Works
This engineering newsletter covers the fundamentals of how SSH establishes secure remote connections through TCP, key exchange, and authentication. It also outlines key techniques for efficient LLM serving, the core anatomy of AI agents, and a structured approach to building evaluation systems.
DEPTH ■■■■■6 min read3 weeks ago
Sign in to save and rate