Get the weekly digestSubscribe

/ THE FEED /

Read what ships.

Deep, recent reads ranked by depth and freshness.

Datadogremove filterGitLabremove filterShopifyremove filterClear all

  1. 01Shopify · architecture

    We gave AI agents a mobile dev environment

    Engineering teams outgrew their local machines while running parallel AI mobile development agents, constrained by heavy builds and lack of iOS tools on Linux. To solve this, they built Remote Dev using warm pools of remote Macs connected via SSH alongside separate Linux VMs for Android virtualization, paired with agent skills and live browser streaming. This setup shifted workflow bottlenecks, increasing AI-merged pull requests from 6 percent to 61 percent.

    DEPTH ■■■■■9 min read3 days ago

    ArchitectureMobile

    Sign in to save and rate

  2. 02GitLab · tutorial

    PHP2Shell: GitLab helps find and remediate critical PHP flaws

    Critical remote code execution vulnerabilities known as PHP2Shell affect the PHP engine across multiple versions, requiring immediate runtime updates to fixed versions or patched distribution packages. The team utilized platform features like container scanning, code search, and automated agent workflows to locate PHP projects and remediate vulnerabilities. Operators must also check logs and environments for signs of compromise as framework updates and input validations cannot prevent these engine-level flaws.

    DEPTH ■■■■■10 min read3 days ago

    ArchitectureSecurity

    Sign in to save and rate

  3. 03Datadog · architecture

    Beyond container image signing: How we enforce software supply chain policies at Datadog

    Container image signing alone cannot detect upstream security compromises occurring before the image is signed. To address this, the engineering team built an internal system called Turnstile that generates cryptographically signed attestations across an artifact's life cycle and evaluates them against environment-specific policies at deployment time. This approach enables the organization to enforce strict security and compliance requirements at scale without disrupting developer workflows.

    DEPTH ■■■■■15 min read5 days ago

    Sign in to save and rate

  4. 04Shopify · architecture

    How Shopify turns open models into task experts

    Shopify uses a continual learning flywheel to post-train open models, such as NVIDIA Nemotron, to serve as dedicated subagents for specific tasks like GraphQL generation. By optimizing inference and utilizing automated self-healing to generate training data from production failures, the team successfully created task experts that outperform frontier models while reducing serving costs by 90-98% and improving response times.

    DEPTH ■■■■■5 min read4 days ago

    Architecture

    Sign in to save and rate

  5. 05Shopify · architecture

    Cross-store product clustering across millions of stores

    Shopify needed to group identical product listings from millions of different merchants under a single global identifier. To solve this at scale without comparing every possible pair, the team implemented a multi-stage pipeline using vector retrieval, a tiered scoring system of ML models, and a bounded graph clustering approach. This architecture successfully standardizes product data across the entire platform while controlling computational costs.

    DEPTH ■■■■■13 min read5 days ago

    Architecture

    Sign in to save and rate

  6. 06GitLab · scaling

    Make every AI credit count: See, cap, and reduce agent spend

    Uncontrolled AI agent spending can be mitigated by combining open-weight models, centralized context graphs to reduce retries, and usage analytics with credit caps. GitLab introduced these capabilities in its Duo Agent Platform to help platform teams trace, limit, and optimize AI credit consumption. The resulting architecture matches specific tasks to lower-cost models while maintaining task completion quality.

    DEPTH ■■■■■6 min read12 days ago

    Sign in to save and rate

  7. 07Shopify · tooling

    Building Overexposed: understanding application exposure

    The team built an automated scanner called Overexposed to track internet-facing services and verify access controls across Kubernetes and Cloud Run. By querying live cloud inventories and probing endpoints like an outsider, the scanner classifies exposure while avoiding false assumptions from static config files. As a result, the engineering organization improved accuracy and significantly reduced inconclusive findings over time.

    DEPTH ■■■■■8 min read6 days ago

    Sign in to save and rate

  8. 08Datadog · architecture

    How we extended Apache DataFusion to execute one query across many machines

    Datadog needed to execute interactive queries across large datasets that exceeded single-node limits while maintaining low latency. To solve this, the team built Distributed DataFusion, an open-source framework extending Apache DataFusion across multiple machines using zero-copy streaming via Apache Arrow and Substrait. As a result, heavy queries complete up to 10 times faster without imposing distribution overhead on lightweight queries.

    DEPTH ■■■■■12 min read3 weeks ago

    Sign in to save and rate

  9. 09Datadog · architecture

    How we built an async-aware Python profiler

    Traditional Python profilers treat asyncio tasks as independent stacks, obscuring logical execution paths and relationships. The Datadog team built an async-aware profiling model that tracks task dependencies to reconstruct unified execution paths ("stacked stacks") while reducing profiling overhead by over 60 percent. This approach provides clearer performance visibility for asynchronous applications without excessive production latency.

    DEPTH ■■■■■19 min read3 weeks ago

    Sign in to save and rate

  10. 10Shopify · architecture

    ShopGym: Realistic, reproducible sandboxes for shopping agents

    Training and evaluating shopping agents is difficult due to changing live store environments, bot detection, and limited hand-built test stores. The team developed ShopGym, a framework that converts live storefronts into self-contained, anonymized sandbox shops and generates benchmark tasks. Evaluation showed that synthetic shops preserve key structural properties and behavioral alignment with live stores, giving agents a reliable environment to practice and improve.

    DEPTH ■■■■■6 min read3 weeks ago

    Sign in to save and rate

  11. 11Shopify · tooling

    Helix: The internal tool powering our Shopify app's native migration

    Shopify is migrating its mobile apps from React Native to native Swift and Kotlin using an internal LLM-powered tool called Helix. Helix breaks migrations down into small checkpoints and enforces strict quality gates covering behavior, UI equivalence, architectural compliance, and human review. This iterative loop allows the team to reliably generate and migrate hundreds of screens to native code.

    DEPTH ■■■■■8 min read4 weeks ago

    Sign in to save and rate

  12. 12Datadog · architecture

    Making Rust observability reliable at scale with OpenTelemetry

    Datadog engineers faced inconsistent tracing, broken spans, and context loss across Rust services due to fragmented tooling and unopinionated OpenTelemetry configurations. To fix this, they contributed upstream to OpenTelemetry to improve interoperability and built an opinionated Rust tracing library called dd-trace-rs. This reduced backend ingestion volume by 20x while increasing the rate of indexed spans per service by 3x.

    DEPTH ■■■■■10 min read7 weeks ago

    Sign in to save and rate

  13. 13GitLab · tutorial

    Three developer tasks worth handing to an agent

    The post explains how to use GitLab Duo Agent Platform features such as automated code reviews, CI/CD pipeline failure diagnosis, and cross-project chat. It provides setup instructions for configuration and outlines a consumption-based pricing model using credits. The features aim to automate routine developer workflows using broader project context than standard IDE assistants.

    DEPTH ■■■■■4 min read6 days ago

    Sign in to save and rate

  14. 14Shopify · migration

    Migrating Shop app from React Native to native

    Shop migrated its mobile app from React Native to native Swift and Kotlin by leveraging AI coding agents to accelerate the rewrite. The migration resulted in improved startup times, higher session stability, smaller Android app sizes, and smoother rendering performance.

    DEPTH ■■■■■5 min read6 weeks ago

    Sign in to save and rate

  15. 15Shopify · migration

    Native is now the future of mobile at Shopify

    Shopify is migrating its mobile applications from React Native back to native Swift and Kotlin. The team determined that the emergence of advanced coding agents significantly reduces the cost of maintaining platform parity, making native development the superior choice again. To execute this migration efficiently, Shopify developed a system called Helix and a CLI-driven, agent-addressable architecture to enable fast, autonomous testing.

    DEPTH ■■■■■10 min read6 weeks ago

    Sign in to save and rate

  16. 16Shopify · architecture

    How River takes security work from a fix to merge

    Shopify developed an AI agent named River to automate security vulnerability remediation from dependency upgrades to pull request merges. The agent validates live states, replays and repairs fixes on current repository heads, and escalates context-dependent decisions to human engineers. This workflow reduced the open issue backlog by about 70 percent and increased freshness-gated security merges significantly.

    DEPTH ■■■■■9 min read7 weeks ago

    Sign in to save and rate