Translate

ADVERTISEMENT

Spotify Cuts Agent Token Usage šŸ“‰, How Proxies Help Databases 🚦, Data Teams Are Context Teams šŸ§‘‍šŸ«

Most of what a coding agent does is I/O rather than reasoning, such as reading five files to answer a question about one method ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌  ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ 

TLDR

TLDR Data 2026-09-07

šŸ“±

Deep Dives

Portal by Spotify cut my Claude Code token usage by 90% (7 minute read)

Most of what a coding agent does is I/O rather than reasoning, such as reading five files to answer a question about one method. Spotify routed that work to two declarative Portal modes, bulk-reader and code-writer, both running Gemini 2.5 Flash on an ephemeral runtime, and reserved the frontier model for problems that need it. A quarter of engineering leaders already spend $200 to $500 per developer per month on tokens, and some are past $2,000.
ZGateway: Learnings from putting a proxy in front of ZippyDB (11 minute read)

This post explains why Meta put a managed proxy tier in front of ZippyDB, its massive key-value store. The real lesson is that proxies can turn client-fleet sprawl into a controllable infrastructure boundary: connection fan-in drops roughly 97–98%, batching and coalescing happen across clients, excess traffic from noisy tenants can be selectively rejected, and failover and load-balancing policy can change centrally without waiting for a million clients to update.
From S3 to GPU in one copy: Rethinking data loading for ML training (50 minute video)

Vortex is an open-source columnar format designed to stream training data from S3 to GPUs with minimal copying. Cascading lightweight encodings, layout-aware pruning, and zero-copy memory paths target CPU and NVMe bottlenecks, giving ML platforms a way to keep expensive accelerators fed without converting everything upfront.
Context, Semantics, and Ontology: A Primer for the Agentic Era (19 minute read)

Semantic layers define business metrics, context layers provide supporting knowledge, and ontologies describe entities and their relationships. Together, they help AI agents interpret data, but people still need to keep that knowledge accurate and current.
šŸš€

Opinions & Advice

Taking Analytics by Storm with Agents (49 minute video)

Nao's founders argue that AI is shifting data teams toward maintaining business context and enabling self-service analytics. They recommend starting with one focused use case, measuring results, and improving data models before investing in a full semantic layer.
Configuring agentic AI analytics: From free-text-to-SQL to Model Context Protocol (21 minute read)

AI analytics can fail when agents generate free-form SQL against inconsistent warehouse metadata. Governed systems should route repeated questions through verified semantic-layer tools, parameterized calls, and explicit refusal paths, reserving open-ended SQL for cases humans can inspect. Maintaining definitions is the hard part regardless of model upgrades.
One round trip beats a thousand, and your batch API probably is not batching (4 minute read)

A 100,000-row Postgres load took 41 minutes because each row became its own statement and transaction; COPY cut the same work to 11 seconds. Real batching removes network round trips, parse overhead, and WAL flush barriers, while driver flags and transaction chunking prevent bulk APIs from silently behaving row by row.
šŸ’»

Launches & Tools

Pre-release of Polars 2.0 (4 minute read)

Polars 2.0 makes the streaming engine the default for lazy queries, aiming for much lower memory use and faster execution while accepting that row order is not guaranteed unless requested. It also tightens type coercion and concatenation behavior, and removes deprecated APIs so data mismatches fail earlier instead of hiding in production pipelines.
Apache Kafka vs Apache Iggy: Same log, different engine (15 minute read)

Apache Iggy is a Rust streaming engine with Kafka-like logs and consumer groups, optimized around thread-per-core execution and modern Linux I/O. It looks promising for low-latency single-node or simpler deployments, but Kafka still has the deeper production story for replication, exactly-once semantics, compaction, and multi-region operations.
Sail 0.7: Stateless Compute, Durable Job State (5 minute read)

Sail 0.7 pushes Spark-style intermediate state toward object storage with blocking shuffle and checkpoint support. It persists shuffle outputs as compressed Arrow streams so downstream task regions retry without cascading upstream failures, while checkpointing keeps iterative jobs from rebuilding long query plans. The design targets stateless workers, smaller clusters, and better resilience under preemption.
šŸŽ

Miscellaneous

From Data Querying to Data Investigations: Rethinking Natural Language Interfaces for Databases (25 minute read)

Text-to-SQL assumes users ask questions that a single query can answer, when in practice they bring problems that need a sequence of queries with reasoning over the intermediate results. The paper proposes data investigations as the replacement paradigm and presents D2, a prototype that autonomously searches, reasons over, and collects data to reach evidence-backed conclusions, benchmarked on a Murder Mystery dataset.
When the source of truth is a Google Sheet (6 minute read)

Warner Music Group turned a hand-edited anti-counterfeit tracking spreadsheet into governed Databricks tables without taking the spreadsheet away from operators. The pipeline handles shifting tabs, renamed headers, late edits, row fingerprints, and full-overwrite loads so executive reporting can trust a messy business interface that people actually use.

Quick Links

Getting ready for PostgreSQL 19 (13 minute read)

PostgreSQL 19 Beta 3 adds temporal SQL, idempotent upsert-and-fetch, IGNORE NULLS window behavior, concurrent repacking, DDL extraction helpers, SQL/PGQ graph querying, and stricter NULL handling.
DuckFlight (GitHub Repo)

DuckFlight lets PostgreSQL tools and Arrow Flight SQL clients read and write the same live DuckDB database without a separate service or copying data.

Want to advertise in TLDR? šŸ“°

If your company is interested in reaching an audience of data engineering professionals and decision makers, you may want to advertise with us.

Want to work at TLDR? šŸ’¼

Apply here, create your own role or send a friend's resume to jobs@tldr.tech and get $1k if we hire them! TLDR is one of Inc.'s Best Bootstrapped businesses of 2025.

If you have any comments or feedback, just respond to this email!

Thanks for reading,
Joel Van Veluwen, Tzu-Ruey Ching & Remi Turpaud


Manage your subscriptions to our other newsletters on tech, startups, and programming. Or if TLDR Data isn't for you, please unsubscribe.
FREE MICROSOFT CERTIFIED STUDENT'S RESUME/CV BUILDER
CREATE YOUR OWN NOW šŸ‘‰

Building a Successful, Professional CV/Resume

A well-crafted CV/resume is essential for making a strong impression on potential employers. Follow these key steps:

  1. Define Your Objective: Identify your career goals and tailor your content to showcase relevant skills.
  2. Choose a Format: Select a clean font (Arial, Calibri, Helvetica) at 10–12pt size.
  3. Write a Strong Header: Include full name, phone, email, and LinkedIn profile.
  4. Highlight Education & Experience: List qualifications and work history in reverse chronological order.
  5. Showcase Technical & Soft Skills: Highlight software proficiency, leadership, and communication abilities.
  6. Optimize & Proofread: Target relevant ATS keywords and eliminate spelling errors.
ADVERTISEMENT

Contact Form

Name

Email *

Message *