Featured

Stripe buys OpenRouter πŸ”€, Anthropic Model 2 πŸ€–, zero knowledge proofs 🧠 

Image
Stripe has finalized an agreement to acquire OpenRouter, a startup that helps companies switch between AI models. The sale price of more than $7B ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌  ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌  Sign Up | Advertise | View Online ...

Benchmarking Agentic Analytics πŸ“Š, Faster Lakehouse Lookups πŸ”Ž, Comet Hits 1.0 ☄️

Kenn uses coding agents at high volume while keeping humans in control of design, review, and final decisions. Detailed specs, adversarial reviews ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌  ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ 

TLDR

TLDR Data 2026-08-17

πŸ“±

Deep Dives

Scratch a simple data model, find a complex one (14 minute read)

A seemingly simple Bible data model quickly breaks down once real-world cases like verse ranges, missing verses, alternate numbering, repeated chapters, and out-of-order text appear. The practical lesson is to model only the complexity the product actually needs, rather than chasing perfect fidelity by default.
Point Lookups on the Lakehouse: How Hudi Indexes Accelerate Read-Heavy Workloads (8 minute read)

Apache Hudi's metadata-table indexes make selective lakehouse reads behave more like database lookups than full scans. Record-level, secondary, expression, and bloom-filter indexes can prune equality predicates to a few files.
Why AI Is a Storage Workload (11 minute read)

AI inference is becoming stateful infrastructure: long-context sessions, agents, RAG, and multimodal workflows create durable KV caches, prefixes, memories, and embeddings that are cheaper to store than recompute after enough reuse. The storage hierarchy is moving into the hot path, with HBM, DRAM, SSDs, object storage, CXL, and flash tiers shaping latency and cost.
Change-Data-Capture Doesn't Solve Dual-Writes (8 minute read)

CDC makes downstream writes retryable, ordered, and observable, but it does not make destination systems safe to write twice. The destination still needs durable idempotency or a way to reject duplicates after recovery. This is a useful design-review lens for teams treating CDC as an automatic consistency fix.
πŸš€

Opinions & Advice

How Kenn is doing Agentic Engineering (8 minute read)

Kenn uses coding agents at high volume while keeping humans in control of design, review, and final decisions. Detailed specs, adversarial reviews, and continuous verification let three engineers ship hundreds of PRs weekly without relying on autonomous loops.
On Benchmarking (7 minute read)

A throughput number is not an architecture decision. Good benchmarks explain the workload, cache state, client behavior, failure modes, and scaling limit behind the result. Without that context, teams risk optimizing for a synthetic score instead of the bottlenecks their production data systems will actually hit.
How we tracked down a 16-year-old SQLite bug (13 minute read)

Tailscale spent six months tracing repeated SQLite corruption to a rare 16-year-old race condition between WAL checkpointing and write transactions, triggered more often by its aggressive manual checkpointing. The investigation led to a SQLite fix, stronger recovery tooling, and a broader lesson that even “boring” technology becomes risky when operated outside its common paths.
πŸ’»

Launches & Tools

Introducing DataBench (22 minute read)

Hex's DataBench tests AI agents on realistic, messy analytics tasks and finds they are strong at gathering evidence but weaker at open-ended decisions where judgment matters. Models often fail by manufacturing certainty, missing subtle data traps or overthinking correct answers, showing why human review is still essential for complex analytical work.
Apache DataFusion Comet 1.0.0 Release (5 minute read)

Comet, the Spark accelerator built on Apache DataFusion, reached 1.0 with semantic versioning, Spark 4 support, broader operator coverage, and extensive correctness testing against Spark's own suite. It is aimed at teams that want faster Spark execution without rewriting jobs or replacing the surrounding Spark ecosystem.
What's new in OpenSearch 3.8 (7 minute read)

OpenSearch 3.8 improves vector ingestion, radial query throughput, and median query latency while expanding AI-agent support. MCP now works across all agent types, tool discovery is richer, and gRPC streaming inference lowers token latency. Analytics teams also get new PPL/SQL tooling, Grok debugging, one-click Prometheus alerts, and search-relevance workflow improvements.
🎁

Miscellaneous

Fairly Ranking the Most Brilliant Birds (19 minute read)

A transparent ranking of the world's most brilliant birds combines chroma, colour variety, sample confidence and diversity, placing the orange-breasted bunting first. The bigger idea is that ranking systems are fairest when every factor is understandable, defensible and tied to a reasonable human judgement.
Snowflake says this 149 GB query scanned -1.5 GB (3 minute read)

Unloading Snowflake QUERY_HISTORY data to Parquet can corrupt values when large numbers are written as INT32. Casting the nine affected columns before export prevents overflow, bad joins, and incorrect analysis.

Quick Links

Spark observability skills (GitHub Repo)

Embrasure has released agent skills for debugging and optimizing Spark using runtime data from the Spark History Server.
Querying 1 Thousand JSON Files From S3 (7 minute read)

DuckDB on ECS Fargate processed 1,000 JSON files about 3.4× faster than Spark on EMR Serverless and at lower cost.

Want to advertise in TLDR? πŸ“°

If your company is interested in reaching an audience of data engineering professionals and decision makers, you may want to advertise with us.

Want to work at TLDR? πŸ’Ό

Apply here, create your own role or send a friend's resume to jobs@tldr.tech and get $1k if we hire them! TLDR is one of Inc.'s Best Bootstrapped businesses of 2025.

If you have any comments or feedback, just respond to this email!

Thanks for reading,
Joel Van Veluwen, Tzu-Ruey Ching & Remi Turpaud


Manage your subscriptions to our other newsletters on tech, startups, and programming. Or if TLDR Data isn't for you, please unsubscribe.

Comments