Case study · Data import

A batch ingestion engine that replaced a $10M license

A Java/Spring Boot batch ingestion system for legacy records replaced a licensed migration tool and saved clients over $10M a year.

Result: Over $10M a year in client licensing removed; company revenue up 10%.

Context

An enterprise SaaS platform onboarded clients with years of legacy records.

New clients needed an expensive third-party tool to migrate their legacy records onto the platform.

Designed a scheduled batch ingestion and migration system on Java, Spring Boot, Hibernate and SQL.

Concurrency

before100%

after0%

How replacing a single global Redis lock with an append-only event log removed lock starvation and write races in a high-concurrency service.

Caching

before100%

after56%

Key-level memory profiling and a shared Redis client library cut cache memory 44%, peak utilization from 94% to 56%, and ended connection drops.

Databases

before1.0×

after0.4×

Finding slow SQL behind partner-facing APIs with OpenTelemetry tracing, then removing expensive joins, partitioning indexes and shrinking payloads.