Updating Data Infrastructure: Legacy System Migration

Successful Migration off of Legacy Data Systems

For When You Can't Afford an Outage

We manage successful migrations off of legacy data systems. We use zero downtime migrations to avoid business disruptions. Our approach to data engineering provides high performing, fault tolerant, fully managed Streaming, Storage, and Search.

Data Engineering by Dattell ➔

Case Study: Legacy Software Migration for Search & Aggregation

Challenge

A multinational, Fortune 500 company needed help migrating from a legacy system with costly licensing fees. The goal was to move to a open source software to save $10M/year in licenses.

The new text search and aggregation solution needed to ingest 80TB of application data daily. The system needed to accommodate for hot and cool storage.

They also needed assistance with Kubernetes and setting up proper security.

Solution

Our engineers worked across teams to understand the use case and design an open source data architecture that could handle this company’s high data volume. Our engineers set expectations with management, trained all pertinent staff on the new architecture, and advised hardware purchases.

We used Kafka for data streaming and OpenSearch for data storage and search. Neither of these software have license fees because they are both governed by the Apache license.

Current Situation

The company hasn’t had a Kafka outage in the 3 years we have managed their data infrastructure. And we have seamlessly support their exponential data growth over that time.

Our client has saved $30M in software licensing since the migration.

Improve Performance, Decrease Costs

Software Costs.
Moving to free Elasticsearch or migrating to Opensearch are both trusted alternatives to paid software that are completely free. This alone saves many clients $1M or more per year.

Hardware costs.
Another example is poorly written queries. A bad query can use 10,000% more hardware.

Business Losses.
Technology companies need their data infrastructure online and collecting 100% of incoming data at all times to avoid costly business losses. Expertise is needed to ensure a reliable data infrastructure.

Improve Performance, Decrease Costs

24x7 Data Engineering Support & Consulting

Visit our OpenSearch page for more details on our support services.

Updating Data Infrastructure: Legacy System Migration