Component: Data migration

Most projects developed on top of Casewhere need data migration. Recognizing both the demand for and the complexity of data migration, Casewhere provides a standard component to facilitate the job:

  • A framework for setting up data migration rules
  • Automation and batch processing
  • Data monitoring
  • Standard plugin interface to work with different data sources
  • Data verification

Features

Automated process and batch processing

You can organize data migration work into processes. For example, one for migrating master data, one for major business entities, another for moving files, and so on.

image-20231212102714874

A process can have as many jobs as needed.

image-20231212103612970

It currently supports two job types: Copy data and Custom. For custom jobs, you can trigger a specific workflow to do all kinds of work, from cleaning up data to enriching migrated data. Copy-data jobs run in batches, and you can control how many batches run simultaneously for a given process.

image-20231212104411644

Monitor migration progress

The component provides visual tools for tracking migration progress. You can always see the current status and progress of processes, jobs, and batches.

image-20231212105640301

The component will stop whenever it encounters an error. You can view the error details or use the Correlation ID to obtain more information.

image-20231212110000908

After fixing the error, you can resume the process or the job. You can also rerun a single batch.

Data verification

The component lets you define rules to verify data after migration. It runs the configured rules right after a batch finishes to ensure everything is migrated as expected. You can decide whether the job should continue or stop when a test fails.

image-20231212111506256

Additionally, the component provides a report comparing the amount of data migrated. You can export the data to Excel.

image-20231214151821229

Installation

Requirements: Casewhere 2.8.0 or later.

Installation guide: Please follow these steps to install the component:

  1. Import the Casewhere Data Migration product.

  2. Link the pages to your worker sites and configure the necessary access control.

    1. It's recommended to create a temporary worker site for data migration and shut it down after finishing the job.

  3. Configure the SQL plugin and update the connection string.

  4. Define the data migration process and implement the necessary rules for transforming and verifying data. For more information, please read the configuration guide.

To learn more about planning a successful data migration, see the preparation guide.

Releases

1.0.0 - 09/07/2021

Casewhere 2.6.0 or later.

Changelog

  • Process design
  • Data migration rules
  • Automation and batch processing
  • Standard plugin interface to work with different data sources

Download (login required): Data migration v1.0.0

1.1.0 - 12/12/2023

Casewhere 2.8.0 or later.

Changelog

  • Process design: More features
  • Data verification rules
  • Automation and batch processing: More features
  • Data migration report

Download (login required): Data migration v1.1.0