WANdisco Incorporated

LiveData Migrator: Automated Hadoop Data Migration

Migrate HDFS data to Hadoop compatible file systems and cloud storage systems (AWS, GCP, AZURE). Avoid business disruption with immediate data availability throughout Hadoop data migration. Ensure data consistency with a smooth transition. Highly scalable and cost effective, we quickly migrate business critical data and applications with no data loss.

Features

  • Live Data Migration to Cloud Storage (AWS, GCP, AZURE)
  • HDFS notification: describes source data changes while migration is underway
  • Selective data migration on Hadoop datasets.
  • Migration progress monitoring, helps estimate completion
  • Migration management via intuitive command-line interface or self-documenting REST API
  • Optional management from WANdisco's browser-based user interfaces
  • Deep integration with cloud vendors' management interfaces.
  • 100% Availability during migration to ensure data consistency and intergrity
  • One Click Migration with Automated Replication
  • Migrate to Azure, AWS, Google Cloud, HDFS or Hadoop-compatible storage.

Benefits

  • Immediate: install and start your migration in seconds
  • Scalable: Efficient migration from gigabytes to exabytes of data
  • Avoid application downtime by migrating data even under active change
  • Track and monitor migration progress
  • Rapidly provisioned Live Data service that supports advanced migration needs
  • Reduce the cost and risk of migrating business-critical data
  • Continue running on-premise big data operations during a migration.
  • Unlock the power of cloud by using live data
  • Moves petabyte-scale data to the cloud without stopping your business
  • Creates and ensures beneficiary data consistency.

Pricing

£3,000 a unit

  • Free trial available

Service documents

Request an accessible format
If you use assistive technology (such as a screen reader) and need versions of these documents in a more accessible format, email the supplier at diliana.miteva@wandisco.com. Tell them what format you need. It will help if you say what assistive technology you use.

Framework

G-Cloud 12

Service ID

5 1 5 3 3 9 2 1 8 8 7 9 5 4 4

Contact

WANdisco Incorporated Diliana Miteva
Telephone: +44 (0)114 3039985
Email: diliana.miteva@wandisco.com

Service scope

Software add-on or extension
Yes, but can also be used as a standalone service
What software services is the service an extension to
LiveData Migrator supports two modes. 1) A standalone tool, a single user-launched process that presents a command line interface. The user is able to run it without going through an installation. 2) A system service, which exposes a REST API and can be managed by a front-end or other service.
Cloud deployment model
  • Public cloud
  • Private cloud
  • Community cloud
  • Hybrid cloud
Service constraints
There are technical prequistes required such as Linux host, network connectivty and infrastructure capacity. There is a requirement for LiveData Migrator to be run on a Linux host. Supported operating systems are Red Hat, Centos, Debian and Ubuntu. In case of migration from a HDFS source, the Linux host will need to be configured as an edge node of the Hadoop cluster.
System requirements
  • Linux host running either Red Hat, Centos, Debian or Ubuntu
  • Network connectivity from that host to your target storage endpoint
  • Sufficient network bandwidth to accommodate the transfer of existing data
  • Minimum of 100GB of free disk space

User support

Email or online ticketing support
Email or online ticketing
Support response times
All customers with a maintenance agreement in effect,
regardless of purchased level of support, are entitled to contact support via WANdisco’s Community Portal or by phone
24x7x365 to open a Support case.
User can manage status and priority of support tickets
Yes
Online ticketing support accessibility
None or don’t know
Phone support
Yes
Phone support availability
24 hours, 7 days a week
Web chat support
No
Onsite support
Yes, at extra cost
Support levels
Platinum Support: 24x7 Phone Support with access to Live Data Community Portal and Knowledge Base Access. This service is intended to be self serve however should extra support be required WANdisco offers proffesional services.
Support available to third parties
Yes

Onboarding and offboarding

Getting started
The software is designed to be self-serve. WANdisco provide an online Quickstart guide so that users can get started with data migration. A more comprehensive Getting Started guide is also provided including details on installation, operation and the full set of commands.

If Buyers require installation support, this can be provided via third parties at extra cost.
Service documentation
Yes
Documentation formats
HTML
End-of-contract data extraction
LiveData Migrator does not hold customer data. Data would reside in a Hadoop storage system or target Cloud storage destination
End-of-contract process
The License is a term license, the customer has the rights to use the software for the term contracted for. At the end of the term the software ceases to function. The customer will be contacted by a WANdisco representative in advance of this event to allow them to renew their agreement without disruption in service. Removal of WANdisco has no impact on the customers data.

Using the service

Web browser interface
Yes
Supported browsers
  • Microsoft Edge
  • Firefox
  • Chrome
  • Safari 9+
Application to install
Yes
Compatible operating systems
Linux or Unix
Designed for use on mobile devices
No
Service interface
Yes
Description of service interface
When LiveData Migrator runs as a standalone tool, users manage data migrations using command line interface from an interactive shell. When LiveData Migrator runs as a service, users can do the same by either using a dedicated graphical user interface accessible via a web browser, or by using other systems and services interfacing the LiveData Migrator via its REST API.
Accessibility standards
None or don’t know
Description of accessibility
When LiveData Migrator runs as a standalone tool, users manage data migrations using command line interface from an interactive shell. When LiveData Migrator runs as a service, users can do the same by either using a dedicated graphical user interface accessible via a web browser, or by using other systems and services interfacing the LiveData Migrator via its REST API.
Accessibility testing
Service development and testing includes ongoing use by visually impaired administrators. Product installation and operational accessibility is assessed against industry-standard requirements.
API
Yes
What users can and can't do using the API
LiveData Migrator offers a REST API for configuration and execution of data migrations
API documentation
Yes
API documentation formats
  • Open API (also known as Swagger)
  • HTML
  • PDF
API sandbox or test environment
Yes
Customisation available
Yes
Description of customisation
As a user deployed software application customers have the ability to configure all aspects of product functionality. This is done from the management console or product API. The users define migration parameters, such as source and target file systems. The users start migrations of data and then check the progress and the outcome of the migrations

Scaling

Independence of resources
User demand considerations are not applicable as only a few administrators are supposed to be using the service. LiveData Migrator performs large scale data migrations and is designed to be highly performant when operating in big data environments.

Analytics

Service usage metrics
Yes
Metrics types
We provide a line chart visualising the volume of data being migrated. We also provide information on the progress of the migrations.
Reporting types
Real-time dashboards

Resellers

Supplier type
Not a reseller

Staff security

Staff security clearance
Staff screening not performed
Government security clearance
Up to Security Clearance (SC)

Asset protection

Knowledge of data storage and processing locations
No
Datacentre security standards
Supplier-defined controls
Penetration testing frequency
Never
Protecting data at rest
Other
Other data at rest protection approach
LiveData Migrator is compatible with TDE (Transparent Data Encryption) used for protection of data at rest.
Data sanitisation process
No
Equipment disposal approach
In-house destruction process

Data importing and exporting

Data export approach
LiveData Migrator does not import, export or hold any data, it just provides a means of transferring data from one location to another.
Data export formats
Other
Other data export formats
LiveData migrator replicates raw data and doesn't manage file formats
Data import formats
Other
Other data import formats
WANdisco replicates raw data and doesn't manage file formats

Data-in-transit protection

Data protection between buyer and supplier networks
Other
Other protection between networks
LiveData Migrator doesn't hold customer data. LiveData Migrator is deployed on customer infrastructure and relies on the customers security procedures and protocols.
Data protection within supplier network
Other
Other protection within supplier network
LiveData Migrator doesn't hold customer data. LiveData Migrator is deployed on customer infrastructure and relies on the customers security procedures and protocols.

Availability and resilience

Guaranteed availability
LiveData Migrator is a software that is run on a customers own infrastrucre and as result we do not provide a SLA on uptime .WANdisco support SLAs are detailed at https://www.wandisco.com/eula
Approach to resilience
This information is available on request.
Outage reporting
The service reports outages via the graphical user interface and also through its API interface

Identity and authentication

User authentication needed
Yes
User authentication
Other
Other user authentication
The LiveData Migrator user interface provides a LDAP/AD connection allowing users to be managed through a suitable Authorization Authority, such as an LDAP or Active Directory. Each LiveData Migrator user can be assigned one or more roles through the organization’s authorization authority.
Access restrictions in management interfaces and support channels
Access is restricted via username and password controls that need to be updated periodically.
Access restriction testing frequency
At least every 6 months
Management access authentication
  • Public key authentication (including by TLS client certificate)
  • Dedicated link (for example VPN)
  • Username or password

Audit information for users

Access to user activity audit information
You control when users can access audit information
How long user audit data is stored for
User-defined
Access to supplier activity audit information
No audit information available
How long system logs are stored for
User-defined

Standards and certifications

ISO/IEC 27001 certification
No
ISO 28000:2007 certification
No
CSA STAR certification
No
PCI certification
No
Other security certifications
No

Security governance

Named board-level person responsible for service security
Yes
Security governance certified
No
Security governance approach
LiveData Migrator provided by WANdisco is compatible with all common security protocols, such as SSL/TLS, LDAP, Kerberos. It is deployed on customer infrastructure and integrates with the customers security protocols and procedures.
Information security policies and processes
WANdisco follows security policies and processes that are consistent with approved standards. Reporting structure related to security policies and processes: David Richards (CEO), Paul Scott-Murphy (VP Product Management), Rob Budas (VP Engineering), Yury Yudin (Director of QA), Ian Mordey (Head of Infrastructure), and their direct reports.

Operational security

Configuration and change management standard
Supplier-defined controls
Configuration and change management approach
LiveDataMigrator log files reflect each operation that is undertaken. These Log file are maintained and reviewed when provided by the customer. All the software components used are monitored regularly and there is a process in place which supports patching which is driven by our Support organisation to ensure our customers are running software in the most efficient and secure way possible. All code changes are reviewed via a non author code review. A verification build job is carried and must pass stability and usability tests.
Vulnerability management type
Supplier-defined controls
Vulnerability management approach
We follow leading edge practices to identify vulnerabilities as soon as possible in the various phases of the software development life cycle. We use Industry standard tools and processes to ensure that we identify threats and are able to deploy patches quickly. We get information about potential threats from our Security partners.
Protective monitoring type
Supplier-defined controls
Protective monitoring approach
Our support organisation engages with our customers to identify potential compromises. They work closely with customers, analyse the root cause of a compromise and update software as required to mitigate any compromises. We also proactively share root cause analysis reports with our customers. As WANdisco Fusion is deployed independently by each customer, there is no risk of a single customer compromise resulting in direct compromise of other customers' use of the software.
Incident management type
Supplier-defined controls
Incident management approach
We have documented processes, procedures and workflow for common events. Users can report incidents via telephone or email. We provide a post incident route cause analysis report which is sent to the customer. These reports include the findings, recommendations and the actions the customer needs to take in order to remediate the incident. We also provide a post incident review meeting with the customer for every major incident.

Secure development

Approach to secure software development best practice
Supplier-defined process

Public sector networks

Connection to public sector networks
No

Pricing

Price
£3,000 a unit
Discount for educational organisations
No
Free trial available
Yes
Description of free trial
A free trial is available on request, which is reviewed on a case by case basis.
Link to free trial
Www.wandisco.com

Service documents

Request an accessible format
If you use assistive technology (such as a screen reader) and need versions of these documents in a more accessible format, email the supplier at diliana.miteva@wandisco.com. Tell them what format you need. It will help if you say what assistive technology you use.