Download pptx - Data migration to Drupal using the migrate module

Data Migration with Drupal using Migrate

Drupal を使ったデータ移行について

Data Migration with Drupal using Migrate, Drupalcamp Kyoto.12th April 2014 - Luc Bézier, @Luukyb

Drupalcamp Kyoto, Japan

https://www.flickr.com/photos/lifes26/4509331619/

Who am I

Data Migration with Drupal using Migrate, Drupalcamp Kyoto.Luc Bézier, @Luukyb

Who am I

Freelance web, exclusively Drupal projects since ~ 4 years.

I moved to Cebu City, Philippines ~ 1 year.

Twitter @[email protected]

Luukyb on drupal.org


Who am I

Contributed to several large data migrationto drupal using migrate module.

Oracle to drupal :BBC Good Food

UK public sector organisation


http://www.flickr.com/photos/larahsphotography/2795859728/

1. Introduction to data migration2. Understanding the migrate module

3. Organise your Data migration with Migrate4. Migrate in Drupal 8


Data migration


https://www.flickr.com/photos/usace_albuquerque/5547589951/

Data migration

Moving data from A to B

(and often, in the middle you transform the data.)



Data migration

Simple migration?Feeds module

Data mapping using UI.drupal.org/project/feeds



Data migration

Use migrate module for a complex migration.

Complex source or destination.



Data migration


https://www.flickr.com/photos/kieranlane/6635502419/

Data migration

Using the migrate module can require code, coffee

and patience.


https://www.flickr.com/photos/kieranlane/6635502419/

Data migration

Good news:Migrate module is very flexible, powerful and well documented.



Introduction to Migrate module

http://www.flickr.com/photos/zigazou76/9104028602





Drupal module

Install and enable like any other contrib module

drupal.org/project/migrate




Created by Mike Ryan.drupal.org/user/4420

Senior Technical Consultantat Acquia




“framework for migrating content into Drupal from other

sources”




What’s inside ?- OOP Architecture

- An API- Some drush commands

- Migrate UI




Built-in support of core items (Nodes, Users, Files, Taxonomy

and comments)




Built-in support for PDO, XML, CSV, JSON, and native MSSQL

and Oracle API sources




You can extend all sources, destinations.




Migration:- 100% native drupal

- iterative




Related modules:- Drupal-to-Drupal data migration (migrate_d2d)

- WordPress Migrate- TYPO3_migrate

Understanding Migrate module






Your migration classes extends the

abstract class Migration




Your source.

$this->source = new MigrateSourceSQL($query);




Your destination.

$this->destination = new MigrateDestinationNode(’article');




Your mapping.

$this->addFieldMapping('field_summary', 'summary');




Transform your data.

$this->addFieldMapping('field_summary', 'summary’)

->callbacks(array($this, ’summaryFormat'));




Extra transformation and processing can be done using

methods like:function prepareRow($row)




Some cool features !Source dependency definition.

$this->addFieldMapping('field_image', ’imagepath') ->sourceMigration(’MediaImages');




Easy to rollback the data.When you run a migration,

migrate module stores the keys.




If you import into a contributed module: 2 cases.




First case, my contrib module does not support migrate.




Example: Media module.

Migrating content for the media module requires migrate_extras.




Migrate extras module implements extra support.

drupal.org/project/migrate_extras




Module maintainers are now recommended to implement

migration directly in the modules.




So second case, my contrib module implements migrate.




Example: field collection.

Comes with a file dedicated to migrate:

field_collection.migrate.inc




Use drush !

Limit the number of items to import,Rollback the data,

Audit your migration, …




Organise your Data migration




Study the source data,keep track of the changes.




Use a separate migration environment.




Use a script to build this environment from scratch.




Install your site with a profile$ drush si profileMigrate the data

$ drush mi MyMigration



Migrate to D8


https://www.flickr.com/photos/michaeljohn/306759922/

Migrate to D8



Drupal 8 will integrate a Migration API to migrate your site from

Drupal 6 and Drupal 7 to Drupal 8.

Migrate to D8



This API will be based on migrate module.(currently still in progress)

Migrate to D8



Migration API in D8:drupal.org/node/2127611

Migration modules list :drupal.org/documentation/migrate

Questions?



Coming camps in PHL



Drupalcamp Manila : 26th April

Drupalcamp Cebu : October 2014 (TBC)

Thank you !



ありがとう[email protected]

@luukyb