(PDF) Drupal for Big Data - is it ready? (European Drupal Days 2015)

Big data is a broad term for data sets so large or complex that traditional data processing applications are inadequate. Challenges include analysis, capture, curation, search, sharing, storage, transfer, visualisation, and information privacy. The term often refers simply to the use of predictive analytics or other certain advanced methods to extract value from data, and seldom to a particular size of data set.

#DrupalDaysEU

Volume

#DrupalDaysEU

Velocity

#DrupalDaysEU

Variety

Hang on…. What is Drupal?

#DrupalDaysEU

DataBase

#DrupalDaysEU

Web server

#DrupalDaysEU

Structure

#DrupalDaysEU

@Data Science for businesses

The fundamental concepts of data science are drawn form many fields that study data analytics …

#DrupalDaysEU

Unstructured data

Can We parse unstructured data with Drupal???

#DrupalDaysEU

function my_analysis_external_views_plugins() { $plugin = array();

$plugin['query']['my_analysis_master_plugin_query'] = array();

….. }

Views???

#DrupalDaysEU

Views???

public function query($get_count = FALSE){

}

#DrupalDaysEU

function execute(&$view){

$data = drupal_http_request(“what so ever”);

}

Views???

https://www.lullabot.com/blog/article/building-views-query-plugins-part-2

#DrupalDaysEU

https://www.drupal.org/project/feeds_crawler

#DrupalDaysEU

Pros

• Great community

• Support

• Reputation

• Myriad of vendors

#DrupalDaysEU

Cons

• Too robust

• Slow

• No lazy loading

• Single threaded

• Heavy

• Structured

Case Studies

#DrupalDaysEU

http://www.fisc.md/

#DrupalDaysEU

http://cloudsense.com

#DrupalDaysEU

https://www.flixbus.com/

#DrupalDaysEU

Only ~2000 nodes???

#DrupalDaysEU

Used to track search results with nodes???

#DrupalDaysEU

http://cwds.uw.edu/visualizing-big-data-drupal-using-data-visualizations-drive-knowledge-discovery

#DrupalDaysEU

Visualizing Big Data In Drupal: Using Data Visualizations to Drive Knowledge Discovery

http://cwds.uw.edu/visualizing-big-data-drupal-using-data-visualizations-drive-knowledge-discovery

#DrupalDaysEU

http://basilseedlibrary.com

#DrupalDaysEU

http://blog.csdn.net/hadoopstudy/article/details/1501123

#DrupalDaysEU

https://www.drupal.org/sandbox/cilefen/1858412

Drupal for big data - is it … ?

#DrupalDaysEU

Acknowledgements

• Nicolas Roberts - niccolo.roberts@gmail.com

• http://www.westridge.com/media/series/out-of-the-box

• Florian Loretan

• My Wife

• Drupal Community

• Organisers - Lenka especially

mailto:niccolo.roberts@gmail.com

#DrupalDaysEU

Grazie

@PassiveManage

passivemanagement.net/contact

http://passivemanagement.net/blog/janis

Drupal for Big Data - is it ready? (European Drupal Days 2015)

Internet

An Introduction to Drupal on Drupal Global Training Days - Mukesh Agarwal, CEO, Innoraft

Introduzione a Drupal Commerce Kickstart - Drupal Days 2014

Accessibility presentation at Drupal Government Days

nodejs - Drupal Developer Days Barcelona

Drupal theming - a practical approach (European Drupal Days 2015)

Ready. Set. Drupal! An Intro to Drupal 8, Part 1

Open Atrium 2 at Drupal Government Days

Drupal Dev Days Milan 2016

Ready. Set. Drupal! An Intro to Drupal 8, Part 2

¡This is drupal! - Global Training Days

QA on Drupal projects - Drupal Dev Days Seville 2017

Drupal Continuous Integration (European Drupal Days 2015)

A new tool for measuring performance in Drupal 8 - Drupal Dev Days Montpellier

Drupal 8 Theming Done Right (European Drupal Days 2015)

Drupal for beginners - Global Training Days - Cebu 2016

Drupal Module Development - OSI Days 2010

Drupal Developer Days Keynote

SUCCESSFUL COMMUNITIES THE NEW BREED OF DRUPAL EVENTS · Drupal Dev Days. Drupal Design Camp. Drupal Business Days. What motivates people to join or leave the (local) Drupal community?

The multilingual Drupal 8 experience (European Drupal Days 2015)

Drupal Security: How to survive Drupalgeddon and prepare for future (European Drupal Days 2015)