1. 20121121WebDB

2. 1988 1995 PC 2000 2006 2007 SWAT2010 2012 Osamu Yonetani CTOIT 3. 4. 2011/9/26Hadoop 5. 100%90% 80%70%60%50%40%30%20%10% 0% 2001 2002 2003 2004 2005 2006 2007 2008 2009 20102011 6. 7. 8. , , , 9. 10. 11. ITUI/SEOR&D 12. IT IT 13. 3839F 14. 15. 16. . 16 17. . 17 18. . / 18 19. . / 19 20. .Gate Review Gate Review Gate ReviewR-StageDev-Stage -Stage -Stage 20 21. Hadoop 22. HadoopJAVAMapReduceJava HDFSMapReduceMAPjavaSHUFFLE REDUCE HDFS 22 23. RDB PV Quest Data Connectorive HadoopmA 23 24. Hive HadoopRDB SQLHiveQLMapReduceSQL Hive MapReduceHive24 25. mahout Java 25 26. Sqoop HadoopRDBMSOracleOraOopRDBMSRDBMS HadoopRDBMS DBHadoop Hadoop 26 27. 1234 20 12040 20089201020112012Web 27 28. Apache Hadoop / CDH MapR / GreenplumMRHeartbeat + DRBDMasterNode1 MasterNode2MasterNode3MasterNode4 Node1Node2 Node3Node4 JobTrackerJobTrackerCLDB CLDB CLDBCLDB NameNodeNameNodeJobTracker JobTracker JobTrackerJobTrackerSecondarySecondary TaskTrackerTaskTrackerTaskTracker TaskTrackerNameNode NameNode FileServer FileServer FileServerFileServerWardenSlaveNode1SlaveNode2 SlaveNode3 SlaveNode4Node5Node6 Node7Node8 TaskTracker TaskTrackerTaskTrackerTaskTracker CLDB CLDB CLDBCLDB JobTracker JobTracker JobTrackerJobTracker DataNodeDataNode DataNode DataNode TaskTrackerTaskTrackerTaskTracker TaskTrackerFileServer FileServer FileServerFileServerMaster4Slave15+batch120 NodeSlave 28 29. 30. /SQLRHadoopMapReduceMahoutJavaR 30 31. 3 31 32. 32 33. R-Tech 33 34. Hadoop 35. 36. * * /ETC/ 36 37. 37 38. 38 39. //////ETC/ 30 /////// ///// 39 40. DB DB *1/18/ *34030and 40 41. hadoopHadoop DB Hadoop DB 1 41 42. Hadoop DBHadoop DB 9501 42 43. 44. with DWH HadoopMahoutLuceneKVS or RDB with S4STORM with Siri GPS 44 45. 46. IT 47. SEO UI PRJ R&D CIO layer 48. 49. rtech_qa1@recruit-tech.co.jp http://recruit-tech.co.jp/ 50.