Upload
others
View
3
Download
0
Embed Size (px)
Citation preview
1
ImportingdatafromMySQLtoHDFSusingSqoop
a) MySQLInstallationonWindows1. DownloadMySQLInstallerandunzipit.
http://dev.mysql.com/downloads/mysql/
2
2. DoubleclickontheextractedfileandclickonInstallMysqlProducts.
3
3. ClickNext
4
4. Clicknext.
5
5. ClickExecute.
6
6. ClickNext
7
7. ClickExecute.
8
8. ClickNext.
9
9. ClickNext.
10
10. ClickNext.
11
11. Setpasswordforrootuserandclicknext.
12
12. ClickNext.
13
13. ClickNext.
14
14. ClickNext.
15
15. ClickNext.
16
16. OpenMysqlCommandLineClient,givepasswordandmysqlcommandlinewillopen.Nowwecancreatetables,databasesetc.
17
17. Createanewdatabaseandusenewdatabaseusingcommandgivenbelow.
createdatabaseDeZyre;
useDeZyre;
18. Createatableandinsertrecordsasgivenbelow.
CREATETABLEplayer(
player_idINTNOTNULLAUTO_INCREMENT,
player_nameVARCHAR(100)NOTNULL,
PRIMARYKEY(player_id)
);
insertintoplayer(player_name)values("Sachin"),("Dravid"),("Dhoni"),("Ganguly"),("Yuvraj"),("Nehra"),("Singh");
18
19
19. Use“ipconfig”commandtofindoutIPofmysqlserver.
20
ImportingDatafromMySQLtoHDFS
20. FindoutIPoftheserverwhereyouwanttoruntheSqoop.GrantprivilegetothatserveronMySQLserver.Let’ssayIPoftheserverwhereSqoopwillberunningis'192.168.138.128'.TograntprivilegeasshownaboveopenMySQLclientandrunfollowingcommand.TogetIPofVMmachine,FirecommandIfconfig
grantallprivilegeson*.*to'root'@'192.168.2.164'IDENTIFIEDBY'password'WITHGRANTOPTION
21
21. ForimportingdatafromSQLtoHDFSusebelowcommandonClouderaVM.
sqoopimport--connectjdbc:mysql://192.168.138.1/dezyre--tableplayer--usernameroot-P--target-dir/user/cloudera/sqoopOut1-m1
22
22. Onceabovecommandiscompleteyoucanseedatain/user/cloudera/sqoopOut1directory.
ExportdatafromHDFStoMySQL
23. Runfollowingcommandforcreatinganewdirectoryandcreatingdata.
hadoopdfs-mkdir/user/cloudera/sqoopOut2/
viplayer.csv
hadoopdfs-putplayer.csv/user/cloudera/sqoopOut2/
hadoopdfs-cat/user/cloudera/sqoopOut2/player.csv
23
24. Runfollowingcommandforexportingdata.
sqoopexport--connectjdbc:mysql://192.168.138.1/dezyre--tableplayer--usernameroot-P--export-dir/user/cloudera/sqoopOut2/-m1
24
25. SeefromMySQLclientifdataexported.
ImportDatatoHive
sqoopimport--connectjdbc:mysql://192.168.2.1/dezyre--usernameroot--passwordpassword--tableplayer--hive-import