9
mmi !:J !? ,1 'LlNlVBTäaT'i IJ I-..ple-.a,,],Q,:h-,s 'fö ,:xe=.( w;r+-= tüule ol? se)-s. Mok : fö{ (-«.,xge o(c? sJs, ua.vo{wwe ev*n v-I'« oocov- 'T CkC"te»sl (?exkx('q(y , H-p 12ca'(uce «xu? {4«b.dm6 (f-&A ke ?«t'y $-=, o(lt '?i'} (eQ'-i? , oiJs,r -=-Py --------.-) 1% öek?u ' ()5( ()uxaltcCtS? (2m-« "Cb"-i(u!':5 cli.ii5" (qrok Q %ex-cb'-i-c(ukx ') , bosl+ o(2 cr>-ibia<exkkl hccvJw«ve, ce»»qic-ka 5y GaiexveJ «uel, (1!eXp«Sl'v'e swt'Mes. S41i,xvt ql«[c: 6> 3;yBr;b,i? ("re sys{e-s (J)FS) (.a vq e b (oc(,a < - (,(IT - reaus-o(o«c7 b7 replio<? Gl') %i«'-ii -3 s7sfö--: t"{e-p'2e?ü 0(( m I«wiex?"y a'+e 'qave<-? (plstur6? - (l'»(e & %?olle /Q 3e o? seJs e(Iciülly Thinkinq the Future Zukunft denken l 4

()5( ()uxaltcCtS? (2m-« Cb-i(u!':5 cli.ii5 (qrok Q · 2018. 3. 8. · Hadoop Distributed File System (HDFSTM): A distributed file system that provides high-throughput access to application

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: ()5( ()uxaltcCtS? (2m-« Cb-i(u!':5 cli.ii5 (qrok Q · 2018. 3. 8. · Hadoop Distributed File System (HDFSTM): A distributed file system that provides high-throughput access to application

mmi !:J

!? ,1

'LlNlVBTäaT'i IJUÄ

I-..ple-.a,,],Q,:h-,s 'fö ,:xe=.( w;r+-= tüule ol? se)-s.Mok : fö{ (-«.,xge o(c? sJs, ua.vo{wwe ev*n v-I'« oocov-'TCkC"te»sl (?exkx('q(y ,

H-p 12ca'(uce «xu? {4«b.dm6(f-&A ke ?«t'y $-=, o(lt '?i'} (eQ'-i? , oiJs,r-=-Py --------.-)

1% öek?u '()5( ()uxaltcCtS? (2m-« "Cb"-i(u!':5 cli.ii5" (qrok Q%ex-cb'-i-c(ukx ') , bosl+ o(2 cr>-ibia<exkkl hccvJw«ve,ce»»qic-ka 5y GaiexveJ «uel, (1!eXp«Sl'v'e swt'Mes.

S41i,xvt ql«[c:6> 3;yBr;b,i? ("re sys{e-s (J)FS)

(.a vq e b (oc(,a <- (,(IT- reaus-o(o«c7 b7 replio<?

Gl') %i«'-ii -3 s7sfö--: t"{e-p'2e?ü0((

m I«wiex?"y a'+e 'qave<-? (plstur6?- (l'»(e & %?olle /Q3e o? seJs e(Iciülly

Thinkinq the FutureZukunft denken

l

4

Page 2: ()5( ()uxaltcCtS? (2m-« Cb-i(u!':5 cli.ii5 (qrok Q · 2018. 3. 8. · Hadoop Distributed File System (HDFSTM): A distributed file system that provides high-throughput access to application

RWHT?Il

>l

l";'reA-'§Jc- r utC o-

G) C?e»=x(?ule qoJes do'ceci. 0-l v'otJ.z, e«iA wrutfü owq precessot ox< 5fömqe ole»tce. ,P yaCl«

(;5i ') )2a«c.k acfe! coyi-ieckcl % cv;Ic'ie«.

Q-==(is ? l-? ?I '?rc?+"A ' -l ( '

l

füleircoqqec(-ü« Jüy

Co»seckoq '»sl ßs!t oe(?!k

t'ce«t«» A- e?(-ie»t<lÖ'3'

Wl

9««ütxp (es, , ,

?(:;")';(e> ewe 'fö? v'eaÄi»<al«Jl7 'fö preÄeJo6z:J@;(uvc oR '?a'kg,

G*5 %utJ«;b"o oure al-ev«aoleel iJo r'q?pa««:s{au'l?fö-sk . tp ose f-t=='(s «o+ c«»? 6e ves;,Qrb< w('ffie»g(a($a% öker"; ,ck6 ö

Thinkinq the Future lZukunft denken

')

Page 3: ()5( ()uxaltcCtS? (2m-« Cb-i(u!':5 cli.ii5 (qrok Q · 2018. 3. 8. · Hadoop Distributed File System (HDFSTM): A distributed file system that provides high-throughput access to application

R?:T?

1:0%/l *N W ?I a%fl

?b : D;sJvsb.ilel 2 svfö"s ()? 5

o h'(es «via olev«ueJ ;ulr:h cLiu-ifü (4-7piac,xü7 6'Ytl.E5p C(«oa-Jzs aurc vel:cci6ed (+7(iSccx{(7 3ha-a a-iäi'@ete»l ',r«(«)ei R (-ile ratskrxoJe (5( uriwe- q«?ele rs, i4rwaA)zt-1

i,.i'-1are- fö (kauei cop;es C)(' ß'(e=,/,, () (5 ?eu,, '?s-a-cQ :

(,,'Ie. s=,rsfö-- )(5 (;;»FS (%(e ß'le- 5y((4accA'e=e=,o olt'srv;boW (;!,1e sysla-x , Pp«>cl-e )o I4:l)ffS= ( H«c)Imp Olt'srv«!:»o

o Cle,.iA Sföre ( :»(>z Souvee .DFS '): Wee.loce (cb-7,.=A'-3 (?aimalxQ*')f2e?ks :

execuh'eq oqd0 ':(5? "«e?eS Pa?((e-€(.?< u(&'6?"' (5(? ok[( (;' ,

ei 2 (t-yc.v«a<s a-ve? UÖ ? üy he u? i t"'t7 aJ f2i=?H.,,,6(@?«'?? :Y

ö ii=-pae=t=xe (ee,,ie?, füL-cac«)(5 ur:xclb7 (C'pe-s soo«e?e , %rxcLe? ')

Thinkinq the Future rZukunft denken

Q

Page 4: ()5( ()uxaltcCtS? (2m-« Cb-i(u!':5 cli.ii5 (qrok Q · 2018. 3. 8. · Hadoop Distributed File System (HDFSTM): A distributed file system that provides high-throughput access to application

RWFH1 rT";?

l :ü li'j

http : / /hadoop . apache . org/

What Is Apache Hadoop?

The ApacheTM Hadoopo' project develops open-source software for reliable,scalable, distributed computing.

The Apache Hadoop software library is a framework that allows for thedistributed processing of large data sets across clusters of computers usingsimple programming models. It is designed to scale up from single servers tothousands of machines, each offering local computation and storage. Ratherthan rely on hardware to deliver high-availability, the library itself is designedto detect and handle failures at the application layer, so delivering a highly-available service on top of a cluster of computers, each of which may be proneto failures.

The project includes these modules:

*

*

*

@

Hadoop Commona The common utilities that support the other Hadoopmodules.

Hadoop Distributed File System (HDFSTM): A distributed file system thatprovides high-throughput access to application data.Hadoop YARN: A framework for job scheduling and cluster resourcemanagement.

Hadoop MapRpdure: A YARN-based system for parallel processing oflarge data sets.

Co-founders: Doug Cutting and Mike Cafarella, January 2006

(Doug Cutting named the system after his son's toy elephant.)

fflThinking the FutureZukunft denken

1r

-'{-

Page 5: ()5( ()uxaltcCtS? (2m-« Cb-i(u!':5 cli.ii5 (qrok Q · 2018. 3. 8. · Hadoop Distributed File System (HDFSTM): A distributed file system that provides high-throughput access to application

R?ü »m

iia1

?rerelui'iiafeoh ,?,, ffikix F)(3ekrcl7;2(?( (xx h) rai-«i'ces cs;(l Le yv'H's «ss,

h . ("5=')44il'&z € y2 'nxh (öv CHI,F)u?g)A<3'5,y,

,:pi'aiqom( yJri'ce'l QS /S = o(ii) ('-ir-vA'-i) G '2"hJvix. U e"2'X" tos ce-t[ree,l «:?«:s)oye«( t9

u (J' = U'U , y. ?(.,,.,At'??,A)e,Th, %X,)Ö"(a') Aeyi.Ao, 7'<< si o(-o=r%3 / 11

7?i. '2-4. (Si-5u(ac< vax(ue üec«h-sp'llAäu , SVD)C>«'vü Mei't"x" , 7!ere eyttfi UeÖ(z')?! (/(.-%s) o"fö" ß0Ls@? =? e'i " w«';f'?i-ioq-'-ie5Jlv9 eqAri% l'% i'& d«'(3oi-iJ cuza!ocr sk';w;se soA kaJ

h= (,)XZ:'V',

71e a«'ü3=-.=.b( el:ei.«*icJg ef2 lo ? «?J(eA 3>x'ci1u(-tv-vo«oes, T? (.ru"«rs «>(? u a-iu< v qre ce4ct?c-(" ?«'r9rh sso3ot<v veckrs ei(? t7

9e-ieiQ: tg %(l'i ,3AX, svn tr-ts7 '»e wv-l/kt os

3 U (E )72"", UU""' Iz 3 VC-(X:"'i> d :i: (E li"' «:d«a?o(Thinkinq the Future

1l So?kJ I'( = C)[11,

7? 11/l inft rlenken

2ff

-(, -

Page 6: ()5( ()uxaltcCtS? (2m-« Cb-i(u!':5 cli.ii5 (qrok Q · 2018. 3. 8. · Hadoop Distributed File System (HDFSTM): A distributed file system that provides high-throughput access to application

R??11I?J?J

T4 'Z-2. (%e=)v==( ?mye=s-'A'os ')(>clue-s He't'X" ssyxze.trsc. ilieve exr*Ve «5r (h'i, l/= (v,,-r "s) aua< /( = do6Qi 'va)"i>5u,,§ ß4

/'l' VA V' "'- -E[Ja :Rl'v?v7'(4

v,2 0ae M( eiöe-iv'ee?/ors 4 t-r i..i;k el3esvq/'-e5 A,'

o {ß !; >C) , ta=(,.,s , /'f ;x ceÄ« pos«'kve? o{eß'qik(ts>«:>') .

lf- Ä;>tÖ rc'=4«-xr, /'d ios ceJleo< uog-i-te5sAw«e(ß'-ct'f-e. (hao) ,

(!) (p? H'po , per-i l'/- k«s Q (:Ao(esky äea»fr'Ab'-rt-[= (vat) (vi«')'

u "'? ? e []/L ? '?a'?':? Ö,,,??.4'i ) %4€ ) ,0 /'/?Ö <=> )<//'/X ?(:) Vxei"

o t-r->o ,==» xTt'tx >o v'xeiT2"/x+ö

Thinkinq the Future rZukunft denken

? l ?

Page 7: ()5( ()uxaltcCtS? (2m-« Cb-i(u!':5 cli.ii5 (qrok Q · 2018. 3. 8. · Hadoop Distributed File System (HDFSTM): A distributed file system that provides high-throughput access to application

RWFHrT ?s2t« s »«i

J

T)e9.2.E.

l" (x) = :s' "li'; iS cayirea< l-wce o(;' t"'i .t:4

!:i) €rote-( h=(=.-il4))eF2""".rtwir = 7 = ffi

1,3

t's cJec! ße ?'be-x«shs sav« 41-1 .

c) Heli'?"', /'( s7«zekr'c ,

// /'f //s = >7x fAl-'kt'sH

l'€ Cs([e! f"k 5y:tecl-vq( Hc,v,,,, .

o ü 'xa(ofr t's4 (-r(Rß") - k (814) ,rie Ti2%'s , B e- ;r2'S

eh L (M') = f >,-(h>-', oie+(h') = /7 x,'tt'i) , i5 für,t-1 ' l'-1 S'l€-»-s*ek'c

g

= k(A')ffl .:/?l-(t-i')) /l'jlI:%4

71 rl

l rilnklnq trie füture lffii 1 -:nken

4-

Page 8: ()5( ()uxaltcCtS? (2m-« Cb-i(u!':5 cli.ii5 (qrok Q · 2018. 3. 8. · Hadoop Distributed File System (HDFSTM): A distributed file system that provides high-throughput access to application

R?Ij iT'?

:4'!W ?m 6%

Tlq 2.Ct. (vY t-a-i , -iqrrü)

C;:(avep M Sya+'«m. ( '1G772"',, kln /A-i (h ') :3 " ' - 3 ;Is (r1 ) eiöer-1 %/Q {u«y=; ,

b(vTr-rv) = exl«h>I='l

S « <

Veii%'kv"l i,x ?zk

r « " l L (vrH v )lc i') "(/ "V - i-?y

(=1

J

C5 <(ect'o«( c«e «4 '7'4. P,'-r., X2-4vTrly== Ä'-t-x: (t't)U!Qk

Ilyll='l

4'-t tty = A-il,a ("r)L?1 3

// ,,t Il= fi

Q(s=:r= -tc,ky r /'f v

U'l«)c

V4-«:»V'V

'%QX

//l///=4

7 I'rhinking the FutureZukunft denken

1I

-,!?-

Page 9: ()5( ()uxaltcCtS? (2m-« Cb-i(u!':5 cli.ii5 (qrok Q · 2018. 3. 8. · Hadoop Distributed File System (HDFSTM): A distributed file system that provides high-throughput access to application

RWHwi

4 (1

ffi m mW :0l kWJ

Ml L?

lA'2S? n,E(E)Q""",syuq'-i<'Jn'cui'l"seQebvaluer21 > '= ;);IH q-c<r >/'-' rq 1 VeabpecA've{y , 7"4e-i

(, X, .

lel"- A'= -.u.xDlo{ o4eubk f'ie y»e:isi'A'vc poJ e9iler?,

7f'l. 2A. G«ave-x MeFc"" r7"«i-<eJvrc wi"« spedra(iecc»'.lies;(-«'ou tr= v«r'?ü,I.-/;<,) vla,a.=>ir( ,71-i

? ('H // /'7- /e /IFaR 7 ot ark h) s k

r:s aki'-ce! Qi r)'= V oüat3(A:i-'iil:ror'io)vryc'R

9pg(;1,ttrt-rtitF2 = «t-ttt2 - zi., (t-trg'»+- itmr-

) IH Al?2 -l .;p% 'A,(":','1+ :X"F, ',?I' + F,?iF f> ..,t,,> (?)('-f

tle.

Thinkinq the FulZukunff rlenken

> ! (2i-A'r)z -s L,l