()5( ()uxaltcCtS? (2m-« Cb-i(u!':5 cli.ii5 (qrok Q · 2018. 3. 8. · Hadoop Distributed File...

mmi !:J

!? ,1

'LlNlVBTäaT'i IJUÄ

I-..ple-.a,,],Q,:h-,s 'fö ,:xe=.( w;r+-= tüule ol? se)-s.Mok : fö{ (-«.,xge o(c? sJs, ua.vo{wwe ev*n v-I'« oocov-'TCkC"te»sl (?exkx('q(y ,

H-p 12ca'(uce «xu? {4«b.dm6(f-&A ke ?«t'y $-=, o(lt '?i'} (eQ'-i? , oiJs,r-=-Py --------.-)

1% öek?u '()5( ()uxaltcCtS? (2m-« "Cb"-i(u!':5 cli.ii5" (qrok Q%ex-cb'-i-c(ukx ') , bosl+ o(2 cr>-ibia<exkkl hccvJw«ve,ce»»qic-ka 5y GaiexveJ «uel, (1!eXp«Sl'v'e swt'Mes.

S41i,xvt ql«[c:6> 3;yBr;b,i? ("re sys{e-s (J)FS)

(.a vq e b (oc(,a <- (,(IT- reaus-o(o«c7 b7 replio<?

Gl') %i«'-ii -3 s7sfö--: t"{e-p'2e?ü0((

m I«wiex?"y a'+e 'qave<-? (plstur6?- (l'»(e & %?olle /Q3e o? seJs e(Iciülly

Thinkinq the FutureZukunft denken

l

4

RWHT?Il

>l

l";'reA-'§Jc- r utC o-

G) C?e»=x(?ule qoJes do'ceci. 0-l v'otJ.z, e«iA wrutfü owq precessot ox< 5fömqe ole»tce. ,P yaCl«

(;5i ') )2a«c.k acfe! coyi-ieckcl % cv;Ic'ie«.

Q-==(is ? l-? ?I '?rc?+"A ' -l ( '

l

füleircoqqec(-ü« Jüy

Co»seckoq '»sl ßs!t oe(?!k

t'ce«t«» A- e?(-ie»t<lÖ'3'

Wl

9««ütxp (es, , ,

?(:;")';(e> ewe 'fö? v'eaÄi»<al«Jl7 'fö preÄeJo6z:J@;(uvc oR '?a'kg,

G*5 %utJ«;b"o oure al-ev«aoleel iJo r'q?pa««:s{au'l?fö-sk . tp ose f-t=='(s «o+ c«»? 6e ves;,Qrb< w('ffie»g(a($a% öker"; ,ck6 ö

Thinkinq the Future lZukunft denken

')

R?:T?

1:0%/l *N W ?I a%fl

?b : D;sJvsb.ilel 2 svfö"s ()? 5

o h'(es «via olev«ueJ ;ulr:h cLiu-ifü (4-7piac,xü7 6'Ytl.E5p C(«oa-Jzs aurc vel:cci6ed (+7(iSccx{(7 3ha-a a-iäi'@ete»l ',r«(«)ei R (-ile ratskrxoJe (5( uriwe- q«?ele rs, i4rwaA)zt-1

i,.i'-1are- fö (kauei cop;es C)(' ß'(e=,/,, () (5 ?eu,, '?s-a-cQ :

(,,'Ie. s=,rsfö-- )(5 (;;»FS (%(e ß'le- 5y((4accA'e=e=,o olt'srv;boW (;!,1e sysla-x , Pp«>cl-e )o I4:l)ffS= ( H«c)Imp Olt'srv«!:»o

o Cle,.iA Sföre ( :»(>z Souvee .DFS '): Wee.loce (cb-7,.=A'-3 (?aimalxQ*')f2e?ks :

execuh'eq oqd0 ':(5? "«e?eS Pa?((e-€(.?< u(&'6?"' (5(? ok[( (;' ,

ei 2 (t-yc.v«a<s a-ve? UÖ ? üy he u? i t"'t7 aJ f2i=?H.,,,6(@?«'?? :Y

ö ii=-pae=t=xe (ee,,ie?, füL-cac«)(5 ur:xclb7 (C'pe-s soo«e?e , %rxcLe? ')

Thinkinq the Future rZukunft denken

Q

RWFH1 rT";?

l :ü li'j

http : / /hadoop . apache . org/

What Is Apache Hadoop?

The ApacheTM Hadoopo' project develops open-source software for reliable,scalable, distributed computing.

The Apache Hadoop software library is a framework that allows for thedistributed processing of large data sets across clusters of computers usingsimple programming models. It is designed to scale up from single servers tothousands of machines, each offering local computation and storage. Ratherthan rely on hardware to deliver high-availability, the library itself is designedto detect and handle failures at the application layer, so delivering a highly-available service on top of a cluster of computers, each of which may be proneto failures.

The project includes these modules:

*

*

*

@

Hadoop Commona The common utilities that support the other Hadoopmodules.

Hadoop Distributed File System (HDFSTM): A distributed file system thatprovides high-throughput access to application data.Hadoop YARN: A framework for job scheduling and cluster resourcemanagement.

Hadoop MapRpdure: A YARN-based system for parallel processing oflarge data sets.

Co-founders: Doug Cutting and Mike Cafarella, January 2006

(Doug Cutting named the system after his son's toy elephant.)

fflThinking the FutureZukunft denken

1r

-'{-

R?ü »m

iia1

?rerelui'iiafeoh ,?,, ffikix F)(3ekrcl7;2(?( (xx h) rai-«i'ces cs;(l Le yv'H's «ss,

h . ("5=')44il'&z € y2 'nxh (öv CHI,F)u?g)A<3'5,y,

,:pi'aiqom( yJri'ce'l QS /S = o(ii) ('-ir-vA'-i) G '2"hJvix. U e"2'X" tos ce-t[ree,l «:?«:s)oye«( t9

u (J' = U'U , y. ?(.,,.,At'??,A)e,Th, %X,)Ö"(a') Aeyi.Ao, 7'<< si o(-o=r%3 / 11

7?i. '2-4. (Si-5u(ac< vax(ue üec«h-sp'llAäu , SVD)C>«'vü Mei't"x" , 7!ere eyttfi UeÖ(z')?! (/(.-%s) o"fö" ß0Ls@? =? e'i " w«';f'?i-ioq-'-ie5Jlv9 eqAri% l'% i'& d«'(3oi-iJ cuza!ocr sk';w;se soA kaJ

h= (,)XZ:'V',

71e a«'ü3=-.=.b( el:ei.«*icJg ef2 lo ? «?J(eA 3>x'ci1u(-tv-vo«oes, T? (.ru"«rs «>(? u a-iu< v qre ce4ct?c-(" ?«'r9rh sso3ot<v veckrs ei(? t7

9e-ieiQ: tg %(l'i ,3AX, svn tr-ts7 '»e wv-l/kt os

3 U (E )72"", UU""' Iz 3 VC-(X:"'i> d :i: (E li"' «:d«a?o(Thinkinq the Future

1l So?kJ I'( = C)[11,

7? 11/l inft rlenken

2ff

-(, -

R??11I?J?J

T4 'Z-2. (%e=)v==( ?mye=s-'A'os ')(>clue-s He't'X" ssyxze.trsc. ilieve exr*Ve «5r (h'i, l/= (v,,-r "s) aua< /( = do6Qi 'va)"i>5u,,§ ß4

/'l' VA V' "'- -E[Ja :Rl'v?v7'(4

v,2 0ae M( eiöe-iv'ee?/ors 4 t-r i..i;k el3esvq/'-e5 A,'

o {ß !; >C) , ta=(,.,s , /'f ;x ceÄ« pos«'kve? o{eß'qik(ts>«:>') .

lf- Ä;>tÖ rc'=4«-xr, /'d ios ceJleo< uog-i-te5sAw«e(ß'-ct'f-e. (hao) ,

(!) (p? H'po , per-i l'/- k«s Q (:Ao(esky äea»fr'Ab'-rt-[= (vat) (vi«')'

u "'? ? e []/L ? '?a'?':? Ö,,,??.4'i ) %4€ ) ,0 /'/?Ö <=> )<//'/X ?(:) Vxei"

o t-r->o ,==» xTt'tx >o v'xeiT2"/x+ö

Thinkinq the Future rZukunft denken

? l ?

RWFHrT ?s2t« s »«i

J

T)e9.2.E.

l" (x) = :s' "li'; iS cayirea< l-wce o(;' t"'i .t:4

!:i) €rote-( h=(=.-il4))eF2""".rtwir = 7 = ffi

1,3

t's cJec! ße ?'be-x«shs sav« 41-1 .

c) Heli'?"', /'( s7«zekr'c ,

// /'f //s = >7x fAl-'kt'sH

l'€ Cs([e! f"k 5y:tecl-vq( Hc,v,,,, .

o ü 'xa(ofr t's4 (-r(Rß") - k (814) ,rie Ti2%'s , B e- ;r2'S

eh L (M') = f >,-(h>-', oie+(h') = /7 x,'tt'i) , i5 für,t-1 ' l'-1 S'l€-»-s*ek'c

g

= k(A')ffl .:/?l-(t-i')) /l'jlI:%4

71 rl

l rilnklnq trie füture lffii 1 -:nken

4-

R?Ij iT'?

:4'!W ?m 6%

Tlq 2.Ct. (vY t-a-i , -iqrrü)

C;:(avep M Sya+'«m. ( '1G772"',, kln /A-i (h ') :3 " ' - 3 ;Is (r1 ) eiöer-1 %/Q {u«y=; ,

b(vTr-rv) = exl«h>I='l

S « <

Veii%'kv"l i,x ?zk

r « " l L (vrH v )lc i') "(/ "V - i-?y

(=1

J

C5 <(ect'o«( c«e «4 '7'4. P,'-r., X2-4vTrly== Ä'-t-x: (t't)U!Qk

Ilyll='l

4'-t tty = A-il,a ("r)L?1 3

// ,,t Il= fi

Q(s=:r= -tc,ky r /'f v

U'l«)c

V4-«:»V'V

'%QX

//l///=4

7 I'rhinking the FutureZukunft denken

1I

-,!?-

RWHwi

4 (1

ffi m mW :0l kWJ

Ml L?

lA'2S? n,E(E)Q""",syuq'-i<'Jn'cui'l"seQebvaluer21 > '= ;);IH q-c<r >/'-' rq 1 VeabpecA've{y , 7"4e-i

(, X, .

lel"- A'= -.u.xDlo{ o4eubk f'ie y»e:isi'A'vc poJ e9iler?,

7f'l. 2A. G«ave-x MeFc"" r7"«i-<eJvrc wi"« spedra(iecc»'.lies;(-«'ou tr= v«r'?ü,I.-/;<,) vla,a.=>ir( ,71-i

? ('H // /'7- /e /IFaR 7 ot ark h) s k

r:s aki'-ce! Qi r)'= V oüat3(A:i-'iil:ror'io)vryc'R

9pg(;1,ttrt-rtitF2 = «t-ttt2 - zi., (t-trg'»+- itmr-

) IH Al?2 -l .;p% 'A,(":','1+ :X"F, ',?I' + F,?iF f> ..,t,,> (?)('-f

tle.

Thinkinq the FulZukunff rlenken

> ! (2i-A'r)z -s L,l