Embed Size (px)
DESCRIPTION
This is the student-focused version of the talk I have been delivering in Hong Kong lately. Very similar to the talk I gave to the CUHK Statistics department. In this one I provide a general description of big data, talk about enabling technologies, give examples of big data in action, and talk about big and open data projects right here in Hong Kong. For more info: http://infoincog.com
Citation preview
definitions
technologies
timing and hype
peoplehong kong
future
the common definition
velocityvolume
varietyveracity
the subjective definition
the easy definition
the real challenge:
what to do with all these data?
components: creating value from data
hardware software
people
servers
storage
networks
appliances
platforms
traditional dbms
columnar db’s
nosql
hadoop
platform architects
stats. people
comp. scientists
traditional it
visualization
hot components
hardware software
people
servers
storage
networks
appliances
platforms
traditional dbms
columnar db’s
nosql
hadoop
platform architects
stats. people
comp. scientists
traditional IT
visualization
applications
a few examples
why now?
• cheap storage• unbounded compute• data accessibility and world datafication• internet scale: Yahoo! and Google– offspring of Hadoop
visi
bilit
y/ex
pect
ation
s
time
trigger inflated expectations
disillusionment
enlightenment
productivity
adapted from gartner hype cycle
visi
bilit
y/ex
pect
ation
s
time
trigger inflated expectations
disillusionment
enlightenment
productivity
adapted from gartner hype cyclebig data: where are we
today?
this will be caused bya lack of data scientists
asia
busi
ness
inte
rest
time
global
usa
asia
hong kong
http://www.infoincog.com/big-data-in-asia-pacific/
enterprise it adoption
Hong Kong
thinking about work?
us orhk
it or other
cs and ds skills most valued ($$$)most disruptive (fun!) techstough to manage visa
cs skills not valued; ds skills valued ($$)non-disruptive tech; back-end supporttough to manage visa
us companies hiring sales teams, not developersvery few it companies based in hkfew skilled people, skills not heavily in demand
many jobs in financenon-disruptive tech; back-end supporteasiest path to stay in hk
location
company
us,it
us,non-it
hk,it
hk,non-it
consider grad school for visa and route to employment
consider start-up
want to get involved?
• want to learn more?– join hkbd* community, ask scott for reading
recommendations• want to meet other developers?– come to odhk meetings and hkbd meetings
• want a project for fyp, to build your resume, or just for fun?– datasets and software projects are everywhere! as scott for
more info• want a job?– scott knows some recruiters and hiring businesses
(*) Hong Kong Big Data on Google+
want more?
Google+: Hong Kong Big Datahttp://www.infoincog.com/
all content by Scott Brady Drummonds – [email protected]
