Upload
gethue
View
111
Download
1
Tags:
Embed Size (px)
DESCRIPTION
Hue is an open source Hadoop Web UI that lets users be more productive, while also providing a framework for building new apps quickly. Get a tour of Hue features and learn how to re-use the APIs for submitting Hive queries, listing HDFS files, and submitting MapReduce jobs.
Citation preview
HUE+SDKHOW TO GET STARTED
Romain RigauxCloudera - Feb 20, 2014
What is Hue?
HUE 1
Desktop-‐like in a browser, did its job but pretty slow, memory leaks and not very IE friendly but definitely advanced for its time (2009-‐2010).
HISTORY
HUE 2
The first flat structure port, with Twitter Bootstrap all over the place.
HISTORY
HUE 2.5
New apps, improved the UX adding new nice functionalities like autocomplete and drag & drop.
HISTORY
HUE 3 ALPHA
Proposed design, didn’t make it.
HISTORY
HUE 3
Transition to the new UI, major improvements and new apps.
HISTORY
HUE 3.5+
APPS
PIGJO
B BROWSER
JOB DESIG
NER
OOZIE
HIVE IMPA
LA
METASTO
RE BROWSERSEARCH
HBASE BROWSER
SQOOP
ZOOKEEPERUSER ADMIN
DB QUERY
SPARK
HOME ...
GUI DESIG
N
FILE BROWSER
USER
USER WORKFL
OWS
USER
YARN JobTracker Oozie
Pig
HDFS
HiveServer2
Hive Metastore
Cloudera Impala
Solr
HBase
Sqoop2
Zookeeper
LDAP SAML
Hue Plugins
APPS
FAST PACE
LAST MONTH
91 issues created and 90 resolved. Core team + Community
STACK
BACKEND
Python + Django (with tiny bits in Java)
FRONTEND
jQueryBootstrap Knockout.js
Love
WHY SDK?
-‐ Other type of visualizations -‐ Export in another format -‐ Simpler API than Hadoop -‐ Custom dashboards -‐ YOUR_COMPANY app
EXTEND HUE AND GET
SDK
HUE http://gethue.com/docs-‐3.5.0/
sdk/sdk.html
Django https://docs.djangoproject.com/en/1.6/intro/reusable-‐apps/
Hue Architecture
/desktop /core /app framework /documents /REST/Thrift libs /... /libs /hadoop /liboauth /liboozie /...
/apps /impala /filebrowser /jobbrowser /oozie /hbase /... /your_app /...
https://github.com/cloudera/hue
2 PARTS
Proxy App
PROXY APP
Put anything inside Hue! !
Integrate external apps
New community Apps
PLUGGABLE APPS
-‐ Hue Hannibal -‐ Hue Chrome notifier
YARN Apps
HUE FRONTEND?
-‐ Build a new Yarn -‐ Embedded REST API -‐ Get it in Job Browser or custom app (inherit login/security/other API)
HADOOP INTERFACES
REST & THRIFT
Many Hadoop interfaces used WebHDFS YARN API (RM, NM, MR...) HiveServer2 Impala HBase Oozie Sqoop2 ZooKeeper ...
DEMO TIME
Missed something?
GET STARTEDBasic usage of the Hue/Django shell Basic access to the Hue/Django DB !
Execute Hive or Impala queries A new set of icons for file types !
Pluggable authentication backends (OAuth 1.0/1.1, LDAP, SAML, OpenId...)
What's next?
HUE 3+
Document Model Unification of internal API (blueprint) External API? Pluggable widgets? (aka within app SDK)
GET HUE
Try in advance the latest and greatest but you’ll have to configure everything on your own.
Get to play with Hue and various Hadoop components in 5 minutes. It’s a self contained CDH environment ready to use.
Newer version than HDP, close to the original 2.5 minus apps like HBase, Impala, Sqoop, Search.
The newest addition, ships Hue 3.0 through the GreenButton products.
Stable and highly tested releases perfectly integrated with the Hadoop ecosystem, automagically configured by Cloudera Manager.
In HDP there’s an old forked version of Hue 2.3.
CLOUDERA’S CDH TARBALL CLOUDERA’S DEMO VM
HORTONWORKS* MAPR* HP CLOUD*
* YOUR MILEAGE MAY VARY.
BIGTOP EMBEDDED/DEMO IN IND. COMPANIES
LINKS
WEBSITE
http://gethue.com
BLOG
http://blog.gethue.com
@gethue
USER GROUP
hue-‐user@
THANKS.
gethue.com
QUESTIONS?