18
New Methods of Disseminating Statistics Hiren Bhimjiyani [email protected] Data Science and Visualisation Team BIS

New Methods of Disseminating Statistics Hiren Bhimjiyani [email protected] Data Science and Visualisation Team BIS

Embed Size (px)

Citation preview

Page 1: New Methods of Disseminating Statistics Hiren Bhimjiyani Hiren.Bhimjiyani@bis.gsi.gov.uk Data Science and Visualisation Team BIS

New Methods of Disseminating Statistics

Hiren [email protected]

Data Science and Visualisation Team BIS

Page 2: New Methods of Disseminating Statistics Hiren Bhimjiyani Hiren.Bhimjiyani@bis.gsi.gov.uk Data Science and Visualisation Team BIS

Digital age

Estimates that about 90% of all the data in the world today has been created in the past few years.

Page 3: New Methods of Disseminating Statistics Hiren Bhimjiyani Hiren.Bhimjiyani@bis.gsi.gov.uk Data Science and Visualisation Team BIS

Key message

Advance users

Page 4: New Methods of Disseminating Statistics Hiren Bhimjiyani Hiren.Bhimjiyani@bis.gsi.gov.uk Data Science and Visualisation Team BIS

How our data is used

Government statistics

Benchmarking

Planning services

Internal research

Marketing

Resource allocation

Policy

Page 5: New Methods of Disseminating Statistics Hiren Bhimjiyani Hiren.Bhimjiyani@bis.gsi.gov.uk Data Science and Visualisation Team BIS

“There is a need for government……to improve the accessibility of existing official

data to meet a wider range of user needs and encourage future use. Ways to do this suggested in the research included:

•simplifying the data structure,

•reducing the volume of data,

•improving online access, especially the search facility on websites,

•Improving the timeliness.”

Statistics CommissionThe Use Made of Official Statistics March 2007

Page 6: New Methods of Disseminating Statistics Hiren Bhimjiyani Hiren.Bhimjiyani@bis.gsi.gov.uk Data Science and Visualisation Team BIS

Three BIS projects

• Allow user to visually explore the data dynamically

• Improve search on the internet (limit use of Word or Excel) proprietary downloadable applications that can’t be indexed

• Provide timely information (API querying)

• Use of Scalable Vector Graphics (SVG) to improve search engine optimisation

Page 7: New Methods of Disseminating Statistics Hiren Bhimjiyani Hiren.Bhimjiyani@bis.gsi.gov.uk Data Science and Visualisation Team BIS

Over to the browser

Page 8: New Methods of Disseminating Statistics Hiren Bhimjiyani Hiren.Bhimjiyani@bis.gsi.gov.uk Data Science and Visualisation Team BIS

BIS Pulse Survey

Page 9: New Methods of Disseminating Statistics Hiren Bhimjiyani Hiren.Bhimjiyani@bis.gsi.gov.uk Data Science and Visualisation Team BIS

Technical challenges: Pulse Survey

My question to JQuery forum“Dear community, I am trying to use the JQuery ui combox and trying to link it to a button……………..Here is my fiddle:…………………….”

Response from JQuery forum“……The Autocomplete Combobox demo is very complex…… It is so complex that

very few developers have been able to modify or enhance it…...”

The menu bar

Page 10: New Methods of Disseminating Statistics Hiren Bhimjiyani Hiren.Bhimjiyani@bis.gsi.gov.uk Data Science and Visualisation Team BIS

Technical challenges: Pulse Survey

The menu bar

//button function for next question function next() { $('#dropdown').combobox("destroy"); //destroy the combobox and erase it leaving the underlying HTML select box  var next_value = (document.getElementById("dropdown").selectedIndex + 1 ); if (next_value ===31){next_value = 1;}//hb //Unselect the currently selected option //setTimeout(function(){ }, 800); $("#dropdown option:selected").removeAttr("selected"); //remove the current selected value from the dropdown box  document.getElementById("dropdown").selectedIndex = next_value; //change the HTML dropdown box value to the third one  $('#dropdown').combobox(); //recreate the combobox. the new value will now stick   selected_value = document.getElementById("dropdown").value; //redefine the selected_value variable and updateData();   //recall the combobox but this time with all its attributes and select event, ui so that if you use the drop down box again it fires properly $("#dropdown").combobox({ select: function (event, ui) { selected_value = ui.item.value; updateData(); //alert(ui.item.value); } } ); }

Page 11: New Methods of Disseminating Statistics Hiren Bhimjiyani Hiren.Bhimjiyani@bis.gsi.gov.uk Data Science and Visualisation Team BIS

Technical challenges: Pulse Survey

The menu bar

//Special function created so that people don't keep pressing the next/previous button really fast//and messing up the transition $('#next').click(function() { var aaa = $(this); aaa.prop('disabled', true); setTimeout(function() { aaa.prop('disabled', false); }, 800);   });

Page 12: New Methods of Disseminating Statistics Hiren Bhimjiyani Hiren.Bhimjiyani@bis.gsi.gov.uk Data Science and Visualisation Team BIS

BIS Economic Growth Dashboard

Page 13: New Methods of Disseminating Statistics Hiren Bhimjiyani Hiren.Bhimjiyani@bis.gsi.gov.uk Data Science and Visualisation Team BIS

Technical challenges: Economic Growth Dashboard

Inclusive or exclusive

Page 14: New Methods of Disseminating Statistics Hiren Bhimjiyani Hiren.Bhimjiyani@bis.gsi.gov.uk Data Science and Visualisation Team BIS

BIS International Trade in Goods map

Page 15: New Methods of Disseminating Statistics Hiren Bhimjiyani Hiren.Bhimjiyani@bis.gsi.gov.uk Data Science and Visualisation Team BIS

Technical challenges: Trade in Goods map

• Loading of large amounts of CSV data into the browser

• Issues with Cross-Origin Resource Sharing (CORS)

End user BIS server

UN serverdatabase

Page 16: New Methods of Disseminating Statistics Hiren Bhimjiyani Hiren.Bhimjiyani@bis.gsi.gov.uk Data Science and Visualisation Team BIS

The tools

D3

CSSprogramming

knowledge

Other custom libsTo get the job done

A good development

platform (IDE) Netbeans (free)

Leaflet

InkScapeSVG editor

(free)

Just scratching the surface

Just scratching the surface

Development environment

JavaScriptprogramming

knowledge

JQuery

HTML5 programming

knowledge

Web hosting service

MapInfo, QGIS

Graphics

Adobe Illustrato

r

R and Python

Page 17: New Methods of Disseminating Statistics Hiren Bhimjiyani Hiren.Bhimjiyani@bis.gsi.gov.uk Data Science and Visualisation Team BIS

Questions

Hiren [email protected]

Data Science and Visualisation Team BIS

Page 18: New Methods of Disseminating Statistics Hiren Bhimjiyani Hiren.Bhimjiyani@bis.gsi.gov.uk Data Science and Visualisation Team BIS

Underlying methods

• Querying a live database using an API

• Disseminating information via non-propriety and open formats such as CSV and JSON

• Search engine optimisation using xml based graphics (SVG)

• Providing on demand content and increasing user engagement through interactivity

• Providing an interface for data access