Upload
megan-taylor
View
190
Download
1
Tags:
Embed Size (px)
DESCRIPTION
My talk on Open Data for QueensJS
Citation preview
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
Megan Taylor, UI Developer at Spies/Assassins, volunteer teacher at ScriptEd, news & data junkie, bibliophile, Flyers fan, scifi geek, kitteh servant
• https://github.com/megantaylor/NYCFarmersMarketLocator
• http://megantaylor.github.io/NYCFarmersMarketLocator/index.html
• @selfmadepsyche
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
A FARMERS MARKET OF OPEN DATA• What is Open Data?
• Why Open Data?
• What Can Open Data Do?
• What’s Out There?
• Farmers Market App
• Open Data Challenges
• Solutions?
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
A FARMERS MARKET OF OPEN DATA• What is Open Data?
• Why Open Data?
• What Can Open Data Do?
• What’s Out There?
• Farmers Market App
• Open Data Challenges
• Solutions?
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
WHAT IS OPEN DATA?
According to the Open Knowledge Foundation…
Open data is data that can be freely used, reused and redistributed by anyone - subject only, at most, to the requirement to attribute and share.
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
WHAT IS OPEN DATA?
AVAILABILITY AND ACCESS + REUSE AND REDISTRIBUTION + !
UNIVERSAL PARTICIPATION = !
INTEROPERABILITY
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
A FARMERS MARKET OF OPEN DATA• What is Open Data?
• Why Open Data?
• What Can Open Data Do?
• What’s Out There?
• Farmers Market App
• Open Data Challenges
• Solutions?
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
WHY OPEN DATA?
Numerous scientists have pointed out the irony that right at the historical moment when we have the technologies to permit worldwide availability and distributed process of scientific data, broadening collaboration and accelerating the pace and depth of discovery…..we are busy locking up that data and preventing the use of correspondingly advanced technologies on knowledge.
John Wilbanks, VP Science, Creative Commons
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
WHY OPEN DATA?
My Administration is committed to creating an unprecedented level of openness in Government. We will work together to ensure the public trust and establish a system of transparency, public participation, and collaboration. Openness will strengthen our democracy and promote efficiency and effectiveness in Government.
President Obama, 2009
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
WHY OPEN DATA?
AVAILABILITY AND ACCESS + REUSE AND REDISTRIBUTION + !
UNIVERSAL PARTICIPATION = !
INTEROPERABILITY
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
WHY OPEN DATA?
This untapped potential can be unleashed if we turn public government data into open data. This will only happen, however, if it is really open, i.e. if there are no restrictions (legal, financial or technological) to its re-use by others. Every restriction will exclude people from re-using the public data, and make it harder to find valuable ways of doing that. For the potential to be realized, public data needs to be open data.
http://opendatahandbook.org/en/why-open-data/index.html
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
A FARMERS MARKET OF OPEN DATA• What is Open Data?
• Why Open Data?
• What Can Open Data Do?
• What’s Out There?
• Farmers Market App
• Open Data Challenges
• Solutions?
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
WHAT CAN OPEN DATA DO?
http://www.nytimes.com/2013/03/24/nyregion/mayor-bloombergs-geek-squad.html?pagewanted=all&_r=0
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
WHAT CAN OPEN DATA DO?
http://wheredoesmymoneygo.org
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
WHAT CAN OPEN DATA DO?
!
BigApps NYC isn't just a competition – it’s three months of community building. Participants have access to hundreds of data resources, mentors, and partners. The event culminates in a grand showcase in the largest-ever public demo of civic tech.
http://www.nycbigapps.com
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
WHAT CAN OPEN DATA DO?
• GPS data alone benefits US economy to the tune of ~$90 billion
• Open weather data supports an estimated $1.5 billion in applications in the secondary insurance market – but much greater value comes from accurate weather predictions, which save the U.S. more than $30 billion annually.
Sources: GPS Innovation Alliance, The Governance Lab @ NYU
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
A FARMERS MARKET OF OPEN DATA• What is Open Data?
• Why Open Data?
• What Can Open Data Do?
• What’s Out There?
• Farmers Market App
• Open Data Challenges
• Solutions?
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
WHATS OUT THERE?!
OPEN DATA AROUND THE WORLD
• 260+ open data portals
• 110+ open data events
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
WHAT’S OUT THERE?• data.gov
• Socrata
• Infochimps
• Google Public data explorer
• W(eather)underground
• The New York Times
• The Guardian Data Blog
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
A FARMERS MARKET OF OPEN DATA• What is Open Data?
• Why Open Data?
• What Can Open Data Do?
• What’s Out There?
• Farmers Market App
• Open Data Challenges
• Solutions?
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
FARMERS MARKET APP
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
FARMERS MARKET APPDATA NEEDED
• location
• open hours
• special closed days?
• special events?
• products?
• misc
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
FARMERS MARKET APP
EFF SCRAPING • Farmers Market data from the State of New York
https://data.ny.gov/
• More Farmers Market data from the USDA http://search.ams.usda.gov/farmersmarkets/v1/svcdesc.html
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
USDA FARMERS MARKET DATA
{"results"[ {"id":"1000087","marketname":"0.2 Sunnyside Greenmarket"},{"id":"1009304","marketname":"0.7 Orchard Farmers Market"}, ]}
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
USDA FARMERS MARKET DATA{"marketdetails":{ "Address":"Skillman - 42 & 43 Sts, Queens, New York, 11104", "GoogleLink":"http:\/\/maps.google.com\/?q=40.746899%2C%20-73.921230%20(%22Sunnyside+Greenmarket%22)", "Products":"Baked goods; Cheese and\/or dairy products; Eggs; Fish and\/or seafood; Fresh fruit and vegetables; Honey; Canned or preserved fruits, vegetables, jams, jellies, preserves, salsas, pickles, dried fruit, etc.; Meat; Poultry; Wine, beer, hard cider","Schedule":"06\/01\/2013 to 12\/21\/2013 Sat: 8:00 AM-3:00 PM;<br> <br> <br> " }}
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
DATA.NY.GOV
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
DATA.NY.GOV{ "market_name" : "Sunnyside Greenmarket", "zip" : "11104", "phone" : "2127887476", "operation_hours" : "Saturday 8am-3pm", "location" : "Skillman Ave., btwn 42nd & 43rd Sts.", "location_points" : { "needs_recoding" : false, "longitude" :"-73.92173", "latitude" : "40.74699" }, "state" : "NY",
"market_link" : { "url" : "http://www.grownyc.org" }, "contact" : "Chelsea Whittaker", "city" : "Sunnyside", "address_line_1" : "Skillman Ave and 42nd St", "county" : "Queens", "fmnp" : "Y", "operation_season" : "May 10 - December 20", "longitude" : "-73.92173", "latitude" : "40.74699"}
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
FARMERS MARKET APP
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
FARMERS MARKET APP
• Messy USDA data, how to clean it up?
• Multiple data sources, how to merge?
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
GROW NYC
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
A FARMERS MARKET OF OPEN DATA• What is Open Data?
• Why Open Data?
• What Can Open Data Do?
• What’s Out There?
• Farmers Market App
• Open Data Challenges
• Solutions?
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
OPEN DATA CHALLENGES
For developers
• Formats
• Definitions
• Standards
• Guidelines
• Quality
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
OPEN DATA CHALLENGES
For non-technical users
• Technical
• Economic
• Socio-cultural
For activists
• Low civil engagement
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
Findability precedes usability. In the alphabet and on the Web. You can’t use what you can’t find.
Peter Morville, President of Semantic Studios, an information architecture and findability consulting firm
OPEN DATA CHALLENGES
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
OPEN DATA CHALLENGES• data.gov
• Socrata
• Infochimps
• Google Public data explorer
• W(eather)underground
• The New York Times
• The Guardian Data Blog
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
OPEN DATA CHALLENGES
For providers
• Audience
• Definitions
• Intermediaries
• Funding and sustainability
• Quality
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
AVAILABILITY AND ACCESS + REUSE AND REDISTRIBUTION + !
UNIVERSAL PARTICIPATION = !
INTEROPERABILITY
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
A FARMERS MARKET OF OPEN DATA• What is Open Data?
• Why Open Data?
• What Can Open Data Do?
• What’s Out There?
• Farmers Market App
• Open Data Challenges
• Solutions?
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
SOLUTIONS?
2013 OPEN DATA POLICY MANAGING INFORMATION AS AN ASSET
The White House developed Project Open Data – this collection of code, tools, and case studies – to help agencies adopt the Open Data Policy and unlock the potential of government data.
http://project-open-data.github.io/
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
SOLUTIONS?• Time
• Data journalism in 2006 vs today
• Research
• Education / Awareness
• http://sunlightfoundation.com/opendataguidelines/
• http://schoolofdata.org/courses/
• What else?
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
https://github.com/megantaylor/NYCFarmersMarketLocator @selfmadepsyche
HALP
• https://github.com/megantaylor/NYCFarmersMarketLocator
• http://megantaylor.github.io/NYCFarmersMarketLocator/index.html
• @selfmadepsyche