Ffctn hackons la-corruption

download Ffctn hackons la-corruption

of 51

  • date post

    07-May-2015
  • Category

    Documents

  • view

    656
  • download

    1

Embed Size (px)

Transcript of Ffctn hackons la-corruption

  • 1.ETUDE DE CASVISUALISER DESDONNES OUVERTES Sbastien Pierre, FFunction inc.@Hackons la Corruption., Novembre 2012 www.ffctn.com FFUNCTION INC, 2011ffunction inc.

2. INFOGRAPHIC : SE7EN SUMMITS FFUNCTION INC, 2011 ffunctioninc. 3. GOOGE DATAVIZ CHALLENGE 2010 (FINALIST) FFUNCTION INC, 2011 ffunctioninc. 4. NATIONAL GEOGRAPHIC SOCIETYS PROJECTS FFUNCTION INC, 2011 ffunction inc. 5. 2008 Canadian FederalTravel & Hospitality Expenses FFUNCTION INC, 2011 ffunction inc. 6. SOME THINGS HAVENT CHANGED SINCE 2008SCRAPING DATAin the absence of open-data, journalists willoften be in the same context, having to spendtime to collect, explore and assess the quality ofthe data. FFUNCTION INC, 2011ffunctioninc. 7. SOME THINGS HAVENT CHANGED SINCE 2008FROM DATA TO STORYEach dataset is a discovery, getting a(compelling) story out of it is still a majorchallenge. FFUNCTION INC, 2011ffunctioninc. 8. THE DATA FFUNCTION INC, 2011 ffunctioninc. 9. As the result of a federal government directive*, Travel and Hospitality Expenses have been published on the web in Canada since 2004 * Called proactive disclosure FFUNCTION INC, 2011 ffunction inc. 10. http://www.tbs-sct.gc.ca/pd-dp/gr-rg/index-eng.asp FFUNCTION INC, 2011ffunction inc. 11. Data is (still) notdirectly accessible,and hosted on eachspecific ministrywebsite, in aspecific format. FFUNCTION INC, 2011 ffunctioninc. 12. FFUNCTION INC, 2011 ffunctioninc. 13. ACCURACY PROBLEMSNON-OPEN DATADATA MAY BE MISSING DATA NOT UP TO DATE FFUNCTION INC, 2011ffunction inc. 14. 22Mb SQL file scraped by citizens(available on Github) FFUNCTION INC, 2011 ffunctioninc. 15. A DATASET WHICH TURNS OUT TO BE A BIT OPAQUE... FFUNCTION INC, 2011ffunctioninc. 16. BUILDING A TOOL TO EXPLORE THE DATA FFUNCTION INC, 2011ffunctioninc. 17. Basic analysis of the data FFUNCTION INC, 2011 ffunction inc. 18. Thinking about how to represent the data FFUNCTION INC, 2011 ffunction inc. 19. Thinking about the flow of interaction FFUNCTION INC, 2011 ffunctioninc. 20. Importing and visualizing the data FFUNCTION INC, 2011 ffunction inc. 21. Mapping out the different types of expenses (travel, hospitality & guidelines) FFUNCTION INC, 2011 ffunction inc. 22. Simplifying the representation (expenses vs guidelines, over guidelines is in red) FFUNCTION INC, 2011ffunction inc. 23. Changing the focus (under/over guidelines instead of total spending) FFUNCTION INC, 2011 ffunction inc. 24. Adding guides to improve reading the information FFUNCTION INC, 2011 ffunctioninc. 25. Adding filtering to narrow down to subsets of the data FFUNCTION INC, 2011 ffunction inc. 26. Trying alternative representations on the data FFUNCTION INC, 2011 ffunction inc. 27. Trying even more alternative representations on the data FFUNCTION INC, 2011 ffunction inc. 28. THE RESULThttp://ffctn.com/a/expensevisualizer FFUNCTION INC, 2011 ffunction inc. 29. FFUNCTION INC, 2011 ffunctioninc. 30. FFUNCTION INC, 2011 ffunctioninc. 31. I just found out the 5 top spendingFederal depts, check it out athttp://ur1.ca/a3spt FFUNCTION INC, 2011 ffunctioninc. 32. FFUNCTION INC, 2011 ffunctioninc. 33. FFUNCTION INC, 2011 ffunctioninc. 34. FINDINGS 1 FFUNCTION INC, 2011 ffunctioninc. 35. Cumulative spending TRENDS ONLY BECOME APPARENTWITH THE PROPER MODE OF REPRESENTATION Monthly spending FFUNCTION INC, 2011ffunction inc. 36. PROBLEMS IN THE DATA QUALITYBECOME VISIBLE FFUNCTION INC, 2011 ffunction inc. 37. THINGS YOU WOULD EXPECTARE NOT NECESSARILY THERE Spending of ministers for all departments FFUNCTION INC, 2011 ffunction inc. 38. DATA TO STORY: CHALLENGESNON-OPEN DATA Missing or incomplete data: is the problem in thescraper or in the actual data? At least you now have a tool to assess (and improve)the data quality FFUNCTION INC, 2011 ffunction inc. 39. DATA TO STORY: CHALLENGESNOT WHAT I THOUGHT You might expect something about the data,but the visualization might prove your wrong You might have been looking for something specificbut you cannot see it in the visualization See my 30 min of data visualization workshop for more on this... FFUNCTION INC, 2011 ffunction inc. 40. DATA TO STORY: CHALLENGESDID I TRY HARD ENOUGH? Theres no secret: youll find something interesting ifyou explore your data enough. If everything fails, you can at least get fun facts orcontroversial examples out of it. FFUNCTION INC, 2011 ffunctioninc. 41. HOSPITALITY EXPENSES SKYROCKET IN 2008 !! FFUNCTION INC, 2011 ffunctioninc. 42. INDUSTRY CANADAS BIG SPENDER 2.5x As muchMINISTERDIRECTOR FFUNCTION INC, 2011 ffunction inc. 43. WAR IS COSTING CANADA AN ARM AND A LEG! 3 MILLIONS! (over a period of five years) FFUNCTION INC, 2011 ffunction inc. 44. THE BEST STORY IS: WE NEED OPEN DATA!THIS IS NOT AN ACCEPTABLE PROACTIVE DISCLOSURE! FFUNCTION INC, 2011 ffunctioninc. 45. TOOLS 1 FFUNCTION INC, 2011 ffunctioninc. 46. GOOGLE REFINE https://github.com/OpenRefine FFUNCTION INC, 2011 ffunctioninc. 47. DATA WRANGLER http://vis.stanford.edu/wrangler/ FFUNCTION INC, 2011 ffunctioninc. 48. DATA WRAPPER http://datawrapper.de/ FFUNCTION INC, 2011ffunctioninc. 49. MANY EYES http://www-958.ibm.com/software/data/cognos/manyeyes/ FFUNCTION INC, 2011ffunctioninc. 50. R17 http://www.rseventeen.com/ FFUNCTION INC, 2011 ffunctioninc. 51. THANK YOU!sebastien@ffctn.com / @ffunctionWWW.FFCTN.COM FFUNCTION INC, 2011 ffunction inc.