transit-datathon

notes and resources from the transit datathon 10/11+10/28 in SF

Projects + Prototypes

• Bicycle Data Mapping
• BART Entry/Exit by hour for each station per day

Data

One week of nextbus realtime data

• AC Transit
• SF MUNI
  A collection of xml files for each minute. This data was collected from the nextbus API

One month of BART entries and exits for all stations

• Entries
• Exits
• Entries and exits by hour
  There is a file for each BART station, the file contains a JSON array of counts of entries or exits with a date and time by the minute.

Collection of BART data

• BART strike hackathon

Collection of MUNI data (In this repo)

A collection of files related to SFMTA, including presenatations and data from MUNI

• RunReport - Reports coming from SF MUNI, including data requested that's not usually published.
• 5-1-14 Equity Strategy ppt.pdf - Report on service equity, demographics and socioeconomic status
• NextBusXMLFeed.pdf - Description and specification of the NextBus API
• RPP_Saturation - Parking permit program data, collected manually from a public meeting.
• SFMTA Quarterly Report (Jul-Sep 2013).pdf - Overall report on the SF MTA
• SFpark_Pilot_Project_Evaluation.pdf - SF Park has real-time time meter data, this document explains the project along with thorough analysis. source
• StopInformation.xls - Directory of all bus stops in SF, their location and the lines that serve them
• Strategic Plan Metrics Report - February 2014 FINAL.pdf - Comprehensive list of metrics on various aspects of the MUNI
• Strategic Plan Progress Report - February 2014 FINAL.pdf - Presentation of how MUNI is progressing against the metrics.
• TEP-CAC3-18-14_v2.pdf - Transit Effectiveness Project, an attempt to optimize service. more info
• The Muni historic vehicle collection_060514.pdf - Index of all the types of subway/cable cars. more info
• Track Repair Work at Cameron Beach Yard.pdf - Example of how complicated rail yards can be. A lot of data of this sort is not digitized, and the railway switches are manual.

Collecting / Requesting Data from SF MUNI

First course of action should be to call 311 and see if you can find out who in Transit Operations you should talk to about a certain kind of data. People can be helpful. If you are having trouble being friendly, you can resort to a "Sunshine request" (there is law requiring public data to be made available by request), call 3-1-1 and say you want to make a sunshine request.

Transit Agency APIs

VTA - data
BART
Tri-Met
LAMTA
wmata

Useful GitHub repositories

TransitJSON Shapely - Python Geometry

http://www.sfmta.com/about-sfmta/reports/gtfs-transit-data

Transformed Bus routes

Traffic Density GeoJSON: in /trafficdensity

• Hill Mapper - http://www.citylab.com/crime/2013/08/san-francisco-has-needed-long-time-hill-mapper/6431/

• San Francisco Shapefile with street names:

https://s3.amazonaws.com/metro-extracts.mapzen.com/san-francisco_california.imposm-shapefiles.zip

• SF 2011 Bicycle count report (PDF):

http://archives.sfmta.com/cms/rbikes/documents/2011BicycleCountReportsml_002.pdf

• SF 2011 Bicycle count (csv): see in bicyclecounts

• SF streets Shapefiles

https://data.sfgov.org/Geographic-Locations-and-Boundaries/San-Francisco-Basemap-Street-Centerlines-Zipped-Sh/5rn4-fswj

• SF topo Shapefiles

https://data.sfgov.org/Geographic-Locations-and-Boundaries/Elevation-Contours-Zipped-Shapefile-Format-/x467-4ghd

• Weather data SF:

https://github.com/zamfi/sf-weather/blob/master/sf-weather.json