Week 2: Data Landscapes Is data available on the .gov site? (on both city, regional, national) What kind of data is in here? Environmental? Health? Etc? Is it in report form, or csv file form, etc.? Are there open data portals? (on both city, regional, national) How are the open data sponsored/funded? What is the environmental protection agency (on city, regional, national)? Do they offer data? Can you find any other data sources for city, regional, national?
The base Open Government Data Platform India is a joint initiative of Government of India and US Government.
2. Who?
Government of India Ambient Air Quality with respect to Ammonia under National Air Quality Monitoring Programme (NAMP) during the year 2010 What kind of data?
Air quality rating, Ammonia concentration in the air
CSV file
4. Who?
India Spend http://aqi.indiaspend.org/aq/breathe/
Data Journalism Initiative How are they funded?
Its a non-profit and a project of The Spending and Policy Research Foundation located in lower Parel in Mumbai, and registered as a Charitable Trust with the Charity Commissioner, Mumbai. What kind of data?
Data on the Indian economy, particularly in areas like education and healthcare as well as data on the states of India.
#Breathe maps detailed PM2.5, PM10, Temp & Humidity data by location in India
Offers map, not exportable data(??)
5.
Week Pick 3 datasets and justify why it's interesting to map them together to give context to the questions that you're researching.
What is sensor journalism?
How is it different than data journalism?
How does the author characterize its benefit over traditional journalism?
Does the author mention any concerns?
Who else is doing sensor journalism? Does it seem to be stemming from a certain geographic area? https://medium.com/@dangerbui/sensor-journalism-uncensored-22db5ec7fcaf#.uerii8y9z
India's air quality: Why India's air quality data can't be trusted The main causes for pollution were growing vehicle population and the rising emissions from coal-based thermal power plants. The main metrics of concern is the presence of PM 2.5, airborne particles less than 2.5 microns in size. These are small enough to penetrate deep into our lungs and bloodstreams and have been connected to lung cancer and heart attacks. Data collected from air sensors do not give an accurate snapshot of the stat on India's air quality because the calibration of air sensors is inconsistent. PM 2.5 sensors in use are not calibrated against each other and manufacturers "self-certify" their own products. India has also not established its own air quality standards. India only has specifications defined by the USEPA. There also exists the issue that air quality data gets reported back to pollution boards, but not to the general public and not in a timely manner. "Data fudging" is also a pervasive problem. Companies install continuous monitoring units to meet statutory requirements but 90% of them are fabricating data primarily on particulate matter. Air quality data is also focused mostly on densely populated urban areas, leaving out those who live outside the city. AirBeam is a personal air quality monitor designed to use Bluetooth, an app, and a website to build awareness about air pollution within its network of users. It’s a wearable air monitor that maps, graphs, and crowdsources your pollution exposures in real-time. It runs on an open source platform called AirCasting. The DustDuino is another open source tool that measures PM 2.5 and PM 10 indoors and outdoors. The sensor data is received by an Arduino board and transmitted to Xively, a data repository and data sharing platform. AirBeam: https://www.kickstarter.com/projects/741031201/airbeam-share-and-improve-your-air Urban Emissions: http://urbanemissions.info/study-air-pollution-six-indian-cities.html **protected…? World Health Organization http://www.who.int/phe/health_topics/outdoorair/databases/cities/en/ The guardian claims that India uses faulty instruments to record air quality data because readings are very different from international records. While some instruments leaked air from the sides, others evaluated a lower-than-stipulated volume of air. If you expect the air input to be 20 litres per minute, but get just 16 litres, your PM 2.5 count will be lower. India launches air quality index to warn over dangerous pollution events (October 17th 2014) Index will track eight major pollutants and warn residents when pollution levels shoot past dangerous levels. Environment Minister Prakash Javadekar said the government was committed to improving air quality as part of a cleanliness drive launched by Prime Minister Narendra Modi. India doesn't have a warning mechanism for high pollution days and until a few years ago the matter was hardly ever discussed. The index will measure levels of PM10, PM2.5 as well as lead, ammonia, carbon monoxide, and nitrogen oxide and calculate overall pollution. The warning levels would be color-coded and come with specific health warnings that could be easily understood by lay people. India’s AQI announced on Monday is based on recommendations by the Indian Institute of Technology, Kanpur. A monitoring station should be able to give you the concentration of a particular pollutant at that moment in time, and its average over a period of time – for CO and O3, the average is taken over eight hours, while for the other three, it is a 24-hour average. The unit of measurement is microgram (or milligram in the case of CO) per cubic meter. It’s worth remembering that the values here are not the actual concentrations of that pollutant, but the concentration weighted to the scale http://aqicn.org/map/india/ http://aqicn.org/city/india/new-delhi/us-embassy/ http://www.thehindu.com/opinion/blogs/blog-datadelve/article7083985.ece http://aqicn.org/city/bangalore/ India's air quality index Twitter feed of US & New Delhi AQIs https://twitter.com/USAndIndia Different countries have their own air quality indices, corresponding to different national air quality standards. Computation of the AQI requires an air pollutant concentration over a specified averaging period, obtained from an air monitor or model. Taken together, concentration and time represent the dose of the air pollutant.
Machine generated alternative text:Current EPA Air Quality Index and Clean Air Campaign Health AdvisoryAQI RangeOta SO61 to 100101 to ISO161 to 200EPA Color ScaleGreenYellowOrangeRedEPA DescriptorModerateUnhealthy for SensitiveGroupsUnhealthy
http://www.theguardian.com/environment/2014/oct/17/india-launches-air-quality-index-to-warn-over-dangerous-pollution-events Swachh Bharat Abhiyan (Cleanliness Drive) Clean India Mission national campaign by the Government of India covering 4,041 statutory cities and towns to clean the streets, roads, and infrastructure of the country officially launched on October 2nd 2014. Data Journalism vs Sensor Journalism What sensor do best is detect characteristics of the physical world such as light, heat, sound, pressure, vibration, air quality and moisture. Today, inexpensive, easy-to-use open source hardware is making it easier for media outlets to create data themselves. As Kelly Tyrrell aptly puts it, “sensor journalism is the first cousin of data journalism.” Here's the distinction: instead of scraping data from the internet or existing databases, you are collecting the data (or enlisting the help of others to do so). Using sensors. In real-time. Local media can engage their audience in a new way. Sensor journalism allows the public to take an active role in data being reported. This raises important questions about surveillance, privacy, and ethics. John Keefe is the Senior Editor for Data News. He's part of WNYC's Data News Team, which helps our journalists use and analyze data and also builds interactive maps, charts and data-driven projects. Keefe also teaches in the Journalism + Design program at The New School university in New York. From <http://www.wnyc.org/people/john-keefe/> http://www.poynter.org/2013/how-sensor-journalism-can-help-us-create-data-improve-our-storytelling/210558/ http://radar.oreilly.com/2013/03/sensor-journalism-data-journalism.html http://airmedia.org/sensor-journalism-uncensored/
The issues with Cartodb stem from the fact that my data plots multiple data points in the same location. Cartodb can geocode this information and plots the information, but the data points are directly on top of each other which makes the map look like very few of the data points were actually plotted. Upon looking closer and clicking on these data points, Cartodb only shows an information bubble with a number of how many data points are in that location, but doesn't show any of the information about these data points that we are trying to plot.
Week 2: Data Landscapes
Is data available on the .gov site? (on both city, regional, national)
What kind of data is in here? Environmental? Health? Etc?
Is it in report form, or csv file form, etc.?
Are there open data portals? (on both city, regional, national)
How are the open data sponsored/funded?
What is the environmental protection agency (on city, regional, national)?
Do they offer data?
Can you find any other data sources for city, regional, national?
The base Open Government Data Platform India is a joint initiative of Government of India and US Government.
1.
Who?
Government of India
Air Quality with respect to Respirable Suspended Particulate Matter(RSPM) in air quality stations under National Air Quality Monitoring Programme (NAMP)in the year 2008
https://data.gov.in/catalog/air-quality-respect-respirable-suspended-particulate-matterrspm-air-quality-stations-under
City data.
What kind of data?
Environmental, Health
CSV file
2.
Who?
Government of India
Ambient Air Quality with respect to Ammonia under National Air Quality Monitoring Programme (NAMP) during the year 2010
What kind of data?
Air quality rating, Ammonia concentration in the air
CSV file
3.
Who?
Government of India
Ambient Air Quality by City, Location - 2012
https://data.gov.in/catalog/city-and-location-wise-ambient-air-quality
What kind of data?
SO2 Annual average (µg/m3), NO2 Annual average (µg/m3), PM10 Annual average (µg/m3)
CSV file
What is the environmental protection agency?
National
United States EPA collaboration with India - http://www.epa.gov/international-cooperation/epa-collaboration-india
4.
Who?
India Spend
http://aqi.indiaspend.org/aq/breathe/
Data Journalism Initiative
How are they funded?
Its a non-profit and a project of The Spending and Policy Research Foundation located in lower Parel in Mumbai, and registered as a Charitable Trust with the Charity Commissioner, Mumbai.
What kind of data?
Data on the Indian economy, particularly in areas like education and healthcare as well as data on the states of India.
#Breathe maps detailed PM2.5, PM10, Temp & Humidity data by location in India
Offers map, not exportable data(??)
5.
Week
Pick 3 datasets and justify why it's interesting to map them together to give context to the questions that you're researching.
What is sensor journalism?
How is it different than data journalism?
How does the author characterize its benefit over traditional journalism?
Does the author mention any concerns?
Who else is doing sensor journalism? Does it seem to be stemming from a certain geographic area?
https://medium.com/@dangerbui/sensor-journalism-uncensored-22db5ec7fcaf#.uerii8y9z
What are their reasons for why air quality data "can't be trusted"?
Who is making these claims? Community groups? Non-profits? Citizens? Officials of some sort?
Cite three specific examples from the article.
http://articles.economictimes.indiatimes.com/2014-10-14/news/55014240_1_india-s-cpcb-new-companies
https://medium.com/@dangerbui/air-quality-in-india-how-sensors-may-harm-or-help-ff46331c8995#.mtu7z2kb7
India's air quality:
Why India's air quality data can't be trusted
The main causes for pollution were growing vehicle population and the rising emissions from coal-based thermal power plants. The main metrics of concern is the presence of PM 2.5, airborne particles less than 2.5 microns in size. These are small enough to penetrate deep into our lungs and bloodstreams and have been connected to lung cancer and heart attacks. Data collected from air sensors do not give an accurate snapshot of the stat on India's air quality because the calibration of air sensors is inconsistent. PM 2.5 sensors in use are not calibrated against each other and manufacturers "self-certify" their own products. India has also not established its own air quality standards. India only has specifications defined by the USEPA. There also exists the issue that air quality data gets reported back to pollution boards, but not to the general public and not in a timely manner. "Data fudging" is also a pervasive problem. Companies install continuous monitoring units to meet statutory requirements but 90% of them are fabricating data primarily on particulate matter. Air quality data is also focused mostly on densely populated urban areas, leaving out those who live outside the city.
AirBeam is a personal air quality monitor designed to use Bluetooth, an app, and a website to build awareness about air pollution within its network of users. It’s a wearable air monitor that maps, graphs, and crowdsources your pollution exposures in real-time. It runs on an open source platform called AirCasting. The DustDuino is another open source tool that measures PM 2.5 and PM 10 indoors and outdoors. The sensor data is received by an Arduino board and transmitted to Xively, a data repository and data sharing platform.
AirBeam:
https://www.kickstarter.com/projects/741031201/airbeam-share-and-improve-your-air
Urban Emissions:
http://urbanemissions.info/study-air-pollution-six-indian-cities.html
**protected…?
World Health Organization
http://www.who.int/phe/health_topics/outdoorair/databases/cities/en/
The guardian claims that India uses faulty instruments to record air quality data because readings are very different from international records. While some instruments leaked air from the sides, others evaluated a lower-than-stipulated volume of air. If you expect the air input to be 20 litres per minute, but get just 16 litres, your PM 2.5 count will be lower.
India launches air quality index to warn over dangerous pollution events (October 17th 2014)
Index will track eight major pollutants and warn residents when pollution levels shoot past dangerous levels. Environment Minister Prakash Javadekar said the government was committed to improving air quality as part of a cleanliness drive launched by Prime Minister Narendra Modi. India doesn't have a warning mechanism for high pollution days and until a few years ago the matter was hardly ever discussed. The index will measure levels of PM10, PM2.5 as well as lead, ammonia, carbon monoxide, and nitrogen oxide and calculate overall pollution. The warning levels would be color-coded and come with specific health warnings that could be easily understood by lay people. India’s AQI announced on Monday is based on recommendations by the Indian Institute of Technology, Kanpur. A monitoring station should be able to give you the concentration of a particular pollutant at that moment in time, and its average over a period of time – for CO and O3, the average is taken over eight hours, while for the other three, it is a 24-hour average. The unit of measurement is microgram (or milligram in the case of CO) per cubic meter. It’s worth remembering that the values here are not the actual concentrations of that pollutant, but the concentration weighted to the scale
http://aqicn.org/map/india/
http://aqicn.org/city/india/new-delhi/us-embassy/
http://www.thehindu.com/opinion/blogs/blog-datadelve/article7083985.ece
http://aqicn.org/city/bangalore/
India's air quality index
Twitter feed of US & New Delhi AQIs
https://twitter.com/USAndIndia
Different countries have their own air quality indices, corresponding to different national air quality standards.
Computation of the AQI requires an air pollutant concentration over a specified averaging period, obtained from an air monitor or model. Taken together, concentration and time represent the dose of the air pollutant.
http://www.theguardian.com/environment/2014/oct/17/india-launches-air-quality-index-to-warn-over-dangerous-pollution-events
Swachh Bharat Abhiyan (Cleanliness Drive)
Clean India Mission national campaign by the Government of India covering 4,041 statutory cities and towns to clean the streets, roads, and infrastructure of the country officially launched on October 2nd 2014.
Data Journalism vs Sensor Journalism
What sensor do best is detect characteristics of the physical world such as light, heat, sound, pressure, vibration, air quality and moisture. Today, inexpensive, easy-to-use open source hardware is making it easier for media outlets to create data themselves. As Kelly Tyrrell aptly puts it, “sensor journalism is the first cousin of data journalism.” Here's the distinction: instead of scraping data from the internet or existing databases, you are collecting the data (or enlisting the help of others to do so). Using sensors. In real-time. Local media can engage their audience in a new way. Sensor journalism allows the public to take an active role in data being reported. This raises important questions about surveillance, privacy, and ethics.
John Keefe is the Senior Editor for Data News. He's part of WNYC's Data News Team, which helps our journalists use and analyze data and also builds interactive maps, charts and data-driven projects. Keefe also teaches in the Journalism + Design program at The New School university in New York.
From <http://www.wnyc.org/people/john-keefe/>
http://www.poynter.org/2013/how-sensor-journalism-can-help-us-create-data-improve-our-storytelling/210558/
http://radar.oreilly.com/2013/03/sensor-journalism-data-journalism.html
http://airmedia.org/sensor-journalism-uncensored/
The issues with Cartodb stem from the fact that my data plots multiple data points in the same location. Cartodb can geocode this information and plots the information, but the data points are directly on top of each other which makes the map look like very few of the data points were actually plotted. Upon looking closer and clicking on these data points, Cartodb only shows an information bubble with a number of how many data points are in that location, but doesn't show any of the information about these data points that we are trying to plot.