Probing for blocked online content is a key component of projects assessing the status of information controls in censorship hotspots around the world. The network probes used for this purpose have greatly evolved over the years. Another key component of the measurement process, however, has seen little improvement – these are the URL databases (aka Citizen Lab test lists) that probes draw upon to uncover blocking of websites in individual countries. The outdated status of many of these lists negatively affects the quality of collected measurements. This project will update the test lists of 60 countries that were found to be outdated or requested for update by the community. This includes updating the lists of 26 African states (e.g., Egypt, Nigeria, Ethiopia), 11 Latin American countries (e.g., Venezuela, Mexico, Chile), eight Asian states (e.g., Bangladesh, Philippines) and nine Balkan and East European countries (e.g., Russia, Belarus, Uzbekistan).
Netalitica will hire local researchers to update these lists, service the global test list, build a repository of custom test lists, improve the methodology of test list updates and collaborate with research organizations to automate aspects of the test list-update process. The project will improve the usability of network probes, foster collaboration among stakeholders and local organizations, increase the quality of collected measurements, and enable researchers to produce reports that adequately portray internet censorship on the ground.
