Search Monitor: Toward a Measure of Transparency



Citizen Lab Occasional Paper #1, “Search Monitor Project: Toward a Measure of Transparency“, (mirror) has been released today. This report interrogates and compares the censorship practices of the search engines provided by Google, Microsoft and Yahoo! for the Chinese market along with the domestic Chinese search engine Baidu. It is based on tests conducted between November 2007 and April 2008 focused on uncovering web sites that have been censored from search engine results.

The report finds that although Internet users in China are able to access more information due to the presence of foreign search engines the web sites that are censored are often the only sources of alternative information available for politically sensitive topics. In addition to censoring the web sites of Chinese dissidents and the Falun Gong movement, the web sites of major news organizations, such as the BBC, as well as international advocacy organizations, such as Human Rights Watch, are also censored.

The data presented in this report indicates that there is not a comprehensive system – such as a list issued by the Chinese government – in place for determining censored content. In fact, the evidence suggests that search engine companies themselves are selecting the specific web sites to be censored raising the possibility of over blocking as well as indicating that there is significant flexibility in choosing how to implement China’s censorship requirements.

This report finds that search engine companies maintain an overall low level of transparency regarding their censorship practices and concludes that independent monitoring is required to evaluate their compliance with public pledges regarding commitments to transparency and human rights. The lack of clarity in the process and the unwillingness of companies to disclose this information acts to bolster China’s current censorship policy that thrives on secrecy and unaccountability.

It is becoming increasingly clear that technology companies face a dilemma when attempting to penetrate the Chinese market. A failure to comply with China’s censorship policies can result in the wholesale blocking of a company’s entire service or significant levels of interference due to China’s filtering system. Companies that have a physical presence in China face the challenge of obtaining proper licensing and their Chinese employees may face legal threats for the foreign company’s failure to comply with China’s censorship policies. However, it is also clear that compliance with China’s censorship policies is also an unattractive option. Google, Microsoft and Yahoo! are all facing tough criticism from governments, human rights groups and civil liberties advocates as well as their shareholders for their complicity in China’s censorship policies.

While foreign search engines do provide more content than domestic search engines, the greatest benefit of having foreign search engines in China may not be increased access to information but is the potential contribution that these companies can make to further transparency and accountability in the process of censorship.

Since this report was finalized, the domestic Chinese search engine Baidu, following the foreign search engines, introduced a censorship notification indicating that it is possible to make progress through engagement. While this development may seem negligible to some and it is certainly no reason to become complacent, it is a small first step toward lifting the veil of secrecy and unaccountability that permeates China’s censorship policies.

11 comments.

  1. Internet censorship is part of the Chinese Government’s tactics to suppress and control. Censorship enables authorities to hide human rights abuses.

    Sign Amnesty International’s pledge – http://action.uncensor.com.au/pledge/ – and send a message to the Chinese Government that censorship is unacceptable. Or discuss the issues at http://www.uncensor.com.au.

  2. I don’t really understand packets etc, but I have to live with this filtering. (Except when on vacation in the US.)
    And so… what I would love to know is: is there any way around the great firewall?

  3. [...] Google, Yahoo and Microsoft assist censorship of the internet in [...]

  4. [...] tightening the censorship screws. And too much of Western criticism of China ignores the role of multinationals such as Google, Yahoo and Microsoft in the filtering process. Chinese-based firms are now working [...]

  5. [...] study published by the University of Toronto’s Citizen Lab in June 2008 found that Google is actually the least censored search engine in China. Google is the second-most widely used search engine in China, behind [...]

  6. [...] is where the problems with Baidu seem to start — with censorship. But Baidu may be fiddling with results far more than ensuring no query about Falun Gong turns up [...]

  7. […] to these companies by government authorities. Previous studies on censorship in blog services and search engines localized for the Chinese market have found similar inconsistency between products. Overall, these […]

  8. […] 這情況說明政府沒有向這些軟體公司提供關鍵字名單,曾經有人研究過大陸的微博審查和針對中國市場的本土化搜尋引擎審查,也發現類似的關鍵字名單不相同情況。總體而言,這些研究表明,對於什麼類型的內容和目標需要審查,軟體公司只是收到一般性的指引,至於如何落實這些指引,公司具有一定程度的靈活性。 […]

  9. […] 這情況說明政府沒有向這些軟體公司提供關鍵字名單,曾經有人研究過大陸的微博審查和針對中國市場的本土化搜尋引擎審查,也發現類似的關鍵字名單不相同情況。總體而言,這些研究表明,對於什麼類型的內容和目標需要審查,軟體公司只是收到一般性的指引,至於如何落實這些指引,公司具有一定程度的靈活性。 […]

  10. […] こうした不一致が示唆するのは、共通のキーワードリストを政府当局が提供しているわけではないということだろう。過去の調査で、 中国のブログや検索エンジンにおける検閲を調べた際も、サービスによって検閲が画一でないことが分かっている。おそらく、中国の企業は当局より要綱が渡されており、検閲対象とすべき内容の種類を指示されているが、具体的にどの程度そういった指示を導入するか幅があると考えられるだろう。 […]

  11. […] Microsoft have long struggled with how to adjust their search engines to deal with Chinese requirements, but the appearance of censorship beyond the localized […]

Post a comment.