174 results for search: Что сделать чтобы обратить внимание старшеклассника детальнее bit.ly/psy3000/feed/peru
HRDAG Retreat 2015
I look at the beach and then at the table surrounded by nerds, deep in thought and conversation about Dirichlet priors, matching algorithms, and armed conflicts. This peculiar (in the best way) environment catalyzes a moment of reflection: how did I get here?
Four years ago, as a second-year statistics PhD student, I watched "Guatemala: The Secret Files" on PBS Frontline World. I listened to stories of family members who disappeared without answers or justice. Then the story shifted to the work being done by archivists and data experts at Guatemala's Historic Archive of the National Police. The scientists' pursuit of the truth energized me. I ...
Multiple Systems Estimation: Collection, Cleaning and Canonicalization of Data
<< Previous post: MSE: The Basics
Q3. What are the steps in an MSE analysis?
Q4. What does data collection look like in the human rights context? What kind of data do you collect?
Q5. [In depth] Do you include unnamed or anonymous victims in the matching process?
Q6. What do you mean by "cleaning" and "canonicalization?"
Q7. [In depth] What are some of the challenges of canonicalization? (more…)
Data on Kosovo Migration
[popup citation="For migrations: Ball, Patrick. (2000). AAAS/ Human Rights Data Analysis Group database of migrations in Albania and Kosovo. For killings: Patrick Ball, Wendy Betts, Fritz Scheuren, Jana Dudukovich, and Jana Asher. (2002). AAAS/ABA-CEELI/Human Rights Data Analysis Group database of killings in Kosovo. For other data: Human Rights Data Analysis Group. (2002). Database of NATO airstrikes, geographic coding, and KLA activity in Kosovo."]
The data on migration from Kosovo are in seven files. All of the files are comma-delimited ASCII. The fields in each file are described below. For more information, see Policy or Panic, section A1, pp. ...
Celebrating Ten Years of Data from the AHPN
Ten years ago, in July 2005, human rights officers stumbled upon a nondescript warehouse in a commercial zone of Guatemala City and changed history. They had discovered an archive–its existence kept secret–belonging to the Guatemalan National Police, whose officers committed human rights atrocities on behalf of the government during the civil war.
Inside the building was the bureaucratic detritus typical of a large government agency: 80 million pages detailing shifts worked, tasks assigned, assignments fulfilled, workers’ whereabouts, and who was supervising whom. The documents, which were found stacked on dirty floors, shoved into bags, ...
Data Archaeology for Human Rights in Central America: HRDAG Collaborates with UWCHR
Patrick Ball is kicking himself for a decision he made almost 25 years ago. “I was clever, but I wasn’t smart,” he says ruefully, as he considers the labyrinth of tables and ASCII-encoded keystrings he used to design a database of human rights violations for the pioneering Salvadoran non-governmental Human Rights Commission (CDHES). Now I’m sitting in his office in San Francisco’s Mission District watching over his shoulder, and trying to keep up, as he bangs out code to decipher the priceless data contained in these old files. Created in 1991 and 1992, during the last days of El Salvador’s internal armed conflict, the files detail ...
When Data Doesn’t Tell the Whole Story
This blog is a part of International Justice Monitor’s technology for truth series, which focuses on the use of technology for evidence and features views from key proponents in the field.
As highlighted by other posts in this series, emerging technology is increasing the amount and type of information available, in some contexts, to criminal and other investigations. Much of what is produced by these emerging technologies (Facebook posts, tweets, YouTube videos, text messages) falls in the category we refer to as “found” data. By “found” data we mean data not generated for a specific investigation, but instead, that is generated for ...
Using Data and Statistics to Bring Down Dictators
In this story, Guerrini discusses the impact of HRDAG’s work in Guatemala, especially the trials of General José Efraín Ríos Montt and Colonel Héctor Bol de la Cruz, as well as work in El Salvador, Syria, Kosovo, and Timor-Leste. Multiple systems estimation and the perils of using raw data to draw conclusions are also addressed.
Megan Price and Patrick Ball are quoted, especially in regard to how to use raw data.
“From our perspective,” Price says, “the solution to that is both to stay very close to the data, to be very conservative in your interpretation of it and to be very clear about where the data came from, how it was collected, what its limitations might be, and to a certain extent to be skeptical about it, to ask yourself questions like, ‘What is missing from this data?’ and ‘How might that missing information change these conclusions that I’m trying to draw?’”
The task is a quantum of workflow
This post describes how we organize our work over ten years, twenty analysts, dozens of countries, and hundreds of projects: we start with a task. A task is a single chunk of work, a quantum of workflow. Each task is self-contained and self-documenting; I'll talk about these ideas at length below. We try to keep each task as small as possible, which makes it easy to understand what the task is doing, and how to test whether the results are correct.
In the example I'll describe here, I'm going to describe work from our Syria database matching project, which includes about 100 tasks. I'll start with the first thing we do with files we receive ...
Reflections: Some Stories Shape You
The first time I met anyone at HRDAG, I was a journalist. It was 2006. I was working on a story about a graduate student at Carnegie Mellon who’d collaborated with the organization on a survey in Sierra Leone, and I contacted Patrick Ball to discuss the work. At the time, I found him challenging.
But I thought his work—trying to estimate how many people were killed, or, in that study, otherwise injured, during wars—was fascinating. Over the next few years, I got to know other researchers working on similar questions. In 2008, as the war in Iraq ramped up, I spoke with epidemiologists from Johns Hopkins University, the World Health Organiz...
Trips to and from Guatemala
HRDAG has been working with the Historic Archive of the National Police in Guatemala (hereafter, the Archive) for the past seven years. The Archive contains a treasure trove of data recorded and kept by the Guatemalan National Police over the past century. When the Archive was first discovered in 2005, researchers there immediately recognized both the value and fragility of the tens of millions of documents. As a result, they reached out to HRDAG, and we reached out to volunteers at Westat to devise a plan to estimate the contents of the entire Archive as quickly as possible in case the documents were destroyed or access to them was limited. ...
Data and Social Good: Using Data Science to Improve Lives, Fight Injustice, and Support Democracy
In this free, downloadable report, Mike Barlow of O’Reilly Media cites several examples of how data and the work of data scientists have made a measurable impact on organizations such as DataKind, a group that connects socially minded data scientists with organizations working to address critical humanitarian issues. HRDAG—and executive director Megan Price—is one of the first organizations whose work is mentioned.
Guatemalan National Police Archive Project
The Historic Archive of the Guatemalan National Police (hereafter the Archive) was discovered, quite by accident, in July 2005. Researchers immediately recognized both the importance and the fragility of the Archive's contents. As a result, in early 2006 the Archive team invited Patrick to evaluate the documents and help them answer a seemingly simple question: How can we learn about the contents of the Archive in a shorter period of time than is needed to systematically examine each individual document?
After inspecting the Archive, Patrick designed a multi-stage random sample of documents. In May 2006, Tamy Guberek, Daniel Guzmán, and ...
Hat-Tip from Guatemala Judges on HRDAG Evidence
We welcome the verdict of a week ago by Judges Barrios, Bustamante, and Xitumul in the conviction of General Efraín Ríos Montt for genocide and crimes against humanity. Their 718-page written opinion contains many compelling arguments, findings, and conclusions. But the section we at HRDAG are most interested in is the one on page 245 (see original, below), where Patrick's testimony is referred to. (more…)
Our Copyright Policy
We have specified "Some Rights Reserved" on our website, instead of the more conventional "All Rights Reserved." This is because some of our web content is covered by a Creative Commons license, which means that it may be copied and even re-purposed, with some stipulations. We have made this decision because HRDAG wants to contribute to the digital commons, defined by Creative Commons as "a pool of content that can be copied, distributed, edited, remixed, and built upon, all within the boundaries of copyright law."
Our Creative Commons License
We are using the Attribution-NonCommercial-ShareAlike license, also known as the BY-NC-SA license. Here is ...
A Universal Declaration of a Few Data Rights
Today we celebrate the 65th anniversary of the Universal Declaration of Human Rights, which was adopted by the UN General Assembly on 10 December 1948. At HRDAG, we are non-partisan: we do not favor any party or government in conflicts. But we are not neutral: we are always in favor of human rights. We believe in the power and value of data; as we see it, data distills human actions and existence, all of which have power and value. With this in mind, we propose these seven articles that comprise our declaration of a few data rights (click through the links for some examples).
Preamble
Whereas data represents the suffering of human beings,
Whereas ...
HRDAG is hiring – technical lead
If this could be you, let us know. Also, please feel free to pass on this link to great people.
Job Title. Technical lead with a hacker's heart
Location. A cool office in SOMA, San Francisco. You need to be on-site with us.
What we do. The Human Rights Data Analysis Group (HRDAG) develops statistical techniques to measure human rights atrocities. Our work helps bring dictators to justice through data analysis of human rights atrocities around the world. Over more than 20 years, our small team has developed technology and statistical techniques to take disjoint, incomplete, and inaccurate information from conflict zones and process it to identify ...
Connect with HRDAG
If you’d like to stay informed about HRDAG events, blogposts, and news, connect with us on Twitter, Facebook or through our RSS feed. We also have a LinkedIn page.
You may contact us directly via email at info @ hrdag.org.
A note for persons in search of assistance with specific human rights cases: We are very sorry for your troubles and your suffering; however, HRDAG does not take on casework. If you need help with a human rights case, you might consider requesting it from the International Committee of the Red Cross (www.icrc.org).
Photo: U.S. National Archives
Rise of the racist robots – how AI is learning all our worst impulses
“If you’re not careful, you risk automating the exact same biases these programs are supposed to eliminate,” says Kristian Lum, the lead statistician at the San Francisco-based, non-profit Human Rights Data Analysis Group (HRDAG). Last year, Lum and a co-author showed that PredPol, a program for police departments that predicts hotspots where future crime might occur, could potentially get stuck in a feedback loop of over-policing majority black and brown neighbourhoods. The program was “learning” from previous crime reports. For Samuel Sinyangwe, a justice activist and policy researcher, this kind of approach is “especially nefarious” because police can say: “We’re not being biased, we’re just doing what the math tells us.” And the public perception might be that the algorithms are impartial.
Primer to Inform Discussions about Bail Reform
The primer addresses what pretrial risk assessment is and what the research supports.
.Rproj Considered Harmful
We aim to produce code that is clear, replicatable across machines and operating systems, and that leaves an easy-to-follow audit trail.