2 results for tag: UNIX


A Newcomer’s Perspective on HRDAG Systems

I’m a high school student who has been working with Patrick Ball here at HRDAG as an intern over the summer. I arrived here after asking my parents about what jobs existed that used data analysis to help people. Through our friend and human rights lawyer Kathy Roberts at the CJA, I was introduced to Patrick and have been lucky enough to spend my time here learning what data analysis looks like as an actual job. Here’s an overview of the tools and methods I have learned so far at HRDAG. Prior to this summer, I didn't realize why data science is so hard. Because of the number of people who work on our projects and the significance of the work ...

The task is a quantum of workflow

This post describes how we organize our work over ten years, twenty analysts, dozens of countries, and hundreds of projects: we start with a task. A task is a single chunk of work, a quantum of workflow. Each task is self-contained and self-documenting; I'll talk about these ideas at length below. We try to keep each task as small as possible, which makes it easy to understand what the task is doing, and how to test whether the results are correct. In the example I'll describe here, I'm going to describe work from our Syria database matching project, which includes about 100 tasks. I'll start with the first thing we do with files we receive ...