Login

Tags

Factual Blog / Tagged:

aaron crow

Drake 1.0.1: You Can Use It Now

We’re pleased to announce the release of Drake version 1.0.1. This release is a quick follow-up to the recently released Drake 1.0.0. The 1.x version of Drake provides easy installation, including a Homebrew recipe for Mac users. We’ve also included a commemorative logo upgrade, check it out! Many thanks to @amalloy for his ownership, guidance, and...

Drake after Two Years: “Barely Famous”

We released Drake (“Data workflow tool, like a ‘Make for data’”) two years ago. The impetus behind Drake was the classic “scratch your own itch”. We craved a text-based data workflow tool that would make it easier to build and manage our data processing tasks. We open sourced Drake in the hope that others would find...

New Drake (Make for Data) Feature: Asynchronous Step Execution

A major new feature in the recent Drake 0.1.4 release is allowing the asynchronous execution of steps. Drake can now automatically parallelize the steps in your workflow based on the specified dependencies. If you have steps in your workflow that have high latency, or you have different steps that use different resources (e.g. one step is...

Extend Drake (Make for Data) with a Simple Clojure Project

Earlier this year we released Drake, an open source data workflow tool. It was exciting to see the interest in Drake. We were especially pleased by the quality of outside contributions made to the project (as one example: S3 support – thanks @howech!). But we weren’t happy with the delay on our side in accepting these...

Introducing Drake, a Kind of ‘Make for Data’

Processing data can be a real a mess! Here at Factual we’ve felt the pain of managing data workflows for a very long time. Here are just a few of the issues: a multitude of steps, with complicated dependencies code and input can change frequently -- it's tiring and error-prone to figure out what needs to be re-built...