Login

Tags

Factual Blog / Tagged:

sysops

Docker, Mesos, Marathon, and the End of Pets

A Few Words on Pets and Cattle The pets vs cattle metaphor is not a new one, and with apologies to my vegan friends, not mine, but bears briefly repeating. Essentially, ssh-ing into a machine, configuring it just so, and naming it after something cute or an erudite allusion – that’s a pet. You’re sad if...

Profiling Hadoop Jobs With Riemann

Factual processes nontrivial amounts of data. Our analyses may range over 1011 records, reading hundreds of gigabytes to hundreds of terabytes of source data and intermediate representations. At this scale, performance optimizations can save us significant time and money. We use VisualVM, jhat, and Yourkit for memory and CPU profiling, and the excellent Criterium for microbenchmarks in...