Clik here to view.
No longer thinking in slots, thinking in aggregate resources and consumption...
The slot model was natural when a machine housed a single core. Though, the slot model did not exist when a machine housed a single core. When machines were single core the model was a machine,...
View ArticleClik here to view.
Extensible machine resources
Physical machines are home to many types of resources these days. The traditional cores, memory, disk, now share space with gpus, co-processors or even protein sequence analysis accelerators. To...
View ArticleClik here to view.
Social scheduling
As a thought experiment. There are always multiple users and limited resources. Users have work, which takes time and resources to complete. The top resource users are visible to all. A user can...
View ArticleClik here to view.
Tail your logs, for fun and profit
If you don’t run tail -F on your logs periodically, you should. It’s illuminating. Try, tail -F /var/log/condor/*Log | grep -i -e error -e fail -e warn I ran that over the weekend and learned a few...
View ArticleClik here to view.
Configuration and policy evaluation
Figuring out how evaluation happens in configuration and policy is a common problem. The confusion is justified. Configuration provides substitution with $() syntax, while policy is full ClassAd...
View ArticleClik here to view.
Web design complexity
One thing that has always impressed me is the ability of web designers to deal with browser idiosyncrasies. For instance, knowing why this happens in firefox-17.0.1-1.fc17.x86_64 - A bootstrap...
View ArticleClik here to view.
Your API is a feature, give it real resource management
So much these days is about distributed resource management. That’s anything that can be created and destroyed in the cloud[0]. Proper management is especially important when the resource’s existence...
View ArticleClik here to view.
Concurrency Limits: Group defaults
Concurrency limits allow for protecting resources by providing a way to cap the number of jobs requiring a specific resource that can run at one time. For instance, limit licenses and filer access at...
View ArticleClik here to view.
Some htcondor-wiki stats
A few years ago I discovered Web Numbr, a service that will monitor a web page for a number and graph that number over time. I installed a handful of webnumbrs to track things at HTCondor’s gittrac...
View ArticleClik here to view.
How accounting group configuration could work with Wallaby
Configuration of accounting groups in HTCondor is too often an expert task that requires coordination between administrators and their tools. Wallaby provides a coordination point, so long as a little...
View ArticleClik here to view.
Statistic changes in HTCondor 7.7
Notice to HTCondor 7.8 users - Statistics implemented during the 7.5 series that landed in 7.7.0 were rewritten by the time 7.8 was released. If you were using the original statistics for monitoring...
View ArticleClik here to view.
Hello Fedora with docker in 3 steps
It really is this simple, 1. sudo yum install -y docker-io 2. sudo systemctl start docker 3. sudo docker run mattdm/fedora cat /etc/system-release Bonus, for when you want to go deeper - If you don’t...
View ArticleClik here to view.
A recipe for starting cloud images with virt-install
I’m a fan of using the same OS image across multiple environments. So, I’m a fan of using cloud images, those with cloud-init installed, even outside of a cloud. The trick to this is properly...
View ArticleClik here to view.
Hadoop on OpenStack with a CLI: Creating a cluster
OpenStack Savanna can already help you create a Hadoop cluster or run a Hadoop workload all through the Horizon dashboard. What it could not do until now is let you do that through a command-line...
View Article