Parallel R

All posts tagged Parallel R

Over the weekend, we updated all of the pbdR packages currently available on the CRAN.  The updates include tons of internal housecleaning as well as many new features. Notably, pbdBASE_0.1-1 and pbdDMAT_0.1-1 were released, which contain lm.fit() methods.  This function in particular has been available at my github for over a month, but didn't make its way to the CRAN until recently because of Read more >>
I am very happy to introduce a new set of packages that has just hit the CRAN. We are calling it the Programming with Big Data in R Project, or pbdR for short (or as I like to jokingly refer to it, 'pretty bad for dyslexics'). You can find out more about the pbdR project at http://r-pbd.org/ The packages are a natural programming framework that are, from the user's point of view, a very simple Read more >>
What is parallelization?Parallelization is using multiple processing cores to, hopefully, make your programs run faster than serial code, which is the use of just one processing core. Parallel code is not always faster than its serial counterpart (but if you're doing it right and you're careful about what you parallelize, it will be --- remember, that's your goal here).  Don't rush to parallelize Read more >>
My last post of substance was all about improving your performance using R to answer programming questions that might be asked during a job interview.  So let's say you nailed the interview and got the job, but you desperately want to be fired for grand incompetence.  Never fear, your pal at librestats once again has your back. The sleep sort First, we'll tackle the sleep sort after an important Read more >>
My time as a grad student will soon draw to a close. With this comes the terrifying realisation that I'm going to start applying for jobs and, hopefully, interviewing soon, forever leaving my comfortable security blanket of academia. With that horrible thought in mind, I've been doing some poking around to see what various kinds of technical interviews are like.  Apparently, it is not entirely Read more >>
So maybe I'm a strange guy, but I think fork bombs are really funny.  What's a fork bomb?  The basic premise is that you spawn a process that spawns a process that spawns a process..., ad infinitum. The most beautiful example of a fork bomb, and really one of the most beautiful lines of code ever, was created by Denis Rolo: Aside from looking like the gnarliest smiley face ever, running Read more >>