Tags » Parallel Computing

Quick Guide to Parallelization in R

(reposted from StackOverflow)

I have a basic system I use where I parallelize my programs on the “for” loops. This method is simple once you understand what needs to be done. 199 more words


The Internet Was Delivered to the Masses; Parallel Computing Is Not Far Behind

Virginia Tech News (08/21/14)

Virginia Polytechnic Institute and State University (Virginia Tech) professor Wu Feng has been a leader in the field of parallel computing, especially in relation to the field of biomedicine. 183 more words

High Performance Computing

How MathWorks hurts research: A review of Matlab Distributed Computing Server

TLDR: MathWorks uses a cumbersome and error-prone DRM called MDCS to control the restrictions on their Parallel Computing Toolbox software for Matlab. The MDCS product is an abuse of the vendor lock-in that occurs when researchers invest years developing Matlab-based research code in an environment with gratis access to Matlab supplied by institutional licenses, and are subsequently squeezed for additional licensing fees for their (ostensibly) already licensed product when they need to run their code in parallel at scale.   3,063 more words


Creating a virtual cluster in R using Amazon ec2

I was recently asked by my department to evaluate Amazon’s elastic compute cloud (ec2) to see if it could serve as a viable alternative to our aging cluster.   1,422 more words

R Programming

Map Reduce with Python

In this post, We’ll implement map-reduce programming model in python using a lightweight map-reduce framework Octopy, it is one of the most widely used programming paradigm and is most often heard in context with Big Data and related technologies, but there is much more than meets the eye. 2,327 more words

Big Data

BBC News: Million neurons on stamp-sized chip

I saw this story on the BBC News and thought you should see it:

Million neurons on stamp-sized chip

Scientists. led by a team at IBM, develop a new computer chip that mimics the organisation of the human brain. 9 more words


DistributableStream — A Java Stream Computational Model for Big Data Processing (part III)

Last time, we showed a simple WordCount example implemented with the DistributableStream API. Now it’s time to see some less trivial examples.