Wednesday, September 15, 2010

More Adventures with Map Reduce and the Cloud

I am compressing video in the cloud via amazon's EC2/mapreduce/s3/etc... I am using map/reduce for this although it is really not a reduce problem only a map problem and not even that - I just need to spawn a bunch of ffmpeg processes....

The problem is I cant map/reduce on a disk that has ffmpeg. So what I did was compiled map reduce on my machine - zipped it - uploaded it to s3 then added a bootstrap action to unzip and ffmpeg whenever the program starts... lets see how this works - I think I need to recompile on debian though - currently using fedora

As for the arabian nights - i have learned that the arabic oral tradition no longer exists because people sit around in cafes and watch tv instead of telling/listening to stories - ahh technology


  1. Adding a bootstrap action to unzip and ffmpeg every time the program is run, like when I installed just as it also

  2. I really enjoy this post. I spend great time, reading it. It's interesting topic and it's great, that author decided to write about it. Seems like he's broad minded person. I would like to read his another posts with great pleasure. It can be my inspiration. kirim mobil