Big Data Drupal: Cloudera Hadoop, MapReduce, Nutch, Solr, Aegir BOA, Drupal
I have written a vague howto http://www.bigdatadrupal.com/howto-big-data-drupal-search and some speculation on future directions http://www.bigdatadrupal.com/content/future-directions on the Big Data Drupal marketing minisite.
Also, I have created a million pages plus search engine running Nutch on Hadoop across a Cloudera managed cluster, sending crawl commits to an Aegir BOA Solr container self-hosted on Proxmox at OVH in sunny Montreal. Another Aegir BOA Drupal vm runs Open Outreach and uses ApacheSolr Examples Nutch Multisite
I am giving a talk at Badcamp on Saturday (along with 160 other sessions, including at least one other Aegir talk on devops) on Big Data Drupal
http://2013.badcamp.net/sessions/big-data-drupal-cloudera-hadoop-mapredu...
#1
for anyone interested, I gave my talk on Big Data Drupal, which included Aegir in the toolchain to a full session at Badcamp on the weekend
on the exact same time was Forking Drupal about Backdrop
I have put a RFC on the Big Data Drupal branded domains, partly revolving around trademark policy, partly around the entire economics and social contract in the Drupal community / marketplace
personally, I completely understand the economic aspects of the Backdrop argument, and am very sympathetic. However, on technical aspects, I prefer the direction of D8. having said that, I've avoided a massive investment in learning the code of the Drupal Way.
But now, Drupal has forked and the marketization of the Drupal commons continues apace and I am not sure I have a place in that. Basically the Drupal social contract seems to have broken down. The Drupal working and middle class are being hollowed-out - like the larger society - automated, offshored, outsourced and competed in a race to the bottom in terms of living wage.
A lot of more established small players are diversifying into Drupal Products i.e. closed source products built on Drupal. A lot of less established smaller players are getting out, becoming employees in bigger shops or trying various things..
I'm diversifying myself. I don't feel like I can win with Drupal. Anyway, I was going to write a blog on the Tragedy of the Drupal Community or something and may well still.
#2
RFC: Future of Big Data Drupal http://niccolox.org/blog/rfc-future-big-data-drupal
#3
Thx for sharing niccolo :) Interesting.