Cloudera

Hadoop is a big deal because it can hold more data than you can easily store and process, and it was made famous by Google, Yahoo, and Facebook. Also it is a big deal because it is an open source. Cloudera is a company that distributes Hadoop to a larger community. They make support available for commercial and personal use. PIG is a higher level language for easy ad-hoc analysi. Great for researchers and technical product managers. Developed at Yahoo. Hive is a sql interface for Hadoop. Allows you to collect data and impose structure on the data later. Great for analysts familiar with existing system. Developed at Facebook. Cassandra is used for a lot of users requesting and updating information. Design points included incremental scalability and low system administration overhead; Cassandra could be useful in many places where a horizontally partitioned (‘sharded”) MySQL instance is currently deployed. Mahout is a machine-learning tool. By enabling you to build machine-learning libraries that are scalable to “reasonably large” datasets, it aims to make building intelligent applications easier and faster.