Hadoop VM

ssh -p 2222 training@localhost

[ ] Using small sample from data
- create it:
  head -50 ../data/purchases.txt > testfile

- pass it to mapper script
  cat testfile | ./mapper.py

- do all the map reduce in one command
  cat testfile | ./mapper.py | sort | ./reducer.py

- run all on a cluster
   hs mapper.py reducer.py myinput output2


[ ] Check progress on hadoop job tracker
   localhost:50030

[ ] Check map reduce output and print it
  hadoop fs -ls output2
  hadoop fs -cat output2/part-00000