Basic Hadoop Pig Script for Beginners

Tamil hero who acted in only one movie in 2016 using Hadoop Pig

# setting up the environment

pig -x local

# Loading the file

A = LOAD '/home/cloudera/Desktop/moviee.csv' USING PigStorage(',') as (Title,Cast);

Dump A;

# separating the Cast Column in the next step

B = foreach A generate Cast ;

grunt> dump B;

# concatenating hero’s the First name and last name.

C = FOREACH B  GENERATE (chararray) REPLACE(Cast, ' ', '');

# tokenizing the word and grouping them and storing in name E

D = foreach C generate flatten (TOKENIZE ((chararray)$0)) as word;

E = group D by word

# generating Count of the word

F = foreach E generate COUNT(D), group;
# Filtering Number = 1 (Which return the hero acted only in one Movie)

I = filter F by num==1;

dump I;

Dump A output :

(Title	Cast)
(Azhagu Kutti Chellam	Akhil)
(Karai Oram	Nikesha Patel)
(Maalai Nerathu Mayakkam	Balakrishna Kola)
(Peigal Jaakkirathai	Jeeva Rathnam)
(Tharkappu	Shakthi Vasudevan)
(Arithaaram	Tamizh)
(Kurangu Kaila Poo Maalai	Praveen Kumar Rajendran)
(Meenakshi Kadhalan Ilangovan	Selvam)
(Thigilodu Vilaiyaadu	Ravikumar)
(Gethu	Udhayanidhi Stalin)
(Kathakali	Vishal)
(Rajini Murugan	Sivakarthikeyan)
(Tharai Thappattai	Sasikumar)
(Moondraam Ullaga Por	Sunil Kumar)
(Aranmanai 2	Siddharth)
(Irudhi Suttru	Madhavan)
(Naalu Per Naalu Vidhama Pesuvaanga	Indrajith)
(Nanaiyadhe Mazhaiye	Dinesh)
(Bangalore Naatkal	Arya)
(Irandu Manam Vendum	Saji Surenderan)
(Naalai Mudhal Kudikka Matten	Raj)
(Saagasam	Prashanth)
(Sethu Boomi	Thaman Kumar)
(Visaranai	Dinesh)
(Anjala	Vimal)
(Jil Jung Juk	Siddharth)
(Vennilavin Arangetram	Samasthi)
(Vil Ambu	Sri)
(Miruthan	Jayam Ravi)
(Navarasa Thilagam	Ma Ka Pa Anand)
(Sethupathi	Vijay Sethupathi)
(Aarathu Sinam	Arulnithi)
(Kanithan	Atharvaa)
(Nayyapudai	Pa. Vijay)
(Pakki Payaluga	Valli)
(Pichaikkaran	Vijay Antony)
(Pokkiri Raja	Jiiva)
(Sowkarpettai	Srikanth)
(Aviyal	Nivin Pauly)
(Enna Pidichirukka	Kevin)
(Kadhalum Kadandhu Pogum	Vijay Sethupathi)
(Kathiravanin Kodai Mazhai	Kannan)
(Mapla Singam	Vimal)
(Natpadhigaram 79	Raj Bharath)
(Aagam	Irfan)
(Endru Thaniyum	Yuvan Mayilsamy)
(Pugazh	Jai)
(Sawaari	Benito Franklin)
(Vidayutham	Ram Saravana)
(Adida Melam	Abhay Krishna)
(	)
(Thozha	Nagarjuna)
(Vaaliba Raja	Sethu)
(Zero	Ashwin Kakumanu)
(Darling 2	Kalaiyarasan)
(	)
(Hello Naan Pei Pesuren	Vaibhav)
(Narathan	Nakul)
(Uyire Uyire	Siddhu)
(	)
(Avan Aval	Vignesh)
(Jithan 2	Jithan Ramesh)
(Kida Poosari Magudi	Thamizh)
(Mudhal Thagaval Arikkai	Rayan)
(Oyee	Geethan Britto)
(Tea Kadai Raja	Raja Subbiah)
(Nijama Nizhala	Akhil Iyer)
(Theri	Vijay)
(Yokkiyan Varan Somba Thooki Ulla Vai	Vijay Nagaraj)
(Maasi Veedhi	Bala)
(Ennul Aayiram	Maha)
(Guhan	Aravind Kalathar)
(Vetrivel	Sasikumar)
(Kalam	Amzath Khan)
(Kanden Kadhal Konden	Guhan)
(Manithan	Udhayanidhi Stalin)
(Salaiyoram	Raj)
(24	Suriya)
(Inaya Thalaimurai	Ashwin Kumar)
(Jumbulingam 3D	Gokulnath)
(Ko 2	Bobby Simha)
(Pencil	G. V. Prakash Kumar)
(Unnodu Ka	Aari)
(Kadha Solla Porom	Akshara)
(Kodeeswaran	Govind Rao)
(Marudhu	Vishal)
(Idhu Namma Aalu	Silambarasan)
(Jeniffer Karuppaiya	T. S. Vasan)
(Meera Jaakirathai	Surendar)
(Sutta Pazham Sudaatha Pazham	Raju)
(Uriyadi	Vijay Kumar)
(Iraivi	Vijay Sethupathi)
(Kallathoni	Deepika)
(Velainu Vandhutta Vellaikaaran	Vishnu Vishal)
(Oru Naal Koothu	Dinesh Ravi)
(Pandiyoda Galatta Thaangala	Nithin Sathya)
(Vithaiyadi Naanunakku	Ramnathan K.B)
(Angali Pangali	Vishnupriyan)
(Enakku Innoru Per Irukku	G. V. Prakash Kumar)
(Muthina Kathirikai	Sundar C)
(Amma Kanakku	Amala Paul)
(Metro	Shirish)
(Raja Manthiri	Kalaiyarasan)
(Appa	Samuthirakani)
(Jackson Durai	Sathyaraj)
(Oru Melliya Kodu	Arjun)
(Paisa	Sree Raam)
(Adra Machan Visilu	Shiva)
(Dhilluku Dhuddu	Santhanam)
(Ardhanaari	Ramkumar)
(Ka Ka Ka Po	Sakshi Agarwal)
(Kizhakku Chandu	Bala)
(Kodambakkam Kokila	Asha Latha)
(Megha Moottam	Sriram)
(Onbathilirundhu Pathuvarai	Kathir)
(Summave Aaduvom	Arun Balaji)
(Kabali	Rajinikanth)
(Vellikizhamai 13�am Thethi	Rathan Mouli)
(Chandi Kuthirai	Rajkamal)
(Ennama Katha Vudranunga	Aarvi)
(Tamilselvanum Thaniyar Anjalum	Jai)
(Thirunaal	Jiiva)
(Joker	Guru Somasundaram)
(Mudinja Ivana Pudi	Sudeep)
(Wagah	Vikram Prabhu)
(Dharma Durai	Vijay Sethupathi)
(Nambiar	Srikanth)
(Yaanai Mel Kuthirai Saavari	Rajendran)
(Bayam Oru Payanam	Bharath Reddy)
(54321	Shabeer)
(Andha Kuyil Needhana	Keerthi Krishna)
(Enakku Veru Engum Kilaigal Kidayathu	Goundamani)
(Meendum Oru Kadhal Kadhai	Walter Phillips)
(Vendru Varuvaan	Veerabharathi)
(Ilamai Oonjal	Namitha)
(Kidaari	Sasikumar)
(Kuttrame Thandanai	Vidharth)
(Thagadu	Ajay)
(Iru Mugan	Vikram)
(Vaaimai	Shanthanu Bhagyaraj)
(Pudhusa Naan Poranthen	Biyon)
(Nayagi	Trisha)
(Pagiri	Prabhu Ranaveeran)
(Sadhuram 2	Yog Japee)
(Uchathula Shiva	Karan)
(Thodari	Dhanush)
(Aandavan Kattalai	Vijay Sethupathi)
(Oruthal	Senthil Jagadeesan)
(Aasi	Varshika)
(Kallattam	Nandha)
(Kanaga Durga	Magi)
(Kollidam	Nesam Murali)
(Nunnunarvu	Mathivanan Sakthivel)
(Thirumaal Perumai	Gopal Ram)
(Devi	Prabhu Deva)
(Rekka	Vijay Sethupathi)
(Remo	Sivakarthikeyan)
(Ammani	Lakshmy Ramakrishnan)
(Kagitha Kappal	Appukutty)
(Nee Enbathu	Mukil)
(Nenjukkulla Nee Neranjirukka	Sivahari)
(Kaashmora	Karthi)
(Kodi	Dhanush)
(Thiraikku Vaaradha Kadhai	Nadhiya)
(Kadalai	Ma Ka Pa Anand)
(Achcham Yenbadhu Madamaiyada	Silambarasan)
(Kadavul Irukaan Kumaru	G. V. Prakash Kumar)
(Meen Kuzhambum Mann Paanaiyum	Kalidas Jayaram)
(Kaththi Sandai	Vishal)
(Mo	Suresh Ravi)
(Saithan	Vijay Antony)
(Bruce Lee	G. V. Prakash Kumar)
(Chennai 600028 II: Second Innings	Shiva)
(S3	Suriya)
(Bogan	Jayam Ravi)
(Kavan	Vijay Sethupathi)
(Motta Shiva Ketta Shiva	Raghava Lawrence)
(Taramani	Vasanth Ravi)
(Yeman	Vijay Antony)

  

Dump B Output

Output ;

Cast)
("Akhil)		("Sasikumar)		("Biyon)
("Nikesha Patel)		("Amzath Khan)		("Trisha)
("Balakrishna Kola)		("Guhan)		("Prabhu Ranaveeran)
("Jeeva Rathnam)		("Udhayanidhi Stalin)		("Yog Japee)
("Shakthi Vasudevan)		("Raj)		("Karan)
("Tamizh)		("Suriya)		("Dhanush)
("Praveen Kumar Rajendran)		("Ashwin Kumar)		("Vijay Sethupathi)
("Selvam)		("Gokulnath)		("Senthil Jagadeesan)
(Ravikumar)		("Bobby Simha)		("Varshika)
("Udhayanidhi Stalin)		("G. V. Prakash Kumar)		("Nandha)
("Vishal)		("Aari)		("Magi)
("Sivakarthikeyan)		("Akshara)		("Nesam Murali)
("Sasikumar)		("Govind Rao)		("Mathivanan Sakthivel)
("Sunil Kumar)		("Vishal)		("Gopal Ram)
("Siddharth)		("Silambarasan)		("Prabhu Deva)
("Madhavan)		("T. S. Vasan)		("Vijay Sethupathi)
("Indrajith)		("Surendar)		("Sivakarthikeyan)
("Dinesh)		("Raju)		("Lakshmy Ramakrishnan)
("Arya)		("Vijay Kumar)		("Appukutty)
("Saji Surenderan)		("Vijay Sethupathi)		("Mukil)
("Raj)		("Deepika)		("Sivahari)
("Prashanth)		("Vishnu Vishal)		("Karthi)
("Thaman Kumar)		("Dinesh Ravi)		("Dhanush)
("Dinesh)		("Nithin Sathya)		("Nadhiya)
("Vimal)		("Ramnathan K.B)		("Ma Ka Pa Anand)
("Siddharth)		("Vishnupriyan)		("Silambarasan)
("Samasthi)		("G. V. Prakash Kumar)		("G. V. Prakash Kumar)
("Sri)		("Sundar C)		("Kalidas Jayaram)
("Jayam Ravi)		("Amala Paul)		("Vishal)
("Ma Ka Pa Anand)		("Shirish)		("Suresh Ravi)
("Vijay Sethupathi)		("Kalaiyarasan)		("Vijay Antony)
("Arulnithi)		()		("G. V. Prakash Kumar)
("Atharvaa)		()		("Shiva)
("Pa. Vijay)		()		("Suriya)
("Valli)		(Cast)		("Jayam Ravi)
("Vijay Antony)		("Samuthirakani)		("Vijay Sethupathi)
("Jiiva)		("Sathyaraj)		("Raghava Lawrence)
("Srikanth)		("Arjun)		("Vasanth Ravi)
("Nivin Pauly)		("Sree Raam)		("Vijay Antony)
("Kevin)		("Shiva)
("Vijay Sethupathi)		("Santhanam)
("Kannan)		("Ramkumar)
("Vimal)		("Sakshi Agarwal)
("Raj Bharath)		("Bala)
("Irfan)		("Asha Latha)
("Yuvan Mayilsamy)		("Sriram)
("Jai)		("Kathir)
("Benito Franklin)		("Arun Balaji)
("Ram Saravana)		("Rajinikanth)
("Abhay Krishna)		("Rathan Mouli)
()		("Rajkamal)
("Nagarjuna)		("Aarvi)
("Sethu)		("Jai)
("Ashwin Kakumanu)		("Jiiva)
("Kalaiyarasan)		("Guru Somasundaram)
()		("Sudeep)
("Vaibhav)		("Vikram Prabhu)
("Nakul)		("Vijay Sethupathi)
("Siddhu)		("Srikanth)
()		("Rajendran)
("Vignesh)		("Bharath Reddy)
("Jithan Ramesh)		("Shabeer)
("Thamizh)		("Keerthi Krishna)
("Rayan)		("Goundamani)
("Geethan Britto)		("Walter Phillips)
("Raja Subbiah)		("Veerabharathi)
("Akhil Iyer)		("Namitha)
("Vijay)		("Sasikumar)
("Vijay Nagaraj)		("Vidharth)
("Bala)		("Ajay)
("Maha)		("Vikram)
("Aravind Kalathar)		("Shanthanu Bhagyaraj)

  

Final Output

(1,Sri)	(1,Gokulnath)	(1,Pa.Vijay)	(1,BenitoFranklin)
(1,Aari)	(1,GovindRao)	(1,Rajkamal)	(1,KalidasJayaram)
(1,Ajay)	(1,Indrajith)	(1,Ramkumar)	(1,KeerthiKrishna)
(1,Arya)	(1,Nagarjuna)	(1,Samasthi)	(1,SajiSurenderan)
(1,Magi)	(1,Prashanth)	(1,Sivahari)	(1,WalterPhillips)
(1,Maha)	(1,Rajendran)	(1,SreeRaam)	(1,YuvanMayilsamy)
(1,Raju)	(1,Ravikumar)	(1,Surendar)	(1,AravindKalathar)
(1,Aarvi)	(1,Santhanam)	(1,Varshika)	(1,BalakrishnaKola)
(1,Akhil)	(1,Sathyaraj)	(1,Vidharth)	(1,RaghavaLawrence)
(1,Arjun)	(1,T.S.Vasan)	(1,YogJapee)	(1,GuruSomasundaram)
(1,Biyon)	(1,AmzathKhan)	(1,AkhilIyer)	(1,PrabhuRanaveeran)
(1,Guhan)	(1,ArunBalaji)	(1,AmalaPaul)	(1,ShakthiVasudevan)
(1,Irfan)	(1,BobbySimha)	(1,Appukutty)	(1,SenthilJagadeesan)
(1,Karan)	(1,DineshRavi)	(1,Arulnithi)	(1,ShanthanuBhagyaraj)
(1,Kevin)	(1,Goundamani)	(1,AshaLatha)	(1,LakshmyRamakrishnan)
(1,Mukil)	(1,NivinPauly)
(1,Nakul)	(1,PrabhuDeva)
(1,Rayan)	(1,RajBharath)
(1,Sethu)	(1,SunilKumar)
(1,Valli)	(1,SureshRavi)
(1,Vijay)	(1,VijayKumar)
(1,Kannan)	(1,AshwinKumar)
(1,Karthi)	(1,NesamMurali)
(1,Kathir)	(1,RajaSubbiah)
(1,Nandha)	(1,Rajinikanth)
(1,Selvam)	(1,RamSaravana)
(1,Siddhu)	(1,RathanMouli)
(1,Sriram)	(1,ThamanKumar)
(1,Sudeep)	(1,VasanthRavi)
(1,Tamizh)	(1,AbhayKrishna)
(1,Trisha)	(1,BharathReddy)
(1,Vikram)	(1,JeevaRathnam)
(1,Akshara)	(1,JithanRamesh)
(1,Deepika)	(1,NikeshaPatel)
(1,Nadhiya)	(1,NithinSathya)
(1,Namitha)	(1,RamnathanK.B)
(1,Shabeer)	(1,VijayNagaraj)
(1,Shirish)	(1,VikramPrabhu)
(1,SundarC)	(1,VishnuVishal)
(1,Thamizh)	(1,Vishnupriyan)
(1,Vaibhav)	(1,GeethanBritto)
(1,Vignesh)	(1,SakshiAgarwal)
(1,Atharvaa)	(1,Samuthirakani)
(1,GopalRam)	(1,Veerabharathi)
(1,Madhavan)	(1,AshwinKakumanu)