Big Data Engineer
Pyramid Global Technologies · NSW, NSW, Australia · On-site
Sign up free: we match you to jobs like this, tailor your application and fill the form. 2 free applications every day.
Job Description for Big Data Engineer:
Primary Skills- Bigdata Hadoop, Hive, Spark, scala, SQL
Secondary Skills- DW/ETL, Unix, Git, Bitbucket, ControlM
- 3-5 years of experience in developing end to end bigdata pipeline
- Must have experience in developing at least 1 bigdata project using hive, spark, scala
- Thorough understanding of Hadoop and spark architecture
- Strong SQL skills
- Basic understanding of Unix scripting
- Good understanding of Data warehouse/ETL concepts
- Experience on any version control tool
- Experience on any job scheduling tool
- Good to have knowledge on Azure or any other cloud
- Good to have experience on Hive Query or spark code optimization