Job Details

Big Data Engineer (with MapReduce)

Advertiser
Deloitte
Location
San Jose, California, United States
Rate
-

Are you an experienced, passionate pioneer in technology - a solutions builder, a roll-up-your-sleeves technologist who wants a daily collaborative environment, think-tank feel and share new ideas with your colleagues - without the extensive demands of travel? If so, consider an opportunity with Project Delivery Practice.
Work you'll do
Support the implementation of data integration requirements and develop the pipeline of data from raw to curation layers including the cleansing, transformation, derivation and aggregation of data.
Communicate effectively (written and spoken) and work with the multi-location development teams and self-manage own work
Support in the development of technical solutions to business problems
The team
Analytics & Cognitive
In this age of disruption, organizations need to navigate the future with confidence, embracing decision making with clear, data-driven choices that deliver enterprise value in a dynamic business environment.
The Analytics & Cognitive team leverages the power of data, analytics, robotics, science and cognitive technologies to uncover hidden relationships from vast troves of data, generate insights, and inform decision-making. Together with the Strategy practice, our Strategy & Analytics portfolio helps clients transform their business by architecting organizational intelligence programs and differentiated strategies to win in their chosen markets.
Analytics & Cognitive will work with our clients to:
Implement large-scale data ecosystems including data management, governance and the integration of structured and unstructured data to generate insights leveraging cloud-based platforms
Leverage automation, cognitive and science-based techniques to manage data, predict scenarios and prescribe actions
Drive operational efficiency by maintaining their data ecosystems, sourcing analytics expertise and providing As-a-Service offerings for continuous insights and improvements
Qualifications
Required
Bachelor-level degree in engineering, information technology, data communications, telecommunications, computer science, or equivalent professional experience and/or qualifications
5+ years of hands-on experience as a Data Engineer or Big Data developer role
3+ years of experience in building scalable and high-performance data pipelines using Apache Hadoop, MapReduce, Pig & Hive
5+ years of experience in Core JAVA and SQL
3+ years or experience in Python & Unix Shell Scripting
Experience with bigdata cross platform compatible file formats like Apache Avro & Apache Parquet
Hands on big data performance tuning and optimization experience in MapReduce and Pig
Strong SQL knowledge with ability to work with the latest database technologies.
Strong data & logical analysis skills
Travel up to 25% (While 25% of travel is a requirement of the role, due to COVID-19, non-essential travel has been suspended until further notice.)
Limited immigration sponsorship may be available
Preferred
Experience in Apache Spark & Scala is a plus
Additional Requirements
Must be willing to live and work in the Greater San Jose, CA area. Relocation assistance provided to qualifying candidates

Send application

Mail this job to me so I can apply later

Apply With CV

You are not logged in. If you have an account, log in to your account. If you do not have an account, why not sign up? It only takes a minute!

latest videos

Upcoming Events