Job Details

Big Data Engineer

Advertiser
International Solutions Group, Inc
Location
Detroit, Michigan, United States
Rate
-
Job Description:
Develop ELT processes from various data repositories and APIs across the enterprise, ensuring data quality and process efficiency
Develop data processing scripts using Spark
Develop relational and NoSQL data models to help conform data to meet users' needs using Hive and HBase
Integrate platform into existing EDW and various operational systems
Develop administration processes to monitor cluster performance, resource usage, backup and mirroring to ensure a highly available platform
Address performance and scalability issues in a large-scale data lake environment
Provide big data platform support and issues resolutions to Data Scientists and fellow engineers

Job Requirements:
Required:
2 years of experience with a Hadoop distribution and ecosystem tools such as Hive, Spark, Nifi and Oozie
2 years of experience developing batch and streaming ETL/ELT processes
2 years of experience with relational and NoSQL databases, including modeling and writing complex queries
Proficiency in at least one programming language such as Python or Java
Excellent communication, analytical, and problem-solving skills
Desired:
Experience with Linux system administration, Linux scripting and basic network skills
AWS experience

Education:
Master's degree in Computer Science, Software Engineering or closely related field

Send application

Mail this job to me so I can apply later

Apply With CV

You are not logged in. If you have an account, log in to your account. If you do not have an account, why not sign up? It only takes a minute!

latest videos

Upcoming Events