Job Details

Senior Big Data Engineer

Advertiser
Rock Central LLC
Location
Detroit, Michigan, United States
Rate
-
The Rock Family of Companies is made up of nearly 100 separate businesses spanning fintech, sports, entertainment, real estate, startups and more. We're united by our culture - a drive to find a better way that fuels our commitment to our clients, our community and our team members. We believe in and build inclusive workplaces, where every voice is heard and diverse perspectives are welcomed. Working for a company in the Family is about more than just a job - it's about having the opportunity to become the best version of yourself.Minimum Qualifications Bachelor's degree in computer science, information technology, or a related field or equivalent experiencePreferred Qualifications 4 years of experience with big data/Hadoop distribution and ecosystem tools, such as Hive, HBase, Spark, Kafka, NiFi and Oozie4 years of experience developing batch and streaming ETL processes4 years of experience working with relational and NoSQL databases, including modeling and writing complex queriesMaster's degree in computer science, information technology, or a related field or equivalent experienceExperience with programming languages, such as Python, Java or C#Experience with Linux system administration, Linux scripting, and basic network skillsExperience coding against and developing REST API'sJob SummaryThe Big Data Engineer is responsible for engaging in the design, development and maintenance of the big data platform and solutions. This includes analytical solutions that provide visibility and decision support using big data technologies.The role involves administering a Hadoop cluster, developing data integration solutions, and work with data scientists, system administrators and data architects to ensure the platform meets business demands.ResponsibilitiesDevelop ELT processes from various data repositories and APIs across the enterprise, ensuring data quality and process efficiencyDevelop data processing scripts using SparkDevelop relational and NoSQL data models to help conform data to meet users' needs using Hive and HBaseIntegrate platform into existing EDW and various operational systemsDevelop administration processes to monitor cluster performance, resource usage, backup and mirroring to ensure a highly available platform.Address performance and scalability issues in a large-scale data lake environmentWho We AreRock Central is a Detroit-basedprofessional services company obsessed with delivering innovative, effective solutions to meet the diverse needs of our clients. From legal and finance to technology and public relations, ourexpertise spans from executive consulting all the way to tactical implementation. We thrive at the intersection of people, process and technologyand empower our partners to unleash the maximum potential of their business through unmatched partnershipand the entrepreneurial spirit of a startup. From the smallest venture to the largest enterprises, we believe having an impact is never a question-it's part of our DNA.DisclaimerThis is an outline of the primary responsibilities of this position. As with everything in life, things change. The tasks and responsibilities can be changed, added to, removed, amended, deleted and modified at any time by the leadership group.The Company is an Equal Employment Opportunity employer, and does not discriminate in any hiring or employment practices. The Company provides reasonable accommodations to qualified individuals with disabilities in accordance with state and federal law. Applicants requiring reasonable accommodation in completing the application and/or participating in the employment application process should notify a representative of the Human Resources Team, The Pulse, at 1-800-411-JOBS.

Send application

Mail this job to me so I can apply later

Apply With CV

You are not logged in. If you have an account, log in to your account. If you do not have an account, why not sign up? It only takes a minute!

latest videos

Upcoming Events