Job Details

Senior Big data Engineer

KoreMinds LLC
Jersey City, New Jersey, United States

Position : Big data Architect / Engineer

Location : Columbus, Plano and Jersey city

Duration : 12+ months contract to perm (fulltime)

Job Description:

  • Working with our LOB (line of business) users, collaborate with other technology teams to design, develop, test full stack cloud data solutions.
  • Leading and be responsible for the craftsmanship, security, availability, resilience and scalability of your solution.
  • Leading the innovation, perform proof of concept and the implementation of cutting-edge technologies
  • BS/BA degree or equivalent experience
  • 5+ years of experience in application development using any of these programming languages: Java, Scala, Python. Experience working in financial industry is preferred.
  • 3+ years of experience working with Amazon Web Services (AWS) including entitlement and IAM policy. AWS professional certification is preferred.
  • 3+ years of experience working on streaming data applications (Spark Streaming, Kafka, Kinesis, and Flink)
  • 3+ years' experience working with data pipeline open source products (Ex Airflow, Jupyter, etc)
  • 3+ years' hands-on experience with Hadoop data platform (MapReduce, Pig, Hive, HBase, Impala), experience working with Cloudera stack is preferred.
  • 1+ years of experience with DevOps automation tools (AWS CloudFormation, Terraform)
  • 1+ years of experience in developing, deploying and monitoring in building large distributed and parallel systems using container technology including Docker, Kubernetes, AWS EKS, AWD Fargate
  • Lead by influence, mentor junior software engineers, ability to navigate to different teams and business to find solutions to complex

#Bigdata #Cloud #AWS #Spark #Scala #Hadoop #Java #MapReduce #Pig #HBase #Cloudera #DevOps #Docker #AirFlow #DataLake

- provided by Dice

Send application

Mail this job to me so I can apply later

Apply With CV

You are not logged in. If you have an account, log in to your account. If you do not have an account, why not sign up? It only takes a minute!

latest videos

Upcoming Events