Job Details

Big Data Consultant (Hadoop, Apache Spark and Amazon S3) *w2

ATR International, Inc.
Charlotte, North Carolina, United States

Big Data Consultant (ETL, Hadoop, Apache Spark and Amazon S3) *w2

**Direct Client in the Banking Industry

This technical role will be responsible for
Design high performing data models on big-data architecture as data services.
Design and build high performing and scalable data pipeline platform using Hadoop, Apache Spark and Amazon S3 based object storage architecture.
Work with business analysts, development teams and project managers for requirements and business rules.
Collaborate with source system and approved provisioning point (APP) teams, Architects, Data Analysts and Modelers to build scalable and performant data solutions.
Effectively work in a hybrid environment where legacy ETL and Data Warehouse applications and new big-data applications co-exist
Work with Infrastructure Engineers and System Administrators as appropriate in designing the big-data infrastructure.
Support ongoing data management efforts for Development, QA and Production environments
Leverage knowledge of industry trends to build best in class technology to provide competitive advantage.
10+ years of application development and implementation experience
10+ years of experience delivering complex enterprise wide information technology solutions
Experience in Hadoop ecosystem tools for real-time batch data ingestion, processing and provisioning such as Apache Flume, Apache Kafka, Apache Sqoop, Apache Flink, Apache Spark or Apache Storm
5+ years of experience delivering ETL, data warehouse and data analytics capabilities on big-data architecture such as Hadoop 5+ years of Java or Python experience
10+ years of ETL (Extract, Transform, Load) Programming experience
10+ years of reporting experience, analytics experience or a combination of both 5+ years of Hadoop experience 5+ years of operational risk, conduct risk or compliance domain experience
Excellent verbal, written, and interpersonal communication skills
Ability to work effectively in virtual environment where key team members and partners are in various time zones and locations
Knowledge and understanding of project management methodologies: used in waterfall or Agile development projects
Knowledge and understanding of DevOps principles Ability to interact effectively and confidently with senior management

- provided by Dice

Send application

Mail this job to me so I can apply later

Apply With CV

You are not logged in. If you have an account, log in to your account. If you do not have an account, why not sign up? It only takes a minute!

latest videos

Upcoming Events