Job Details

AWS Big Data Engineer

Advertiser
Apex Systems
Location
Philadelphia, Pennsylvania, United States
Rate
-
AWS Data Engineer Overview Apex Systems is looking for an experienced Data Engineer with AWS and Spark experience for one of our largest technology clients in Philadelphia, PA. If you are interested in learning more about this position, please email your resume to Summary Need experienced data engineer with 6+ years of experience working with Data Centric Applications and Services in AWS Cloud. You will also need 3+ years of experience working in Apache Spark. Qualifications Expertise with Python, PySpark, Scala, PyData, DataFrames, or Jupyter Notebook and understands the fundamentals of functional programming language. Excellent data modelling experience and understanding of core concepts of Big Data Has practical experience working with 100s of Terabytes to Petabytes of data Solid experience and understanding of various core AWS services such as EC2, S3, EMRSpark, Glue, SQS, KinesisFirehose, DynamoDBDAX, Step functions, ElasticSearch, Athena and Redshift. Hands on programming experience using AWS SDK (Boto3), Java SDK or CLI Deep understand AWS Infrastructure, networking best practices, multi-region latency and fail overdisaster recovery strategy Has practical experience transferring big data in and out of AWS, transforming and computing in AWS at scale Experience in developing distributed applications and dynamic workflows using serverless architecture Analytical skills and experience in solving big data problems effectively using SparkEMR Experience with public cloud data sharing practices and security Experience working with CICD pipelines Other Preferred Requirements Experience with real time data streaming, batching and transformations on data in transit Nice to have experience in infrastructure automation using Infrastructure as Code methodology and well versed with CloudFormation or Terraform Non-Technical Experience Effective Collaborator and Team Player Quick Learner and Self-starter with excellent debugging skills Ability to foresee scalability, budget issues and make judgements EEO Employer Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at or

Send application

Mail this job to me so I can apply later

Apply With CV

You are not logged in. If you have an account, log in to your account. If you do not have an account, why not sign up? It only takes a minute!

latest videos

Upcoming Events