Job Details

Senior Big Data Developer

eSolutionsFirst, LLC
Mc Lean, Virginia, United States

Client's Single Family Division is currently seeking a Senior Big Data Developer to implement BigData tools and methods of data processing
and ingestion as a member of the Credit Analytics and Reporting team.

Responsibilities include:
o Cleanse, manipulate and analyze large datasets (Structured and Unstructured data - XMLs, JSONs, PDFs) using Hadoop platform.
o Develop Python, PySpark, Spark scripts to filter/cleanse/map/aggregate data.
o Manage and implement data processes (Data Quality reports)
o Develop data profiling, deduping logic, matching logic for analysis
o Programming Languages experience in Python, PySpark and Spark for data ingestion
o Programming experience in BigData platform using Hadoop platform
Present ideas and recommendations on Hadoop and other technologies best use to management

Qualifications :

  • 5+ years of experience in processing large volumes and variety of data (Structured and unstructured data, writing code for parallel processing, XMLS, JSONs, PDFs)
  • 3+ years of programming experience in Hadoop, Spark, Python for data processing and analysis.
  • Strong SQL experience is a must
  • 3+ years of experience - using Hadoop platform and performing analysis. Familiarity with Hadoop cluster environment and configurations for resource management for analysis work
  • Detail oriented. Excellent communication skills (verbal and written)
  • Must be able to manage multiple priorities and meet deadlines
  • Degree in Statistics, Economics, Business, Mathematics, Computer Science or related field

At minimum of 3 years of Spark, Python, Hadoop, and Hive.
Soft Skill Must Haves: Excellent written communication and oral communication - 8/10 communication minimum. Excellent analytical skills.

- provided by Dice

Send application

Mail this job to me so I can apply later

Apply With CV

You are not logged in. If you have an account, log in to your account. If you do not have an account, why not sign up? It only takes a minute!

latest videos

Upcoming Events