Client's Single Family Division is currently seeking a Senior Big Data Developer to implement BigData tools and methods of data processingand ingestion as a member of the Credit Analytics and Reporting team.Responsibilities include:o Cleanse, manipulate and analyze large datasets (Structured and Unstructured data - XMLs, JSONs, PDFs) using Hadoop platform.o Develop Python, PySpark, Spark scripts to filter/cleanse/map/aggregate data.o Manage and implement data processes (Data Quality reports)o Develop data profiling, deduping logic, matching logic for analysiso Programming Languages experience in Python, PySpark and Spark for data ingestiono Programming experience in BigData platform using Hadoop platform• Present ideas and recommendations on Hadoop and other technologies best use to managementQualifications :
At minimum of 3 years of Spark, Python, Hadoop, and Hive.Soft Skill Must Haves: Excellent written communication and oral communication - 8/10 communication minimum. Excellent analytical skills.
You are not logged in. If you have an account, log in to your account. If you do not have an account, why not sign up? It only takes a minute!
You must login to use this facility.
0 Job saves