Position: Big Data Engineer
Location: Jersey City, New Jersey (Remote till COVID 19 settled down)
Duration: 12+ Month Contract (Extendable)
Interview: Phone and Skype
"Remote till COVID 19 settled down"
Deploy data processing jobs to production Configure and setup Talend environments.
Work with stakeholders to identify and document requirements.
Configure and schedule data pipelines Translate business requirements to technical specifications and coded data pipelines.
Troubleshoot data pipelines Qualifications: Passionate coders with 3-5 years of application development experience with Talend. Proficiency with Talend Open Data Studio or Talend Big Data is a must. Must have worked on projects that have resulted in code being deployed to production
Experience with Snowflake, Redshift, or Azure Synapse strongly desired. Expert knowledge of developing with Talend Cloud.
Knowledge of data formats and ETL and ELT processes in a Hadoop environment including Spark Hive, Parquet, MapReduce, YARN, HBase and other NoSQL databases. Experience in dealing with structured, semi-structured and unstructured data in batch and real-time environments. Experience with working in AWS, Azure, and/or Google Cloud environments. Familiarity with DevOps and CI/CD as well as Agile tools and processes including Git, Jenkins, Jira and Confluence. Good Knowledge on Map Reduce and Spark design patterns Experience in Spark to process large stream of data. Experienced in running MapReduce and Spark jobs over YARN. Client facing or consulting experience highly preferred. Skilled problem solvers with the desire and proven ability to create innovative solutions. Flexible and adaptable attitude, disciplined to manage multiple responsibilities and adjust to varied environments. Future technology leaders- dynamic individuals energized by fast paced personal and professional growth. Phenomenal communicators who can explain and present concepts to technical and non-technical audiences alike, including high level decision makers. Bachelor's Degree in MIS, Computer Science, Math, Engineering or comparable major. Solid foundation in Computer Science, with strong competencies in data structures, algorithms and software design. Knowledge and experience in developing software using agile methodologies. Proficient in authoring, editing and presenting technical documents. Ability to communicate effectively via multiple channels (verbal, written, etc.) with technical and non-technical staff.
Lead Recruiter | APETAN Consulting LLC |
Corp. Office: 15 Union Avenue, office # 6, Rutherford, New Jersey 07070
- provided by Dice