Job Details

Big Data Engineer (Full-Time)

VentureSoft Global
Santa Clara, California, United States
Job Title Data Engineer (Full-Time) Location Bay Area, CA Job Description bull Very Strong engineering skills. Should have an analytical approach and have good programming skills. bull Provide business insights, while leveraging internal tools and systems, databases and industry data bull Minimum of 5+ yearsrsquo experience. Experience in retail business will be a plus. bull Excellent written and verbal communication skills for varied audiences on engineering subject matter bull Ability to document requirements, data lineage, subject matter in both business and technical terminology. bull Guide and learn from other team members. bull Demonstrated ability to transform business requirements to code, specific analytical reports and tools bull This role will involve coding, analytical modeling, root cause analysis, investigation, debugging, testing and collaboration with the business partners, product managers other engineering team. Must Haves Excellent knowledge and experience with Hive and SQL Experience with Spark SQL Proficient with one programming language JavaScalaPython General understanding of how to build end-to-end data pipelines Good to Have Experience n architecting data pipelines ndash from Data model to the jobs and the sequence of jobs Ability to build dashboards with Tableau or looker Software Engineering knowledge ndash ability to build web applications using Java and AngularJS or ReactJS tech stacks Technical Requirements bull Knowledgeexperience on Teradata Physical Design and Implementation, Teradata SQL Performance Optimization bull Advanced SQL (preferably Teradata) bull Experience working with large data sets, experience working with distributed computing (MapReduce, Hadoop, Hive, Pig, Apache Spark, etc.). bull Strong Hadoop scripting skills to process petabytes of data bull Experience in UnixLinux shell scripting or similar programmingscripting knowledge bull Experience in ETL processes bull Real time data ingestion (Kafka) Education BS degree in specific technical fields like computer science, math, statistics preferred Thanks, Vinutha

Send application

Mail this job to me so I can apply later

Apply With CV

You are not logged in. If you have an account, log in to your account. If you do not have an account, why not sign up? It only takes a minute!

latest videos

Upcoming Events