Job Details

Big Data Engineer

Adroit Resources
San Jose, California, United States
1. What You'll Do Optimize data delivery, automate manual processes, re-design infrastructure forimproved scalability and identify, design and implement data ingestion, data delivery process improvements. Collaborate with analytics, data scientists and product teams to assist in building and optimizing innovative products and services to market Develop analytics tools that utilize data pipeline to provide actionable insights into customer acquisition, operational efficiency and key business performance metrics. Build big data pipelines, data sets and conduct performance tuning Working knowledge of message queuing, stream processing, and highly scalablelsquobig datarsquo data stores. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS lsquobig datarsquo technologies. Experience supporting and working with cross-functional teams in a dynamic environment Keep data separated and secure across architectural boundaries through multiple data centers and AWS regions.What you background looks like Deep problem-solving skills to perform root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. Build processes supporting data transformation, data structures, metadata, dependency and workload management. 2. What You Know Experience with big data tools Hadoop, Spark, Kafka, etc. Experience with relational SQL and NoSQL databases such as Cassandra. Experience with AWS cloud services EC2, EMR, Athena Experience with object-orientedobject function scripting languages Python, Java, C++, Scala, etc. Advanced SQL knowledge and experience working with relational databases, query authoring (SQL) as well as familiarity with unstructured datasets. Proven experience in manipulating, processing and extracting value from large disconnected datasets. Strong project management and organizational skills. Experience supporting and working with cross-functional teams in a dynamic environment.Perks 3. Experience 5+ years of experience in a Data Engineer role. 4. Education Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.

Send application

Mail this job to me so I can apply later

Apply With CV

You are not logged in. If you have an account, log in to your account. If you do not have an account, why not sign up? It only takes a minute!

latest videos

Upcoming Events