Job Details

Senior Big Data Engineer

Advertiser
Lytx, Inc.
Location
San Diego, California, United States
Rate
-
Innovation Lives HereYou go all in no matter what you do, and so do we. You want to use your powers for good, and that's exactly what we do at Lytx. Our team is made up of hungry, humble, and capable people who are making a difference every day with technology that helps save lives each year.Why Lytx:Are you looking to take your career in Data Engineering to the next level? Do you enjoy building data pipelines that enable critical business insights? Are you a specialist in designing and delivering scalable streaming data solutions? Lytx is looking for a Senior Data Engineer to join our growing team!You'll know you're right for this job if you enjoy working with data pipelines that enable decision makers and facilitate the development of machine learning algorithms. While you have excellent technical skills, your ability to drive results and influence technology decisions are also very apparent. In addition, you intimately know the Data Engineering landscape and enjoy advising software developers and mentoring more junior employees.What You'll Do:Provide senior-level contributions to the development teams responsible for implementing critical data applicationsParticipate in the full software development lifecycle (requirements, design, code, unit test, deployment, sustaining)Develop and lead streaming data pipelines used for training and developing machine learning modelsParticipate in the research, design, and testing of next generation data engine platformsDevelop and guide long-term strategy for data pipelines and persistent data storageEvaluate and recommend database infrastructure and tools including cloud technologiesBuild integrated and automated data pipelines using the Hadoop Ecosystem (Spark, Kafka, Hive, Yarn, Oozie)Develop efficient and effective T-SQL to extract, transform, and load data from source systemsProcess documentation and data flow diagrammingMentor and coach junior engineers, software developers, and data analystsPerform other related duties as assignedWhat You'll Need:Minimum 5 years of experience in Data Engineering and/or Software DevelopmentMinimum 3 years of experience working with the Apache Hadoop EcosystemMinimum 3 years of experience with MS SQL Server or other RDBMSSignificant experience with Spark, Kafka, Nifi, and other streaming data toolsSolid understanding of the Hadoop Ecosystem including HDFS, MapReduce, Sqoop, Yarn, Hive, and OozieSolid understanding of T-SQL and ETL programming including SQL Server Integration Services (SSIS)Solid understanding of common data warehousing technologies and techniquesExcellent conceptual, analytical, and problem-solving skillsExperience in a high growth, fast paced environmentDemonstrated record of delivering quality technology outcomesStrong organizational skills and a keen attention to detailSelf-motivated, engaged, and accountableBachelor's degree or equivalent experience requiredBonus points for: Familiarity with Java programming is a plusFamiliarity with cloud data offerings (AWS, GCP, Snowflake) is a plusFamiliarity with Greenplum is a plusLytx, Inc. is proud to be an equal opportunity/affirmative action employer and maintains a drug-free workplace. We are committed to attracting, retaining and maximizing the performance of a diverse and inclusive workforce. EOE/M/F/Disabled/Vet.

Send application

Mail this job to me so I can apply later

Apply With CV

You are not logged in. If you have an account, log in to your account. If you do not have an account, why not sign up? It only takes a minute!

latest videos

Upcoming Events