Job Details

Software Engineer - Big Data Platform (BDP)

Sunnyvale, California, United States
We are on a mission to connect every member of the global workforce with economic opportunity, and that starts right here with LinkedIn. Talent is our number one priority, and we make sure to apply that philosophy both to our customers and to our own employees as well. Explore cutting-edge technology and flex your creativity. Work and learn from the best. Push your skills higher. Tackle big problems. Innovate. Create. Write code that makes a difference in professionals' lives. Searching for your dream job? At LinkedIn, we strive to help our employees find passion and purpose. Join us in changing the way the world works. The Big Data Platform group at LinkedIn builds and manages the data lake and the compute platform that trains ML models, supports data exploration, runs scheduled data processing, and serves insights and member experiences. We run one of the largest big data clusters on the planet spanning tens of thousands of nodes, managing storage systems of Exabyte capacity, processing petabytes of data daily. We extensively collaborate with open source and influence open-source communities. We have a team of contributors, committers, and committee members in Apache, CNCF, Linux Foundation, and other open-source projects. We are looking for talented data infrastructure engineers to build the next generation of big data platform in the cloud. Responsibilities - Design and implement large-scale distributed systems with security and compliance in mind. - Optimize the performance of distributed systems at scale. - Improve the observability and understandability of the various system/offline systems - Build frameworks that validate functionality and performance of large scale offline systems - Optimize performance of these systems by profiling and identifying bottlenecks - Build systems that are secure and compliant - Collaborate with different teams within the Big Data Platform group to incorporate their work and vice versa - Work closely with the open-source communities to participate and influence cutting edge open-source projects (for example, Apache Spark, Apache Iceberg, Apache Gobblin, Azkaban, Apache Hadoop, Kubernetes, TensorFlow, Presto) Basic Qualifications: - BA/BS Degree in Computer Science or related technical discipline, or related practical experience. - 1+ years of industry experience - Hands on experience developing distributed systems - Experience in software design, development, and algorithm related solutions. - Experience programming in Object-oriented languages such as Java, C++ and/or Functional languages such as Scala Preferred Qualifications: - BS in CS and 1+ years of relevant work experience, MS in CS with relevant project experience in distributed systems field - MS or PhD in Computer Science or related technical discipline - Experience with Hadoop ecosystem (MapReduce, YARN, HDFS, Hive, Spark, Presto) or similar big data ecosystems - Experience with industry or academic research in data management, relational databases, and/or large-data, parallel and distributed systems - Experience with open-source projects - Experience with cloud computing (e. . , Azure) - Experience in distributed systems - Ability to diagnose technical problems, debug code, and automate routine tasks - Expert knowledge in computer science, with strong competencies in data structures, algorithms, and software design. Equal Opportunity StatementLinkedIn is committed to diversity in its workforce and is proud to be an equal opportunity employer. LinkedIn considers qualified applicants without regard to race, color, religion, creed, gender, national origin, age, disability, veteran status, marital status, pregnancy, sex, gender expression or identity, sexual orientation, citizenship, or any other legally protected class. LinkedIn is an Affirmative Action and Equal Opportunity Employer as described in our equal opportunity statement here: https://lnkd. /equalemploymentopportunity2017. Please reference http://www1. . /employers/upload/eeoc_self_print_poster. and https://www. . /ofccp/regs/compliance/posters/pdf/OFCCP_EEO_Supplement_Final_JRF_QA_508c. for more information. LinkedIn is committed to offering an inclusive and accessible experience for all job seekers, including individuals with disabilities. Our goal is to foster an inclusive and accessible workplace where everyone has the opportunity to be successful. If you need a reasonable accommodation to search for a job opening, apply for a position, or participate in the interview process, connect with us at and describe the specific accommodation requested for a disability-related limitation. Reasonable accommodations are modifications or adjustments to the application or hiring process that would enable you to fully participate in that process. Examples of reasonable accommodations include but are not limited to: -Documents in alternate formats or read aloud to you -Having interviews in an accessible location-Being accompanied by a service dog-Having a sign language interpreter present for the interviewA request for an accommodation will be responded to within three business days. However, non-disability related requests, such as following up on an application, will not receive a response. LinkedIn will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by LinkedIn, or (c) consistent with LinkedIn's legal duty to furnish information. Pay Transparency Policy StatementAs a federal contractor, LinkedIn follows the Pay Transparency and non-discrimination provisions described at this link: https://lnkd. /paytransparency. Global Data Privacy Notice for Job CandidatesThis document provides transparency around the way in which LinkedIn handles personal data of employees and job applicants: https://lnkd. /GlobalDataPrivacyNotice

Send application

Mail this job to me so I can apply later

Apply With CV

You are not logged in. If you have an account, log in to your account. If you do not have an account, why not sign up? It only takes a minute!

latest videos

Upcoming Events