Job Details

Data Engineer- Big Data -Buffalo, NY

IBM Corporation
Buffalo, New York, United States

At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lead in this new era of technology and solve some of the world's most challenging problems? If so, lets talk.

Your Role and Responsibilities

The position of the Big Data Engineer plays a key role in the development and deployment of innovative big data platforms for advanced analytics and data processing. The Data Engineer defines and builds the data pipelines that will enable faster, better, data-informed decision-making within the business. Develops applications on Big Data and Cognitive technologies including API development. Expected to have traditional Application Development background along with knowledge of Analytics libraries, open-source Natural Language Processing, statistical and big data computing libraries. Strong technical abilities to understand, design, write and debug complex code.

As a Big Data Engineer, you'll be responsible for designing and building high performance, scalable data solutions. You'll design, develop, and test robust, scalable data platform components. Data Engineers are knowledgeable in one or more the following technologies: PySpark, Databricks, OR Scala.

Successful candidates for these positions will need to live within 300 miles of one of our IBM Client Innovation Centers in Baton Rouge, Monroe, LI Buffalo, NY or; East Lansing, MI. The IBM Client Innovation Centers is an in-bound delivery model where we support our clients from one of our Baton Rouge, Monroe or East Lansing centers. Some travel is expected, and all candidates must be willing and able to travel to meet our client needs across the US. Travel is typically related to knowledge transfer and training at the client site (Monday thru Friday). You are expected to travel approximately 60% of the time post-covid.


Health Insurance. Paid time off. Corporate Holidays. Sick leave. Family planning. Financial Guidance. Competitive 401K. Training and Learning. We continue to expand our benefits and programs, offering some of the best support, guidance and coverage for a diverse employee population.


Our goal is to be essential to the world, which starts with our people. Company wide we kicked off an internal talent strategy program called Go Organic. At our core, we are committed to believing and investing in our workforce through:

Skill development: helping our employees grow their foundational skills

Finding the dream job at IBM: navigating our company with the potential for many careers by channeling an employee's strengths and career aspirations

Diversity of people: Diversity of thought driving collective innovation

In 2015, Go Organic filled approximately 50% of our open positions with internal talent that were promoted into the role.


With an employee population of 375,000 in over 170 countries, amazingly we connect, collaborate, and care. IBMers drive a corporate culture of shared responsibility. We love grand challenges and everyday improvements for our company and for the world. We care about each other, our clients, and the communities we live, work, and play in!

Required Technical and Professional Expertise

Required skills:

4+ years experience using object orientated programming languages
4+ years experience in Big Data technologies (Hadoop, Hive, etc)
Experience with one or more of the following: PySpark, Databricks, or Scala
Ability to explore and analyze datasets using SQL
Understanding of data flows, data architecture, ETL and processing of structured and unstructured data
Ability to work in an agile environment

Preferred Technical and Professional Expertise


Send application

Mail this job to me so I can apply later

Apply With CV

You are not logged in. If you have an account, log in to your account. If you do not have an account, why not sign up? It only takes a minute!

latest videos

Upcoming Events