Job Details

Sr. Big Data Solutions Architect

Bank of the West
San Ramon, California, United States
At Bank of the West, our people are having a positive impact on the world. We're investing where we feel we can make the most impact, like advancing diversity and women entrepreneurship programs, financing for more small businesses, and promoting programs for sustainable energy. From our locations across the U.S., Bank of the West is taking action to help protect the planet, improve people's lives, and strengthen communities. We are part of BNP Paribas, a global leader supporting the UN Sustainable Development Goals (SDGs). Yes, we're a bank, but as the bank for a changing world, we are continually seeking to improve the ways we help our customers, while contributing to more sustainable and equitable growth. Job Description You will develop and configure big data technology stack to develop and maintain the modern technology stack for scale and enable AI/ML capabilities to support strategic growth. Partner end-to-end with Product Managers and Data Scientists to understand business requirements and design prototypes and bring ideas to production Facilitate problem diagnosis and resolution in technical and functional areas. Encourage change, especially in support of data engineering best practices and developer satisfaction * Write high-quality code that is consistent with our standards, creating new standards as necessary * Automate for metadata management, High Availability within the data hub configuration. * Configure Hadoop clusters including installations * Work in team setting and mentor team members where required * Demonstrate correctness with pragmatic automated tests * Build POCs and work with business leaders to understand requirements. * Review the work of other engineers in a collegial fashion to promote and improve quality and engineering practices * Develop strong working relationships with others across levels and functions * Participate and coordinate Communities-of-Practice in those technologies in which you have an interest * Serve as a member of an agile engineering team and participate in the team's workflow #LI-BG1 Qualifications * 10 years' relevant experience * You are an expert in design, coding, and scripting with strong Python, Java, Scala, Spark, SQL, Hive * You love automating your code * Experience in development and configuration of big data stack using Hortonworks/Cloudera big data stack. * Demonstrate a deep knowledge and ability work in Big Data engineering ecosystem with complex data sourcing, building pipelines * Experience HDP 3.1 or CDH * Proficient in configuration and tuning, Grafana, Prometheus * Experience in setting up production configuration, deployment in enterprise environment * Experience in Apache NiFi, Apache Spack, Schema Registry, Apache Knox HDFS, Apache Atlas, Apache Ranger, Apache Kafka, Data Analytics Studio, Apache Airflow * GItlab, CI/CD, Automation, tuning. LDAP/AD configuration, Access controls in Apache Ranger and building frameworks to support Data pipelines * Experience in building, distributed, scalable, and reliable data pipelines that ingest and process data at scale and in batch and real-time * Experience with streaming technologies such as Spark streaming. * Experience with various messaging systems, such as Kafka * Experience with Hadoop cluster configuration and optimizations * Experience with DaaS implementation * Experience in implementing Real Time Streaming Architecture * Experience with Data Lab concept with Zeppelin, Jupyter * Working experience with various NoSQL databases such as Cassandra, HBase, MongoDB, * Working experience with time-series DB such as Apache Druid * Working knowledge of various columnar storage such as Parquet, AVRO and ORC * Understanding of software development best practice, Agile/Scrum * Elasticsearch, Cassandra is a plus Education * Bachelor's Degree Equal Employment Opportunity Policy Bank of the West is an Equal Opportunity employer and proud to provide equal employment opportunity to all job seekers without regard to any status protected by applicable law. Bank of the West is also an Affirmative Action employer - Minority / Female / Disabled / Veteran. Bank of the West will consider for employment qualified applicants with criminal histories pursuant to the San Francisco Fair Chance Ordinance subject to the requirements of all state and federal laws and regulations.


Send application

Mail this job to me so I can apply later

Apply With CV

You are not logged in. If you have an account, log in to your account. If you do not have an account, why not sign up? It only takes a minute!

latest videos

Upcoming Events