Job Details

Big Data Engineer

Advertiser
e-Solutions
Location
Irving, Texas, United States
Rate
-
Job DescriptionGreetings,Hope you are doing well!!My name is Garry and I am a Staffing Specialist at E-Solutions INC.I am reaching out to you on an exciting job opportunity with one of our clients. Big Data EngineerLocation :: NJ/ Irving TX/ Tampa FL/ NC, Charlotte/ ChicagoFulltime/Permanent Role 5 Experience with Big Data, Hadoop on Data Warehousing or Data Integration projects. Analysis, Design, development, support and Enhancements of ETL/ELT in data warehouse environment with Cloudera Bigdata Technologies (Hadoop, MapReduce, Sqoop, PySpark, Spark, HDFS, Hive, , Sentry) along with Oracle SQL/PL-SQL, Unix commands and shell scripting; Strong development experience in creating Sqoop scripts, PySpark programs, HDFS commands, HDFS file formats (Parquet, Avro, ORC etc.), Stream Sets pipeline creation, jobs scheduling, hive/impala queries, Unix commands, scripting and shell scripting etc. Writing Hive scripts for gathering stats on table post data loads. Strong SQL experience (Oracle and Hadoop (Hive)) Writing complex SQL queries and performed tuning based on the Hive explain plan results. Proven ability to write high quality code. Expertise implementing complex ETL/ELT logic. Develop and enforce strong reconciliation process. Accountable for ETL/ELT design documentation. Good knowledge of Big Data, Hadoop, Hive, Impala database, data security and dimensional model design. Basic knowledge of UNIX/LINUX shell scripting. Utilize ETL/ELT standards and practices towards establishing and following centralized metadata repository. Effective communication, presentation, & organizational skills. Familiar with Project Management methodologies like Waterfall and Agile Ability to establish priorities & follow through on projects, paying close attention to detail with minimal supervision. Thanks and Regards, Garry Sr. Recruiter P: E: 2N Market St, Suite # 400, San Jose, CA- 95113 USA | CANADA | UK | SINGAPORE | MALAYSIA | INDIA Disclaimer: E-Solutions provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state and local laws. We especially invite women, minorities, veterans, and individuals with disabilities to apply. EEO/AA/M/F/Vet/Disability.

Send application

Mail this job to me so I can apply later

Apply With CV

You are not logged in. If you have an account, log in to your account. If you do not have an account, why not sign up? It only takes a minute!

latest videos

Upcoming Events