Hadoop / Big Data Engineer Job at Cloud Analytics Technologies LLC, Phoenix, AZ

OWVtQjRlNzVsYVRmcE9sclBPUEJTUkRVaEE9PQ==
  • Cloud Analytics Technologies LLC
  • Phoenix, AZ

Job Description

JOB DESCRIPTION:

Big Data Engineer:

This engineer will help us build an ingestion pipeline designed to get data ingested from various data bases and source systems into our new big-data environment being built on Azure.

Essential Duties and Responsibilities:

  • Day to Day support of existing data ingest jobs
  • Creation, support, and scheduling of ingestions from new sources
  • Ongoing data engineering and enhancements to data sets within the environment
  • Proficient with big data technologies
  • Hive, Pig, HBase, MapReduce
  • Experience with open source ingestion tools
  • Sqoop, Flume, Spark streaming, Kafka, Nifi
  • Proven experience building real-time steaming data sets
  • Experience working with and performing analysis using large data sets
  • 10-1000 TB
  • Familiarity with common data science toolkits, such as R, Jupyter, & Python
  • Previous experience with traditional databases such as: Netezza, MySQL, Teradata, Oracle, etc
  • Preferred Experience with Azure products: Azure Data Lake Store, Azure HD Insights, Cosmos DB, PowerBI

Job Tags

Similar Jobs

DLM Pro

Class A CDL OTR Flatbed Driver - No Experience Needed Job at DLM Pro

 ...Class A CDL OTR Flatbed Driver No Experience Needed Location: Houston, TX Weekly Pay...  ...Job Overview Looking to start your trucking career? Were hiring Class A CDL drivers...  ...pass DOT drug test and road test Clean driving record preferred Positive attitude and... 

KIA South Atlanta

Title Clerk Job at KIA South Atlanta

Title Clerk We are a leading automotive dealership committed to providing an exceptional car-buying and service experience. We provide a positive, professional work environment, aggressive pay plans with career advancement opportunities, and the best training in the...

Addison Group

Medical Billing Specialist Job at Addison Group

 ...Job Title: Medical Billing Specialist (Full Cycle) Location (city, state): Chevy Chase, MD Compensation: $19.00 $23 per hour (based...  ...Perks: Hybrid work potential after 90 days (3 days remote / 2 days onsite). Opportunity to join a growing team with... 

Hill Country Christian School of Austin

Director of Athletics Job at Hill Country Christian School of Austin

 ...Director of Athletics Position Purpose To advance the gospel and the mission of Hill Country Christian School by ensuring that every area within our athletics department pursues character formation in our students through rigorous and excellent athletic programs.... 

Enterprise Medical Recruiting

OB/GYN Position in Poplar Bluff, Missouri - $400K Base Salary + $50K Sign-On Job at Enterprise Medical Recruiting

We are scheduling interviews with an OB-GYN practice that is adding another OB-GYN physician to its Women's Health team. Position Details ~$400,000 base salary and a $50,000 signing bonus. ~ Light 1:2 call schedule with six weeks of vacation ~ Access to da ...