Computer Aid, Inc.

Senior Data Engineer

Location US-NC-Huntersville
Employment Type
Permanent
Experience Level
Senior

Position Description/Responsibilities (CCC/Vendor)

The Senior Data Engineer will be responsible for the design, development, and implementation of ETL jobs and streaming processes required to ingest and transform the data in the data lake. The data engineer will also assist the data scientists in the data exploration, data visualization, and feature engineering processes. The individual will work on one or many product teams at a time.  He/she must have very strong communication and analytical skills and an ability to work as part of an agile team (product owner, developers, etc.) at the interface with traditional IT, where he/she interacts with the data architecture group to gather system knowledge necessary to execute his/her tasks. 

 

Responsibilities:

 

  • Work with CoE data scientists to architect and flood static data models to enable the development of ML and other statistical models
  • Build ETL jobs and streaming processes based on jointly defined requirements for the data pipeline
  • Assist in exploratory data analysis and visualization in Python to help drive insights
  • Translate insights into predictive power by assisting data scientists with feature engineering in Python
  • Design and create data pipelines for more dynamic data environments to be used when models built on those insights go live
  • Work with data architecture team to understand and improve inbound data pipeline
  • Support the bug fixing and performance analysis along the data pipeline
  • Bring experience in Oracle, data warehouse, and data lake management to development team
  • Build Oracle stored procedures/functions packages, Unix Shell Scripts as required
  • Serve as a strong advocate for a culture of process and data quality across development teams
  • Follow an agile development methodology

Position Requirements/Technical Skills (CCC/Vendor)

Technical Requirements:

 

  • BS/MS degree in Computer Science, Engineering, Mathematics, Statistics or related subject
  • 5-7 years of experience working with both tools like Hadoop, Spark, Hive, Pig, SQL, UNIX, Spark Streaming, and Kafka
  • Experienced with data modelling and design patterns Experienced with TeraData, Oracle, MySQL, Informatica, Tableau, QlikView or similar databases
  • Experience with data visualization in Python, Rshiny, or similar
  • Experience in engineering features for predictive models in R or Python
  • Strong analytical and problem-solving skills
  • Experience working with Agile

 CAI IS EOE

Company Overview (CCC Only)

Computer Aid, Inc.

 

CAI is a global IT services firm that is currently managing active engagements with over 100 Fortune 1000 companies and government agencies around the world.  CAI offerings include balanced outsourcing solutions, Legacy Support, Application Development, Application Knowledge Capture, Service Desk/Desktop Services, and Managed Staffing Services.  Our unique methodologies and tools enable us to provide our clients with real techniques for increasing productivity, profitability and competitiveness. 

 

Headquartered in Allentown, PA, with offices and staff throughout the US, Canada, Europe and the Asia Pacific region, CAI offers a variety of delivery options including on-site, off-site and blended solutions.  Our delivery model allows us to successfully leverage our global staff of over 3,500 technical and managerial professionals. 

 

CAI is an Equal Opportunity/Affirmative Action employer. Minorities, women, veterans and individuals with disabilities will receive consideration and are encouraged to apply.

Status of Your Application:

Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.
Share on your newsfeed