Data Engineer in Atlanta, GA at HUNTER Technical Resources

Date Posted: 7/4/2020

Job Snapshot

  • Employee Type:
  • Location:
    Atlanta, GA
  • Job Type:
  • Experience:
    Not Specified
  • Date Posted:
  • Job ID:

Job Description

Data Engineer

The Data Engineer will perform the technical activities required to support the Data Acquisition teams goal to migrate licensed and purchased data onto the company Data Fabric. We purchase and license third party data to augment its differential data assets and data products. The Data Engineer will work closely with the Enterprise Data Steward, The Data Acquisition team and the Data Fabric Technologies teams.

- Implement third party data assets on to the company Data Fabric.
- Analyze and profile data to design a data schema for Data Fabric. The Data Engineer will evaluate data cardinality, data cleansing requirements, frequency of updates, matching keys and the downstream uses of the data.
- Configure, code and test data preparation plug-ins in a variety of Google Cloud tools including Python, JAVA, Google Data Flow.
- Implement and deploy with IT data pipelines to production environments.
- Comply with company data security, compliance and governance rules at all times.
- Develop requirements for Data Fabric technology where there are gaps in platform capabilities.
- Use Data Fabric best practices including Data Catalog and Collibra.
- Provide support to data stewards, product team and IT for downstream usage.

- BS/ MS in Computer Science, Management Information Systems, or a related field
- 5+ years in data engineering, data wrangling or related roles.
- Strong skills in Python, JAVA, Google Data Prep, Google Data Flow or related skills.
- Experience in developing a data schema and data models.
- Experience in Cloud technologies and Google Data Cloud tools.
- Hands-on experience with cloud technologies, GCP, Azure or AWS.
- Strong analytical skills and attention to detail and accuracy
- Excellent communication skills and ability to work independently as well as in teams
- Work experience in regulatory and data compliant environments