Data Engineer | UPKEY
Discord Join our student community on Discord Close

Data Engineer

Job type Full-time Company Auction Edge Location Tennessee - TN

Responsibilities

  • Develop reliable and performant programs that migrate data collected in near-realtime from on-premise systems to a centralized cloud-based data store
  • Develop reliable and performant programs that predict future behaviors, such as buyer behavior, based on past behavior. Accuracy of models versus cost to run are key.
  • Monitor and maintain multiple data pipelines reaching from on-premise sites to the cloud
  • Maintain and enhance documentation on both on-premise and cloud-hosted data stores
  • Maintain and develop standards for how data is coded and described both in source systems as well as how it's transformed as it's stored in the target system
  • Ensure the security of critical data
  • Understand data schemas for multiple on-premise, line-of-business applications as well as multi-tenant, cloud-hosted data stores

 

Required Qualifications

  • 3+ years of database development experience using scripting or other languages
  • 1+ years using predictive models
  • 1+ years reporting and analytics
  • Excellent working knowledge of SQL and query optimization
  • Excellent working knowledge of entity-relationship diagrams including the modeling of database schemas

 

Preferred Qualifications

  • 1+ years of experience programming in JavaScript, Java, Python, Ruby, C# or other equivalent  languages
  • 1+ years of experience with ETL tools such as Talend, Informatica, Clover, Pentaho, etc.
  • Postgres is our primary database, experience as a developer or administrator a plus
  • Experience in a cloud AWS environment
    • RDS, Aurora, DynamoDB, Key rotation
  • Data warehouse techniques
  • Data visualization experience a plus
  • Stream Processing experience preferred
    • Kafka, Kinesis or DynamoDB Streams
Apply now