Devops Engineer, Data | UPKEY
Discord Join our student community on Discord Close

Devops Engineer, Data

Job type Full-time Company Housecall Pro Location Remote

What you’ll be doing:

  • Manage cloud resources using Infrastructure-as-Code techniques (e.g. Terraform)
  • Build out best practices around monitoring, testing, alerting
  • Apply SDLC techniques to the deployment of data systems
  • Measure & optimize infrastructure costs
  • Orchestrate movement and transformation of data using SQL and Python tooling

 

Qualifications:

  • Strong knowledge of data-relevant AWS services such as RDS, S3, EMR, Kinesis, DynamoDB, and Lambda (or equivalents from GCP or Azure)
  • Solid understanding of the software development lifecycle, and CI/CD tools and practices
  • Experience running containerized workloads in production, especially batch workloads
  • Familiarity with modern MPP-columnar data warehouse platforms such as Redshift, Snowflake, Greenplum, ClickHouse (we use Snowflake)
  • Familiarity with DAG-oriented workflow tools such as Luigi, Airflow, Prefect
  • Some experience with SQL & Python
  • Ability and willingness to learn
  • Familiarity with Spark and the Hadoop ecosystem is a bonus
Apply now