The ad says“Experience using the latest AI tooling (Claude, Codex, etc.)”
The ad says“Hands-on experience using multiple data platforms and tools (e.g. Airflow, Hive, Kafka, Postgres, Redshift, S3, Spark, Trino, Airbyte), and experience deploying, monitoring, and maintaining at least one of them”
The ad says“Experience with Airflow, Luigi, Prefect, or other ETL scheduling tools”
The ad says“Experience using the latest AI tooling (Claude, Codex, etc.)”
The ad says“Experience using the latest AI tooling (Claude, Codex, etc.)”
The ad says“Experience designing and implementing software (pipelines, services and client libraries) that is run in Docker containers, automatically tested on a continuous integration (CI) system, and versioned in git. You have experience writing shell scripts, Makefiles, or other configuration to glue together these components”
The ad says“Experience with cloud data pipeline services like dbt Cloud, Airbyte, or Hightouch”
The ad says“Experience designing and implementing software (pipelines, services and client libraries) that is run in Docker containers, automatically tested on a continuous integration (CI) system, and versioned in git. You have experience writing shell scripts, Makefiles, or other configuration to glue together these components”
The ad says“Experience with Airflow, Luigi, Prefect, or other ETL scheduling tools”
The ad says“Message driven or streaming architectures, such as those with Kafka, Spark, Flink”
The ad says“Experience designing and implementing software (pipelines, services and client libraries) that is run in Docker containers, automatically tested on a continuous integration (CI) system, and versioned in git. You have experience writing shell scripts, Makefiles, or other configuration to glue together these components”
The ad says“Experience with cloud data pipeline services like dbt Cloud, Airbyte, or Hightouch”
The ad says“You have experience provisioning and managing infrastructure with infrastructure-as-code tools (we use Terraform, but experience with similar tools like CloudFormation, Pulumi, or SaltStack is totally fine!)”
The ad says“Experience with at least one JVM language (we use Kotlin, but Java or Scala experience works)”
The ad says“Hands-on experience using multiple data platforms and tools (e.g. Airflow, Hive, Kafka, Postgres, Redshift, S3, Spark, Trino, Airbyte), and experience deploying, monitoring, and maintaining at least one of them”
The ad says“Experience with at least one JVM language (we use Kotlin, but Java or Scala experience works)”
The ad says“Ability to deploy containerized software in Kubernetes, or sufficient experience in similar technologies like Apache Mesos or Amazon ECS”
The ad says“Experience designing and implementing software (pipelines, services and client libraries) that is run in Docker containers, automatically tested on a continuous integration (CI) system, and versioned in git. You have experience writing shell scripts, Makefiles, or other configuration to glue together these components”
The ad says“Message driven or streaming architectures, such as those with Kafka, Spark, Flink”
The ad says“Redshift, Presto, or other MPP database experience”
The ad says“Postgres, MySQL, or other RDBMS experience”
The ad says“Hands-on experience using multiple data platforms and tools (e.g. Airflow, Hive, Kafka, Postgres, Redshift, S3, Spark, Trino, Airbyte), and experience deploying, monitoring, and maintaining at least one of them”
The ad says“Redshift, Presto, or other MPP database experience”
The ad says“You are able to design and implement high-quality software in Python”
The ad says“Postgres, MySQL, or other RDBMS experience”
The ad says“Hands-on experience using multiple data platforms and tools (e.g. Airflow, Hive, Kafka, Postgres, Redshift, S3, Spark, Trino, Airbyte), and experience deploying, monitoring, and maintaining at least one of them”
The ad says“Hands-on experience using multiple data platforms and tools (e.g. Airflow, Hive, Kafka, Postgres, Redshift, S3, Spark, Trino, Airbyte), and experience deploying, monitoring, and maintaining at least one of them”
The ad says“Experience designing and implementing software (pipelines, services and client libraries) that is run in Docker containers, automatically tested on a continuous integration (CI) system, and versioned in git. You have experience writing shell scripts, Makefiles, or other configuration to glue together these components”
The ad says“Hands-on experience using multiple data platforms and tools (e.g. Airflow, Hive, Kafka, Postgres, Redshift, S3, Spark, Trino, Airbyte), and experience deploying, monitoring, and maintaining at least one of them”
The ad says“Experience using SQL to read and manage data”
The ad says“Message driven or streaming architectures, such as those with Kafka, Spark, Flink”
The ad says“You have experience provisioning and managing infrastructure with infrastructure-as-code tools (we use Terraform, but experience with similar tools like CloudFormation, Pulumi, or SaltStack is totally fine!)”
The ad says“Hands-on experience using multiple data platforms and tools (e.g. Airflow, Hive, Kafka, Postgres, Redshift, S3, Spark, Trino, Airbyte), and experience deploying, monitoring, and maintaining at least one of them”
Values
The ad says“Ability to deploy containerized software in Kubernetes, or sufficient experience in similar technologies like Apache Mesos or Amazon ECS”
The ad says“Ability to deploy containerized software in Kubernetes, or sufficient experience in similar technologies like Apache Mesos or Amazon ECS”
The ad says“You have experience provisioning and managing infrastructure with infrastructure-as-code tools (we use Terraform, but experience with similar tools like CloudFormation, Pulumi, or SaltStack is totally fine!)”
The ad says“Hands-on experience using multiple data platforms and tools (e.g. Airflow, Hive, Kafka, Postgres, Redshift, S3, Spark, Trino, Airbyte), and experience deploying, monitoring, and maintaining at least one of them”
The ad says“Experience with at least one JVM language (we use Kotlin, but Java or Scala experience works)”
The ad says“Experience with Airflow, Luigi, Prefect, or other ETL scheduling tools”
The ad says“Experience with Airflow, Luigi, Prefect, or other ETL scheduling tools”
The ad says“You have experience provisioning and managing infrastructure with infrastructure-as-code tools (we use Terraform, but experience with similar tools like CloudFormation, Pulumi, or SaltStack is totally fine!)”
The ad says“You have experience provisioning and managing infrastructure with infrastructure-as-code tools (we use Terraform, but experience with similar tools like CloudFormation, Pulumi, or SaltStack is totally fine!)”
The ad says“Experience with at least one JVM language (we use Kotlin, but Java or Scala experience works)”
SpotHero is seeking a Senior Data Engineer to join the Data Engineering squad
This squad interacts with data consumers such as Data Science, Marketing, Engineering, and Business Analysts to provide data platform solutions that meet their day-to-day needs and long term vision
As a Senior Data Engineer, you’ll focus heavily on backend application development with a focus on building reusable infrastructure services for our stakeholders to enable them to model, store, access, process, and analyze SpotHero’s data
You’ll also design, instantiate, observe and maintain infrastructure services, both AWS-managed and open source solutions
As a Senior Data Engineer, you’ll influence the technology choices and patterns established for data-heavy workloads at SpotHero
Work with our Analytics, Data Science, Marketing and other squads to understand their data storage and processing needs
Be a hands-on contributor to the design and implementation of our data platform solutions from the infrastructure layer up to the API
Build robust pipelines that make sure data is where it needs to be, when it needs to be there in a manner that scales
Build frameworks and tools to help others design and build their own data pipelines in a self-service manner
Performance testing and engineering to ensure that our systems always scale to meet our needs
Be a key member of the team focused on hands-on contribution to the implementation and operation of our data platform
Benefits
Career game changer – A truly unique experience to work for a fast-growing startup in a role with unlimited potential for growth
Flexible PTO policy and great work/life balance – We value and support each individual team member
Annual parking stipend – we help people park!
The opportunity to collaborate with fun, innovative, and passionate people in a casual, yet highly productive atmosphere
Medical (prescription drug and paramedical coverage), Dental, Vision, Life Insurance, STD, and LTD
Up to 95% of Medical Premiums, 50% of Dental & Vision Premiums, company-sponsored Life Insurance, 401K, and generous parental leave
Preferred experience
Demonstrated experience designing and supporting technology intended to be used by other stakeholders
You are able to design and implement high-quality software in Python
Strong ability to communicate on both business and technology subjects
You have experience provisioning and managing infrastructure with infrastructure-as-code tools (we use Terraform, but experience with similar tools like CloudFormation, Pulumi, or SaltStack is totally fine!)
We care about your abilities, not how you gained them. You might demonstrate the capabilities below through any combination of relevant professional experience, experience in a research setting, formal education, self-guided learning, open source contributions, or public speaking / writing / teaching experience
Experience with Airflow, Luigi, Prefect, or other ETL scheduling tools
Experience using SQL to read and manage data
Experience designing and implementing software (pipelines, services and client libraries) that is run in Docker containers, automatically tested on a continuous integration (CI) system, and versioned in git. You have experience writing shell scripts, Makefiles, or other configuration to glue together these components
Ability to deploy containerized software in Kubernetes, or sufficient experience in similar technologies like Apache Mesos or Amazon ECS
Hands-on experience using multiple data platforms and tools (e.g. Airflow, Hive, Kafka, Postgres, Redshift, S3, Spark, Trino, Airbyte), and experience deploying, monitoring, and maintaining at least one of them
Experience using the latest AI tooling (Claude, Codex, etc.)
Experience with cloud data pipeline services like dbt Cloud, Airbyte, or Hightouch
Redshift, Presto, or other MPP database experience
Experience with at least one JVM language (we use Kotlin, but Java or Scala experience works)
Postgres, MySQL, or other RDBMS experience
Message driven or streaming architectures, such as those with Kafka, Spark, Flink
