Senior Software Engineer, Data Engineering

Job Description

The members of our Data Engineering department build systems and infrastructure for collecting, storing, and analyzing huge sets of data in batch and streaming pipelines. As a sub-team within Data Engineering, the Business Data team is responsible for the quality, content, and timely delivery of our core analytics and business intelligence data sets. We build and maintain tools to help the rest of the company find, transform, store, and visualize their data. We value curiosity, enthusiasm, responsibility and generosity of spirit.

We’re looking for a skilled engineer who cares about the data that flows through pipelines and the internal customers who will use that data. We work in Scala, Python, PHP, Java, and SQL, and we work with technologies like Hadoop, Kafka, Scalding, Airflow, Avro/Thrift, Vertica, Looker, GCS, Dataproc, and BigQuery. Experience with any of these is helpful but not required.


About the Role:

  • Our team is responsible for the daily delivery of hundreds of business-critical datasets in batch and streaming.
  • We help define, maintain, and monitor the ETLs that generate our core business analytics datasets.
  • We build and maintain internal tools for finding, querying, transforming, and visualizing data.
  • We support the company’s analytics database and work to establish best practices for users of it.

About You:

  • You understand that being an effective software engineer is about communicating with people as much as it is about writing code.
  • You are willing to work with and improve code you did not originally write.
  • You are generous with your time and experience, and can mentor other engineers.
  • You are flexible with languages and tools and are willing to learn whatever is necessary to get the job done.
  • You can take on unconstrained problems and know when to seek help.
  • You have familiarity with a few of the following: Writing and scheduling ETL pipelines, either batch or streaming. Writing SQL queries for exploration and analysis. Building and modifying full-stack internal tool web apps

This is a full-time role with options to work in our headquarters located in Brooklyn, NY.


Keep Commerce Human.

Technology we use