[IT] SOFTWARE ENGINEER - DATA | JUNIOR / MID

The Data Engineering team is developing the backbone of *** solutions. To do this, the team is using cutting-edge technologies and frameworks such as BigQuery, Spanner, Bigtable, Dataprocto process and analyze data, to help create the pipelines required to handle millions of events daily, and collaborate with the data science team to enable the innovative work inmachine learning and AIto be utilized in our production environment.

• Contribute to the development of *** Micro Batch/Real Time streaming pipelines (lambda architecture)
• Work closely with the engineering team on data preprocessing and data structure
• Collaborate with key stakeholders to drive the architecture strategies
• Participate in architecture reviews
• Maintain a culture of innovation, in an environment that requires high levels of scalability, security, and reliability

• BA/BS or MS degree in Computer Science preferred, or equivalent work experience
• Understanding of distributed data systems
• Previous experience with Java and Scala
• Previous experience working with big data tools such as Bigtable, Apache Spark, Apache Spark Streaming, Apache Heron, BigQuery
• Preferred: Google Cloud, Kubernetes
• Experience running production Golang systems, Infrastructure background, Low Latency / High Throughput Architectural System Designs
• Strong interest in data engineering
• Eagerness to learn new technologies on the fly and ship to production
• Knowledge in data science is a plus
• Experience working on diverse teams a plus

*** is proud to be an equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status.

Originally posted on Himalayas