Data Engineer- Silver Conversions and Scheduling

PLATO is Canada’s largest Indigenous-owned software testing and technology services company. For nearly 30 years, our expert teams have helped our clients deliver reliable products that users enjoy interacting with.

Our 100% Canada‑based team brings deep experience in QA, software testing, and IT services, along with a shared commitment to collaboration, mentorship, and continuous improvement. We’re a team that shows up for each other, whether that’s tackling complex client challenges or helping colleagues grow through coaching and knowledge‑sharing.

As Canada’s largest Indigenous‑owned software testing company, we’re proud of our roots and our mission to build a stronger, more inclusive technology workforce. At the same time, we warmly welcome applicants of all backgrounds and experiences who are passionate about quality, teamwork, and making an impact.

The Data Engineer will build Silver layer conversion and scheduling pipelines in the medallion Lakehouse on Microsoft Fabric. They will transform Bronze data into cleansed, conformed Silver datasets and orchestrate their execution reliably.

Develop Silver layer conversion and transformation pipelines using Microsoft Fabric, Azure Data Factory, Spark and Delta Lake

Build and maintain scheduling and orchestration of Silver pipelines, including dependencies, retries and failure handling

Use reusable PySpark libraries and metadata-driven configuration to speed up delivery

Apply standard error handling, logging, monitoring and unit-testing patterns

Support reconciliation, checkpointing, replay and recovery to maintain data integrity

Tune Spark workloads for performance and cost efficiency

Must have a minimum of 5 years of experience with the following:

Microsoft Fabric (Data Factory, Lakehouse), PySpark, Spark SQL, Delta Lake, Azure Data Factory, Azure Storage

• Pipeline orchestration and scheduling (Fabric Data Factory / Azure Data Factory)
• PySpark and Spark SQL data transformation
• Microsoft Purview exposure for cataloguing and lineage

At PLATO, we believe that great work happens when people feel supported, connected, and challenged in the right ways. You’ll be part of a collaborative environment where experienced professionals share knowledge, mentor others, and contribute to solving complex, real‑world client projects.

We are committed to inclusive hiring practices and encourage applications from individuals of all backgrounds, including women, persons with disabilities, visible minorities, and Indigenous peoples. If you require accommodation at any stage of the recruitment process, we’re here to support you.

PLATO respectfully acknowledges that we operate on treaty territories, unceded First Nations and Inuit territories, and within Métis homelands. We honour the long history of these lands and actively work toward reconciliation between Indigenous and non‑Indigenous peoples on Turtle Island.

Originally posted on Himalayas