Gayashan Amarasinghe

I am a Data Technical Lead at an Australian gentailer, an energy retailer and generator, and a data engineer at the core. I have spent three years there building and running the data platform. The work runs from ingestion of raw market data through to the reporting and forecasting that trading, finance, and executive stakeholders depend on.

I lead a small team and set the pipeline design and data modelling patterns we build against. Most of my time still goes into designing and building pipelines on Databricks and Delta Lake, and I stay close to the code. I am the in-house subject matter expert for AEMO market data (MMS), MSATS, and PDR, and I handled our migration off SQL Server.

I came to this from a PhD in distributed systems at The University of Melbourne, and before that more than half a decade lecturing at the University of Moratuwa in Sri Lanka. I started out as a Java engineer at WSO2 working on the Carbon Kernel. The teaching years left me comfortable explaining complex, regulated data to technical teams and senior decision makers alike.

I have a personal interest in how data adds commercial value. NEM Constraints, a personal project working with AEMO market data, is where I explored that.

Skills:

• Energy market domain: AEMO NEM market data (MMS), MSATS, PDR, NEM constraints
• Languages and data: Python, SQL, PySpark, Java, C++, Bash, Apache Spark, pandas, NoSQL
• Platforms and tooling: Databricks, Delta Lake, Azure Data Factory, Databricks Workflows
• Automation and AI: ELT/ETL pipeline automation, AI-assisted development (Claude Code, Databricks Genie)
• Ways of working: Data migration and integration, microservices, RESTful APIs, Agile/Scrum, TDD

Away from the keyboard I ride bikes (road, gravel, and cross country) and read science fiction and biographies. I am also the garden automator and fixer behind my wife’s gardening passion.