Darian Yane 👋

Azure-certified Data Engineer with 3 years of experience delivering production-grade cloud data platforms in consulting environments. Strong expertise in Databricks and Microsoft Fabric (Spark-based processing), building scalable lakehouse solutions and high-performance data pipelines. Exposure to AI-driven solutions, supporting the development of data pipelines and infrastructure for machine learning and LLM-based use cases.Currently working as a Data Engineer at Oranga Tamariki — Ministry for Children on a fixed-term engagement, leading the redesign of Databricks pipelines using medallion architecture and scalable data models. Delivered a 70% reduction in pipeline runtime through SCD2 implementation, hash-based deduplication, and parallel processing.Proven track record working across end-to-end data solutions, including architecture, development, and optimization using Microsoft Fabric, Databricks, Azure Data Factory, Azure Synapse, Python, and SQL. Comfortable working directly with stakeholders, translating business requirements into technical solutions, and delivering reliably in Agile, cross-functional teams.