Everyone's talking about data Lakehouses but what is a Lakehouse other than a nice place to go fishing? Why do you need to know about the lakehouse architecture, whats the benefits and is it all just hype?
In this session I'll cover what the Data Lakehouse architecture is, where it fits against existing architectures like a data warehouse, and why you should build one. We'll also cover the underlying technology options to arm you with all of the information you need to plan your next data platform.
- SQLBits 2023
Building your data platform in the cloud is easy, but as soon as that dreaded word "security" becomes involved it suddenly becomes incredibly painful. How do you go about integrating it with your existing networking, how do you manage user security, what on earth is a private endpoint? Over the past year, a lot of these tools have evolved and we now have a set of mature patterns we can apply to actually make a modern data platform secure.
In this session I'll guide you from through a secure reference architecture with Data Factory, Databricks, Data Lake, and Azure Synapse, working together as a secure, fully productionised platform. Each has their own idiosyncrasies, but this session will teach you the options available and the pitfalls to avoid.
- Data Grillen 2022
- Data Relay 2022
- SQLBits 2023
In this session we'll look at the process, prerequisites, and pitfalls of setting up a continuous deployment pipeline for Azure Synapse. In this demo-heavy session we'll set up a YAML pipeline using Azure DevOps to deploy Azure Synapse workspace resources through a development lifecycle.
- Data Toboggan
- DataMinds Connect 2022
- Data Saturday Denmark 2023
How do we handle the edge cases, the unique or temporary solutions to get data from emails, file shares, FTP, someone's desktop etc? We need DIY ETL when the easy data sources don't exist, and the usual methods won't work. In this session, we'll take 3 scenarios, solve them and make them reliable, and repeatable, with tools like Power Automate, Azure functions and more.
- SQL Saturday Vienna 2021
Get the most out of your Reporting Services (SSRS) environments with this arsenal of PowerShell, SQL and admin tools. You'll leave this session knowing and controlling more about your SSRS environments than you thought possible covering monitoring, security, administration and deployment.
- DATA:Scotland 2019
People love creating content in Power BI but how do we track changes or backup all these new reports? We’ll look at 3 different ways to bring your reports under source control and how to automate the process using Microsoft Flow and PowerShell.
- 3 May 2019 - Scotland Power BI User Group, Edinburgh
- 13 June 2019 - Glasgow SQL User Group
- 21 June 2019 - Data Grillen, Lingen, Germany
Power BI is the shiny new tech for processing and visualizing data in the Microsoft Data Platform. However, the plumbing in the background does need managing (even if it is cloud-based and supposedly automagic).
In this session we will take a look at how to manage your datasets, security, monitor licensing and more, all through the ultimate administration interface: PowerShell!
You'll leave the session with an overview of the management capabilities of Power BI and couple that knowledge with the awesome power (and automation possibilities) of PowerShell
- 25 July 2018 - Cardiff MSFT Stack User Group
- 08 Oct 2018 - DataRelay Newcastle
- 09 Oct 2018 - DataRelay Leeds
- 2 Nov 2018 - Scotland Power BI User Group
- 1 Mar 2019 - SQLBits, Manchester
- 29 June 2019 - SQL Saturday Cork, Ireland
There’s the quick way or there’s the right way. In this session we will look at good practices and standards to follow when writing PowerShell to make it easier for you and others to trust and reuse your code By the end of this session you’ll have a guide to being a better PowerShell citizen, following best practices and sharing your code with others. Become a member of the PowerShell Standards Agency* (Not a real thing) and write better code for Everybody
- 30 May 2018 - Scottish PowerShell & DevOps User Group, Glasgow
- 22 June 2018 - SQL Grillen, Lingen, Germany
- 25 July 2018 - Microsoft Stack User Group, Cardiff, Wales
- 23 August 2018 - Austin Texas User Group, Texas (YouTube)
- 20 Sept 2018 - DevOps North East User Group
- Full resources can be found on my co-presenter's GitHub: The PowerShell Standards Agency
- 28 Nov 2017 - Scottish PowerShell & DevOps User Group