The Blueprint Lakehouse Monitor enables you to dive deeper into the usage of your Azure Databricks environment and perform advanced analysis of cost, telemetry and usage metrics from a centralized location. The tool gives granular and continuous visibility into your clusters, jobs and notebooks, providing key insights that will allow your team to maximize utilization of your analytics platform to best serve your company.
The Blueprint Lakehouse Monitor incorporates the deep experience of our team and leverages advanced analytics to increase cost transparency and enhance performance of your Azure Databricks environment. This is accomplished by consolidating all available consumption data, spark metrics and operating system-level data. The tool tracks Azure Databricks job-level metrics and leverages pattern-based analysis to alert you to outliers and optimization opportunities. This is enabled by a data enrichment process for the data across these internal platform data sources.
If you prefer to explore the data yourself, we have you covered. The comprehensive set of metadata that the Blueprint Lakehouse Monitor unveils is available in an easy-to-access structure that can be analyzed through your tool of choice. Our team has included a Power BI template for download from within the tool to accelerate the process.
The Blueprint Lakehouse Monitor is primarily deployed as cloud based application into your Azure tenant. You can learn more about the Azure deployment here.
An alternative approach is an Azure VM based deployment. You can learn more about the Azure VM deployment here.
The Azure security requirements used in the deployment approach is available here.