Synapse & PBI Together!
Not being a data engineering expert (and with minimal coding skills), in his Azure Synapse + PBI sessions, Rishi demonstrates how to leverage the power of Azure for running large, complex data transformation/shaping activities with a focus on UI-based tools (e.g Synapse pipelines/Mapping Data Flows) rather than scripting. In this way, it is possible to leverage the spark engine for transformations, and to have CSV/parquet outputs stored in delta-lake format in order to achieve a “data warehouse style” data lake! Rishi shows the example of working with the NYC Taxi dataset which has over 2 billion rows and brings it into a performant and insightful-driven Power BI data model /report using Enterprise Power BI features such as aggregations and data marts.
UK Power BI User Group - Querying large datasets at scale with Power BI and Synapse With Rishi Sapra
​
​
This session will take a 2.4 billion row dataset on New York City taxis and look at how to build a complete end-to-end solution using Azure Synapse and Power BI. We will cover everything from designing an data model with an aggregated fact table, ingesting data from Azure SQL DW into a Delta lakehouse in Azure Synapse as well as Datamarts, Aggregations and visual interactions in Power BI! Rishi will show key concepts for working with large data volumes such as seamlessly combining Import and Direct Query mode within the same Power BI data model in order to optimise performance. Attendees should have some experience in working with large datasets already and a familiarity of dataflows and database technologies.
Data Taboggan - Querying large datasets at scale with Power BI and Synapse
​
​
This session will take a 2.4 billion row dataset on New York City taxis and look at how to build a complete end-to-end solution using Azure Synapse and Power BI. We will cover everything from designing an data model with an aggregated fact table, ingesting data from Azure SQL DW into a Delta lakehouse in Azure Synapse as well as Datamarts, Aggregations and visual interactions in Power BI! Rishi will show key concepts for working with large data volumes such as seamlessly combining Import and Direct Query mode within the same Power BI data model in order to optimise performance. Attendees should have some experience in working with large datasets already and a familiarity of dataflows and database technologies.
Downloadable
Presentation Slides