Episode 516 - Digital Intelligence Architecture

In this episode, Sujit D'Mello and Cynthia Kreng are joined by special guest Mike Becker, an Azure Architect at Microsoft, to discuss how various Azure services can be combined to create a complex solution. Sujit covers the latest enhancements in AKS, including Azure CNI, load balancer support, network isolated clusters, cost recommendations, and GPU driver options. Mike shares insights into a comprehensive Azure cloud solution for collecting and analyzing economic data and media feedback about companies, highlighting the use of Azure Data Factory, Databricks, Power BI, and OpenAI for sentiment analysis. The discussion delves into the architectural decisions, technical challenges, and practical applications of these technologies in delivering robust and secure solutions.

Media file: https://azpodcast.blob.core.windows.net/episodes/Episode516.mp3

YouTube: https://youtu.be/wG12eJymh54

Resources:

ADF how it works
https://learn.microsoft.com/en-us/azure/data-factory/introduction#how-does-it-work
Azure Data Factory- Best Practices
https://learn.microsoft.com/en-us/answers/questions/1283307/azure-data-factory-best-practices
Azure Data Bricks Medallion architecture
https://learn.microsoft.com/en-us/azure/databricks/lakehouse/medallion
Azure Data Bricks Best Practices
https://dzone.com/articles/azure-databricks-best-practices-for-a-developer
Sentiment Analysis with Azure AI services
https://learn.microsoft.com/en-us/azure/synapse-analytics/machine-learning/tutorial-cognitive-services-sentiment
Power BI recommendations
https://community.fabric.microsoft.com/t5/Desktop/Power-BI-Development-and-Best-Practices/m-p/4632985/highlight/true#M1386307
Improve Power BI model's performance
https://powerbi.microsoft.com/en-us/blog/best-practice-rules-to-improve-your-models-performance/
GitLab best practices - if you cannot use Azure DevOps
https://about.gitlab.com/topics/version-control/what-are-gitlab-flow-best-practices/