Azure Friday (Audio)

Thomas Alex joins Lara Rubbelke to discuss how Microsoft uses Apache Kafka for HDInsight to power Siphon, a data ingestion service for internal use. Apache Kafka for HDInsight is an enterprise-grade, open-source, streaming ingestion service. Microsoft created Siphon as a highly available and reliable service to ingest massive amounts of data for processing in near real time. Siphon handles ingesti...

Anubhav Mishra (Developer Advocate, HashiCorp), joins Scott Hanselman to discuss how to use HashiCorp Terraform to create & manage Kubernetes clusters in Azure using Azure Kubernetes Service (AKS). Mishra further explains the benefits of using Terraform to provision Azure infrastructure and demonstrates how to configure a Kubernetes cluster on AKS.Jump To: [01:52] Demo Start For more informati...

Gaurav Malhotra joins Lara Rubbelke to discuss how you can operationalize Jars and Python scripts running on Azure Databricks as an activity step in a Data Factory pipeline. Jump To: [01:55] Demo Start For more information:Transform data by running a Jar activity in Azure Databricks docsTransform data by running a Python activity in Azure Databricks docsAzure Databricks overviewAzure Data Factory...

Murali Krishnaprasad joins Lara Rubbelke to discuss Interactive Query (also called Hive LLAP, or Low Latency Analytical Processing, or Live Long and Process), which is an Azure HDInsight cluster type. Interactive Query supports in-memory caching, which makes Hive queries super-fast and interactive. See how to use HDInsight Interactive Query to analyze extremely large datasets (~100TB) in common fi...

Kylie Liang joins Lara Rubbelke to demo how to use Ansible, an open-source, simple IT automation engine for automating cloud provisioning, configuration management and application deployments on Azure. Kylie also shares the roadmap for Ansible on Azure. Jump To:[00:15]  Demo Start For more information:Ansible in Azure Documentation (docs)Ansible Playbook Samples for Azure (GitHub)Ansible modules (...

Jean-Sébastien Brunner joins Lara Rubbelke to discuss new features that enable you to implement the intelligent cloud, intelligent edge vision for streaming analytics: Stream Analytics running real-time analytics with custom code on IoT Edge. We also discuss substreams, which is a new time management feature for independently processing the timeline of each device (very useful for an IoT scenario)...

Steve Lasker joins Lara Rubbelke to discuss ACR Build, a cloud-native container build solution enabling pre-check, git commit and base image update docker builds for OS and framework patching.  Jump To:[03:18] Demo Start For more information:  Automate OS and framework patching with ACR Build (docs)Demo 42 sample (GitHub)Azure Container Registry (product info)Azure Container Registry (pricing)Azur...

Gaurav Malhotra joins Scott Hanselman to discuss Event-driven architecture (EDA), which is a common data integration pattern that involves production, detection, consumption, and reaction to events. Learn how you can do event-based data integration using Azure Data Factory. Jump To:[01:53] Demo Start For more information:Event trigger-based data integration with Azure Data Factory (blog post)Creat...

Justin Luk joins Scott Hanselman to show the new Azure Cloud Shell editor. Since its launch, Cloud Shell included a variety of editors (vi, emacs, and nano) for editing files. In collaboration with the Visual Studio Code team and their open-source Monaco project, the same web standards-based editor that powers Visual Studio Code is now integrated directly into Cloud Shell. Jump To:[02:05] Demo Sta...

Chacko Daniel joins Scott Hanselman to discuss Azure Service Fabric Mesh, which offers the same reliability, mission-critical performance and scale customers get with Service Fabric, but no more overhead of cluster management and patching operations. Service Fabric Mesh supports both Windows and Linux containers allowing you to develop with any programming language and framework of your choice. Ju...

Yashesvi Sharma joins Scott Hanselman to discuss how to significantly reduce costs up to 72 percent compared to pay-as-you-go prices with one-year or three-year terms on Windows and Linux virtual machines (VMs). When you combine the cost savings gained from Azure RIs with the added value of the Azure Hybrid Benefit, you can save even more. Jump To:[04:59] Demo Start For more information:Prepay for...

Xiaokai He joins Scott Hanselman to discuss Azure SignalR Service. See how easy it is to start building your real-time web application without setting up your own SignalR server. Jump To: [01:05] Demo Start For more information, see:Azure SignalR Service product pageAzure SignalR samples (GitHub)ASP.NET SignalRWhat is Azure SignalR Service (docs)Azure SignalR Service pricingCreate a free account (...

Kiran Madnani chats with Scott Hanselman about Azure Monitor, where you can set up alerts to monitor the metrics and log data for the entire stack across your infrastructure, application, and Azure platform. Learn about the next generation of alerts in Azure, which provides a new consolidated alerts experience in Azure Monitor. Plus, new metrics-based alerts platform that is faster and leveraged b...

Byron Tardif joins Scott Hanselman to discuss Azure App Service Web Apps, the best way to build and host web applications in the programming language of your choice without managing infrastructure. It offers auto-scaling and high availability, supports both Windows and Linux, and enables automated deployments from GitHub, Visual Studio Team Services, or any Git repo. Jump To:[01:45] Demo #1 [09:10...

Arturo Lucatero joins Donovan Brown to discuss Azure AD Managed Service Identity, which can be used to authenticate to any service that supports Azure AD authentication. For more information, see:What is Managed Service Identity (MSI) for Azure resources? (docs)Create a free account (Azure)Follow @donovanbrown Follow @AzureFriday Follow @ArLucaID

James Baker joins Lara Rubbelke to introduce Azure Data Lake Storage Gen2, which is redefining cloud storage for big data analytics due to multi-modal (object store and file system) access and combining the best qualities of a dedicated analytics file system with those of a cloud-scale object store. For more information:Introduction to Azure Data Lake Storage Gen2 Preview (docs)Azure Data Lake Sto...

Vinod Kurpad joins Lara Rubbelke to discuss how Azure Cost Management APIs provide critical cost management features like budgets and data APIs to enable granular analysis of your cloud spending. In this episode, you'll see how to control what happens in your subscription when you reach budget limits you define using the Azure Budgets API with Action Groups in Azure Monitor.[05:30] - Azure Budgets...

Kit Merker, VP of Business Development at JFrog shows how you can easily build and release software using popular DevOps tools including Git, Jenkins, Artifactory, and Azure Kubernetes Service (AKS). JFrog Artifactory is a universal package management binary repository that enables DevOps teams to go seamlessly from Code to Cloud, and support your build, push, and deployment to AKS. You'll also le...

Aaron and Scott check out the latest extensions for Azure CLI. Azure CLI Extensions provide new, exciting features, and the Alias Extension is the first of many user-centric extensions that make Azure automation simple and easy. For more information, see:Azure CLI DocsCreate a free account (Azure)Follow @SHanselman Follow @AzureFriday Follow @twitchax

Aaron and Scott check out the latest updates in Azure PowerShell, from simplified scenarios to -AsJob backgrounding support. This new functionality is now available on Mac, Linux, and Windows with PowerShell Core 6.For more information:Azure PowerShell docsCreate a free account (Azure)Follow @SHanselman Follow @AzureFriday Follow @twitchax

Peter Pogorski chats with Scott Hanselman about building Service Fabric applications with the Service Fabric for VS Code extension. This episode introduces the process of creating and debugging Service Fabric applications with the new Service Fabric extension for VS Code. The extension enables you to create, build, and deploy Service Fabric applications (e.g., C#, Java, Containers, and Guests) to...

Brendan Burns joins Lara Rubbelke to discuss GA of Azure Kubernetes Service (AKS). Developers can drastically simplify how they build and run container-based solutions without deep Kubernetes expertise. For more information:Quickstart: Deploy an Azure Kubernetes Service (AKS) clusterAzure Container Hackfest repo on GitHubSample: BikeSharing360Node repo on GitHubAzure Kubernetes Service (AKS) produ...

Shrirang Shirodkar joins Donovan Brown to discuss what's new in App Service for Java developers. You'll see how Java developers can build web apps for Linux without having to deal with custom Docker containers (i.e., how to use the Tomcat Docker containers provided out of the box). How to use the new deployment mechanism in Kudu - 'wardeploy' (for Linux and Windows both). You'll learn what are the...

Jayanta Mondal stops by to chat with Scott Hanselman about Gremlin, the traversal query language for Cosmos DB graph. Gremlin being a dataflow language and procedural is nature, writing efficient Gremlin queries requires the knowledge of graph structure and the query execution plan. Learn how to structure a Gremlin query, and what are the best practices, and tips & tricks to get the best perfo...

Carey MacDonald stops by to chat with Scott Hanselman about Azure Cosmos DB, a managed database service with unlimited horizontal scale, allowing you to scale storage and throughput independently. In this video, Carey will cover how to partition your data in Azure Cosmos DB, best practices for choosing a partition key, and how to troubleshoot bad partition key choices. For more information, see:Az...