Creating an Azure SQL Database As A Federated Data Source In Azure Data Lake Analytics

In this demo I will be creating a new Azure SQL Database and I will be configuring it to serve as a federated data source in Azure Data Lake Analytics.

About Federating the data source of SQL Database in Azure Data Lake Analytics

Federating the Data Source of SQL Database in Azure Data Lake Analytics will allow us to query the database with U-SQL and to join data from the database to data which is already available in the Azure Data Lake Store which will work as a distributed storage and analytics engine.

STEPS INVOLVED

  1. Creating an Azure Storage account in Azure Portal.
  2. Upload a SQL Database to the new storage account.
  3. Creating a new SQL database in azure portal and restoring it.
  4. Configuring the data lake analytics account to query towards the database.

CREATING AN AZURE STORAGE ACCOUNT IN MICROSOFT AZURE PORTAL

Open up your Azure portal using this link.


Follow the below commands now,

New - Storage - Storage account


Fill the below fields with storage name, deployment model, account kind, performance, replication mode, storage service encryption, subscription, etc.,


Make sure you select the resource group as an existing one with the same one which you created for the Azure Data Lake Store, here its “rgdl”.


Select the location and pin to the dashboard, now click on create to create a storage account.


You can find the notification of deployment for the storage account getting deployed and created.


Now move on the Resource Group by clicking on Resource Groups on the left pane of the Microsoft Azure portal.


Click on the resource group which you selected when you created the storage account. Here its “rgdl”.


You can find the storage account added here in the resource group as shown below.


Now you need to create a container in the storage account to upload the database, click on Blobs under your storage account as shown below.


Click on the Container to create a new container.


Enter the name for the container as bacpacs as shown below to create a new blob container. Click on Create now.


Once after the container is created click on the container name “bacpacs” to open it.


Click on Upload here.


Click on Open button and select the file with academics-stackexchange-users.bacpac to upload the file to the container.  


Once after the Uploading button is completed return for the container pane and here you can find the file uploaded.


KEYNOTES IN SHORT

  1. Creating a Storage Account.
  2. Creating Blob for the Container
  3. Creating a Container
  4. Uploading the file into the Container

Keep following my articles for working on the topics of uploading a SQL Database to the new storage account, creating a new SQL database in Azure portal and restoring it, and configuring the data lake analytics account to query towards the database.