Using Data Lake Analytics Linked Service Service Principal Authentication in Data Factory

Question

Trying to add a compute node to ADF (v1), using Azure Data Lake Analytics Linked Service to make some simple u-sql jobs. Data Lake Store Linked Service is already in place and working with service principle authentication, but I can't deploy ADLA linked service with servicePrincipalId and Key.

As per this article, ADLA Linked Service supports service principle authentication for some time now: https://docs.microsoft.com/en-us/azure/data-factory/v1/data-factory-usql-activity#azure-data-lake-analytics-linked-service

The intellisense tells me the parameters are not valid and insists on user credential. Here's a screenshot:

ADF Portal Editor ADLA-ls

(Same warnings in visual studio data factory project btw.)

When I deploy with SPN anyway, I get the error "Entity provisioning failed: Internal Server Error".

Anyone successfully use service principle auth with ADLA linked service?

I have the same issue. SP auth is only accepted for data lake storage in ADFv1. I currently have an open support ticket with Microsoft about it. — Paul Andrew
@PaulAndrew, are you using User Credential auth in the meantime, or do you have any different workaround? — grayincarnation

Simon Zeinstra Simon Zeinstra · Accepted Answer · 2018-01-08T15:07:02

It works for me using the following settings:

{
  "name": "datalakeanalyticsinstanceLinkedService",
  "properties": {
    "type": "AzureDataLakeAnalytics",
    "typeProperties": {
      "accountName": "datalakeanalyticsinstance",
      "servicePrincipalId": "xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxx",
      "servicePrincipalKey": "abcdefghijklmopqrstuvwxyz123456780",
      "tenant": "mytenant.onmicrosoft.com"
    }
  }
}

Also make sure you've run the "Add User Wizard" from Data Lake Analytics. Using this wizard I added the service principal as an Owner with R+W permissions.

Edit: This blog post was just published with many details on Serivce Principal authentication

Using Data Lake Analytics Linked Service Service Principal Authentication in Data Factory

2 Answers