Error getting OAuth token from AAD for AppPrincipalId

I am creating HDInsight using Data Lake Store using a service principal via template deployment (wrapper script).

While running the deployment script after creating the Spark HDInsight cluster, I got the following error:

Mistake:

At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-debug for usage details. {
  "status": "Failed",
  "error": {
    "code": "ResourceDeploymentFailure",
    "message": "The resource operation completed with terminal provisioning state 'Failed'.",
    "details": [
      {
        "code": "InvalidDocumentErrorCode",
        "message": "DeploymentDocument 'AmbariConfiguration_x_x' failed the validation. Error: 'Error while getting access to the datalake storage account hdiclusterdls: Error while getting the OAuth token from AAD for AppPrincipalId xxxxxx-xxxxxx-xxxxxx-xxxxxx-xxxxxx, ResourceUri https://management.core.windows.net/, AADTenantId https://login.windows.net/xxxxxx-xxxxxx-xxxxxx-xxxxxx-xxxxxx, ClientCertificateThumbprint xxxxxx-xxxxxx-xxxxxx-xxxxxx-xxxxxx.'"
      }
    ]
  }
}  Correlation ID: xxxxxx-xxxxxx-xxxxxx-xxxxxx-xxxxxx

      

        
        
        
      

    

I am guessing there is some problem between HDInsight and Data Lake integration using Service Principal authentication.

Any help is greatly appreciated.