An HDInsight Spark Cluster Behind a Private Link with No Storage Key in State

An HDInsight Spark cluster in your virtual network, reached over a private link, on ADLS Gen2 through a user-assigned identity so no storage key sits in state, with encryption in transit and TLS 1.2 on the gateway. There is no scale-to-zero: nodes_at_rest says what bills when the cluster idles. An external Hive metastore makes the cluster disposable; the public gateway is accepted by name.

This is the operations reference: version drift, dependants and neighbours. For what the module provisions, its inputs and outputs, and how to buy it, see the catalogue entry.

terraformAzureDatabasesv1.0.0static-validated

Provider drift

This artifact declares no Terraform provider requirements, so there is nothing to drift. Provider freshness applies to Terraform and OpenTofu modules.

What depends on this

No reference architecture names this module, so changing it affects only configurations that reference it directly.

Nearest alternatives

Same cloud, same category. These are what you would weigh against it without changing provider.

A Databricks Workspace in Your VNet with No Public IPs A Kusto Cluster with an SLA, Off the Internet, Encrypted Twice A Managed Instance that Is Entra-Only, Private and Zone-Redundant A Search Service with an SLA, Reached by Identity A Synapse Workspace with No SQL Login, a Managed Network and a Dedicated Pool Audited Azure Cache for Redis Azure Cosmos DB Account Azure SQL Database

The same job on other clouds

Managed Spark on other providers. Useful when the cloud is still open, or when you are pricing a second one. How far a comparison like that can be trusted is covered in comparing clouds.

A Spark Application that Runs Inside Your VPCAWS Dataproc Single-Node ClusterGoogle Cloud

Installing it

module "azure_hdinsight_spark" {
  source  = "www.iac-bazaar.com/iac-bazaar/azure-hdinsight-spark/azure"
  version = "1.0.0"
}

A registry token is required for the download itself. Installing through the registry protocol has the two credential steps.