A Serverless Spark Application with a Ceiling on Every Run and Logs in Your Bucket

An OCI Data Flow application that runs Spark from a file in Object Storage with the driver and executor shapes you size, logs to a bucket you own (required, or the output is lost with the run), reaches your VCN through a Data Flow private endpoint when you give one, stops a run after the ceiling you set and an idle session after thirty minutes, and terminates runs when deleted.

This is the operations reference: version drift, dependants and neighbours. For what the module provisions, its inputs and outputs, and how to buy it, see the catalogue entry.

terraformOracle CloudDatabasesv1.0.0static-validated

Provider drift

This artifact declares no Terraform provider requirements, so there is nothing to drift. Provider freshness applies to Terraform and OpenTofu modules.

What depends on this

No reference architecture names this module, so changing it affects only configurations that reference it directly.

Nearest alternatives

Same cloud, same category. These are what you would weigh against it without changing provider.

A Cache Cluster with Replicas, Behind an NSG A Data Integration Workspace on Your VCN so Pipelines Reach Private Databases A GoldenGate Deployment that Is Private, Backed Up and Patched A NoSQL Table that Is Not Reclaimed Behind Your Back A PostgreSQL that Keeps Its Password in the Vault and Its Backups An Analytics Instance on a Private Endpoint that Announces Maintenance An OpenSearch Cluster that Authenticates and Has a Quorum Autonomous Database (Serverless)

The same job on other clouds

Managed Spark on other providers. Useful when the cloud is still open, or when you are pricing a second one. How far a comparison like that can be trusted is covered in comparing clouds.

A Databricks Workspace in Your VNet with No Public IPsAzure A Spark Application that Runs Inside Your VPCAWS An EMR Cluster Whose Master Is Not on the Internet, Which the API Default IsTencent Cloud An EMR Cluster with Kerberos On, Which security_mode NORMAL Quietly Is NotAlibaba Cloud An HDInsight Spark Cluster Behind a Private Link with No Storage Key in StateAzure An MRS Cluster in Safe Mode, with a Key Pair and Logs That Survive a Failed BuildHuawei Cloud Dataproc Single-Node ClusterGoogle Cloud

Installing it

module "oci_data_flow" {
  source  = "www.iac-bazaar.com/iac-bazaar/oci-data-flow/oci"
  version = "1.0.0"
}

A registry token is required for the download itself. Installing through the registry protocol has the two credential steps.