An Apache Spark-based analytics platform optimized for Azure.
Hi Lalit Patil,
it sounds like you’ve already filed a quota increase for your Standard_DDs_v5, Standard_DDs4, and Standard_Dv5 families in West Europe but you’re still hitting a “quota exceeded” error when you start a cluster. Usually that means one of two things is still blocking you:
- You’re bumping into the Total Regional vCPU quota (not just the family‐level quota).
- The family‐level quota increase hasn’t fully propagated or the wrong quota type was requested.
Here’s a quick checklist to help track it down:
- Identify exactly which quota is being hit • Copy the full error text – does it say “Total Regional Cores quota” or “Standard_DDv5 Family Cores quota”? • If it’s “Total Regional Cores,” you need to bump the regional limit, not just the D-series family.
- Double-check your quotas in the portal • In the Azure portal, go to Subscriptions → Usage + quotas → Filter by Region = West Europe → Category = Compute. • Verify both of these limits: – Total Regional vCPUs – Standard_DDs_v5 (and any other VM family you use) • Look at current usage vs current limit to confirm that your requested increase is actually above the usage.
- Ensure the change has propagated • Quota increases can take up to 30 minutes or more to fully apply. • Sign out/in or refresh the portal to make sure you’re seeing the updated limits.
- Check SKU availability/capacity • Sometimes a SKU is “not available in location” due to capacity constraints, and you’ll see a SkuNotAvailable error rather than a quota error. • You can try a sibling SKU (for example Standard_D4s_v5 instead of Standard_DDv5) or spin up an instance pool with smaller VMs.
- If you’re on a pay-as-you-go (individual) subscription • Make sure you selected “Service and subscription limits (quotas)” and the correct subscription when you filed the request. • If everything looks correct but the increase isn’t taking hold, you’ll need to open an Azure support case so the support team can validate and manually push the increase through.
Hope this helps you narrow it down! If you still can’t get the cluster up, let me know:
– The exact error message you’re seeing
– Screenshots (or values) of your Total Regional vCPUs and Standard_DDs_v5 limits vs usage
– Whether you waited at least 30 minutes after the quota increase and then refreshed the portal
– The SKU families you actually selected on the cluster config page
Reference docs
– How to view and monitor quotas in Azure: https://learn.microsoft.com/azure/quotas/view-quotas
– Request a regional vCPU quota increase: https://learn.microsoft.com/azure/quotas/regional-quota-requests#request-an-increase-for-regional-vcpu-quotas
– Request a VM-family vCPU quota increase: https://learn.microsoft.com/azure/quotas/per-vm-quota-requests#request-an-increase-for-adjustable-quotas
– Troubleshoot cores quota errors for Databricks: https://learn.microsoft.com/azure/databricks/kb/clusters/quota-errors