In Databricks, I don’t use spark.conf.get("spark.databricks.workspaceUrl") anymore …
at least in Notebooks that are run in Job-Tasks.
Recently, while setting up some Databricks Jobs, I discovered that you get the Workspace ID and Workspace URL as Dynamic Value References in the Job Parameters. This feature is around for some while, but I never stumbled over it. Sure, you can do spark.conf.get("spark.databricks.workspaceUrl") within your notebook, but when it comes to testing, it can be handy to pass this as a parameter you can overwrite.
How are you using these dynamic variables?
