Databricks Runtime 17 is set to make some Pandas users happy.
While I’m certainly not the biggest fan of Pandas, some Databricks users will be excited to learn that Runtime 17 comes with Pandas 2.2.3 preinstalled. This update is long overdue, as Runtime 16 was still on version 1.5.3.
Perhaps it is time to remove the custom PyPI installation from your cluster and save some time during cluster startup.
