-
Notifications
You must be signed in to change notification settings - Fork 125
Description
Request to add support for passing sysctl param values, equivalent to:
https://docs.docker.com/reference/cli/docker/container/run/#sysctl
We have the need to pass keep_alive related parameters to the running container:
net.ipv4.tcp_keepalive_time
net.ipv4.tcp_keepalive_intvl
net.ipv4.tcp_keepalive_probes
This is necessary because, on Azure Databricks, the associated Azure networking resources used by the underlying Azure VM have very short idle timeouts (4 minutes), that silently drop TCP connections. This causes scripts invoked by databricks workflows to not be able to maintain tcp connections (for example external odbc queries) that exceed 4 minutes. Enabling the options would allow OS level keep-alive packets to be sent to maintain the connection.
Thanks.