Bug description
My users were reporting that dashboards were taking a long time to load. It seems that for each SQL query, Superset open a new SSH connection. That can be quite costly and can even trigger rate-limiting or rejection from the ssh server.
I added a side-car container using autossh to my setup, removed tunneling from the database connection parameters and pointed the database connections to that container instead of the actual database. My "cache warmup" periodic task went from 10 minutes to 3 minutes and users report a day-and-night difference. In addition, the logs are much more readable now :)
Could the tunneling implementation be improved by pooling the ssh connection across requests?
(I'm using Superset 5.0.0 but I mentioned Superset 6.0.0 in the bug details because that was the closest available option)
Screenshots/recordings
No response
Superset version
6.0.0
Python version
I don't know
Node version
I don't know
Browser
Not applicable
Additional context
No response
Checklist
Bug description
My users were reporting that dashboards were taking a long time to load. It seems that for each SQL query, Superset open a new SSH connection. That can be quite costly and can even trigger rate-limiting or rejection from the ssh server.
I added a side-car container using autossh to my setup, removed tunneling from the database connection parameters and pointed the database connections to that container instead of the actual database. My "cache warmup" periodic task went from 10 minutes to 3 minutes and users report a day-and-night difference. In addition, the logs are much more readable now :)
Could the tunneling implementation be improved by pooling the ssh connection across requests?
(I'm using Superset 5.0.0 but I mentioned Superset 6.0.0 in the bug details because that was the closest available option)
Screenshots/recordings
No response
Superset version
6.0.0
Python version
I don't know
Node version
I don't know
Browser
Not applicable
Additional context
No response
Checklist