When having a service with a dependency to fos_oauth_server.client_manager, the connection to the database is established. I worked around it be marking the fos_oauth_server.client_manager lazy=true.
If that's a valid solution to you, I will send a PR, otherwise please tell me what to do?