Language servers installed using Mason don't work unless specifically mentioned in user.lua.lsp.mason `servers` variable

I'm having this weird issue with Mason. When I download a language server using :Mason, i does not work at all. I need to go into configuration and add it to the `servers` variable in `user.lua.lsp.mason` for it to work. I think there were probably some breaking changes, since this config has been updated in July the last time. Dont know how to fix though, please help.