Android: Cannot use app links to redirect back to the app

I am trying to implement an auth flow where the users logins via Custom Tab and then redirected back to the app with an app-link (https), but the redirect is still handled by the tab. If I select 'Open In Chrome' button from the menu, then app links works correctly. Is there anyway to avoid/fix that? 

Thank you in advance