django-allauth with keycloak error in callback

Question

I followed a tutorial and configured django-allauth to use keycloak. I can goto http://localhost:8000/accounts/login/ and click on keycloak link and login. However after login I am getting directed here http://localhost:8000/accounts/keycloak/login/callback/?state=BHsAgXJIwUPA&session_state=4f604dd6-6fc6-466f-a337-bd1638dfe3ba&code=9b8e5c15-cc74-4710-965c-23c5284ee80a.4f604dd6-6fc6-466f-a337-bd1638dfe3ba.7b02b8f1-ed96-4d71-adfd-c01da3ec13fb and getting

{'provider': 'keycloak', 'code': 'unknown', 'exception': ConnectionError(MaxRetryError("HTTPConnectionPool(host='localhost', port=8081): Max retries exceeded with url: /auth/realms/sarwa/protocol/openid-connect/token (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f8a4472d860>: Failed to establish a new connection: [Errno 111] Connection refused',))",),)}

Any help as to what I am doing wrong would be appreciated