Fix logout route in Keycloak provider so a KeycloakostError doesn't lead to Internal Server Error in API server by dabla · Pull Request #59382 · apache/airflow

dabla · 2025-12-13T09:37:23Z

This PR is also related to issue #59359.

Problem is during the logout route defined in the Keycloak provider is that there the refresh_token is also called directly on the Keycloak client. When a KeycloakPostError is raised when the refresh token fails, the error will also be raised and this will lead to an HTTP 500 Internal Server Error in the API server.

So I extracted a refresh_token method from the refresh_user method in the KeycloakAuthManager so the refresh_token method is guarded and thus catches the KeycloakPostError, that way I can also re-use that method in the logout route so that when an exception occurs the API server doesn't return an HTTP 500 Internal Server Error.

INFO:     172.31.60.49:0 - "GET /auth/logout HTTP/1.1" 500 Internal Server Error
ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/usr/local/lib/python3.13/site-packages/uvicorn/protocols/http/httptools_impl.py", line 409, in run_asgi
    result = await app(  # type: ignore[func-returns-value]
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        self.scope, self.receive, self.send
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "/usr/local/lib/python3.13/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
    return await self.app(scope, receive, send)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.13/site-packages/fastapi/applications.py", line 1082, in __call__
    await super().__call__(scope, receive, send)
  File "/usr/local/lib/python3.13/site-packages/starlette/applications.py", line 113, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/usr/local/lib/python3.13/site-packages/starlette/middleware/errors.py", line 186, in __call__
    raise exc
  File "/usr/local/lib/python3.13/site-packages/starlette/middleware/errors.py", line 164, in __call__
    await self.app(scope, receive, _send)
  File "/usr/local/lib/python3.13/site-packages/starlette/middleware/gzip.py", line 29, in __call__
    await responder(scope, receive, send)
  File "/usr/local/lib/python3.13/site-packages/starlette/middleware/gzip.py", line 130, in __call__
    await super().__call__(scope, receive, send)
  File "/usr/local/lib/python3.13/site-packages/starlette/middleware/gzip.py", line 46, in __call__
    await self.app(scope, receive, self.send_with_compression)
  File "/usr/local/lib/python3.13/site-packages/starlette/middleware/cors.py", line 85, in __call__
    await self.app(scope, receive, send)
  File "/usr/local/lib/python3.13/site-packages/starlette/middleware/base.py", line 189, in __call__
    raise app_exc
  File "/usr/local/lib/python3.13/site-packages/starlette/middleware/base.py", line 144, in coro
    await self.app(scope, receive_or_disconnect, send_no_error)
  File "/usr/local/lib/python3.13/site-packages/starlette/middleware/exceptions.py", line 63, in __call__
    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
  File "/usr/local/lib/python3.13/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
    raise exc
  File "/usr/local/lib/python3.13/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
  File "/usr/local/lib/python3.13/site-packages/starlette/routing.py", line 716, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/usr/local/lib/python3.13/site-packages/starlette/routing.py", line 736, in app
    await route.handle(scope, receive, send)
  File "/usr/local/lib/python3.13/site-packages/starlette/routing.py", line 462, in handle
    await self.app(scope, receive, send)
  File "/usr/local/lib/python3.13/site-packages/fastapi/applications.py", line 1082, in __call__
    await super().__call__(scope, receive, send)
  File "/usr/local/lib/python3.13/site-packages/starlette/applications.py", line 113, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/usr/local/lib/python3.13/site-packages/starlette/middleware/errors.py", line 186, in __call__
    raise exc
  File "/usr/local/lib/python3.13/site-packages/starlette/middleware/errors.py", line 164, in __call__
    await self.app(scope, receive, _send)
  File "/usr/local/lib/python3.13/site-packages/starlette/middleware/exceptions.py", line 63, in __call__
    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
  File "/usr/local/lib/python3.13/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
    raise exc
  File "/usr/local/lib/python3.13/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
  File "/usr/local/lib/python3.13/site-packages/starlette/routing.py", line 716, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/usr/local/lib/python3.13/site-packages/starlette/routing.py", line 736, in app
    await route.handle(scope, receive, send)
  File "/usr/local/lib/python3.13/site-packages/starlette/routing.py", line 290, in handle
    await self.app(scope, receive, send)
  File "/usr/local/lib/python3.13/site-packages/starlette/routing.py", line 78, in app
    await wrap_app_handling_exceptions(app, request)(scope, receive, send)
  File "/usr/local/lib/python3.13/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
    raise exc
  File "/usr/local/lib/python3.13/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
  File "/usr/local/lib/python3.13/site-packages/starlette/routing.py", line 75, in app
    response = await f(request)
               ^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.13/site-packages/fastapi/routing.py", line 308, in app
    raw_response = await run_endpoint_function(
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ...<3 lines>...
    )
    ^
  File "/usr/local/lib/python3.13/site-packages/fastapi/routing.py", line 221, in run_endpoint_function
    return await run_in_threadpool(dependant.call, **values)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.13/site-packages/starlette/concurrency.py", line 38, in run_in_threadpool
    return await anyio.to_thread.run_sync(func)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.13/site-packages/anyio/to_thread.py", line 61, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        func, args, abandon_on_cancel=abandon_on_cancel, limiter=limiter
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "/usr/local/lib/python3.13/site-packages/anyio/_backends/_asyncio.py", line 2525, in run_sync_in_worker_thread
    return await future
           ^^^^^^^^^^^^
  File "/usr/local/lib/python3.13/site-packages/anyio/_backends/_asyncio.py", line 986, in run
    result = context.run(func, *args)
  File "/usr/local/lib/python3.13/site-packages/airflow/providers/keycloak/auth_manager/routes/login.py", line 91, in logout
    tokens = client.refresh_token(user.refresh_token)
  File "/usr/local/lib/python3.13/site-packages/keycloak/keycloak_openid.py", line 410, in refresh_token
    return raise_error_from_response(data_raw, KeycloakPostError)
  File "/usr/local/lib/python3.13/site-packages/keycloak/exceptions.py", line 195, in raise_error_from_response
    raise error(
    ...<3 lines>...
    )
keycloak.exceptions.KeycloakPostError: 400: b'{"error":"invalid_grant","error_description":"Token is not active"}'
2025-12-13T08:57:45.315734Z [warning  ] KeycloakPostError encountered during token refresh. Suppressing the exception and returning None. [airflow.providers.keycloak.auth_manager.keycloak_auth_manager] loc=keycloak_manager.py:37
Traceback (most recent call last):
  File "/usr/local/airflow/plugins/infrabel/auth/keycloak_manager.py", line 32, in refresh_user
    tokens = client.refresh_token(user.refresh_token)
  File "/usr/local/lib/python3.13/site-packages/keycloak/keycloak_openid.py", line 410, in refresh_token
    return raise_error_from_response(data_raw, KeycloakPostError)
  File "/usr/local/lib/python3.13/site-packages/keycloak/exceptions.py", line 195, in raise_error_from_response
    raise error(
    ...<3 lines>...
    )
keycloak.exceptions.KeycloakPostError: 400: b'{"error":"invalid_grant","error_description":"Token is not active"}'

^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

…ostError doesn't propagate to API server also which leads to Internal Server Error

shahar1 · 2025-12-13T10:56:53Z

CI is unhappy :(

dabla · 2025-12-13T12:32:12Z

I've put this PR in draft because I still need to add a test for the logout route

dabla · 2025-12-13T12:32:55Z

CI is unhappy :(

Yes it's still WIP but I wanted to already start the PR so we know it's being handled ;-)

…en refresh_token is being invoked in logout route

dabla · 2025-12-13T12:37:18Z

Test added

…oken

…akAuthManagerUser

…oken

vincbeck

One nit, overall, looks good

…/keycloak_auth_manager.py Co-authored-by: Vincent <97131062+vincbeck@users.noreply.github.com>

potiuk

NICE!

…ead to Internal Server Error in API server (apache#59382) * refactor: Fix logout route in Keycloak provider also so the KeycloakPostError doesn't propagate to API server also which leads to Internal Server Error * refactor: Fixed static checks * refactor: Fixed refresh_token invocations * refactor: Must call refresh_user in refresh route * refactor: refresh_token must always return a dict * refactor: Added test when keycloak client raises KeycloakPostError when refresh_token is being invoked in logout route * refactor: Fixed some additional static checks * refactor: Refactored refresh_user * refactor: Reformatted imports * refactor: Fixed mocking in refresh test * refactor: Removed unused mocking of keycloak client in test_refresh_token * refactor: Fixed mock get_auth_manager and added missing import KeycloakAuthManagerUser * refactor: Refresh token route calls refresh_user instead of refresh_token * refactor: Changed assert on refresh user * Update providers/keycloak/src/airflow/providers/keycloak/auth_manager/keycloak_auth_manager.py Co-authored-by: Vincent <97131062+vincbeck@users.noreply.github.com> * refactor: Fixed calls to refresh_tokens instead of refresh_token --------- Co-authored-by: Vincent <97131062+vincbeck@users.noreply.github.com>

refactor: Fix logout route in Keycloak provider also so the KeycloakP…

c9bb323

…ostError doesn't propagate to API server also which leads to Internal Server Error

dabla requested review from bugraoz93 and vincbeck as code owners December 13, 2025 09:37

boring-cyborg Bot added area:providers provider:keycloak labels Dec 13, 2025

refactor: Fixed static checks

8f2b4dd

dabla added 3 commits December 13, 2025 13:06

refactor: Fixed refresh_token invocations

6b043f9

refactor: Must call refresh_user in refresh route

3340f4d

refactor: refresh_token must always return a dict

db2bc99

dabla marked this pull request as draft December 13, 2025 12:31

Merge branch 'main' into fix/login-refresh-route-keycloak-provider

3f9e648

refactor: Added test when keycloak client raises KeycloakPostError wh…

986c3b8

…en refresh_token is being invoked in logout route

dabla marked this pull request as ready for review December 13, 2025 12:37

dabla added 10 commits December 13, 2025 18:08

refactor: Fixed some additional static checks

32dc04a

refactor: Refactored refresh_user

8763f39

Merge branch 'main' into fix/login-refresh-route-keycloak-provider

a0fa31d

refactor: Reformatted imports

12dff72

refactor: Fixed mocking in refresh test

3c34eed

refactor: Removed unused mocking of keycloak client in test_refresh_t…

5303bf6

…oken

refactor: Fixed mock get_auth_manager and added missing import Keyclo…

7d84193

…akAuthManagerUser

refactor: Refresh token route calls refresh_user instead of refresh_t…

9af6eaa

…oken

refactor: Changed assert on refresh user

c07a6b7

Merge branch 'main' into fix/login-refresh-route-keycloak-provider

5ac54cd

vincbeck reviewed Dec 15, 2025

View reviewed changes

Comment thread providers/keycloak/src/airflow/providers/keycloak/auth_manager/keycloak_auth_manager.py Outdated

dabla and others added 2 commits December 15, 2025 17:27

Update providers/keycloak/src/airflow/providers/keycloak/auth_manager…

b22af36

…/keycloak_auth_manager.py Co-authored-by: Vincent <97131062+vincbeck@users.noreply.github.com>

Merge branch 'main' into fix/login-refresh-route-keycloak-provider

fbb8326

refactor: Fixed calls to refresh_tokens instead of refresh_token

a30eb51

vincbeck approved these changes Dec 15, 2025

View reviewed changes

dabla changed the title ~~Fix logout route in Keycloak provider so a KeycloakostError doesn't leads to Internal Server Error in API server~~ Fix logout route in Keycloak provider so a KeycloakostError doesn't lead to Internal Server Error in API server Dec 15, 2025

dabla requested a review from vincbeck December 16, 2025 06:40

potiuk approved these changes Dec 16, 2025

View reviewed changes

potiuk merged commit 5ee00b3 into apache:main Dec 16, 2025
82 checks passed

shahar1 mentioned this pull request Dec 30, 2025

Status of testing Providers that were prepared on December 30, 2025 #59952

Closed

54 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Fix logout route in Keycloak provider so a KeycloakostError doesn't lead to Internal Server Error in API server#59382

Fix logout route in Keycloak provider so a KeycloakostError doesn't lead to Internal Server Error in API server#59382
potiuk merged 20 commits intoapache:mainfrom
dabla:fix/login-refresh-route-keycloak-provider

dabla commented Dec 13, 2025 •

edited

Loading

Uh oh!

shahar1 commented Dec 13, 2025

Uh oh!

dabla commented Dec 13, 2025

Uh oh!

dabla commented Dec 13, 2025

Uh oh!

dabla commented Dec 13, 2025

Uh oh!

vincbeck left a comment

Uh oh!

Uh oh!

potiuk left a comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Conversation

dabla commented Dec 13, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

shahar1 commented Dec 13, 2025

Uh oh!

dabla commented Dec 13, 2025

Uh oh!

dabla commented Dec 13, 2025

Uh oh!

dabla commented Dec 13, 2025

Uh oh!

vincbeck left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

potiuk left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

dabla commented Dec 13, 2025 •

edited

Loading