feat: Add resource-info-fetcher - #863

Open

sbernauer wants to merge 80 commits into

mainfrom

Commits on Jul 16, 2026

Initial development of resource-info-fetcher
sbernauer
committed
ccadaf8
feat: Implement Trino catalog and schema
sbernauer
committed
a1da9db

Commits on Jul 20, 2026

feat: Cache tag and user lookups
sbernauer
committed
d56a198
feat: Lookup Superset things (by id)
sbernauer
committed
f28fdb7
chore: More parallism
sbernauer
committed
90b010d
feat: Add Kafka topic support
sbernauer
committed
53e83c6
Crying in GraphQL
sbernauer
committed
0e2857a

Commits on Jul 21, 2026

feat: Also fetch domains and data products
sbernauer
committed
551c2f6
RawDataHubUrn -> DataHubUrn
sbernauer
committed
a8310f6
refactor: Move user-info-fetcher sidecar creation into separate module
sbernauer
committed
a25da2b
Merge remote-tracking branch 'origin/main' into spike/rif
sbernauer
committed
e5d1f05
Merge branch 'refactor/uif-sidecar' into spike/rif
sbernauer
committed
9698dc8
Re-add Tiltfile
sbernauer
committed
f5b5bf9

Commits on Jul 22, 2026

Implement RIF into operator
sbernauer
committed
2cfd78d

Commits on Jul 23, 2026

Improve test
sbernauer
committed
86127a6

Commits on Jul 24, 2026

chore: Switch endpoints from complex enum to path based
sbernauer
committed
554a7f2
chore: Move env out of global config to the requests
sbernauer
committed
e5ff314

Commits on Jul 27, 2026

WIP for Maxi :)
sbernauer
committed
970da87
fix kuttl test
sbernauer
committed
2e4655f
refactor Python assert script
sbernauer
committed
8c9d8c5
refactor Python script
sbernauer
committed
dff0f99
Merge remote-tracking branch 'origin/main' into spike/rif
sbernauer
committed
74c648d
Remove leftover files
sbernauer
committed
32cd6e2
cargo fmt
sbernauer
committed
9d95f1f

Commits on Jul 30, 2026

Fix OpenShift on high disk usage
sbernauer
committed
d52110c
Merge remote-tracking branch 'origin/main' into spike/rif
sbernauer
committed
26f51e9
cargo update
sbernauer
committed
7c11523
Slightly improve docs
sbernauer
committed
fc889ca
Stupid YAML linter
sbernauer
committed
59af952

Commits on Jul 31, 2026

feat: Add rootPath field for DataHub
sbernauer
committed
215d4b9
changelog
sbernauer
committed
4dc05fc
Improve code comments
sbernauer
committed
6571afa
regenerate nix
sbernauer
committed
f770b04

Commits on Aug 5, 2026

Update rust/resource-info-fetcher/src/main.rs

sbernauer
and
Maleware
authored
8c2a0df
Merge branch 'main' into spike/rif
sbernauer
authored
af16a08

Commits on Aug 6, 2026

docs: Link in nav
sbernauer
committed
bf85e53

Commits on Aug 7, 2026

WIP: Error when too many data products are returned
sbernauer
committed
cd9a38e

Commits on Aug 10, 2026

Merge remote-tracking branch 'origin/main' into spike/rif
sbernauer
committed
fde8854
fix: Use utils::http::client_builder helper
sbernauer
committed
c20d1d1
clippy
sbernauer
committed
e3e84ed
feat: Allow configuring max cache size.
sbernauer
committed
f481d44
regenerate nix
sbernauer
committed
fdcb012

Commits on Aug 17, 2026

fix: Mount the log volume into the info-fetcher sidecars
maltesander
committed
ea4f5b7
docs: Document that a failed metadata lookup does not deny by itself
maltesander
committed
38d4773
chore: Remove dead code from the resource-info-fetcher
maltesander
committed
dde8df3
fix: Treat dashboard and chart ids as opaque strings
maltesander
committed
28a1808
fix: Bound the length of query parameter values
maltesander
committed
2ebbd09
fix: Answer 400 instead of 500 for identifiers DataHub rejects
maltesander
committed
3836ea1
fix: Warn when a URN resolves to an entity type we cannot read
maltesander
committed
cd65817
fix: Raise the data product page size to 1000
maltesander
committed
481baa8
feat: Add a cached bearer token to info-fetcher-commons
maltesander
committed
71b635a
feat: Cache the OAuth2 access token in the Keycloak and Entra backends
maltesander
committed
22e7f06
docs: Document that metadata is not inherited from parent containers
maltesander
committed
97ec049
fix: Reject resource names DataHub cannot express as a URN
maltesander
committed
3c9d7a9
test: Cover the URN mapping and the GraphQL response mapping
maltesander
committed
66160b4
fix: Rotate the file logs of the Stackable Rust containers
maltesander
committed
94a4034
fix: set log rotation period to minutely
maltesander
committed
931b0ae
fix: Cache failed lookups briefly
maltesander
committed
9e223cc
fix: Log a failed lookup where the backend is queried
maltesander
committed
e19ac0a
docs: Fix the broken rustdoc links
maltesander
committed
1f3290a

Commits on Aug 21, 2026

Commits on Aug 24, 2026

docs: add resource info fetcher readme
maltesander
committed
e6848cc
docs: remove stale file references
maltesander
committed
acb1fa7
test: consolidate filenames
maltesander
committed
86b119c
fix(info-fetcher-commons): do not log HTTP response bodies
maltesander
committed
811251f
fix(resource-info-fetcher): report GraphQL errors instead of parse failures
maltesander
committed
076f3ca
fix: bound the info-fetcher response caches by default
maltesander
committed
91543cd
refactor(user-info-fetcher): share the token retry logic between backends
maltesander
committed
e4a52d0
fix: remove obsolete error variant
maltesander
committed
ff5ad9e
fix(info-fetcher-commons): read the config file without blocking
maltesander
committed
40c5813
fix(resource-info-fetcher): strip the corpuser URN prefix exactly once
maltesander
committed
617a83f
fix: use async read_config_file
maltesander
committed
1bd6fb2
docs: add breaking credential volume name change
maltesander
committed
ab6df0f

Commits on Aug 25, 2026

Revert "test: consolidate filenames"
maltesander
committed
4b25d3a
fix(test): keep the mint-pat step POSIX so it runs under dash
maltesander
committed
38dc494
fix(info-fetcher): create the file log directory before initializing telemetry
maltesander
committed
b2a39f6
fix: mount info-fetcher config and credentials read-only
maltesander
committed
df5ca96
docs: reorder changelog entries
maltesander
committed
f2ad7c4
fix(regorules): do not hand fetcher errors to policies as data
maltesander
committed
498e1a6