Skip to content

[RFC] Provide CF Platform Logs over Otel - #1624

Open
beyhan wants to merge 9 commits into
mainfrom
otel-platform-logs
Open

[RFC] Provide CF Platform Logs over Otel #1624
beyhan wants to merge 9 commits into
mainfrom
otel-platform-logs

Conversation

@beyhan

@beyhan beyhan commented Sep 10, 2026 •
edited
Loading

Copy link
Copy Markdown
Member

chombium and others added 7 commits September 10, 2026 09:37
@chombium @jorbaum
@Katharin4 @beyhan @silvestre
add rfc for platform logs over otel
d3d2b56 
Co-authored-by: Joris Baum <joris.baum@sap.com>
Co-authored-by: Katharina Weisbarth <katharina.weisbarth@sap.com>
Co-authored-by: Beyhan Veli <beyhan.veli@sap.com>
Co-authored-by: Silvestre Zabala <silvestre.zabala@sap.com>
@jorbaum @beyhan
Fix minor typos
8683cf1
@jorbaum @beyhan
Fix a bunch of typos
b90a2bd
@jorbaum @beyhan
Add affected components
441c0d7
@jorbaum @beyhan
Fix spacing
0c965be
@jorbaum @beyhan
Questions, diagram, semantic convention clarification
bde34c7
@beyhan
Add small fixes RFC and K8s
dd3e3b7
@beyhan beyhan changed the title Otel platform logs [RFC] Provide CF Platform Logs over Otel Sep 10, 2026
@beyhan
beyhan requested review from a team, Gerg, cweibel, mkocher and stephanme and removed request for a team September 10, 2026 11:08
@beyhan beyhan added toc rfc CFF community RFC labels Sep 10, 2026
@beyhan beyhan mentioned this pull request Sep 10, 2026
Open
jorbaum
jorbaum reviewed Sep 11, 2026
View reviewed changes

@jorbaum jorbaum left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I found a minor fix for one sentence.

Proof-read again and still gets my 👍

Comment thread toc/rfc/rfc-draft-platform-logs-with-opentelemetry.md Outdated
beyhan and others added 2 commits September 11, 2026 16:27
@beyhan beyhan moved this from Inbox to In Progress in CF Community Sep 15, 2026
@jorbaum

jorbaum commented Sep 18, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

There are two additional log paths for "platform logs" besides blackbox:

  1. BOSH jobs → forwarder-agent → syslog-agent → registered as an aggregate drain → log-cache
  2. BOSH jobs → forwarder-agent → loggregator-agent → doppler → RLP (legacy, removed in shared-nothing)

Those are logs produced by platform components, but also visible to users of the CF platform.

For 1) we might need to come up with a way to replace this path in this RFC? Log Cache has no OTLP ingress and the collector has no log-cache exporter.

forwarder-agent ─┬─ syslog-agent ──(RFC5424 syslog)──► log-cache-syslog-server ─► Log Cache ─► cf tail / Grafana
                 └─ otel-collector ──(OTLP)──► external backend        ✗ no route into Log Cache

For 2) OTLP egress with otel-collector is the modern equivalent. Even though RFC 0018 mainly targeted metrics only. The collector already supports those as it is able to forward everything coming from the forwarder-agent to otel endpoints (opt-in via EMIT_OTEL_LOGS).

I guess it depends on how we want to scope "platform logs" for this RFC.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mkocher mkocher Awaiting requested review from mkocher mkocher was automatically assigned from cloudfoundry/toc
@Gerg Gerg Awaiting requested review from Gerg Gerg was automatically assigned from cloudfoundry/toc
@stephanme stephanme Awaiting requested review from stephanme stephanme was automatically assigned from cloudfoundry/toc
@cweibel cweibel Awaiting requested review from cweibel cweibel was automatically assigned from cloudfoundry/toc
1 more reviewer
@jorbaum jorbaum jorbaum left review comments
Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

rfc CFF community RFC toc

Projects

CF Community
Status: In Progress

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@beyhan @jorbaum @chombium