Skip to content

Conversation

@sharanrudresh
Copy link
Member

No description provided.

}

// Retain only the specified fields for key and value
BsonDocument dlqKeyDoc = keyDocument != null ? retainFields(keyDocument, "fullDocument._id") : null;

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

could you please add some tests around this?

return Optional.empty();
}

// Retain only the specified fields for key and value

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's add a new option for enabling this behavior. What do you think about calling it "errors.deadletterqueue.content.redacted"?

partitionMap,
sourceOffset,
sourceConfig.getDlqTopic(),
Schema.STRING_SCHEMA,

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[question] what's the reason for this change?

}

// Retain only the specified fields for key and value
BsonDocument dlqKeyDoc = keyDocument != null ? retainFields(keyDocument, "fullDocument._id") : null;

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the "fullDocument" field won't exist by default. See more details on that here by searching for "change.stream.full.document".
You'll want to take a look at this code to get a better idea of how this keyDocument is defined. Based on that, we'll want to decide which fields not to redact.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants