I noticed that request object is being logged here which contains the body of the request sent to livy
here - https://github.com/apache/incubator-livy/blob/f3e23ed0b34da9d44ec06c724d5d03c7cf15aebe/server/src/main/scala/org/apache/livy/server/interactive/InteractiveSession.scala#L119
I would like to implement a redaction logic using spark.redaction.regex that is used for a spark session to stop sensitive information from being exposed in logs
I noticed that request object is being logged here which contains the body of the request sent to livy
here - https://github.com/apache/incubator-livy/blob/f3e23ed0b34da9d44ec06c724d5d03c7cf15aebe/server/src/main/scala/org/apache/livy/server/interactive/InteractiveSession.scala#L119
I would like to implement a redaction logic using spark.redaction.regex that is used for a spark session to stop sensitive information from being exposed in logs