Skip to content
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
d71313e
created golden files
dyl10s Aug 18, 2025
14eb829
initial implementation
dyl10s Aug 18, 2025
271083d
realistic http access logs
dyl10s Aug 18, 2025
e88ab8e
realistic goxcdr logs
dyl10s Aug 18, 2025
40e5b5c
golden files update
dyl10s Aug 18, 2025
07f1081
removed undeeded code
dyl10s Aug 18, 2025
f2bb3dc
Merge remote-tracking branch 'origin/master' into feat/couchbase-refa…
dyl10s Aug 19, 2025
30f8885
added new line to input.log
dyl10s Aug 19, 2025
b5c2b0d
Merge remote-tracking branch 'origin/master' into feat/couchbase-refa…
dyl10s Aug 20, 2025
05a9597
Merge remote-tracking branch 'origin/master' into feat/couchbase-refa…
dyl10s Aug 25, 2025
9d53e09
Merge remote-tracking branch 'origin/master' into feat/couchbase-refa…
dyl10s Aug 25, 2025
1b17692
updated regex to correctly capture multiline
dyl10s Aug 26, 2025
42ef74b
update golden files
dyl10s Aug 26, 2025
c3880de
Merge branch 'master' into feat/couchbase-refactor
dyl10s Aug 26, 2025
1ff0392
Merge branch 'master' into feat/couchbase-refactor
dyl10s Aug 26, 2025
17afe1e
Merge remote-tracking branch 'origin' into feat/couchbase-refactor
dyl10s Aug 27, 2025
3ba843b
Merge branch 'master' into feat/couchbase-refactor
franciscovalentecastro Nov 24, 2025
3179a55
Update confgenerator goldens.
franciscovalentecastro Nov 24, 2025
d75fcc0
Update transformation test goldens.
franciscovalentecastro Nov 24, 2025
02000d2
Merge branch 'master' into feat/couchbase-refactor
franciscovalentecastro Feb 26, 2026
dadefa4
Update couchbase.go
franciscovalentecastro Feb 26, 2026
98d6b99
Update goldens.
franciscovalentecastro Feb 26, 2026
da86e2e
Update regex.
franciscovalentecastro Feb 26, 2026
ed0555d
Update regex.
franciscovalentecastro Feb 26, 2026
ff1fa6a
Update goldens.
franciscovalentecastro Feb 26, 2026
09e198c
Merge branch 'master' into feat/couchbase-refactor
franciscovalentecastro Feb 26, 2026
139b66b
Update test to work with go-yaml library.
franciscovalentecastro Feb 26, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions apps/couchbase.go
Original file line number Diff line number Diff line change
Expand Up @@ -251,7 +251,7 @@ func (p LoggingProcessorMacroCouchbase) Expand(ctx context.Context) []confgenera
LoggingProcessorParseRegexComplex: confgenerator.LoggingProcessorParseRegexComplex{
Parsers: []confgenerator.RegexParser{
{
Regex: `^\[(?<type>[^:]*):(?<level>[^,]*),(?<timestamp>\d+-\d+-\d+T\d+:\d+:\d+.\d+Z),(?<node_name>[^:]*):([^:]+):(?<source>[^\]]+)\](?<message>.*)$`,
Regex: `^\[(?<type>[^:]*):(?<level>[^,]*),(?<timestamp>\d+-\d+-\d+T\d+:\d+:\d+.\d+Z),(?<node_name>[^:]*):([^:]+):(?<source>[^\]]+)\](?<message>[\s|\S]*)?`,

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Re @dyl10s :

What is the reason that [\s|\S] fixes the regex for multiline parsing ? Is this specific thing for couchbase logs (e.g. trailing whitespace) ?

Parser: confgenerator.ParserShared{
TimeKey: "timestamp",
TimeFormat: "%Y-%m-%dT%H:%M:%S.%L",
Expand Down Expand Up @@ -385,7 +385,7 @@ func (p LoggingProcessorMacroCouchbaseGOXDCR) Expand(ctx context.Context) []conf
LoggingProcessorParseRegexComplex: confgenerator.LoggingProcessorParseRegexComplex{
Parsers: []confgenerator.RegexParser{
{
Regex: `^(?<timestamp>\d{4}-\d{2}-\d{2}T\d{2}:\d{2}:\d{2}.\d*Z) (?<level>\w+) (?<log_type>\w+.\w+): (?<message>.*)$`,
Regex: `^(?<timestamp>\d{4}-\d{2}-\d{2}T\d{2}:\d{2}:\d{2}.\d*Z) (?<level>\w+) (?<log_type>\w+.\w+): (?<message>[\s|\S]*)?`,
Parser: confgenerator.ParserShared{
TimeKey: "timestamp",
TimeFormat: "%Y-%m-%dT%H:%M:%S.%L",
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,10 @@
timestamp: 2025-08-18T09:16:33.764000000Z
- jsonPayload:
level: debug
message: "Rebalance progress: 45% completed"
message: |-
Rebalance progress: 45% completed
Continuation line giving rebalance details
Still continuing additional rebalance logs with memory usage stats...
node_name: ns_1@127.0.0.1
source: rebalance
type: ns_server
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,9 @@
- jsonPayload:
level: ERROR
log_type: Router
message: Failed to route mutation for key "user:12345", retrying...
message: |-
Failed to route mutation for key "user:12345", retrying...
Additional detail: document size exceeded configured threshold
labels:
compute.googleapis.com/resource_name: hostname
logging.googleapis.com/instrumentation_source: agent.googleapis.com/couchbase_goxdcr
Expand Down
Loading