Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

error running app: unable to create Temporal client: failed reaching server: context deadline exceeded #2352

Open
donbeave opened this issue Dec 12, 2024 · 7 comments
Open

error running app: unable to create Temporal client: failed reaching server: context deadline exceeded #2352

donbeave opened this issue Dec 12, 2024 · 7 comments
Assignees
@iamKunalGupta

Comments

@donbeave
Copy link

Hi!

I'm following Quick Start documentation trying to start PeerDB and getting the error right after that.

git clone --recursive https://github.com/PeerDB-io/peerdb.git
cd peerdb

./run-peerdb.sh

After running ./run-peerdb.sh I can see the error from flow_api, flow-worker and flow-snapshot-worker containers with such message:

flow-worker           | {"time":"2024-12-12T14:31:02.12755389Z","level":"INFO","msg":"error running app: unable to create Temporal client: failed reaching server: context deadline exceeded","deploymentUid":""}
flow-snapshot-worker  | {"time":"2024-12-12T14:31:02.127564723Z","level":"INFO","msg":"error running app: unable to create Temporal client: failed reaching server: context deadline exceeded","deploymentUid":""}
flow_api              | {"time":"2024-12-12T14:31:02.128625015Z","level":"INFO","msg":"error running app: unable to create Temporal client: failed reaching server: context deadline exceeded","deploymentUid":""}

All three of them exiting on start with similar messages:

{"time":"2024-12-12T14:34:06.855572912Z","level":"INFO","msg":"error running app: unable to create Temporal client: failed reaching server: context deadline exceeded","deploymentUid":""}
panic: unable to create Temporal client: failed reaching server: context deadline exceeded

goroutine 1 [running]:
main.main()
	/root/flow/main.go:254 +0x1f68

It looks like there is something wrong with the Temporal connection configuration.
@iamKunalGupta
Copy link
Member

Can you re run docker compose? I have seen this on resource constrained systems sometimes where temporal slows down a bit.

Also can you check temporal logs? That should also clear things up a bit

@iamKunalGupta iamKunalGupta self-assigned this Dec 12, 2024
@donbeave
Copy link
Author

@iamKunalGupta I tried re-running it many times. Same error always.

Nothing suspicious in the temporal logs.

This is Docker Compose output:

./run-peerdb.sh
Cloning into 'peerdb'...
remote: Enumerating objects: 27830, done.
remote: Counting objects: 100% (2027/2027), done.
remote: Compressing objects: 100% (1051/1051), done.
remote: Total 27830 (delta 1287), reused 1551 (delta 948), pack-reused 25803 (from 1)
Receiving objects: 100% (27830/27830), 11.43 MiB | 5.39 MiB/s, done.
Resolving deltas: 100% (18991/18991), done.
[+] Pulling 10/10
 ✔ flow-api Pulled                                                                                                                                                                                            1.1s 
 ✔ flow-worker Pulled                                                                                                                                                                                         1.2s 
 ✔ catalog Pulled                                                                                                                                                                                             0.8s 
 ✔ temporal-ui Pulled                                                                                                                                                                                         0.7s 
 ✔ temporal-admin-tools Pulled                                                                                                                                                                                0.7s 
 ✔ flow-snapshot-worker Pulled                                                                                                                                                                                1.2s 
 ✔ peerdb Pulled                                                                                                                                                                                              1.3s 
 ✔ minio Pulled                                                                                                                                                                                               0.7s 
 ✔ peerdb-ui Pulled                                                                                                                                                                                           1.2s 
 ✔ temporal Pulled                                                                                                                                                                                            0.8s 
[+] Running 10/0
 ✔ Container peerdb-quickstart-minio-1  Created                                                                                                                                                               0.0s 
 ✔ Container catalog                    Created                                                                                                                                                               0.0s 
 ✔ Container temporal                   Created                                                                                                                                                               0.0s 
 ✔ Container peerdb-server              Created                                                                                                                                                               0.0s 
 ✔ Container temporal-ui                Created                                                                                                                                                               0.0s 
 ✔ Container temporal-admin-tools       Created                                                                                                                                                               0.0s 
 ✔ Container flow-snapshot-worker       Created                                                                                                                                                               0.0s 
 ✔ Container flow_api                   Created                                                                                                                                                               0.0s 
 ✔ Container flow-worker                Created                                                                                                                                                               0.0s 
 ✔ Container peerdb-ui                  Created                                                                                                                                                               0.0s 
Attaching to flow-snapshot-worker, flow-worker, flow_api, minio-1, peerdb-server, peerdb-ui
minio-1               | MinIO Object Storage Server
minio-1               | Copyright: 2015-2024 MinIO, Inc.
minio-1               | License: GNU AGPLv3 - https://www.gnu.org/licenses/agpl-3.0.html
minio-1               | Version: RELEASE.2024-11-07T00-52-20Z (go1.23.3 linux/arm64)
minio-1               | 
minio-1               | API: http://192.168.107.2:9000  http://127.0.0.1:9000 
minio-1               | WebUI: http://192.168.107.2:36987 http://127.0.0.1:36987  
minio-1               | 
minio-1               | Docs: https://docs.min.io
minio-1               | Added `myminiopeerdb` successfully.
minio-1               | mc: <ERROR> Unable to make bucket `myminiopeerdb/peerdbbucket`. Your previous request to create the named bucket succeeded and you already own it.
peerdb-server         | 2024-12-12T23:39:30.753798Z  INFO NOTICE: relation "refinery_schema_history" already exists, skipping    
peerdb-server         | 2024-12-12T23:39:30.755671Z  INFO current version: 41    
peerdb-server         | 2024-12-12T23:39:30.755691Z  INFO no migrations to apply    
peerdb-server         | 2024-12-12T23:39:30.755892Z  INFO Listening on 0.0.0.0:9900
peerdb-server         | 2024-12-12T23:39:30.755899Z  INFO MIRROR commands enabled
peerdb-server         | 2024-12-12T23:39:30.755900Z  INFO connecting to flow server at grpc://flow_api:8112/grpc
flow-worker           | 2024/12/12 23:39:32 maxprocs: Leaving GOMAXPROCS=10: CPU quota undefined
flow_api              | 2024/12/12 23:39:32 maxprocs: Leaving GOMAXPROCS=10: CPU quota undefined
flow-snapshot-worker  | 2024/12/12 23:39:32 maxprocs: Leaving GOMAXPROCS=10: CPU quota undefined
peerdb-ui             |   ▲ Next.js 14.2.17
peerdb-ui             |   - Local:        http://localhost:3000
peerdb-ui             |   - Network:      http://0.0.0.0:3000
peerdb-ui             | 
peerdb-ui             |  ✓ Starting...
peerdb-ui             |  ✓ Ready in 35ms
flow-worker           | {"time":"2024-12-12T23:39:40.585875245Z","level":"INFO","msg":"error running app: unable to create Temporal client: failed reaching server: context deadline exceeded","deploymentUid":""}
flow-worker           | panic: unable to create Temporal client: failed reaching server: context deadline exceeded
flow-worker           | 
flow-worker           | goroutine 1 [running]:
flow-worker           | main.main()
flow-worker           | 	/root/flow/main.go:254 +0x1f68
flow_api              | {"time":"2024-12-12T23:39:40.593155074Z","level":"INFO","msg":"error running app: unable to create Temporal client: failed reaching server: context deadline exceeded","deploymentUid":""}
flow-snapshot-worker  | {"time":"2024-12-12T23:39:40.601851193Z","level":"INFO","msg":"error running app: unable to create Temporal client: failed reaching server: context deadline exceeded","deploymentUid":""}
flow_api              | panic: unable to create Temporal client: failed reaching server: context deadline exceeded
flow_api              | 
flow_api              | goroutine 1 [running]:
flow_api              | main.main()
flow_api              | 	/root/flow/main.go:254 +0x1f68
flow-snapshot-worker  | panic: unable to create Temporal client: failed reaching server: context deadline exceeded
flow-snapshot-worker  | 
flow-snapshot-worker  | goroutine 1 [running]:
flow-snapshot-worker  | main.main()
flow-snapshot-worker  | 	/root/flow/main.go:254 +0x1f68
flow-worker exited with code 0
flow_api exited with code 0
flow-snapshot-worker exited with code 0
flow-worker           | {"time":"2024-12-12T23:39:48.974778759Z","level":"INFO","msg":"error running app: unable to create Temporal client: failed reaching server: context deadline exceeded","deploymentUid":""}
flow-worker           | panic: unable to create Temporal client: failed reaching server: context deadline exceeded
flow-worker           | 
flow-worker           | goroutine 1 [running]:
flow-worker           | main.main()
flow-worker           | 	/root/flow/main.go:254 +0x1f68
flow_api              | {"time":"2024-12-12T23:39:48.983627045Z","level":"INFO","msg":"error running app: unable to create Temporal client: failed reaching server: context deadline exceeded","deploymentUid":""}
flow_api              | panic: unable to create Temporal client: failed reaching server: context deadline exceeded
flow_api              | 
flow_api              | goroutine 1 [running]:
flow_api              | main.main()
flow_api              | 	/root/flow/main.go:254 +0x1f68
flow-snapshot-worker  | {"time":"2024-12-12T23:39:48.993775455Z","level":"INFO","msg":"error running app: unable to create Temporal client: failed reaching server: context deadline exceeded","deploymentUid":""}
flow-snapshot-worker  | panic: unable to create Temporal client: failed reaching server: context deadline exceeded
flow-snapshot-worker  | 
flow-snapshot-worker  | goroutine 1 [running]:
flow-snapshot-worker  | main.main()
flow-snapshot-worker  | 	/root/flow/main.go:254 +0x1f68
flow-worker           | 2024/12/12 23:39:49 maxprocs: Leaving GOMAXPROCS=10: CPU quota undefined
flow_api              | 2024/12/12 23:39:49 maxprocs: Leaving GOMAXPROCS=10: CPU quota undefined
flow-worker           | {"time":"2024-12-12T23:39:57.378325222Z","level":"INFO","msg":"error running app: unable to create Temporal client: failed reaching server: context deadline exceeded","deploymentUid":""}
flow-worker           | panic: unable to create Temporal client: failed reaching server: context deadline exceeded
flow-worker           | 
flow-worker           | goroutine 1 [running]:
flow-worker           | main.main()
flow-worker           | 	/root/flow/main.go:254 +0x1f68
flow-snapshot-worker  | {"time":"2024-12-12T23:39:57.398877626Z","level":"INFO","msg":"error running app: unable to create Temporal client: failed reaching server: context deadline exceeded","deploymentUid":""}
flow_api              | {"time":"2024-12-12T23:39:57.398883459Z","level":"INFO","msg":"error running app: unable to create Temporal client: failed reaching server: context deadline exceeded","deploymentUid":""}
flow_api              | panic: unable to create Temporal client: failed reaching server: context deadline exceeded
flow-snapshot-worker  | panic: unable to create Temporal client: failed reaching server: context deadline exceeded
flow_api              | 
flow_api              | goroutine 1 [running]:
flow_api              | main.main()
flow_api              | 	/root/flow/main.go:254 +0x1f68
flow-snapshot-worker  | 
flow-snapshot-worker  | goroutine 1 [running]:
flow-snapshot-worker  | main.main()
flow-snapshot-worker  | 	/root/flow/main.go:254 +0x1f68
flow-worker           | 2024/12/12 23:39:58 maxprocs: Leaving GOMAXPROCS=10: CPU quota undefined
flow_api              | 2024/12/12 23:39:58 maxprocs: Leaving GOMAXPROCS=10: CPU quota undefined
flow-snapshot-worker  | 2024/12/12 23:39:58 maxprocs: Leaving GOMAXPROCS=10: CPU quota undefined

@donbeave
Copy link
Author

And temporal logs looks ok, no errors:

TEMPORAL_ADDRESS is not set, setting it to 192.168.107.3:7233
PostgreSQL started.
Setup PostgreSQL schema.
2024-12-12T23:45:03.824Z	INFO	Starting schema setup	{"config": {"SchemaFilePath":"","SchemaName":"","InitialVersion":"0.0","Overwrite":false,"DisableVersioning":false}, "logging-call-at": "/home/runner/work/docker-builds/docker-builds/temporal/tools/common/schema/setuptask.go:64"}
2024-12-12T23:45:03.824Z	DEBUG	Setting up version tables	{"logging-call-at": "/home/runner/work/docker-builds/docker-builds/temporal/tools/common/schema/setuptask.go:74"}
2024-12-12T23:45:03.826Z	DEBUG	Current database schema version 1.14 is greater than initial schema version 0.0. Skip version upgrade	{"logging-call-at": "/home/runner/work/docker-builds/docker-builds/temporal/tools/common/schema/setuptask.go:135"}
2024-12-12T23:45:03.827Z	INFO	Schema setup complete	{"logging-call-at": "/home/runner/work/docker-builds/docker-builds/temporal/tools/common/schema/setuptask.go:150"}
2024-12-12T23:45:03.838Z	INFO	UpdateSchemaTask started	{"config": {"DBName":"","TargetVersion":"","SchemaDir":"/etc/temporal/schema/postgresql/v12/temporal/versioned","SchemaName":"","IsDryRun":false}, "logging-call-at": "/home/runner/work/docker-builds/docker-builds/temporal/tools/common/schema/updatetask.go:105"}
2024-12-12T23:45:03.839Z	DEBUG	Schema Dirs: []	{"logging-call-at": "/home/runner/work/docker-builds/docker-builds/temporal/tools/common/schema/updatetask.go:213"}
2024-12-12T23:45:03.839Z	DEBUG	found zero updates from current version 1.14	{"logging-call-at": "/home/runner/work/docker-builds/docker-builds/temporal/tools/common/schema/updatetask.go:135"}
2024-12-12T23:45:03.839Z	INFO	UpdateSchemaTask done	{"logging-call-at": "/home/runner/work/docker-builds/docker-builds/temporal/tools/common/schema/updatetask.go:128"}
2024-12-12T23:45:03.866Z	INFO	Starting schema setup	{"config": {"SchemaFilePath":"","SchemaName":"","InitialVersion":"0.0","Overwrite":false,"DisableVersioning":false}, "logging-call-at": "/home/runner/work/docker-builds/docker-builds/temporal/tools/common/schema/setuptask.go:64"}
2024-12-12T23:45:03.866Z	DEBUG	Setting up version tables	{"logging-call-at": "/home/runner/work/docker-builds/docker-builds/temporal/tools/common/schema/setuptask.go:74"}
2024-12-12T23:45:03.868Z	DEBUG	Current database schema version 1.6 is greater than initial schema version 0.0. Skip version upgrade	{"logging-call-at": "/home/runner/work/docker-builds/docker-builds/temporal/tools/common/schema/setuptask.go:135"}
2024-12-12T23:45:03.868Z	INFO	Schema setup complete	{"logging-call-at": "/home/runner/work/docker-builds/docker-builds/temporal/tools/common/schema/setuptask.go:150"}
2024-12-12T23:45:03.879Z	INFO	UpdateSchemaTask started	{"config": {"DBName":"","TargetVersion":"","SchemaDir":"/etc/temporal/schema/postgresql/v12/visibility/versioned","SchemaName":"","IsDryRun":false}, "logging-call-at": "/home/runner/work/docker-builds/docker-builds/temporal/tools/common/schema/updatetask.go:105"}
2024-12-12T23:45:03.880Z	DEBUG	Schema Dirs: []	{"logging-call-at": "/home/runner/work/docker-builds/docker-builds/temporal/tools/common/schema/updatetask.go:213"}
2024-12-12T23:45:03.880Z	DEBUG	found zero updates from current version 1.6	{"logging-call-at": "/home/runner/work/docker-builds/docker-builds/temporal/tools/common/schema/updatetask.go:135"}
2024-12-12T23:45:03.880Z	INFO	UpdateSchemaTask done	{"logging-call-at": "/home/runner/work/docker-builds/docker-builds/temporal/tools/common/schema/updatetask.go:128"}
Temporal CLI address: 192.168.107.3:7233.
2024/12/12 23:45:03 Loading config; env=docker,zone=,configDir=config
2024/12/12 23:45:03 Loading config files=[config/docker.yaml]
{"level":"info","ts":"2024-12-12T23:45:03.893Z","msg":"Build info.","git-time":"2024-11-05T22:46:53.000Z","git-revision":"8e808f9aa7b8efbfdf08521ad454aa80596d044d","git-modified":false,"go-arch":"arm64","go-os":"linux","go-version":"go1.22.8","cgo-enabled":false,"server-version":"1.25.2","debug-mode":false,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/cmd/server/main.go:176"}
{"level":"info","ts":"2024-12-12T23:45:03.895Z","msg":"dynamic config changed for the key: system.forcesearchattributescacherefreshonread oldValue: nil newValue: { constraints: {} value: true }","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/dynamicconfig/file_based_client.go:362"}
{"level":"info","ts":"2024-12-12T23:45:03.895Z","msg":"dynamic config changed for the key: frontend.enableupdateworkflowexecution oldValue: nil newValue: { constraints: {} value: true }","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/dynamicconfig/file_based_client.go:362"}
{"level":"info","ts":"2024-12-12T23:45:03.895Z","msg":"dynamic config changed for the key: limit.maxidlength oldValue: nil newValue: { constraints: {} value: 255 }","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/dynamicconfig/file_based_client.go:362"}
{"level":"info","ts":"2024-12-12T23:45:03.895Z","msg":"Updated dynamic config","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/dynamicconfig/file_based_client.go:208"}
{"level":"warn","ts":"2024-12-12T23:45:03.895Z","msg":"Not using any authorizer and flag `--allow-no-auth` not detected. Future versions will require using the flag `--allow-no-auth` if you do not want to set an authorizer.","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/cmd/server/main.go:206"}
time=2024-12-12T23:45:03.896 level=ERROR msg="failed reaching server: last connection error: connection error: desc = \"transport: Error while dialing: dial tcp 192.168.107.3:7233: connect: connection refused\""
Waiting for Temporal server to start...
{"level":"info","ts":"2024-12-12T23:45:03.910Z","msg":"Use rpc address 127.0.0.1:7233 for cluster active.","component":"metadata-initializer","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/temporal/cluster_metadata_loader.go:92"}
{"level":"info","ts":"2024-12-12T23:45:03.913Z","msg":"Quota changed","service":"history","component":"persistence","scope":"host","current-quota":null,"new-quota":9000,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/quotas/calculator/logged_calculator.go:124"}
{"level":"info","ts":"2024-12-12T23:45:03.917Z","msg":"historyClient: ownership caching disabled","service":"history","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/client/history/client.go:92"}
{"level":"info","ts":"2024-12-12T23:45:03.918Z","msg":"Quota changed","service":"history","component":"task-scheduler","scope":"host","current-quota":null,"new-quota":0,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/quotas/calculator/logged_calculator.go:124"}
{"level":"info","ts":"2024-12-12T23:45:03.922Z","msg":"creating new visibility manager","visibility_plugin_name":"postgres12","visibility_index_name":"temporal_visibility","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/persistence/visibility/factory.go:150"}
{"level":"info","ts":"2024-12-12T23:45:03.923Z","msg":"Initialized lazy loaded OwnershipBasedQuotaScaler","service":"history","service":"history","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/fx.go:95"}
{"level":"info","ts":"2024-12-12T23:45:03.923Z","msg":"Initialized service resolver for persistence rate limiting","service":"history","service":"history","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/fx.go:92"}
{"level":"info","ts":"2024-12-12T23:45:03.923Z","msg":"Created gRPC listener","service":"history","address":"192.168.107.3:7234","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/rpc/rpc.go:177"}
{"level":"info","ts":"2024-12-12T23:45:03.924Z","msg":"Quota changed","service":"matching","component":"persistence","scope":"host","current-quota":null,"new-quota":3000,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/quotas/calculator/logged_calculator.go:124"}
{"level":"info","ts":"2024-12-12T23:45:03.928Z","msg":"Initialized service resolver for persistence rate limiting","service":"matching","service":"matching","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/fx.go:92"}
{"level":"info","ts":"2024-12-12T23:45:03.928Z","msg":"Created gRPC listener","service":"matching","address":"192.168.107.3:7235","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/rpc/rpc.go:177"}
{"level":"info","ts":"2024-12-12T23:45:03.928Z","msg":"historyClient: ownership caching disabled","service":"matching","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/client/history/client.go:92"}
{"level":"info","ts":"2024-12-12T23:45:03.931Z","msg":"creating new visibility manager","visibility_plugin_name":"postgres12","visibility_index_name":"temporal_visibility","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/persistence/visibility/factory.go:150"}
{"level":"info","ts":"2024-12-12T23:45:03.933Z","msg":"Quota changed","service":"frontend","component":"persistence","scope":"host","current-quota":null,"new-quota":2000,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/quotas/calculator/logged_calculator.go:124"}
{"level":"info","ts":"2024-12-12T23:45:03.937Z","msg":"historyClient: ownership caching disabled","service":"frontend","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/client/history/client.go:92"}
{"level":"info","ts":"2024-12-12T23:45:03.937Z","msg":"Quota changed","service":"frontend","component":"rpc-handler","scope":"host","current-quota":null,"new-quota":2400,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/quotas/calculator/logged_calculator.go:124"}
{"level":"info","ts":"2024-12-12T23:45:03.938Z","msg":"Initialized service resolver for persistence rate limiting","service":"frontend","service":"frontend","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/fx.go:92"}
{"level":"info","ts":"2024-12-12T23:45:03.938Z","msg":"Created gRPC listener","service":"frontend","address":"192.168.107.3:7233","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/rpc/rpc.go:177"}
{"level":"info","ts":"2024-12-12T23:45:03.941Z","msg":"creating new visibility manager","visibility_plugin_name":"postgres12","visibility_index_name":"temporal_visibility","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/persistence/visibility/factory.go:150"}
{"level":"info","ts":"2024-12-12T23:45:03.943Z","msg":"Service is not requested, skipping initialization.","service":"internal-frontend","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/temporal/fx.go:542"}
{"level":"info","ts":"2024-12-12T23:45:03.945Z","msg":"Quota changed","service":"worker","component":"persistence","scope":"host","current-quota":null,"new-quota":500,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/quotas/calculator/logged_calculator.go:124"}
{"level":"info","ts":"2024-12-12T23:45:03.949Z","msg":"Initialized service resolver for persistence rate limiting","service":"worker","service":"worker","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/fx.go:92"}
{"level":"info","ts":"2024-12-12T23:45:03.950Z","msg":"historyClient: ownership caching disabled","service":"worker","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/client/history/client.go:92"}
{"level":"info","ts":"2024-12-12T23:45:03.953Z","msg":"creating new visibility manager","visibility_plugin_name":"postgres12","visibility_index_name":"temporal_visibility","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/persistence/visibility/factory.go:150"}
{"level":"info","ts":"2024-12-12T23:45:03.953Z","msg":"PProf not started due to port not set","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/pprof/pprof.go:68"}
{"level":"info","ts":"2024-12-12T23:45:03.953Z","msg":"Starting server for services","value":{"frontend":{},"history":{},"matching":{},"worker":{}},"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/temporal/server_impl.go:105"}
{"level":"info","ts":"2024-12-12T23:45:03.959Z","msg":"RuntimeMetricsReporter started","service":"matching","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/metrics/runtime.go:138"}
{"level":"info","ts":"2024-12-12T23:45:03.959Z","msg":"matching starting","service":"matching","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/service.go:88"}
{"level":"info","ts":"2024-12-12T23:45:03.959Z","msg":"Starting to serve on matching listener","service":"matching","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/service.go:102"}
{"level":"info","ts":"2024-12-12T23:45:03.959Z","msg":"Update worker pool size","service":"history","key":"worker-pool-size","value":512,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/tasks/fifo_scheduler.go:167"}
{"level":"info","ts":"2024-12-12T23:45:03.959Z","msg":"fifo scheduler started","service":"history","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/tasks/fifo_scheduler.go:97"}
{"level":"info","ts":"2024-12-12T23:45:03.959Z","msg":"interleaved weighted round robin task scheduler started","service":"history","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/tasks/interleaved_weighted_round_robin.go:131"}
{"level":"info","ts":"2024-12-12T23:45:03.959Z","msg":"Update worker pool size","service":"history","key":"worker-pool-size","value":512,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/tasks/fifo_scheduler.go:167"}
{"level":"info","ts":"2024-12-12T23:45:03.959Z","msg":"fifo scheduler started","service":"history","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/tasks/fifo_scheduler.go:97"}
{"level":"info","ts":"2024-12-12T23:45:03.959Z","msg":"interleaved weighted round robin task scheduler started","service":"history","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/tasks/interleaved_weighted_round_robin.go:131"}
{"level":"info","ts":"2024-12-12T23:45:03.960Z","msg":"Update worker pool size","service":"history","key":"worker-pool-size","value":512,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/tasks/fifo_scheduler.go:167"}
{"level":"info","ts":"2024-12-12T23:45:03.960Z","msg":"fifo scheduler started","service":"history","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/tasks/fifo_scheduler.go:97"}
{"level":"info","ts":"2024-12-12T23:45:03.960Z","msg":"interleaved weighted round robin task scheduler started","service":"history","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/tasks/interleaved_weighted_round_robin.go:131"}
{"level":"info","ts":"2024-12-12T23:45:03.960Z","msg":"Update worker pool size","service":"history","key":"worker-pool-size","value":512,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/tasks/fifo_scheduler.go:167"}
{"level":"info","ts":"2024-12-12T23:45:03.960Z","msg":"fifo scheduler started","service":"history","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/tasks/fifo_scheduler.go:97"}
{"level":"info","ts":"2024-12-12T23:45:03.960Z","msg":"interleaved weighted round robin task scheduler started","service":"history","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/tasks/interleaved_weighted_round_robin.go:131"}
{"level":"info","ts":"2024-12-12T23:45:03.960Z","msg":"Update worker pool size","service":"history","component":"memory-scheduled-queue-processor","key":"worker-pool-size","value":64,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/tasks/fifo_scheduler.go:167"}
{"level":"info","ts":"2024-12-12T23:45:03.960Z","msg":"fifo scheduler started","service":"history","component":"memory-scheduled-queue-processor","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/tasks/fifo_scheduler.go:97"}
{"level":"info","ts":"2024-12-12T23:45:03.961Z","msg":"RuntimeMetricsReporter started","service":"history","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/metrics/runtime.go:138"}
{"level":"info","ts":"2024-12-12T23:45:03.961Z","msg":"Update worker pool size","key":"worker-pool-size","value":512,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/tasks/sequential_scheduler.go:221"}
{"level":"info","ts":"2024-12-12T23:45:03.961Z","msg":"sequential scheduler started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/tasks/sequential_scheduler.go:99"}
{"level":"info","ts":"2024-12-12T23:45:03.961Z","msg":"interleaved weighted round robin task scheduler started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/tasks/interleaved_weighted_round_robin.go:131"}
{"level":"info","ts":"2024-12-12T23:45:03.961Z","msg":"Update worker pool size","key":"worker-pool-size","value":128,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/tasks/sequential_scheduler.go:221"}
{"level":"info","ts":"2024-12-12T23:45:03.961Z","msg":"sequential scheduler started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/tasks/sequential_scheduler.go:99"}
{"level":"info","ts":"2024-12-12T23:45:03.961Z","msg":"interleaved weighted round robin task scheduler started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/tasks/interleaved_weighted_round_robin.go:131"}
{"level":"info","ts":"2024-12-12T23:45:03.961Z","msg":"history starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/service.go:87"}
{"level":"info","ts":"2024-12-12T23:45:03.961Z","msg":"Replication task fetchers started.","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/replication/task_fetcher.go:141"}
{"level":"info","ts":"2024-12-12T23:45:03.961Z","msg":"StreamReceiverMonitor started.","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/replication/stream_receiver_monitor.go:111"}
{"level":"info","ts":"2024-12-12T23:45:03.961Z","msg":"none","component":"shard-controller","address":"192.168.107.3:7234","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/controller_impl.go:136"}
{"level":"info","ts":"2024-12-12T23:45:03.961Z","msg":"Starting to serve on history listener","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/service.go:100"}
{"level":"info","ts":"2024-12-12T23:45:03.962Z","msg":"RuntimeMetricsReporter started","service":"frontend","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/metrics/runtime.go:138"}
{"level":"info","ts":"2024-12-12T23:45:03.962Z","msg":"frontend starting","service":"frontend","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/frontend/service.go:372"}
{"level":"info","ts":"2024-12-12T23:45:03.962Z","msg":"Starting to serve on frontend listener","service":"frontend","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/frontend/service.go:390"}
{"level":"info","ts":"2024-12-12T23:45:03.963Z","msg":"Membership heartbeat upserted successfully","address":"192.168.107.3","port":6935,"hostId":"1c0a1af9-b8e3-11ef-b5d5-0242c0a86b03","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/monitor.go:341"}
{"level":"info","ts":"2024-12-12T23:45:03.964Z","msg":"bootstrap hosts fetched","bootstrap-hostports":"192.168.107.3:6933,192.168.107.3:6939,192.168.107.3:6934,192.168.107.3:6935","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/monitor.go:383"}
{"level":"info","ts":"2024-12-12T23:45:03.964Z","msg":"RuntimeMetricsReporter started","service":"worker","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/metrics/runtime.go:138"}
{"level":"info","ts":"2024-12-12T23:45:03.964Z","msg":"worker starting","service":"worker","component":"worker","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/worker/service.go:242"}
{"level":"info","ts":"2024-12-12T23:45:03.965Z","msg":"Membership heartbeat upserted successfully","address":"192.168.107.3","port":6934,"hostId":"1c085255-b8e3-11ef-b5d5-0242c0a86b03","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/monitor.go:341"}
{"level":"info","ts":"2024-12-12T23:45:03.966Z","msg":"bootstrap hosts fetched","bootstrap-hostports":"192.168.107.3:6939,192.168.107.3:6934,192.168.107.3:6935,192.168.107.3:6933","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/monitor.go:383"}
{"level":"info","ts":"2024-12-12T23:45:03.967Z","msg":"Membership heartbeat upserted successfully","address":"192.168.107.3","port":6939,"hostId":"1c0d5911-b8e3-11ef-b5d5-0242c0a86b03","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/monitor.go:341"}
{"level":"info","ts":"2024-12-12T23:45:03.968Z","msg":"Current reachable members","component":"service-resolver","service":"history","addresses":["192.168.107.3:7234"],"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/service_resolver.go:331"}
{"level":"info","ts":"2024-12-12T23:45:03.968Z","msg":"Current reachable members","component":"service-resolver","service":"matching","addresses":["192.168.107.3:7235"],"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/service_resolver.go:331"}
{"level":"info","ts":"2024-12-12T23:45:03.968Z","msg":"none","component":"shard-controller","address":"192.168.107.3:7234","component":"shard-controller","address":"192.168.107.3:7234","shard-update":"RingMembershipChangedEvent","number-processed":1,"number-deleted":0,"number-changed":0,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/ownership.go:116"}
{"level":"info","ts":"2024-12-12T23:45:03.968Z","msg":"none","shard-id":2,"address":"192.168.107.3:7234","lifecycle":"Started","component":"shard-context","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/context_impl.go:1618"}
{"level":"info","ts":"2024-12-12T23:45:03.968Z","msg":"Current reachable members","component":"service-resolver","service":"history","addresses":["192.168.107.3:7234"],"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/service_resolver.go:331"}
{"level":"info","ts":"2024-12-12T23:45:03.968Z","msg":"none","component":"shard-controller","address":"192.168.107.3:7234","numShards":1,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/controller_impl.go:286"}
{"level":"info","ts":"2024-12-12T23:45:03.968Z","msg":"none","shard-id":3,"address":"192.168.107.3:7234","lifecycle":"Started","component":"shard-context","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/context_impl.go:1618"}
{"level":"info","ts":"2024-12-12T23:45:03.969Z","msg":"none","component":"shard-controller","address":"192.168.107.3:7234","numShards":2,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/controller_impl.go:286"}
{"level":"info","ts":"2024-12-12T23:45:03.969Z","msg":"Membership heartbeat upserted successfully","address":"192.168.107.3","port":6933,"hostId":"1c0b749f-b8e3-11ef-b5d5-0242c0a86b03","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/monitor.go:341"}
{"level":"info","ts":"2024-12-12T23:45:03.969Z","msg":"bootstrap hosts fetched","bootstrap-hostports":"192.168.107.3:6934,192.168.107.3:6935,192.168.107.3:6933,192.168.107.3:6939","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/monitor.go:383"}
{"level":"info","ts":"2024-12-12T23:45:03.969Z","msg":"none","shard-id":1,"address":"192.168.107.3:7234","lifecycle":"Started","component":"shard-context","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/context_impl.go:1618"}
{"level":"info","ts":"2024-12-12T23:45:03.969Z","msg":"none","component":"shard-controller","address":"192.168.107.3:7234","numShards":3,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/controller_impl.go:286"}
{"level":"info","ts":"2024-12-12T23:45:03.969Z","msg":"none","shard-id":4,"address":"192.168.107.3:7234","lifecycle":"Started","component":"shard-context","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/context_impl.go:1618"}
{"level":"info","ts":"2024-12-12T23:45:03.969Z","msg":"none","component":"shard-controller","address":"192.168.107.3:7234","numShards":4,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/controller_impl.go:286"}
{"level":"info","ts":"2024-12-12T23:45:03.969Z","msg":"Current reachable members","component":"service-resolver","service":"matching","addresses":["192.168.107.3:7235"],"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/service_resolver.go:331"}
{"level":"info","ts":"2024-12-12T23:45:03.970Z","msg":"bootstrap hosts fetched","bootstrap-hostports":"192.168.107.3:6934,192.168.107.3:6935,192.168.107.3:6933,192.168.107.3:6939","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/monitor.go:383"}
{"level":"info","ts":"2024-12-12T23:45:03.970Z","msg":"Current reachable members","component":"service-resolver","service":"worker","addresses":["192.168.107.3:7239"],"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/service_resolver.go:331"}
{"level":"info","ts":"2024-12-12T23:45:03.971Z","msg":"Current reachable members","component":"service-resolver","service":"frontend","addresses":["192.168.107.3:7233"],"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/service_resolver.go:331"}
{"level":"info","ts":"2024-12-12T23:45:03.971Z","msg":"Current reachable members","component":"service-resolver","service":"matching","addresses":["192.168.107.3:7235"],"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/service_resolver.go:331"}
{"level":"info","ts":"2024-12-12T23:45:03.971Z","msg":"Current reachable members","component":"service-resolver","service":"history","addresses":["192.168.107.3:7234"],"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/service_resolver.go:331"}
{"level":"info","ts":"2024-12-12T23:45:03.971Z","msg":"Current reachable members","component":"service-resolver","service":"matching","addresses":["192.168.107.3:7235"],"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/service_resolver.go:331"}
{"level":"info","ts":"2024-12-12T23:45:03.971Z","msg":"Current reachable members","component":"service-resolver","service":"worker","addresses":["192.168.107.3:7239"],"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/service_resolver.go:331"}
{"level":"info","ts":"2024-12-12T23:45:03.971Z","msg":"Frontend is now healthy","service":"frontend","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/frontend/workflow_handler.go:242"}
{"level":"info","ts":"2024-12-12T23:45:03.971Z","msg":"Current reachable members","component":"service-resolver","service":"history","addresses":["192.168.107.3:7234"],"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/service_resolver.go:331"}
{"level":"info","ts":"2024-12-12T23:45:03.971Z","msg":"Current reachable members","component":"service-resolver","service":"worker","addresses":["192.168.107.3:7239"],"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/service_resolver.go:331"}
{"level":"info","ts":"2024-12-12T23:45:03.972Z","msg":"Range updated for shardID","shard-id":4,"address":"192.168.107.3:7234","shard-range-id":12,"previous-shard-range-id":11,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/context_impl.go:1204"}
{"level":"info","ts":"2024-12-12T23:45:03.972Z","msg":"Task key range updated","shard-id":4,"address":"192.168.107.3:7234","number":12582912,"next-number":13631488,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/task_key_generator.go:177"}
{"level":"info","ts":"2024-12-12T23:45:03.972Z","msg":"Acquired shard","shard-id":4,"address":"192.168.107.3:7234","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/context_impl.go:1985"}
{"level":"info","ts":"2024-12-12T23:45:03.972Z","msg":"none","shard-id":4,"address":"192.168.107.3:7234","lifecycle":"Starting","component":"shard-engine","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/context_impl.go:1463"}
{"level":"info","ts":"2024-12-12T23:45:03.972Z","msg":"none","shard-id":4,"address":"192.168.107.3:7234","component":"history-engine","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/history_engine.go:327"}
{"level":"info","ts":"2024-12-12T23:45:03.972Z","msg":"none","shard-id":4,"address":"192.168.107.3:7234","component":"visibility-queue-processor","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_immediate.go:113"}
{"level":"info","ts":"2024-12-12T23:45:03.972Z","msg":"Task rescheduler started.","shard-id":4,"address":"192.168.107.3:7234","component":"visibility-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/rescheduler.go:127"}
{"level":"info","ts":"2024-12-12T23:45:03.972Z","msg":"none","shard-id":4,"address":"192.168.107.3:7234","component":"visibility-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_immediate.go:122"}
{"level":"info","ts":"2024-12-12T23:45:03.972Z","msg":"none","service":"history","component":"memory-scheduled-queue-processor","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/memory_scheduled_queue.go:103"}
{"level":"info","ts":"2024-12-12T23:45:03.972Z","msg":"none","service":"history","component":"memory-scheduled-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/memory_scheduled_queue.go:108"}
{"level":"info","ts":"2024-12-12T23:45:03.972Z","msg":"none","shard-id":4,"address":"192.168.107.3:7234","component":"transfer-queue-processor","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_immediate.go:113"}
{"level":"info","ts":"2024-12-12T23:45:03.972Z","msg":"Task rescheduler started.","shard-id":4,"address":"192.168.107.3:7234","component":"transfer-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/rescheduler.go:127"}
{"level":"info","ts":"2024-12-12T23:45:03.972Z","msg":"none","shard-id":4,"address":"192.168.107.3:7234","component":"transfer-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_immediate.go:122"}
{"level":"info","ts":"2024-12-12T23:45:03.972Z","msg":"none","shard-id":4,"address":"192.168.107.3:7234","component":"archival-queue-processor","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_scheduled.go:153"}
{"level":"info","ts":"2024-12-12T23:45:03.972Z","msg":"Task rescheduler started.","shard-id":4,"address":"192.168.107.3:7234","component":"archival-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/rescheduler.go:127"}
{"level":"info","ts":"2024-12-12T23:45:03.972Z","msg":"none","shard-id":4,"address":"192.168.107.3:7234","component":"archival-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_scheduled.go:162"}
{"level":"info","ts":"2024-12-12T23:45:03.972Z","msg":"none","shard-id":4,"address":"192.168.107.3:7234","component":"timer-queue-processor","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_scheduled.go:153"}
{"level":"info","ts":"2024-12-12T23:45:03.972Z","msg":"Task rescheduler started.","shard-id":4,"address":"192.168.107.3:7234","component":"timer-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/rescheduler.go:127"}
{"level":"info","ts":"2024-12-12T23:45:03.972Z","msg":"none","shard-id":4,"address":"192.168.107.3:7234","component":"timer-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_scheduled.go:162"}
{"level":"info","ts":"2024-12-12T23:45:03.972Z","msg":"none","shard-id":4,"address":"192.168.107.3:7234","component":"history-engine","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/history_engine.go:336"}
{"level":"info","ts":"2024-12-12T23:45:03.972Z","msg":"none","shard-id":4,"address":"192.168.107.3:7234","lifecycle":"Started","component":"shard-engine","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/context_impl.go:1466"}
{"level":"info","ts":"2024-12-12T23:45:03.973Z","msg":"queue reader started","shard-id":4,"address":"192.168.107.3:7234","component":"visibility-queue-processor","queue-reader-id":0,"lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/reader.go:182"}
{"level":"info","ts":"2024-12-12T23:45:03.973Z","msg":"queue reader started","shard-id":4,"address":"192.168.107.3:7234","component":"transfer-queue-processor","queue-reader-id":0,"lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/reader.go:182"}
{"level":"info","ts":"2024-12-12T23:45:03.973Z","msg":"queue reader started","shard-id":4,"address":"192.168.107.3:7234","component":"archival-queue-processor","queue-reader-id":0,"lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/reader.go:182"}
{"level":"info","ts":"2024-12-12T23:45:03.973Z","msg":"queue reader started","shard-id":4,"address":"192.168.107.3:7234","component":"timer-queue-processor","queue-reader-id":0,"lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/reader.go:182"}
{"level":"info","ts":"2024-12-12T23:45:03.976Z","msg":"Range updated for shardID","shard-id":2,"address":"192.168.107.3:7234","shard-range-id":12,"previous-shard-range-id":11,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/context_impl.go:1204"}
{"level":"info","ts":"2024-12-12T23:45:03.976Z","msg":"Task key range updated","shard-id":2,"address":"192.168.107.3:7234","number":12582912,"next-number":13631488,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/task_key_generator.go:177"}
{"level":"info","ts":"2024-12-12T23:45:03.976Z","msg":"Acquired shard","shard-id":2,"address":"192.168.107.3:7234","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/context_impl.go:1985"}
{"level":"info","ts":"2024-12-12T23:45:03.976Z","msg":"none","shard-id":2,"address":"192.168.107.3:7234","lifecycle":"Starting","component":"shard-engine","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/context_impl.go:1463"}
{"level":"info","ts":"2024-12-12T23:45:03.976Z","msg":"Range updated for shardID","shard-id":3,"address":"192.168.107.3:7234","shard-range-id":12,"previous-shard-range-id":11,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/context_impl.go:1204"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"Task key range updated","shard-id":3,"address":"192.168.107.3:7234","number":12582912,"next-number":13631488,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/task_key_generator.go:177"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"Acquired shard","shard-id":3,"address":"192.168.107.3:7234","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/context_impl.go:1985"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","shard-id":3,"address":"192.168.107.3:7234","lifecycle":"Starting","component":"shard-engine","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/context_impl.go:1463"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","shard-id":3,"address":"192.168.107.3:7234","component":"history-engine","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/history_engine.go:327"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","shard-id":3,"address":"192.168.107.3:7234","component":"timer-queue-processor","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_scheduled.go:153"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"Task rescheduler started.","shard-id":3,"address":"192.168.107.3:7234","component":"timer-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/rescheduler.go:127"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","shard-id":3,"address":"192.168.107.3:7234","component":"timer-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_scheduled.go:162"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","shard-id":3,"address":"192.168.107.3:7234","component":"visibility-queue-processor","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_immediate.go:113"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"Task rescheduler started.","shard-id":3,"address":"192.168.107.3:7234","component":"visibility-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/rescheduler.go:127"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","shard-id":3,"address":"192.168.107.3:7234","component":"visibility-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_immediate.go:122"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","service":"history","component":"memory-scheduled-queue-processor","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/memory_scheduled_queue.go:103"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","service":"history","component":"memory-scheduled-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/memory_scheduled_queue.go:108"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","shard-id":3,"address":"192.168.107.3:7234","component":"transfer-queue-processor","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_immediate.go:113"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"Task rescheduler started.","shard-id":3,"address":"192.168.107.3:7234","component":"transfer-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/rescheduler.go:127"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","shard-id":3,"address":"192.168.107.3:7234","component":"transfer-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_immediate.go:122"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","shard-id":3,"address":"192.168.107.3:7234","component":"archival-queue-processor","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_scheduled.go:153"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"Task rescheduler started.","shard-id":3,"address":"192.168.107.3:7234","component":"archival-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/rescheduler.go:127"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","shard-id":3,"address":"192.168.107.3:7234","component":"archival-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_scheduled.go:162"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","shard-id":3,"address":"192.168.107.3:7234","component":"history-engine","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/history_engine.go:336"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","shard-id":3,"address":"192.168.107.3:7234","lifecycle":"Started","component":"shard-engine","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/context_impl.go:1466"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","shard-id":2,"address":"192.168.107.3:7234","component":"history-engine","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/history_engine.go:327"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","shard-id":2,"address":"192.168.107.3:7234","component":"transfer-queue-processor","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_immediate.go:113"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"Task rescheduler started.","shard-id":2,"address":"192.168.107.3:7234","component":"transfer-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/rescheduler.go:127"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","shard-id":2,"address":"192.168.107.3:7234","component":"transfer-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_immediate.go:122"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","shard-id":2,"address":"192.168.107.3:7234","component":"archival-queue-processor","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_scheduled.go:153"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"Task rescheduler started.","shard-id":2,"address":"192.168.107.3:7234","component":"archival-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/rescheduler.go:127"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"queue reader started","shard-id":3,"address":"192.168.107.3:7234","component":"timer-queue-processor","queue-reader-id":0,"lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/reader.go:182"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","shard-id":2,"address":"192.168.107.3:7234","component":"archival-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_scheduled.go:162"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","shard-id":2,"address":"192.168.107.3:7234","component":"timer-queue-processor","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_scheduled.go:153"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"Task rescheduler started.","shard-id":2,"address":"192.168.107.3:7234","component":"timer-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/rescheduler.go:127"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","shard-id":2,"address":"192.168.107.3:7234","component":"timer-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_scheduled.go:162"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","shard-id":2,"address":"192.168.107.3:7234","component":"visibility-queue-processor","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_immediate.go:113"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"Task rescheduler started.","shard-id":2,"address":"192.168.107.3:7234","component":"visibility-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/rescheduler.go:127"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","shard-id":2,"address":"192.168.107.3:7234","component":"visibility-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_immediate.go:122"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","service":"history","component":"memory-scheduled-queue-processor","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/memory_scheduled_queue.go:103"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","service":"history","component":"memory-scheduled-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/memory_scheduled_queue.go:108"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","shard-id":2,"address":"192.168.107.3:7234","component":"history-engine","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/history_engine.go:336"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"none","shard-id":2,"address":"192.168.107.3:7234","lifecycle":"Started","component":"shard-engine","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/context_impl.go:1466"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"queue reader started","shard-id":2,"address":"192.168.107.3:7234","component":"transfer-queue-processor","queue-reader-id":0,"lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/reader.go:182"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"queue reader started","shard-id":3,"address":"192.168.107.3:7234","component":"visibility-queue-processor","queue-reader-id":0,"lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/reader.go:182"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"queue reader started","shard-id":2,"address":"192.168.107.3:7234","component":"archival-queue-processor","queue-reader-id":0,"lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/reader.go:182"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"queue reader started","shard-id":3,"address":"192.168.107.3:7234","component":"transfer-queue-processor","queue-reader-id":0,"lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/reader.go:182"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"queue reader started","shard-id":2,"address":"192.168.107.3:7234","component":"timer-queue-processor","queue-reader-id":0,"lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/reader.go:182"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"queue reader started","shard-id":2,"address":"192.168.107.3:7234","component":"visibility-queue-processor","queue-reader-id":0,"lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/reader.go:182"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"queue reader started","shard-id":3,"address":"192.168.107.3:7234","component":"archival-queue-processor","queue-reader-id":0,"lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/reader.go:182"}
{"level":"info","ts":"2024-12-12T23:45:03.977Z","msg":"Range updated for shardID","shard-id":1,"address":"192.168.107.3:7234","shard-range-id":12,"previous-shard-range-id":11,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/context_impl.go:1204"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"Task key range updated","shard-id":1,"address":"192.168.107.3:7234","number":12582912,"next-number":13631488,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/task_key_generator.go:177"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"Acquired shard","shard-id":1,"address":"192.168.107.3:7234","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/context_impl.go:1985"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"none","shard-id":1,"address":"192.168.107.3:7234","lifecycle":"Starting","component":"shard-engine","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/context_impl.go:1463"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"none","shard-id":1,"address":"192.168.107.3:7234","component":"history-engine","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/history_engine.go:327"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"none","service":"history","component":"memory-scheduled-queue-processor","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/memory_scheduled_queue.go:103"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"none","service":"history","component":"memory-scheduled-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/memory_scheduled_queue.go:108"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"none","shard-id":1,"address":"192.168.107.3:7234","component":"transfer-queue-processor","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_immediate.go:113"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"Task rescheduler started.","shard-id":1,"address":"192.168.107.3:7234","component":"transfer-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/rescheduler.go:127"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"none","shard-id":1,"address":"192.168.107.3:7234","component":"transfer-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_immediate.go:122"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"none","shard-id":1,"address":"192.168.107.3:7234","component":"archival-queue-processor","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_scheduled.go:153"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"Task rescheduler started.","shard-id":1,"address":"192.168.107.3:7234","component":"archival-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/rescheduler.go:127"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"none","shard-id":1,"address":"192.168.107.3:7234","component":"archival-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_scheduled.go:162"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"none","shard-id":1,"address":"192.168.107.3:7234","component":"timer-queue-processor","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_scheduled.go:153"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"Task rescheduler started.","shard-id":1,"address":"192.168.107.3:7234","component":"timer-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/rescheduler.go:127"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"none","shard-id":1,"address":"192.168.107.3:7234","component":"timer-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_scheduled.go:162"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"none","shard-id":1,"address":"192.168.107.3:7234","component":"visibility-queue-processor","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_immediate.go:113"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"Task rescheduler started.","shard-id":1,"address":"192.168.107.3:7234","component":"visibility-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/rescheduler.go:127"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"none","shard-id":1,"address":"192.168.107.3:7234","component":"visibility-queue-processor","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/queue_immediate.go:122"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"none","shard-id":1,"address":"192.168.107.3:7234","component":"history-engine","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/history_engine.go:336"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"none","shard-id":1,"address":"192.168.107.3:7234","lifecycle":"Started","component":"shard-engine","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/shard/context_impl.go:1466"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"queue reader started","shard-id":1,"address":"192.168.107.3:7234","component":"transfer-queue-processor","queue-reader-id":0,"lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/reader.go:182"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"queue reader started","shard-id":1,"address":"192.168.107.3:7234","component":"archival-queue-processor","queue-reader-id":0,"lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/reader.go:182"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"queue reader started","shard-id":1,"address":"192.168.107.3:7234","component":"timer-queue-processor","queue-reader-id":0,"lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/reader.go:182"}
{"level":"info","ts":"2024-12-12T23:45:03.978Z","msg":"queue reader started","shard-id":1,"address":"192.168.107.3:7234","component":"visibility-queue-processor","queue-reader-id":0,"lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/history/queues/reader.go:182"}
{"level":"info","ts":"2024-12-12T23:45:04.106Z","msg":"Current reachable members","component":"service-resolver","service":"frontend","addresses":["192.168.107.3:7233"],"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/service_resolver.go:331"}
{"level":"info","ts":"2024-12-12T23:45:04.374Z","msg":"Current reachable members","component":"service-resolver","service":"frontend","addresses":["192.168.107.3:7233"],"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/service_resolver.go:331"}
{"level":"info","ts":"2024-12-12T23:45:04.378Z","msg":"Current reachable members","component":"service-resolver","service":"frontend","addresses":["192.168.107.3:7233"],"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/service_resolver.go:331"}
{"level":"info","ts":"2024-12-12T23:45:04.379Z","msg":"Current reachable members","component":"service-resolver","service":"worker","addresses":["192.168.107.3:7239"],"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/membership/ringpop/service_resolver.go:331"}
{"level":"info","ts":"2024-12-12T23:45:04.382Z","msg":"Quota changed","service":"frontend","component":"rpc-handler","scope":"namespace","wf-namespace":"temporal-system","current-quota":null,"new-quota":2400,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/quotas/calculator/logged_calculator.go:124"}
{"level":"info","ts":"2024-12-12T23:45:04.382Z","msg":"Quota changed","service":"frontend","component":"visibility-handler","scope":"namespace","wf-namespace":"temporal-system","current-quota":null,"new-quota":10,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/quotas/calculator/logged_calculator.go:124"}
{"level":"info","ts":"2024-12-12T23:45:04.382Z","msg":"Quota changed","service":"frontend","component":"namespace-replication","scope":"namespace","wf-namespace":"temporal-system","current-quota":null,"new-quota":10,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/quotas/calculator/logged_calculator.go:124"}
{"level":"info","ts":"2024-12-12T23:45:04.386Z","msg":"Quota changed","service":"history","component":"persistence","scope":"namespace","wf-namespace":"temporal-system","current-quota":null,"new-quota":0,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/quotas/calculator/logged_calculator.go:124"}
{"level":"info","ts":"2024-12-12T23:45:04.394Z","msg":"temporal-sys-history-scanner-workflow workflow successfully started","service":"worker","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/worker/scanner/scanner.go:292"}
{"level":"info","ts":"2024-12-12T23:45:04.398Z","msg":"temporal-sys-tq-scanner-workflow workflow successfully started","service":"worker","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/worker/scanner/scanner.go:292"}
{"level":"info","ts":"2024-12-12T23:45:04.574Z","msg":"Quota changed","service":"frontend","component":"persistence","scope":"namespace","wf-namespace":"temporal-system","current-quota":null,"new-quota":0,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/quotas/calculator/logged_calculator.go:124"}
{"level":"info","ts":"2024-12-12T23:45:04.575Z","msg":"Quota changed","service":"frontend","component":"long-poll-handler","scope":"namespace","wf-namespace":"temporal-system","current-quota":null,"new-quota":1200,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/quotas/calculator/logged_calculator.go:124"}
{"level":"info","ts":"2024-12-12T23:45:04.575Z","msg":"Started Worker","service":"worker","Namespace":"temporal-system","TaskQueue":"temporal-sys-tq-scanner-taskqueue-0","WorkerID":"1@ea19ac47872c@","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/worker/scanner/scanner.go:239"}
{"level":"info","ts":"2024-12-12T23:45:04.576Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-tq-scanner-taskqueue-0/1","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.576Z","msg":"none","component":"matching-engine","wf-task-queue-name":"ea19ac47872c:dbe353cb-029e-4243-9e2d-ca6988646279","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.576Z","msg":"Quota changed","service":"matching","component":"persistence","scope":"namespace","wf-namespace":"temporal-system","current-quota":null,"new-quota":0,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/quotas/calculator/logged_calculator.go:124"}
{"level":"info","ts":"2024-12-12T23:45:04.576Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-tq-scanner-taskqueue-0/2","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.576Z","msg":"none","component":"matching-engine","wf-task-queue-name":"temporal-sys-tq-scanner-taskqueue-0","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"UserData","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.577Z","msg":"none","component":"matching-engine","wf-task-queue-name":"ea19ac47872c:1adb1ab8-03dc-4ffb-b4e7-ad688efdd8f8","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.577Z","msg":"none","component":"matching-engine","wf-task-queue-name":"temporal-sys-history-scanner-taskqueue-0","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"UserData","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.577Z","msg":"Started Worker","service":"worker","Namespace":"temporal-system","TaskQueue":"temporal-sys-history-scanner-taskqueue-0","WorkerID":"1@ea19ac47872c@","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/worker/scanner/scanner.go:239"}
{"level":"info","ts":"2024-12-12T23:45:04.582Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-tq-scanner-taskqueue-0/2","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.583Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-history-scanner-taskqueue-0/1","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.583Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-tq-scanner-taskqueue-0/3","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.583Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-tq-scanner-taskqueue-0/3","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.583Z","msg":"none","component":"matching-engine","wf-task-queue-name":"temporal-sys-history-scanner-taskqueue-0","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.585Z","msg":"none","component":"matching-engine","wf-task-queue-name":"temporal-sys-tq-scanner-taskqueue-0","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.585Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-history-scanner-taskqueue-0/3","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.585Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-history-scanner-taskqueue-0/2","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.585Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-history-scanner-taskqueue-0/3","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.586Z","msg":"none","component":"matching-engine","wf-task-queue-name":"ea19ac47872c:04a98ef7-aa90-4405-8a2d-75a568d2f93b","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.586Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-history-scanner-taskqueue-0/2","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.586Z","msg":"Started Worker","service":"worker","Namespace":"temporal-system","TaskQueue":"temporal-sys-processor-parent-close-policy","WorkerID":"1@ea19ac47872c@","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/worker/parentclosepolicy/processor.go:98"}
{"level":"info","ts":"2024-12-12T23:45:04.586Z","msg":"none","component":"matching-engine","wf-task-queue-name":"temporal-sys-processor-parent-close-policy","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"UserData","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.587Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-history-scanner-taskqueue-0/1","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.587Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-tq-scanner-taskqueue-0/1","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.587Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-processor-parent-close-policy/3","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.587Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-processor-parent-close-policy/1","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.588Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-processor-parent-close-policy/3","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.588Z","msg":"none","component":"matching-engine","wf-task-queue-name":"ea19ac47872c:a4b1fec4-9281-4fc8-9ade-c90c59c6b903","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.588Z","msg":"Started Worker","service":"worker","Namespace":"temporal-system","TaskQueue":"temporal-sys-batcher-taskqueue","WorkerID":"1@ea19ac47872c@","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/worker/batcher/batcher.go:96"}
{"level":"info","ts":"2024-12-12T23:45:04.588Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-batcher-taskqueue/1","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.588Z","msg":"none","component":"matching-engine","wf-task-queue-name":"temporal-sys-batcher-taskqueue","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"UserData","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.589Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-batcher-taskqueue/2","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.589Z","msg":"none","component":"matching-engine","wf-task-queue-name":"temporal-sys-processor-parent-close-policy","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.590Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-processor-parent-close-policy/2","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.590Z","msg":"none","component":"matching-engine","wf-task-queue-name":"ea19ac47872c:f8f009f0-6676-497e-85c0-f48421c4da83","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.590Z","msg":"Started Worker","service":"worker","Namespace":"temporal-system","TaskQueue":"default-worker-tq","WorkerID":"1@ea19ac47872c@","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/worker/worker.go:113"}
{"level":"info","ts":"2024-12-12T23:45:04.590Z","msg":"none","component":"matching-engine","wf-task-queue-name":"default-worker-tq","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"UserData","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.590Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-batcher-taskqueue/3","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.590Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/default-worker-tq/1","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.592Z","msg":"Started Worker","service":"worker","Namespace":"temporal-system","TaskQueue":"temporal-sys-dlq-activity-tq","WorkerID":"1@ea19ac47872c@","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/worker/worker.go:113"}
{"level":"info","ts":"2024-12-12T23:45:04.592Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/default-worker-tq/3","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.592Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-dlq-activity-tq/3","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.593Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/default-worker-tq/3","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.593Z","msg":"none","component":"matching-engine","wf-task-queue-name":"temporal-sys-dlq-activity-tq","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"UserData","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.593Z","msg":"Started Worker","service":"worker","Namespace":"temporal-system","TaskQueue":"temporal-sys-delete-namespace-activity-tq","WorkerID":"1@ea19ac47872c@","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/worker/worker.go:113"}
{"level":"info","ts":"2024-12-12T23:45:04.594Z","msg":"none","component":"matching-engine","wf-task-queue-name":"temporal-sys-delete-namespace-activity-tq","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.594Z","msg":"none","component":"matching-engine","wf-task-queue-name":"temporal-sys-dlq-activity-tq","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.594Z","msg":"none","component":"matching-engine","wf-task-queue-name":"temporal-sys-delete-namespace-activity-tq","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"UserData","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.594Z","msg":"Started Worker","service":"worker","Namespace":"temporal-system","TaskQueue":"temporal-sys-migration-activity-tq","WorkerID":"1@ea19ac47872c@","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/worker/worker.go:113"}
{"level":"info","ts":"2024-12-12T23:45:04.594Z","msg":"none","component":"matching-engine","wf-task-queue-name":"temporal-sys-migration-activity-tq","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.594Z","msg":"none","component":"matching-engine","wf-task-queue-name":"temporal-sys-migration-activity-tq","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"UserData","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.595Z","msg":"Started Worker","service":"worker","Namespace":"temporal-system","TaskQueue":"temporal-sys-add-search-attributes-activity-tq","WorkerID":"1@ea19ac47872c@","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/worker/worker.go:113"}
{"level":"info","ts":"2024-12-12T23:45:04.595Z","msg":"none","component":"worker-manager","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/worker/worker.go:118"}
{"level":"info","ts":"2024-12-12T23:45:04.595Z","msg":"none","component":"perns-worker-manager","lifecycle":"Starting","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/worker/pernamespaceworker.go:167"}
{"level":"info","ts":"2024-12-12T23:45:04.595Z","msg":"none","component":"perns-worker-manager","lifecycle":"Started","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/worker/pernamespaceworker.go:178"}
{"level":"info","ts":"2024-12-12T23:45:04.595Z","msg":"worker service started","service":"worker","component":"worker","address":"192.168.107.3:7239","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/worker/service.go:274"}
{"level":"info","ts":"2024-12-12T23:45:04.595Z","msg":"none","component":"matching-engine","wf-task-queue-name":"temporal-sys-add-search-attributes-activity-tq","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.595Z","msg":"none","component":"matching-engine","wf-task-queue-name":"temporal-sys-add-search-attributes-activity-tq","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"UserData","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.596Z","msg":"Quota changed","service":"frontend","component":"rpc-handler","scope":"namespace","wf-namespace":"default","current-quota":null,"new-quota":2400,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/quotas/calculator/logged_calculator.go:124"}
{"level":"info","ts":"2024-12-12T23:45:04.596Z","msg":"Quota changed","service":"frontend","component":"visibility-handler","scope":"namespace","wf-namespace":"default","current-quota":null,"new-quota":10,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/quotas/calculator/logged_calculator.go:124"}
{"level":"info","ts":"2024-12-12T23:45:04.596Z","msg":"Quota changed","service":"frontend","component":"namespace-replication","scope":"namespace","wf-namespace":"default","current-quota":null,"new-quota":10,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/quotas/calculator/logged_calculator.go:124"}
{"level":"info","ts":"2024-12-12T23:45:04.596Z","msg":"Quota changed","service":"frontend","component":"persistence","scope":"namespace","wf-namespace":"default","current-quota":null,"new-quota":0,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/quotas/calculator/logged_calculator.go:124"}
{"level":"info","ts":"2024-12-12T23:45:04.597Z","msg":"none","component":"matching-engine","wf-task-queue-name":"ea19ac47872c:2e440207-45af-4868-9059-2718127859c8","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.597Z","msg":"none","component":"matching-engine","wf-task-queue-name":"temporal-sys-per-ns-tq","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"UserData","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.597Z","msg":"Quota changed","service":"frontend","component":"long-poll-handler","scope":"namespace","wf-namespace":"default","current-quota":null,"new-quota":1200,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/quotas/calculator/logged_calculator.go:124"}
{"level":"info","ts":"2024-12-12T23:45:04.597Z","msg":"Started Worker","service":"worker","Namespace":"temporal-system","TaskQueue":"temporal-sys-per-ns-tq","WorkerID":"server-worker@1@ea19ac47872c@temporal-system","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/worker/pernamespaceworker.go:508"}
{"level":"info","ts":"2024-12-12T23:45:04.597Z","msg":"none","component":"matching-engine","wf-task-queue-name":"ea19ac47872c:409a5751-b09a-481f-97be-e7cb529090e7","wf-task-queue-type":"Workflow","wf-namespace":"default","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.597Z","msg":"Quota changed","service":"matching","component":"persistence","scope":"namespace","wf-namespace":"default","current-quota":null,"new-quota":0,"logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/common/quotas/calculator/logged_calculator.go:124"}
{"level":"info","ts":"2024-12-12T23:45:04.597Z","msg":"none","component":"matching-engine","wf-task-queue-name":"temporal-sys-per-ns-tq","wf-task-queue-type":"Workflow","wf-namespace":"default","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"UserData","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.597Z","msg":"Started Worker","service":"worker","Namespace":"default","TaskQueue":"temporal-sys-per-ns-tq","WorkerID":"server-worker@1@ea19ac47872c@default","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/worker/pernamespaceworker.go:508"}
{"level":"info","ts":"2024-12-12T23:45:04.597Z","msg":"none","component":"matching-engine","wf-task-queue-name":"temporal-sys-per-ns-tq","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.598Z","msg":"none","component":"matching-engine","wf-task-queue-name":"temporal-sys-per-ns-tq","wf-task-queue-type":"Activity","wf-namespace":"default","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.598Z","msg":"none","component":"matching-engine","wf-task-queue-name":"temporal-sys-batcher-taskqueue","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:45:04.600Z","msg":"none","component":"matching-engine","wf-task-queue-name":"default-worker-tq","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
Temporal server started.
Registering default namespace: default.
time=2024-12-12T23:45:04.952 level=WARN msg="Passing the namespace as an argument is now deprecated; please switch to using -n instead"
  NamespaceInfo.Name                    default
  NamespaceInfo.Id                      2eef9c79-5e39-4752-ab8b-7fb96230edd8
  NamespaceInfo.Description             Default namespace for Temporal Server.
  NamespaceInfo.OwnerEmail               
  NamespaceInfo.State                   Registered
  NamespaceInfo.Data                    map[]
  Config.WorkflowExecutionRetentionTtl  24h0m0s
  ReplicationConfig.ActiveClusterName   active
  ReplicationConfig.Clusters            [{"clusterName":"active"}]
  Config.HistoryArchivalState           Disabled
  Config.VisibilityArchivalState        Disabled
  IsGlobalNamespace                     false
  FailoverVersion                       0
  FailoverHistory                       []
  Config.HistoryArchivalUri              
  Config.VisibilityArchivalUri           
Default namespace default already registered.
             Name                Type    
  ExecutionStatus             Keyword    
  StateTransitionCount        Int        
  RootRunId                   Keyword    
  ExecutionDuration           Int        
  ParentRunId                 Keyword    
  HistoryLength               Int        
  BatcherNamespace            Keyword    
  ParentWorkflowId            Keyword    
  WorkflowId                  Keyword    
  BatcherUser                 Keyword    
  RunId                       Keyword    
  ExecutionTime               Datetime   
  WorkflowType                Keyword    
  TemporalScheduledById       Keyword    
  TemporalChangeVersion       KeywordList
  StartTime                   Datetime   
  TaskQueue                   Keyword    
  BuildIds                    KeywordList
  TemporalScheduledStartTime  Datetime   
  CloseTime                   Datetime   
  TemporalNamespaceDivision   Keyword    
  HistorySizeBytes            Int        
  RootWorkflowId              Keyword    
  BinaryChecksums             KeywordList
  TemporalSchedulePaused      Bool       
  CustomDoubleField           Double     
  CustomTextField             Text       
  CustomBoolField             Bool       
  CustomIntField              Int        
  CustomStringField           Text       
  CustomKeywordField          Keyword    
  CustomDatetimeField         Datetime   
Namespace cache refreshed.
Adding Custom*Field search attributes.
{"level":"warn","ts":"2024-12-12T23:45:04.996Z","msg":"Search attribute CustomIntField already exists.","service":"frontend","namespace":"default","visibility-search-attribute":"CustomIntField","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/frontend/operator_handler.go:340"}
{"level":"warn","ts":"2024-12-12T23:45:04.996Z","msg":"Search attribute CustomDatetimeField already exists.","service":"frontend","namespace":"default","visibility-search-attribute":"CustomDatetimeField","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/frontend/operator_handler.go:340"}
{"level":"warn","ts":"2024-12-12T23:45:04.996Z","msg":"Search attribute CustomDoubleField already exists.","service":"frontend","namespace":"default","visibility-search-attribute":"CustomDoubleField","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/frontend/operator_handler.go:340"}
{"level":"warn","ts":"2024-12-12T23:45:04.996Z","msg":"Search attribute CustomBoolField already exists.","service":"frontend","namespace":"default","visibility-search-attribute":"CustomBoolField","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/frontend/operator_handler.go:340"}
{"level":"warn","ts":"2024-12-12T23:45:04.996Z","msg":"Search attribute CustomKeywordField already exists.","service":"frontend","namespace":"default","visibility-search-attribute":"CustomKeywordField","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/frontend/operator_handler.go:340"}
{"level":"warn","ts":"2024-12-12T23:45:04.996Z","msg":"Search attribute CustomStringField already exists.","service":"frontend","namespace":"default","visibility-search-attribute":"CustomStringField","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/frontend/operator_handler.go:340"}
{"level":"warn","ts":"2024-12-12T23:45:04.996Z","msg":"Search attribute CustomTextField already exists.","service":"frontend","namespace":"default","visibility-search-attribute":"CustomTextField","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/frontend/operator_handler.go:340"}
Search attributes have been added
{"level":"info","ts":"2024-12-12T23:46:03.618Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-batcher-taskqueue/1","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:46:03.621Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-dlq-activity-tq/1","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:46:03.622Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/default-worker-tq/2","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:46:04.605Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-dlq-activity-tq/2","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:47:02.631Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/default-worker-tq/1","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:47:04.620Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-processor-parent-close-policy/1","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:48:01.642Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-processor-parent-close-policy/2","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:48:01.642Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/default-worker-tq/2","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:48:02.628Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-batcher-taskqueue/2","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:52:02.834Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-batcher-taskqueue/3","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Started","cause":"Poll","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:289"}
{"level":"info","ts":"2024-12-12T23:52:06.813Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-processor-parent-close-policy/3","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Stopped","cause":"Idle","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:307"}
{"level":"info","ts":"2024-12-12T23:52:06.820Z","msg":"none","component":"matching-engine","wf-task-queue-name":"/_sys/default-worker-tq/1","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","worker-build-id":"_unversioned_","lifecycle":"Stopped","cause":"Idle","logging-call-at":"/home/runner/work/docker-builds/docker-builds/temporal/service/matching/physical_task_queue_manager.go:307"}

@iamKunalGupta
Copy link
Member

This is very weird tbh, I cleaned my old containers and cloned and re-ran, seems to be working fine for me.

Once temporal is up (and the rest of the containers are failing), can you try running the left over containers one by one?

@iamKunalGupta
Copy link
Member

I have generally seen this happen only when developing flow-* locally and using temporal via the container, a re-run of the build usually, does it for me

@donbeave
Copy link
Author

I tried that as well. Tried to run temporal, wait for a while (5-10 minutes), and later run the rest of them.

@iamKunalGupta
Copy link
Member

If you are available for a few mins, maybe we can sit down and take a look at it? You can join the community slack and message and we can schedule a call https://slack.peerdb.io/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@iamKunalGupta iamKunalGupta

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@donbeave @iamKunalGupta