Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug]: pass undefined(empty) to the RestoreRBAC API will crash the server #38985

Open
1 task done
shanghaikid opened this issue Jan 3, 2025 · 6 comments
Open
1 task done

[Bug]: pass undefined(empty) to the RestoreRBAC API will crash the server #38985

shanghaikid opened this issue Jan 3, 2025 · 6 comments
Labels
kind/bug Issues or changes related a bug triage/accepted Indicates an issue or PR is ready to be actively worked on.
Milestone
2.5.3

Comments

@shanghaikid
Copy link
Contributor

Is there an existing issue for this?

  • I have searched the existing issues

Environment

- Milvus version: master-20250103-1825ab54-amd64

Current Behavior

milvus crashed after I pass undefined to the restoreRBAC api

Expected Behavior

No response

Steps To Reproduce

No response

Milvus Log

milvus.log

Anything else?

No response
@shanghaikid shanghaikid added kind/bug Issues or changes related a bug needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Jan 3, 2025
@shanghaikid
Copy link
Contributor Author 

[2025/01/03 08:43:05.928 +00:00] [DEBUG] [rootcoord/root_coord.go:3035] ["ListPrivilegeGroups success"] [traceID=7dfd531d768acec6e6f1bfbb19fe90be] [role=rootcoord] [in="base:{msg_type:ListPrivilegeGroups timestamp:1735893785 sourceID:1}"]
[2025/01/03 08:43:05.930 +00:00] [DEBUG] [proxy/impl.go:5655] [RestoreRBAC] [traceID=28aace9572954888a9ec21018097570d] [req=]
[2025/01/03 08:43:05.930 +00:00] [DEBUG] [rootcoord/root_coord.go:2823] [RestoreRBAC] [traceID=28aace9572954888a9ec21018097570d] [role=rootcoord]
[2025/01/03 08:43:06.220 +00:00] [INFO] [datacoord/channel_manager.go:625] ["Check ToWatch/ToRelease channel operations progress"] ["channel count"=1] ["channel names"="[by-dev-rootcoord-dml_0_455054108900721255v0]"]
[2025/01/03 08:43:06.222 +00:00] [INFO] [datanode/services.go:384] ["DataNode receives CheckChannelOperationProgress"] [traceID=89938a3af6dfececa86bd2e3a31c8c42] [channel=by-dev-rootcoord-dml_0_455054108900721255v0] [operation=ToWatch]
[2025/01/03 08:43:06.222 +00:00] [INFO] [datacoord/channel_manager.go:700] ["Got channel operation progress"] [opID=455054108974120962] [nodeID=1] ["check operation"=ToWatch] [channel=by-dev-rootcoord-dml_0_455054108900721255v0] ["got state"=WatchSuccess] [progress=100]
[2025/01/03 08:43:06.222 +00:00] [INFO] [datacoord/channel_manager.go:660] ["Finish to Check ToWatch/ToRelease channel operations progress"] ["channel count"=1] ["channel names"="[by-dev-rootcoord-dml_0_455054108900721255v0]"]
[2025/01/03 08:43:06.222 +00:00] [INFO] [datacoord/channel_manager.go:555] ["Notify channel operations to datanode"] [assignment=1] ["total operation count"=1] ["channel names"="[by-dev-rootcoord-dml_1_455054108900721263v0]"]
[2025/01/03 08:43:06.222 +00:00] [INFO] [datacoord/handler.go:70] [GetDataVChanPositions] [collectionID=455054108900721263] [channel=by-dev-rootcoord-dml_1_455054108900721263v0] [numOfSegments=0]
[2025/01/03 08:43:06.222 +00:00] [INFO] [datacoord/handler.go:436] ["channel seek position set from channel checkpoint meta"] [channel=by-dev-rootcoord-dml_1_455054108900721263v0] [posTs=455054140429565959] [posTime=2025/01/03 08:43:05.208 +00:00]
[2025/01/03 08:43:06.222 +00:00] [INFO] [datacoord/channel_manager.go:675] ["Notify channel operation"] [channel=by-dev-rootcoord-dml_1_455054108900721263v0] [assignment=1] [operation=ToWatch] [opID=455054108974120964]
[2025/01/03 08:43:06.222 +00:00] [INFO] [datanode/services.go:356] ["DataNode receives NotifyChannelOperation"] [traceID=2cdc5a7875dd26bd2a820d0d03bb89a1] ["operation count"=1]
[2025/01/03 08:43:06.222 +00:00] [INFO] [channel/channel_manager.go:331] ["Start to execute channel operation"] [channel=by-dev-rootcoord-dml_1_455054108900721263v0] [opID=455054108974120964] [state=ToWatch]
[2025/01/03 08:43:06.222 +00:00] [INFO] [pipeline/flow_graph_dmstream_input_node.go:74] ["datanode consume without replicateID, try to get replicateID from dbProperties"] [nodeID=1] [vchannel=by-dev-rootcoord-dml_1_455054108900721263v0] [dbProperties=null]
[2025/01/03 08:43:06.223 +00:00] [INFO] [msgdispatcher/manager.go:66] ["create new dispatcherManager"] [role=datanode] [nodeID=1] [pchannel=by-dev-rootcoord-dml_1]
[2025/01/03 08:43:06.223 +00:00] [INFO] [msgdispatcher/dispatcher.go:97] ["creating dispatcher..."] [pchannel=by-dev-rootcoord-dml_1] [subName=datanode-1-by-dev-rootcoord-dml_1_455054108900721263v0-true] [isMain=true]
[2025/01/03 08:43:06.223 +00:00] [INFO] [msgstream/mq_msgstream.go:124] ["Msg Stream state"] [can_produce=true]
[2025/01/03 08:43:06.223 +00:00] [DEBUG] [server/rocksmq_impl.go:542] ["Rocksmq create consumer group successfully "] [module=rocksmq] [topic=by-dev-rootcoord-dml_1] [group=datanode-1-by-dev-rootcoord-dml_1_455054108900721263v0-true] [elapsed=0]
[2025/01/03 08:43:06.223 +00:00] [DEBUG] [server/rocksmq_impl.go:568] ["Rocksmq register consumer successfully "] [module=rocksmq] [topic=by-dev-rootcoord-dml_1] [elapsed=0]
[2025/01/03 08:43:06.223 +00:00] [INFO] [msgstream/mq_msgstream.go:922] ["MsgStream begin to seek start msg: "] [channel=by-dev-rootcoord-dml_1] [MessageID="AQBAalStUAY="]
[2025/01/03 08:43:06.223 +00:00] [INFO] [channel/channel_manager.go:386] ["Start timer for ToWatch operation"] [channel=by-dev-rootcoord-dml_1_455054108900721263v0] [opID=455054108974120964] [timeout=2m0s]
[2025/01/03 08:43:06.223 +00:00] [DEBUG] [datacoord/channel_manager.go:681] ["Success to notify channel operations"] [channel=by-dev-rootcoord-dml_1_455054108900721263v0] [assignment=1] [operation=ToWatch] [opID=455054108974120964]
[2025/01/03 08:43:06.223 +00:00] [INFO] [datacoord/channel_manager.go:597] ["Finish to notify channel operations to datanode"] [assignment=1] ["operation count"=1] ["success count"=1] ["failure count"=0]
[2025/01/03 08:43:06.223 +00:00] [DEBUG] [server/rocksmq_impl.go:946] ["successfully seek"] [module=rocksmq] [topic=by-dev-rootcoord-dml_1] [group=datanode-1-by-dev-rootcoord-dml_1_455054108900721263v0-true] [msgId=455054140435857409]
[2025/01/03 08:43:06.223 +00:00] [INFO] [msgstream/mq_msgstream.go:932] ["MsgStream seek finished"] [channel=by-dev-rootcoord-dml_1]
[2025/01/03 08:43:06.223 +00:00] [INFO] [msgdispatcher/manager.go:167] ["dispatcherManager is running..."] [role=datanode] [nodeID=1] [pchannel=by-dev-rootcoord-dml_1]
[2025/01/03 08:43:06.223 +00:00] [INFO] [msgstream/mq_msgstream.go:1006] ["skip msg"] [source=0] [type=CreateCollection] [size=736] [msgTs=455054140429565959] [posTs=455054140429565959]
[2025/01/03 08:43:06.223 +00:00] [INFO] [msgdispatcher/dispatcher.go:126] ["seek successfully"] [pchannel=by-dev-rootcoord-dml_1] [subName=datanode-1-by-dev-rootcoord-dml_1_455054108900721263v0-true] [isMain=true] [posTs=455054140429565959] [posTime=2025/01/03 08:43:05.208 +00:00] [tsLag=1.015513918s]
[2025/01/03 08:43:06.223 +00:00] [INFO] [msgdispatcher/dispatcher.go:162] ["add new target"] [vchannel=by-dev-rootcoord-dml_1_455054108900721263v0] [isMain=true]
[2025/01/03 08:43:06.223 +00:00] [INFO] [msgdispatcher/manager.go:114] ["add main dispatcher"] [role=datanode] [nodeID=1] [vchannel=by-dev-rootcoord-dml_1_455054108900721263v0]
[2025/01/03 08:43:06.223 +00:00] [INFO] [msgdispatcher/dispatcher.go:190] ["get signal"] [pchannel=by-dev-rootcoord-dml_1] [signal=start] [isMain=true]
[2025/01/03 08:43:06.223 +00:00] [INFO] [msgdispatcher/dispatcher.go:213] ["handle signal done"] [pchannel=by-dev-rootcoord-dml_1] [signal=start] [isMain=true]
[2025/01/03 08:43:06.223 +00:00] [INFO] [msgdispatcher/client.go:103] ["register done"] [role=datanode] [nodeID=1] [vchannel=by-dev-rootcoord-dml_1_455054108900721263v0]
[2025/01/03 08:43:06.223 +00:00] [INFO] [pipeline/flow_graph_dmstream_input_node.go:89] ["datanode seek successfully when register to msgDispatcher"] [nodeID=1] [vchannel=by-dev-rootcoord-dml_1_455054108900721263v0] [msgID="\u0001\u0000@jT\ufffdP\u0006"] [tsTime=2025/01/03 08:43:05.208 +00:00] [tsLag=1.015563793s]
[2025/01/03 08:43:06.223 +00:00] [INFO] [pipeline/flow_graph_dd_node.go:362] ["ddNode add sealed and growing segments"] [collectionID=455054108900721263] ["No. sealed segments"=0] ["No. growing segments"=0]
[2025/01/03 08:43:06.223 +00:00] [INFO] [pipeline/data_sync_service.go:86] ["dataSyncService starting flow graph"] [collectionID=455054108900721263] [vChanName=by-dev-rootcoord-dml_1_455054108900721263v0]
[2025/01/03 08:43:06.223 +00:00] [INFO] [channel/channel_manager.go:415] ["Stop timer for ToWatch operation succeeded"] [channel=by-dev-rootcoord-dml_1_455054108900721263v0] [opID=455054108974120964] [timeout=2m0s]
[2025/01/03 08:43:06.223 +00:00] [INFO] [channel/channel_manager.go:210] ["Success to watch"] [opID=455054108974120964] [channel=by-dev-rootcoord-dml_1_455054108900721263v0] [State=WatchSuccess]
[2025/01/03 08:43:06.223 +00:00] [INFO] [msgdispatcher/dispatcher.go:218] ["begin to work"] [pchannel=by-dev-rootcoord-dml_1] [isMain=true]
[2025/01/03 08:43:06.223 +00:00] [DEBUG] [writebuffer/write_buffer.go:266] ["checkpoint from latest consumed msg"] [collectionID=455054108900721263] [channel=by-dev-rootcoord-dml_1_455054108900721263v0] [cpTimestamp=455054140521316355]
[2025/01/03 08:43:07.223 +00:00] [INFO] [datacoord/channel_manager.go:625] ["Check ToWatch/ToRelease channel operations progress"] ["channel count"=1] ["channel names"="[by-dev-rootcoord-dml_1_455054108900721263v0]"]

SIGNAL CATCH BY NON-GO SIGNAL HANDLER
SIGNO: 11; SIGNAME: Segmentation fault; SI_CODE: 1; SI_ADDR: 0x40
BACKTRACE:
github.com/milvus-io/milvus/internal/metastore/kv/rootcoord.(*Catalog).RestoreRBAC
/workspace/source/internal/metastore/kv/rootcoord/kv_catalog.go:1530 pc=0x5ce588c


panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x40 pc=0x5ce588c]
[2025/01/03 08:43:07.224 +00:00] [INFO] [datanode/services.go:384] ["DataNode receives CheckChannelOperationProgress"] [traceID=79e1b0c93da68df2f9c74a2c31c93987] [channel=by-dev-rootcoord-dml_1_455054108900721263v0] [operation=ToWatch]
[2025/01/03 08:43:07.224 +00:00] [INFO] [datacoord/channel_manager.go:700] ["Got channel operation progress"] [opID=455054108974120964] [nodeID=1] ["check operation"=ToWatch] [channel=by-dev-rootcoord-dml_1_455054108900721263v0] ["got state"=WatchSuccess] [progress=100]
[2025/01/03 08:43:07.224 +00:00] [INFO] [datacoord/channel_manager.go:660] ["Finish to Check ToWatch/ToRelease channel operations progress"] ["channel count"=1] ["channel names"="[by-dev-rootcoord-dml_1_455054108900721263v0]"]
[2025/01/03 08:43:07.361 +00:00] [DEBUG] [datacoord/import_scheduler.go:150] ["peek slots done"] [nodeSlots="{\"1\":16}"]
[2025/01/03 08:43:07.888 +00:00] [DEBUG] [querynodev2/services.go:73] ["QueryNode current state"] [traceID=44550e17da9c15ed7849c352f6583b62] [NodeID=1] [StateCode=Healthy]
[2025/01/03 08:43:07.889 +00:00] [INFO] [datacoord/meta.go:1778] ["UpdateChannelCheckpoint done"] [traceID=1fd20226326ce11c59b2d504e4baef97] [channel=by-dev-rootcoord-dml_0_455054108900721255v0] [ts=455054140521316355] [time=2025/01/03 08:43:05.558 +00:00]
[2025/01/03 08:43:07.889 +00:00] [INFO] [datacoord/meta.go:1778] ["UpdateChannelCheckpoint done"] [traceID=1fd20226326ce11c59b2d504e4baef97] [channel=by-dev-rootcoord-dml_1_455054108900721263v0] [ts=455054140521316355] [time=2025/01/03 08:43:05.558 +00:00]
[2025/01/03 08:43:07.889 +00:00] [DEBUG] [pipeline/flow_graph_time_tick_node.go:135] ["UpdateChannelCheckpoint success"] [channel=by-dev-rootcoord-dml_0_455054108900721255v0] [cpTs=455054140521316355] [cpTime=2025/01/03 08:43:05.558 +00:00]
[2025/01/03 08:43:07.889 +00:00] [DEBUG] [pipeline/flow_graph_time_tick_node.go:135] ["UpdateChannelCheckpoint success"] [channel=by-dev-rootcoord-dml_1_455054108900721263v0] [cpTs=455054140521316355] [cpTime=2025/01/03 08:43:05.558 +00:00]
[2025/01/03 08:43:07.929 +00:00] [DEBUG] [observers/resource_observer.go:97] ["start to check resource group"] [enableRGAutoRecover=true] [resourceGroupNum=1]
[2025/01/03 08:43:07.929 +00:00] [DEBUG] [observers/resource_observer.go:105] ["recover resource groups..."]
[2025/01/03 08:43:07.929 +00:00] [DEBUG] [observers/resource_observer.go:125] ["check resource group done"] [enableRGAutoRecover=true] [resourceGroupNum=1]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Collection] [rateType=DMLUpsert] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Collection] [rateType=DMLDelete] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Collection] [rateType=DMLBulkLoad] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Collection] [rateType=DQLSearch] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Collection] [rateType=DQLQuery] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Collection] [rateType=DDLFlush] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Collection] [rateType=DMLInsert] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Partition] [rateType=DMLUpsert] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Partition] [rateType=DMLDelete] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Partition] [rateType=DMLBulkLoad] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Partition] [rateType=DQLSearch] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Partition] [rateType=DQLQuery] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Partition] [rateType=DMLInsert] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Collection] [rateType=DMLInsert] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Collection] [rateType=DMLUpsert] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Collection] [rateType=DMLDelete] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Collection] [rateType=DMLBulkLoad] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Collection] [rateType=DQLSearch] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Collection] [rateType=DQLQuery] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Collection] [rateType=DDLFlush] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Partition] [rateType=DQLSearch] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Partition] [rateType=DQLQuery] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Partition] [rateType=DMLInsert] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Partition] [rateType=DMLUpsert] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Partition] [rateType=DMLDelete] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:08.015 +00:00] [DEBUG] [proxy/simple_rate_limiter.go:235] ["RateLimiter register for rateType"] [source=Partition] [rateType=DMLBulkLoad] [rateLimit=+inf] [burst=1.7976931348623157e+308]
[2025/01/03 08:43:09.359 +00:00] [DEBUG] [datacoord/import_scheduler.go:150] ["peek slots done"] [nodeSlots="{\"1\":16}"]

goroutine 4512 gp=0xc00315a540 m=13 mp=0xc0012a2008 [running]:
panic({0x6386120?, 0x9e39040?})
/go/pkg/mod/golang.org/[email protected]/src/runtime/panic.go:779 +0x158 fp=0xc005158d80 sp=0xc005158cd0 pc=0x1fe3b18
runtime.panicmem(...)
/go/pkg/mod/golang.org/[email protected]/src/runtime/panic.go:261
runtime.sigpanic()
/go/pkg/mod/golang.org/[email protected]/src/runtime/signal_unix.go:881 +0x378 fp=0xc005158de0 sp=0xc005158d80 pc=0x1ffe818
github.com/milvus-io/milvus/internal/metastore/kv/rootcoord.(*Catalog).RestoreRBAC(0xc00113f380, {0x73e1328, 0xc003fc6450}, {0x0, 0x0}, 0x0)
/workspace/source/internal/metastore/kv/rootcoord/kv_catalog.go:1530 +0x1ec fp=0xc0051591f8 sp=0xc005158de0 pc=0x5ce588c
github.com/milvus-io/milvus/internal/rootcoord.(*MetaTable).RestoreRBAC(0xc0019c2120, {0x73e1328, 0xc003fc6450}, {0x0, 0x0}, 0x0)
/workspace/source/internal/rootcoord/meta_table.go:1525 +0xd1 fp=0xc005159270 sp=0xc0051591f8 pc=0x5d231b1
github.com/milvus-io/milvus/internal/rootcoord.executeRestoreRBACTaskSteps.func1({0x73e1328, 0xc003fc6450})
/workspace/source/internal/rootcoord/rbac_task.go:228 +0x63 fp=0xc0051593d8 sp=0xc005159270 pc=0x5d3cd63
github.com/milvus-io/milvus/internal/rootcoord.(*simpleStep).Execute(0x20?, {0x73e1328?, 0xc003fc6450?})
/workspace/source/internal/rootcoord/step.go:576 +0x27 fp=0xc0051593f8 sp=0xc0051593d8 pc=0x5d72827
github.com/milvus-io/milvus/internal/rootcoord.(*baseRedoTask).Execute(0xc003f9f000, {0x73e1328, 0xc003fc6450})
/workspace/source/internal/rootcoord/redo.go:63 +0x95 fp=0xc005159520 sp=0xc0051593f8 pc=0x5d3f015
github.com/milvus-io/milvus/internal/rootcoord.executeRestoreRBACTaskSteps({0x73e1328, 0xc003fc6450}, 0xc0013d1080, 0xc003f9ee80)
/workspace/source/internal/rootcoord/rbac_task.go:244 +0x325 fp=0xc0051595a0 sp=0xc005159520 pc=0x5d3c9a5
github.com/milvus-io/milvus/internal/rootcoord.(*Core).RestoreRBAC(0xc0013d1080, {0x73e1328, 0xc003fc6450}, 0xc003f9ee80)
/workspace/source/internal/rootcoord/root_coord.go:2829 +0x22e fp=0xc005159700 sp=0xc0051595a0 pc=0x5d687ce
github.com/milvus-io/milvus/internal/distributed/rootcoord.(*Server).RestoreRBAC(0x9e5c4e0?, {0x73e1328?, 0xc003fc6450?}, 0xc003fe8050?)
/workspace/source/internal/distributed/rootcoord/service.go:550 +0x28 fp=0xc005159730 sp=0xc005159700 pc=0x5d88528
github.com/milvus-io/milvus/internal/proto/rootcoordpb._RootCoord_RestoreRBAC_Handler.func1({0x73e1328?, 0xc003fc6450?}, {0x66b4060?, 0xc003f9ee80?})
/workspace/source/internal/proto/rootcoordpb/root_coord_grpc.pb.go:1776 +0xce fp=0xc005159768 sp=0xc005159730 pc=0x509face
github.com/milvus-io/milvus/internal/distributed/rootcoord.(*Server).startGrpcLoop.ServerIDValidationUnaryServerInterceptor.func7({0x73e1328, 0xc003fc6450}, {0x66b4060, 0xc003f9ee80}, 0x2e10874?, 0xc003f87f20)
/workspace/source/pkg/util/interceptor/server_id_interceptor.go:54 +0xe5 fp=0xc0051597b0 sp=0xc005159768 pc=0x5d86785
github.com/milvus-io/milvus/internal/distributed/rootcoord.(*Server).startGrpcLoop.ChainUnaryServer.func8.1.1({0x73e1328?, 0xc003fc6450?}, {0x66b4060?, 0xc003f9ee80?})
/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:25 +0x34 fp=0xc0051597f0 sp=0xc0051597b0 pc=0x5d86654
github.com/milvus-io/milvus/internal/distributed/rootcoord.(*Server).startGrpcLoop.ClusterValidationUnaryServerInterceptor.func6({0x73e1328, 0xc003fc6450}, {0x66b4060, 0xc003f9ee80}, 0x20?, 0xc003f81ba0)
/workspace/source/pkg/util/interceptor/cluster_interceptor.go:48 +0xc8 fp=0xc005159848 sp=0xc0051597f0 pc=0x5d88de8
github.com/milvus-io/milvus/internal/distributed/rootcoord.(*Server).startGrpcLoop.ChainUnaryServer.func8.1.1({0x73e1328?, 0xc003fc6450?}, {0x66b4060?, 0xc003f9ee80?})
/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:25 +0x34 fp=0xc005159888 sp=0xc005159848 pc=0x5d86654
github.com/milvus-io/milvus/pkg/util/logutil.UnaryTraceLoggerInterceptor({0x73e1328?, 0xc003fc63c0?}, {0x66b4060, 0xc003f9ee80}, 0x18?, 0xc003f81bc0)
/workspace/source/pkg/util/logutil/grpc_interceptor.go:23 +0x43 fp=0xc0051598b8 sp=0xc005159888 pc=0x4d65463
github.com/milvus-io/milvus/internal/distributed/rootcoord.(*Server).startGrpcLoop.ChainUnaryServer.func8.1.1({0x73e1328?, 0xc003fc63c0?}, {0x66b4060?, 0xc003f9ee80?})
/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:25 +0x34 fp=0xc0051598f8 sp=0xc0051598b8 pc=0x5d86654
github.com/milvus-io/milvus/internal/distributed/rootcoord.(*Server).startGrpcLoop.ChainUnaryServer.func8({0x73e1328, 0xc003fc63c0}, {0x66b4060, 0xc003f9ee80}, 0x1fb5565?, 0x80?)
/go/pkg/mod/github.com/grpc-ecosystem/[email protected]/chain.go:34 +0xb8 fp=0xc005159950 sp=0xc0051598f8 pc=0x5d864f8
github.com/milvus-io/milvus/internal/proto/rootcoordpb._RootCoord_RestoreRBAC_Handler({0x6a09620, 0xc0010312c0}, {0x73e1328, 0xc003fc63c0}, 0xc003f95a80, 0xc001b844b0)
/workspace/source/internal/proto/rootcoordpb/root_coord_grpc.pb.go:1778 +0x143 fp=0xc0051599a0 sp=0xc005159950 pc=0x509f923
google.golang.org/grpc.(*Server).processUnaryRPC(0xc001bd2000, {0x73e1328, 0xc003fc62d0}, {0x74081c0, 0xc0017a0f00}, 0xc003f93d40, 0xc001b84690, 0x9eae048, 0x0)
/go/pkg/mod/google.golang.org/[email protected]/server.go:1379 +0xdf8 fp=0xc005159da0 sp=0xc0051599a0 pc=0x27e6d18
google.golang.org/grpc.(*Server).handleStream(0xc001bd2000, {0x74081c0, 0xc0017a0f00}, 0xc003f93d40)
/go/pkg/mod/google.golang.org/[email protected]/server.go:1790 +0xe8b fp=0xc005159f78 sp=0xc005159da0 pc=0x27ebbeb
google.golang.org/grpc.(*Server).serveStreams.func2.1()
/go/pkg/mod/google.golang.org/[email protected]/server.go:1029 +0x8b fp=0xc005159fe0 sp=0xc005159f78 pc=0x27e4d8b
runtime.goexit({})
/go/pkg/mod/golang.org/[email protected]/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc005159fe8 sp=0xc005159fe0 pc=0x2022981
created by google.golang.org/grpc.(*Server).serveStreams.func2 in goroutine 696
/go/pkg/mod/google.golang.org/[email protected]/server.go:1040 +0x125

goroutine 1 gp=0xc0000061c0 m=nil [chan receive, 2 minutes]:
runtime.gopark(0x1be099f9d1d99?, 0xc0015f1950?, 0x77?, 0x5?, 0x5?)
/go/pkg/mod/golang.org/[email protected]/src/runtime/proc.go:402 +0xce fp=0xc001d1d5a0 sp=0xc001d1d580 pc=0x1fe828e
runtime.chanrecv(0xc0000e4660, 0x0, 0x1)
/go/pkg/mod/golang.org/[email protected]/src/runtime/chan.go:583 +0x3bf fp=0xc001d1d618 sp=0xc001d1d5a0 pc=0x1fad4ff
runtime.chanrecv1(0xc0011990c0?, 0x6a50577?)
/go/pkg/mod/golang.org/[email protected]/src/runtime/chan.go:442 +0x12 fp=0xc001d1d640 sp=0xc001d1d618 pc=0x1fad112
github.com/milvus-io/milvus/cmd/roles.(*MilvusRoles).Run(0xc0011e6c80)
/workspace/source/cmd/roles/roles.go:554 +0x15c5 fp=0xc001d1dba8 sp=0xc001d1d640 pc=0x5de0685
github.com/milvus-io/milvus/cmd/milvus.(*run).execute(0xa157860, {0xc000074840, 0x3, 0x3}, 0xc0013431f0)
/workspace/source/cmd/milvus/run.go:47 +0x2c5 fp=0xc001d1dc68 sp=0xc001d1dba8 pc=0x5ded1c5
github.com/milvus-io/milvus/cmd/milvus.RunMilvus({0xc000074840, 0x3, 0x3})
/workspace/source/cmd/milvus/milvus.go:60 +0x202 fp=0xc001d1dcd8 sp=0xc001d1dc68 pc=0x5dece62
main.main()
/workspace/source/cmd/main.go:97 +0x252 fp=0xc001d1df50 sp=0xc001d1dcd8 pc=0x5df1772
runtime.main()

@yanliang567
Copy link
Contributor

/assign @czs007
/unassign

@sre-ci-robot sre-ci-robot assigned czs007 and unassigned yanliang567 Jan 3, 2025
@yanliang567 yanliang567 added triage/accepted Indicates an issue or PR is ready to be actively worked on. and removed needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Jan 3, 2025
@yanliang567 yanliang567 added this to the 2.5.2 milestone Jan 3, 2025
@xiaofan-luan
Copy link
Collaborator

/assign @shaoting-huang

@sre-ci-robot
Copy link
Contributor

@xiaofan-luan: GitHub didn't allow me to assign the following users: shaoting-huang.

Note that only milvus-io members, repo collaborators and people who have commented on this issue/PR can be assigned. Additionally, issues/PRs can only have 10 assignees at the same time.
For more information please see the contributor guide

In response to this:

/assign @shaoting-huang

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@xiaofan-luan
Copy link
Collaborator

/assign @shaoting-huang

@sre-ci-robot
Copy link
Contributor

@xiaofan-luan: GitHub didn't allow me to assign the following users: shaoting-huang.

Note that only milvus-io members, repo collaborators and people who have commented on this issue/PR can be assigned. Additionally, issues/PRs can only have 10 assignees at the same time.
For more information please see the contributor guide

In response to this:

/assign @shaoting-huang

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@yanliang567 yanliang567 modified the milestones: 2.5.2, 2.5.3 Jan 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
kind/bug Issues or changes related a bug triage/accepted Indicates an issue or PR is ready to be actively worked on.
Projects
None yet
Milestone
2.5.3
Development

No branches or pull requests
5 participants
@shanghaikid @sre-ci-robot @czs007 @yanliang567 @xiaofan-luan