Skip to content

bug: readiness manager #2725

@bg-ts

Description

@bg-ts

Current Behavior

ApisixPluginConfig ApisixUpstream crds, never gets marked as done in readiness manager, which causes the ingress controller to take 5 minutes(hardcoded timeout) to the ingress controller to apply changes to apisix.
To make matters worse, this happens every time the ingress controller is restarted.

Expected Behavior

All apisix crds to be marked as done when appropriate., ingress controller starting to sync changes in a timely fashion.

Error Logs

2026-02-25T21:32:53.339Z	INFO	root/root.go:125	controller start configuration	{"config": {"log_level":"info","controller_name":"apisix.apache.org/apisix-ingress-controller","leader_election_id":"apisix-ingress-controller-leader","metrics_addr":":8080","server_addr":":9092","enable_server":false,"enable_http2":false,"probe_addr":":8081","secure_metrics":false,"leader_election":{"lease_duration":"30s","renew_deadline":"20s","retry_period":"2s"},"exec_adc_timeout":"15s","provider":{"type":"apisix-standalone","sync_period":"1m0s","init_sync_delay":"20m0s"},"webhook":{"enable":true,"tls_cert_file":"tls.crt","tls_key_file":"tls.key","tls_cert_dir":"/certs","port":9443},"disable_gateway_api":false}}
2026-02-25T21:32:53.345Z	INFO	provider.client	client/client.go:63	ADC client initialized
2026-02-25T21:32:53.346Z	INFO	setup	manager/run.go:216	check ReferenceGrants is enabled
2026-02-25T21:32:53.348Z	INFO	setup	manager/run.go:227	setting up controllers
2026-02-25T21:32:53.361Z	INFO	setup	manager/run.go:243	setting up webhooks
2026-02-25T21:32:53.361Z	INFO	controller-runtime.controller-runtime.builder	builder/webhook.go:226	Registering a validating webhook	{"GVK": "networking.k8s.io/v1, Kind=Ingress", "path": "/validate-networking-k8s-io-v1-ingress"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.webhook	webhook/server.go:183	Registering webhook	{"path": "/validate-networking-k8s-io-v1-ingress"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.builder	builder/webhook.go:226	Registering a validating webhook	{"GVK": "networking.k8s.io/v1, Kind=IngressClass", "path": "/validate-networking-k8s-io-v1-ingressclass"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.webhook	webhook/server.go:183	Registering webhook	{"path": "/validate-networking-k8s-io-v1-ingressclass"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.builder	builder/webhook.go:226	Registering a validating webhook	{"GVK": "gateway.networking.k8s.io/v1, Kind=Gateway", "path": "/validate-gateway-networking-k8s-io-v1-gateway"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.webhook	webhook/server.go:183	Registering webhook	{"path": "/validate-gateway-networking-k8s-io-v1-gateway"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.builder	builder/webhook.go:226	Registering a validating webhook	{"GVK": "apisix.apache.org/v1alpha1, Kind=GatewayProxy", "path": "/validate-apisix-apache-org-v1alpha1-gatewayproxy"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.webhook	webhook/server.go:183	Registering webhook	{"path": "/validate-apisix-apache-org-v1alpha1-gatewayproxy"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.builder	builder/webhook.go:226	Registering a validating webhook	{"GVK": "gateway.networking.k8s.io/v1, Kind=HTTPRoute", "path": "/validate-gateway-networking-k8s-io-v1-httproute"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.webhook	webhook/server.go:183	Registering webhook	{"path": "/validate-gateway-networking-k8s-io-v1-httproute"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.builder	builder/webhook.go:226	Registering a validating webhook	{"GVK": "gateway.networking.k8s.io/v1, Kind=GRPCRoute", "path": "/validate-gateway-networking-k8s-io-v1-grpcroute"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.webhook	webhook/server.go:183	Registering webhook	{"path": "/validate-gateway-networking-k8s-io-v1-grpcroute"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.builder	builder/webhook.go:226	Registering a validating webhook	{"GVK": "gateway.networking.k8s.io/v1alpha2, Kind=TCPRoute", "path": "/validate-gateway-networking-k8s-io-v1alpha2-tcproute"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.webhook	webhook/server.go:183	Registering webhook	{"path": "/validate-gateway-networking-k8s-io-v1alpha2-tcproute"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.builder	builder/webhook.go:226	Registering a validating webhook	{"GVK": "gateway.networking.k8s.io/v1alpha2, Kind=UDPRoute", "path": "/validate-gateway-networking-k8s-io-v1alpha2-udproute"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.webhook	webhook/server.go:183	Registering webhook	{"path": "/validate-gateway-networking-k8s-io-v1alpha2-udproute"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.builder	builder/webhook.go:226	Registering a validating webhook	{"GVK": "apisix.apache.org/v2, Kind=ApisixConsumer", "path": "/validate-apisix-apache-org-v2-apisixconsumer"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.webhook	webhook/server.go:183	Registering webhook	{"path": "/validate-apisix-apache-org-v2-apisixconsumer"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.builder	builder/webhook.go:226	Registering a validating webhook	{"GVK": "apisix.apache.org/v2, Kind=ApisixTls", "path": "/validate-apisix-apache-org-v2-apisixtls"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.webhook	webhook/server.go:183	Registering webhook	{"path": "/validate-apisix-apache-org-v2-apisixtls"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.builder	builder/webhook.go:226	Registering a validating webhook	{"GVK": "apisix.apache.org/v2, Kind=ApisixRoute", "path": "/validate-apisix-apache-org-v2-apisixroute"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.webhook	webhook/server.go:183	Registering webhook	{"path": "/validate-apisix-apache-org-v2-apisixroute"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.builder	builder/webhook.go:226	Registering a validating webhook	{"GVK": "apisix.apache.org/v1alpha1, Kind=Consumer", "path": "/validate-apisix-apache-org-v1alpha1-consumer"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.webhook	webhook/server.go:183	Registering webhook	{"path": "/validate-apisix-apache-org-v1alpha1-consumer"}
2026-02-25T21:32:53.362Z	INFO	setup	manager/run.go:252	setting up health checks
2026-02-25T21:32:53.362Z	INFO	setup	manager/run.go:258	setting up ready checks
2026-02-25T21:32:53.362Z	INFO	setup	manager/run.go:264	starting controller manager
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.metrics	server/server.go:208	Starting metrics server
2026-02-25T21:32:53.362Z	INFO	controller-runtime	manager/server.go:83	starting server	{"name": "health probe", "addr": "[::]:8081"}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.metrics	server/server.go:247	Serving metrics server	{"bindAddress": ":8080", "secure": false}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.webhook	webhook/server.go:191	Starting webhook server
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.certwatcher	certwatcher/certwatcher.go:211	Updated current TLS certificate
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.webhook	webhook/server.go:242	Serving webhook server	{"host": "", "port": 9443}
2026-02-25T21:32:53.362Z	INFO	controller-runtime.controller-runtime.certwatcher	certwatcher/certwatcher.go:133	Starting certificate poll+watcher	{"interval": "10s"}
I0225 21:32:53.462843       1 leaderelection.go:257] attempting to acquire leader lease ingress-apisix/apisix-ingress-controller-leader...
{"level":"info","message":"ADC server is running on: /sockets/adc.sock","timestamp":"2026-02-25T21:32:59.326Z"}
2026-02-25T21:33:18.529Z	INFO	controller-runtime.apisixroute-resource	v1/apisixroute_webhook.go:78	Validation for ApisixRoute upon update	{"name": "test-route", "namespace": "ingress-apisix"}
2026-02-25T21:33:18.637Z	INFO	controller-runtime.gatewayproxy-resource	v1/gatewayproxy_webhook.go:81	Validation for GatewayProxy upon update	{"name": "apisix-config", "namespace": "ingress-apisix"}
I0225 21:33:24.095001       1 leaderelection.go:271] successfully acquired lease ingress-apisix/apisix-ingress-controller-leader
2026-02-25T21:33:24.095Z	INFO	provider	apisix/provider.go:254	starting provider, waiting for readiness
2026-02-25T21:33:24.095Z	INFO	status.updater	status/updater.go:131	started status update handler
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "ingressclass", "controllerGroup": "networking.k8s.io", "controllerKind": "IngressClass", "source": "kind source: *v1.IngressClass"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "ingressclass", "controllerGroup": "networking.k8s.io", "controllerKind": "IngressClass", "source": "kind source: *v1alpha1.GatewayProxy"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "ingressclass", "controllerGroup": "networking.k8s.io", "controllerKind": "IngressClass", "source": "kind source: *v1.Secret"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "tlsroute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "TLSRoute", "source": "kind source: *v1.Gateway"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "tlsroute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "TLSRoute", "source": "kind source: *v1alpha2.TLSRoute"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "apisixtls", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixTls", "source": "kind source: *v1.Secret"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "apisixtls", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixTls", "source": "kind source: *v2.ApisixTls"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "apisixtls", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixTls", "source": "kind source: *v1.IngressClass"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "tlsroute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "TLSRoute", "source": "kind source: *v1beta1.ReferenceGrant"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "apisixtls", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixTls", "source": "kind source: *v1alpha1.GatewayProxy"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "grpcroute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "GRPCRoute", "source": "kind source: *v1.GRPCRoute"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "tlsroute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "TLSRoute", "source": "kind source: *v1alpha1.BackendTrafficPolicy"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "tlsroute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "TLSRoute", "source": "kind source: *v1alpha1.GatewayProxy"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "tlsroute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "TLSRoute", "source": "kind source: *v1.EndpointSlice"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "grpcroute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "GRPCRoute", "source": "kind source: *v1.EndpointSlice"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "tcproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "TCPRoute", "source": "kind source: *v1beta1.ReferenceGrant"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "consumer", "controllerGroup": "apisix.apache.org", "controllerKind": "Consumer", "source": "kind source: *v1alpha1.Consumer"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "tcproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "TCPRoute", "source": "kind source: *v1.Gateway"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "tcproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "TCPRoute", "source": "kind source: *v1.EndpointSlice"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "tcproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "TCPRoute", "source": "kind source: *v1alpha1.GatewayProxy"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "grpcroute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "GRPCRoute", "source": "kind source: *v1alpha1.BackendTrafficPolicy"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "grpcroute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "GRPCRoute", "source": "kind source: *v1.Gateway"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "grpcroute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "GRPCRoute", "source": "kind source: *v1beta1.ReferenceGrant"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "gatewayclass", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "GatewayClass", "source": "kind source: *v1.GatewayClass"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "grpcroute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "GRPCRoute", "source": "kind source: *v1alpha1.PluginConfig"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "httproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "HTTPRoute", "source": "kind source: *v1.HTTPRoute"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "grpcroute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "GRPCRoute", "source": "channel source: 0xc0006d0380"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "httproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "HTTPRoute", "source": "kind source: *v1.EndpointSlice"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "tcproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "TCPRoute", "source": "kind source: *v1alpha1.BackendTrafficPolicy"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "httproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "HTTPRoute", "source": "kind source: *v1alpha1.BackendTrafficPolicy"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "consumer", "controllerGroup": "apisix.apache.org", "controllerKind": "Consumer", "source": "kind source: *v1.Gateway"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "apisixconsumer", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixConsumer", "source": "kind source: *v1.Secret"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "httproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "HTTPRoute", "source": "kind source: *v1.Gateway"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "apisixroute", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixRoute", "source": "kind source: *v2.ApisixPluginConfig"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "consumer", "controllerGroup": "apisix.apache.org", "controllerKind": "Consumer", "source": "kind source: *v1alpha1.GatewayProxy"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "apisixroute", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixRoute", "source": "kind source: *v1.Secret"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "httproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "HTTPRoute", "source": "channel source: 0xc0006d01c0"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "httproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "HTTPRoute", "source": "kind source: *v1beta1.ReferenceGrant"}
2026-02-25T21:33:24.095Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "httproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "HTTPRoute", "source": "kind source: *v1alpha1.PluginConfig"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "apisixconsumer", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixConsumer", "source": "kind source: *v2.ApisixConsumer"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "apisixconsumer", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixConsumer", "source": "kind source: *v1.IngressClass"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "httproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "HTTPRoute", "source": "kind source: *v1alpha1.HTTPRoutePolicy"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "apisixroute", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixRoute", "source": "kind source: *v2.ApisixUpstream"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "tcproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "TCPRoute", "source": "kind source: *v1alpha2.TCPRoute"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "apisixconsumer", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixConsumer", "source": "kind source: *v1alpha1.GatewayProxy"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "consumer", "controllerGroup": "apisix.apache.org", "controllerKind": "Consumer", "source": "kind source: *v1.Secret"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "gateway", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1alpha2.UDPRoute"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "gateway", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1alpha1.GatewayProxy"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "gateway", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1.Secret"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "gateway", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1.GRPCRoute"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "gateway", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1beta1.ReferenceGrant"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "grpcroute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "GRPCRoute", "source": "kind source: *v1alpha1.GatewayProxy"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "apisixroute", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixRoute", "source": "kind source: *v2.ApisixRoute"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "gateway", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1.Gateway"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "gateway", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1alpha2.TLSRoute"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "apisixroute", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixRoute", "source": "kind source: *v1alpha1.GatewayProxy"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "gateway", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1alpha2.TCPRoute"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "gateway", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1.GatewayClass"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "gateway", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1.HTTPRoute"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "apisixroute", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixRoute", "source": "kind source: *v1.IngressClass"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "apisixroute", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixRoute", "source": "kind source: *v1.EndpointSlice"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "apisixpluginconfig", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixPluginConfig", "source": "kind source: *v2.ApisixPluginConfig"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "httproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "HTTPRoute", "source": "kind source: *v1alpha1.GatewayProxy"}
2026-02-25T21:33:24.096Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "apisixupstream", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixUpstream", "source": "kind source: *v2.ApisixUpstream"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "ingress", "controllerGroup": "networking.k8s.io", "controllerKind": "Ingress", "source": "kind source: *v1.IngressClass"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "ingress", "controllerGroup": "networking.k8s.io", "controllerKind": "Ingress", "source": "kind source: *v1.Secret"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "ingress", "controllerGroup": "networking.k8s.io", "controllerKind": "Ingress", "source": "kind source: *v1.EndpointSlice"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "ingress", "controllerGroup": "networking.k8s.io", "controllerKind": "Ingress", "source": "kind source: *v1alpha1.GatewayProxy"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "ingress", "controllerGroup": "networking.k8s.io", "controllerKind": "Ingress", "source": "channel source: 0xc0006d0460"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "ingress", "controllerGroup": "networking.k8s.io", "controllerKind": "Ingress", "source": "kind source: *v2.ApisixPluginConfig"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "ingress", "controllerGroup": "networking.k8s.io", "controllerKind": "Ingress", "source": "kind source: *v1.Ingress"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "ingress", "controllerGroup": "networking.k8s.io", "controllerKind": "Ingress", "source": "kind source: *v1alpha1.HTTPRoutePolicy"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "ingress", "controllerGroup": "networking.k8s.io", "controllerKind": "Ingress", "source": "kind source: *v1alpha1.BackendTrafficPolicy"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "udproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "UDPRoute", "source": "kind source: *v1alpha2.UDPRoute"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "udproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "UDPRoute", "source": "kind source: *v1beta1.ReferenceGrant"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "udproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "UDPRoute", "source": "kind source: *v1.Gateway"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "udproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "UDPRoute", "source": "kind source: *v1.EndpointSlice"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "udproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "UDPRoute", "source": "kind source: *v1alpha1.BackendTrafficPolicy"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "udproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "UDPRoute", "source": "kind source: *v1alpha1.GatewayProxy"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "apisixglobalrule", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixGlobalRule", "source": "kind source: *v2.ApisixGlobalRule"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "apisixglobalrule", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixGlobalRule", "source": "kind source: *v1.IngressClass"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "apisixglobalrule", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixGlobalRule", "source": "kind source: *v1alpha1.GatewayProxy"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "gatewayproxy", "controllerGroup": "apisix.apache.org", "controllerKind": "GatewayProxy", "source": "kind source: *v1alpha1.GatewayProxy"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "gatewayproxy", "controllerGroup": "apisix.apache.org", "controllerKind": "GatewayProxy", "source": "kind source: *v1.Secret"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "gatewayproxy", "controllerGroup": "apisix.apache.org", "controllerKind": "GatewayProxy", "source": "kind source: *v1.Service"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "gatewayproxy", "controllerGroup": "apisix.apache.org", "controllerKind": "GatewayProxy", "source": "kind source: *v1.Gateway"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "gatewayproxy", "controllerGroup": "apisix.apache.org", "controllerKind": "GatewayProxy", "source": "kind source: *v1.IngressClass"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "gatewayproxy", "controllerGroup": "apisix.apache.org", "controllerKind": "GatewayProxy", "source": "kind source: *v1.EndpointSlice"}
2026-02-25T21:33:24.097Z	INFO	controller-runtime	controller/controller.go:204	Starting EventSource	{"controller": "apisixglobalrule", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixGlobalRule", "source": "kind source: *v1.Secret"}
2026-02-25T21:33:24.098Z	INFO	readiness	readiness/manager.go:128	registering readiness state	{"gvk": "apisix.apache.org/v2, Kind=ApisixRoute", "registered_count": 1}
2026-02-25T21:33:24.100Z	INFO	readiness	readiness/manager.go:128	registering readiness state	{"gvk": "apisix.apache.org/v2, Kind=ApisixPluginConfig", "registered_count": 1}
2026-02-25T21:33:24.106Z	INFO	readiness	readiness/manager.go:139	readiness manager started
2026-02-25T21:33:24.196Z	INFO	controller-runtime	controller/controller.go:239	Starting Controller	{"controller": "ingressclass", "controllerGroup": "networking.k8s.io", "controllerKind": "IngressClass"}
2026-02-25T21:33:24.196Z	INFO	controller-runtime	controller/controller.go:248	Starting workers	{"controller": "ingressclass", "controllerGroup": "networking.k8s.io", "controllerKind": "IngressClass", "worker count": 1}
2026-02-25T21:33:24.196Z	INFO	controller-runtime	controller/controller.go:239	Starting Controller	{"controller": "apisixtls", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixTls"}
2026-02-25T21:33:24.196Z	INFO	controller-runtime	controller/controller.go:248	Starting workers	{"controller": "apisixtls", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixTls", "worker count": 1}
2026-02-25T21:33:24.196Z	INFO	controller-runtime	controller/controller.go:239	Starting Controller	{"controller": "tlsroute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "TLSRoute"}
2026-02-25T21:33:24.196Z	INFO	controller-runtime	controller/controller.go:248	Starting workers	{"controller": "tlsroute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "TLSRoute", "worker count": 1}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:239	Starting Controller	{"controller": "consumer", "controllerGroup": "apisix.apache.org", "controllerKind": "Consumer"}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:239	Starting Controller	{"controller": "grpcroute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "GRPCRoute"}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:248	Starting workers	{"controller": "consumer", "controllerGroup": "apisix.apache.org", "controllerKind": "Consumer", "worker count": 1}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:248	Starting workers	{"controller": "grpcroute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "GRPCRoute", "worker count": 1}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:239	Starting Controller	{"controller": "apisixconsumer", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixConsumer"}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:248	Starting workers	{"controller": "apisixconsumer", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixConsumer", "worker count": 1}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:239	Starting Controller	{"controller": "gatewayclass", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "GatewayClass"}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:248	Starting workers	{"controller": "gatewayclass", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "GatewayClass", "worker count": 1}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:239	Starting Controller	{"controller": "tcproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "TCPRoute"}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:248	Starting workers	{"controller": "tcproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "TCPRoute", "worker count": 1}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:239	Starting Controller	{"controller": "apisixroute", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixRoute"}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:248	Starting workers	{"controller": "apisixroute", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixRoute", "worker count": 1}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:239	Starting Controller	{"controller": "apisixglobalrule", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixGlobalRule"}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:239	Starting Controller	{"controller": "apisixpluginconfig", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixPluginConfig"}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:248	Starting workers	{"controller": "apisixpluginconfig", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixPluginConfig", "worker count": 1}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:239	Starting Controller	{"controller": "gatewayproxy", "controllerGroup": "apisix.apache.org", "controllerKind": "GatewayProxy"}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:239	Starting Controller	{"controller": "gateway", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway"}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:248	Starting workers	{"controller": "apisixglobalrule", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixGlobalRule", "worker count": 1}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:248	Starting workers	{"controller": "gatewayproxy", "controllerGroup": "apisix.apache.org", "controllerKind": "GatewayProxy", "worker count": 1}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:239	Starting Controller	{"controller": "apisixupstream", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixUpstream"}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:248	Starting workers	{"controller": "gateway", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "worker count": 1}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:239	Starting Controller	{"controller": "httproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "HTTPRoute"}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:239	Starting Controller	{"controller": "udproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "UDPRoute"}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:248	Starting workers	{"controller": "apisixupstream", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixUpstream", "worker count": 1}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:248	Starting workers	{"controller": "httproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "HTTPRoute", "worker count": 1}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:239	Starting Controller	{"controller": "ingress", "controllerGroup": "networking.k8s.io", "controllerKind": "Ingress"}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:248	Starting workers	{"controller": "udproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "UDPRoute", "worker count": 1}
2026-02-25T21:33:24.197Z	INFO	controller-runtime	controller/controller.go:248	Starting workers	{"controller": "ingress", "controllerGroup": "networking.k8s.io", "controllerKind": "Ingress", "worker count": 1}
2026-02-25T21:33:24.198Z	INFO	status.updater	status/updater.go:143	received a status update	{"namespace": "ingress-apisix", "name": "test-plugin-config", "kind": "ApisixPluginConfig"}
2026-02-25T21:33:24.198Z	INFO	readiness	readiness/manager.go:163	marking resource as done	{"gvk": "apisix.apache.org/v2, Kind=ApisixRoute", "name": {"name":"test-route","namespace":"ingress-apisix"}, "state_count": 1}
2026-02-25T21:33:24.200Z	INFO	status.updater	status/updater.go:143	received a status update	{"namespace": "ingress-apisix", "name": "test-route", "kind": "ApisixRoute"}
2026-02-25T21:38:24.106Z	INFO	provider	apisix/provider.go:256	Ready detected, starting sync loop
2026-02-25T21:38:24.106Z	INFO	provider.client	client/client.go:177	syncing all resources
2026-02-25T21:38:24.106Z	INFO	provider.client	client/client.go:201	syncing resources for config	{"service_number": 1}
{"level":"info","message":"PUT /sync","requestId":"b686e95c-07b5-4178-8a5d-64a79ca645c2","timestamp":"2026-02-25T21:38:24.110Z"}
(node:1) [DEP0169] DeprecationWarning: `url.parse()` behavior is not standardized and prone to errors that have security implications. Use the WHATWG URL API instead. CVEs are not issued for `url.parse()` vulnerabilities.
(Use `node --trace-deprecation ...` to show where the warning was created)
2026-02-25T21:39:24.107Z	INFO	provider.client	client/client.go:177	syncing all resources
2026-02-25T21:39:24.107Z	INFO	provider.client	client/client.go:201	syncing resources for config	{"service_number": 1}
{"level":"info","message":"PUT /sync","requestId":"1a04319d-333d-416b-ae9b-21410f4a3c86","timestamp":"2026-02-25T21:39:24.108Z"}

Steps to Reproduce

values.yaml:

apisix:
  deployment:
    role: traditional
    role_traditional:
      config_provider: yaml
etcd:
  enabled: false
ingress-controller:
  enabled: true
  config:
    provider:
      type: apisix-standalone
  apisix:
    adminService:
      namespace: ingress-apisix
  gatewayProxy:
    createDefault: true
extraDeploy:
  - apiVersion: apisix.apache.org/v2
    kind: ApisixPluginConfig
    metadata:
      name: test-plugin-config
      namespace: ingress-apisix
    spec:
      ingressClassName: "apisix"
      plugins:
        - name: mocking
          enable: true
          config:
            response_status: 200
            response_example: "mock response"
            with_mock_header: false
  - apiVersion: apisix.apache.org/v2
    kind: ApisixRoute
    metadata:
      name: test-route
      namespace: ingress-apisix
    spec:
      ingressClassName: "apisix"
      http:
      - name: "test-route"
        plugin_config_name: "test-plugin-config"
        match:
          paths:
            - /test
        backends:
          - serviceName: "apisix-gateway"
            servicePort: 80
helm upgrade -i apisix --version 2.13.0 \
  --namespace ingress-apisix \
  --create-namespace \
  --values values.yaml \
  apisix/apisix

Environment

  • APISIX Ingress controller version 2.0.1
  • Kubernetes cluster version v1.33.4+k3s1

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions