Skip to content

[NU-1872] Bump Flink to 1.20 #15309

[NU-1872] Bump Flink to 1.20

[NU-1872] Bump Flink to 1.20 #15309

GitHub Actions / REPORT-IntegrationTests-2.13 failed Nov 13, 2024 in 1s

38 passed, 1 failed and 1 skipped

Tests failed

Report Passed Failed Skipped Time
components/openapi/target/it-reports/TEST-pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest.xml 1❌ 7s
components/openapi/target/it-reports/TEST-pl.touk.nussknacker.openapi.functional.OpenAPIServiceSpec.xml 1✅ 6s
designer/processReports/target/it-reports/TEST-pl.touk.nussknacker.processCounts.influxdb.InfluxCountsReporterSpec.xml 3✅ 3s
engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSlotsCountSpec.xml 1✅ 327ms
engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSpec.xml 9✅ 1⚪ 142s
engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingProcessTestRunnerSpec.xml 2✅ 5s
engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.JavaConfigDeploymentManagerSpec.xml 1✅ 13s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeBinTest.xml 1✅ 10s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerAvroTest.xml 1✅ 31s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerJsonTest.xml 1✅ 31s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerProbesTest.xml 2✅ 61s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeBinTest.xml 1✅ 8s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeDockerTest.xml 2✅ 309ms
security/target/it-reports/TEST-pl.touk.nussknacker.ui.security.oauth2.GenericOidcServiceSpec.xml 1✅ 3s
utils/kafka-components-utils/target/it-reports/TEST-pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateDisabledTest.xml 6✅ 2s
utils/kafka-components-utils/target/it-reports/TEST-pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateEnabledTest.xml 6✅ 4s

❌ components/openapi/target/it-reports/TEST-pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest.xml

1 tests were completed in 7s with 0 passed, 1 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest 1❌ 7s

❌ pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest

❌ (It is not a test it is a sbt.testing.SuiteSelector)
	java.util.concurrent.CompletionException: org.apache.pekko.pattern.AskTimeoutException: Recipient [Actor[pekko://flink/user/rpc#-782740756]] had already been terminated. Message of type [org.apache.flink.runtime.rpc.pekko.SupervisorActor$StartRpcActor].

✅ components/openapi/target/it-reports/TEST-pl.touk.nussknacker.openapi.functional.OpenAPIServiceSpec.xml

1 tests were completed in 6s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.openapi.functional.OpenAPIServiceSpec 1✅ 6s

✅ pl.touk.nussknacker.openapi.functional.OpenAPIServiceSpec

✅ service returns customers

✅ designer/processReports/target/it-reports/TEST-pl.touk.nussknacker.processCounts.influxdb.InfluxCountsReporterSpec.xml

3 tests were completed in 3s with 3 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.processCounts.influxdb.InfluxCountsReporterSpec 3✅ 3s

✅ pl.touk.nussknacker.processCounts.influxdb.InfluxCountsReporterSpec

✅ invokes counts for point in time data
✅ invokes query for date range
✅ should detect restarts one SingleDifference mode

✅ engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSlotsCountSpec.xml

1 tests were completed in 327ms with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSlotsCountSpec 1✅ 327ms

✅ pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSlotsCountSpec

✅ deploy scenario with too low task manager slots counts

✅ engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSpec.xml

10 tests were completed in 142s with 9 passed, 0 failed and 1 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSpec 9✅ 1⚪ 142s

✅ pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSpec

✅ deploy scenario in running flink
⚪ continue on timeout exception during scenario deploy
✅ cancel of not existing job should not fail
✅ be able verify&redeploy kafka scenario
✅ save state when redeploying
✅ snapshot state and be able to deploy using it
✅ should stop scenario and deploy it using savepoint
✅ fail to redeploy if old is incompatible
✅ fail to redeploy if result produced by aggregation is incompatible
✅ extract scenario definition

✅ engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingProcessTestRunnerSpec.xml

2 tests were completed in 5s with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.management.streaming.FlinkStreamingProcessTestRunnerSpec 2✅ 5s

✅ pl.touk.nussknacker.engine.management.streaming.FlinkStreamingProcessTestRunnerSpec

✅ should run scenario in test mode
✅ should return correct error messages

✅ engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.JavaConfigDeploymentManagerSpec.xml

1 tests were completed in 13s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.management.streaming.JavaConfigDeploymentManagerSpec 1✅ 13s

✅ pl.touk.nussknacker.engine.management.streaming.JavaConfigDeploymentManagerSpec

✅ deploy java scenario in running flink

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeBinTest.xml

1 tests were completed in 10s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeBinTest 1✅ 10s

✅ pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeBinTest

✅ should run scenario and pass data to output

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerAvroTest.xml

1 tests were completed in 31s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerAvroTest 1✅ 31s

✅ pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerAvroTest

✅ avro ping-pong should work

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerJsonTest.xml

1 tests were completed in 31s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerJsonTest 1✅ 31s

✅ pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerJsonTest

✅ json ping-pong should work

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerProbesTest.xml

2 tests were completed in 61s with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerProbesTest 2✅ 61s

✅ pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerProbesTest

✅ readiness probe
✅ liveness probe

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeBinTest.xml

1 tests were completed in 8s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeBinTest 1✅ 8s

✅ pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeBinTest

✅ binary version should handle ping pong via http

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeDockerTest.xml

2 tests were completed in 309ms with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeDockerTest 2✅ 309ms

✅ pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeDockerTest

✅ docker image should handle ping pong via http
✅ should get scenario definition via http

✅ security/target/it-reports/TEST-pl.touk.nussknacker.ui.security.oauth2.GenericOidcServiceSpec.xml

1 tests were completed in 3s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.ui.security.oauth2.GenericOidcServiceSpec 1✅ 3s

✅ pl.touk.nussknacker.ui.security.oauth2.GenericOidcServiceSpec

✅ Basic OpenIDConnect flow

✅ utils/kafka-components-utils/target/it-reports/TEST-pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateDisabledTest.xml

6 tests were completed in 2s with 6 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateDisabledTest 6✅ 2s

✅ pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateDisabledTest

✅ should validate existing source topic
✅ should validate not existing source topic
✅ should validate existing sink topic
✅ should validate not existing sink topic
✅ should not validate not existing topic when validation disabled
✅ should fetch topics every time when not valid using cache

✅ utils/kafka-components-utils/target/it-reports/TEST-pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateEnabledTest.xml

6 tests were completed in 4s with 6 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateEnabledTest 6✅ 4s

✅ pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateEnabledTest

✅ should validate existing source topic
✅ should not validate not existing source topic
✅ should validate existing sink topic
✅ should validate not existing sink topic
✅ should not validate not existing topic when validation disabled
✅ should use cache when validating

Annotations

Check failure on line 59 in engine/flink/test-utils/src/main/scala/pl/touk/nussknacker/engine/flink/test/FlinkMiniClusterHolder.scala

See this annotation in the file changed.

@github-actions github-actions / REPORT-IntegrationTests-2.13

pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest ► (It is not a test it is a sbt.testing.SuiteSelector)

Failed test found in:
  components/openapi/target/it-reports/TEST-pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest.xml
Error:
  java.util.concurrent.CompletionException: org.apache.pekko.pattern.AskTimeoutException: Recipient [Actor[pekko://flink/user/rpc#-782740756]] had already been terminated. Message of type [org.apache.flink.runtime.rpc.pekko.SupervisorActor$StartRpcActor].
Raw output
java.util.concurrent.CompletionException: org.apache.pekko.pattern.AskTimeoutException: Recipient [Actor[pekko://flink/user/rpc#-782740756]] had already been terminated. Message of type [org.apache.flink.runtime.rpc.pekko.SupervisorActor$StartRpcActor].
	at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:331)
	at java.base/java.util.concurrent.CompletableFuture.uniApplyNow(CompletableFuture.java:670)
	at java.base/java.util.concurrent.CompletableFuture.uniApplyStage(CompletableFuture.java:658)
	at java.base/java.util.concurrent.CompletableFuture.thenApplyAsync(CompletableFuture.java:2099)
	at scala.concurrent.java8.FuturesConvertersImpl$CF.thenApply(FutureConvertersImpl.scala:35)
	at org.apache.flink.runtime.rpc.pekko.SupervisorActor.startRpcActor(SupervisorActor.java:205)
	at org.apache.flink.runtime.rpc.pekko.PekkoRpcService.registerRpcActor(PekkoRpcService.java:354)
	at org.apache.flink.runtime.rpc.pekko.PekkoRpcService.startServer(PekkoRpcService.java:268)
	at org.apache.flink.runtime.rpc.RpcEndpoint.<init>(RpcEndpoint.java:147)
	at org.apache.flink.runtime.rpc.RpcEndpoint.<init>(RpcEndpoint.java:162)
	at org.apache.flink.runtime.taskexecutor.TaskExecutor.<init>(TaskExecutor.java:336)
	at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.startTaskManager(TaskManagerRunner.java:674)
	at org.apache.flink.runtime.minicluster.MiniCluster.startTaskManager(MiniCluster.java:767)
	at org.apache.flink.runtime.minicluster.MiniCluster.startTaskManagers(MiniCluster.java:748)
	at org.apache.flink.runtime.minicluster.MiniCluster.start(MiniCluster.java:459)
	at org.apache.flink.runtime.testutils.MiniClusterResource.startMiniCluster(MiniClusterResource.java:248)
	at org.apache.flink.runtime.testutils.MiniClusterResource.before(MiniClusterResource.java:110)
	at org.apache.flink.test.util.MiniClusterWithClientResource.before(MiniClusterWithClientResource.java:64)
	at pl.touk.nussknacker.engine.flink.test.FlinkMiniClusterHolderImpl.start(FlinkMiniClusterHolder.scala:59)
	at pl.touk.nussknacker.engine.flink.test.FlinkSpec.beforeAll(FlinkSpec.scala:24)
	at pl.touk.nussknacker.engine.flink.test.FlinkSpec.beforeAll$(FlinkSpec.scala:21)
	at pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest.beforeAll(OpenApiScenarioIntegrationTest.scala:29)
	at org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:212)
	at org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210)
	at org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208)
	at pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest.org$scalatest$BeforeAndAfter$$super$run(OpenApiScenarioIntegrationTest.scala:29)
	at org.scalatest.BeforeAndAfter.run(BeforeAndAfter.scala:273)
	at org.scalatest.BeforeAndAfter.run$(BeforeAndAfter.scala:271)
	at pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest.run(OpenApiScenarioIntegrationTest.scala:29)
	at org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321)
	at org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517)
	at sbt.TestRunner.runTest$1(TestFramework.scala:153)
	at sbt.TestRunner.run(TestFramework.scala:168)
	at sbt.TestFramework$$anon$3$$anonfun$$lessinit$greater$1.$anonfun$apply$1(TestFramework.scala:336)
	at sbt.TestFramework$.sbt$TestFramework$$withContextLoader(TestFramework.scala:296)
	at sbt.TestFramework$$anon$3$$anonfun$$lessinit$greater$1.apply(TestFramework.scala:336)
	at sbt.TestFramework$$anon$3$$anonfun$$lessinit$greater$1.apply(TestFramework.scala:336)
	at sbt.TestFunction.apply(TestFramework.scala:348)
	at sbt.Tests$.processRunnable$1(Tests.scala:475)
	at sbt.Tests$.$anonfun$makeSerial$1(Tests.scala:481)
	at sbt.std.Transform$$anon$3.$anonfun$apply$2(Transform.scala:47)
	at sbt.std.Transform$$anon$4.work(Transform.scala:69)
	at sbt.Execute.$anonfun$submit$2(Execute.scala:283)
	at sbt.internal.util.ErrorHandling$.wideConvert(ErrorHandling.scala:24)
	at sbt.Execute.work(Execute.scala:292)
	at sbt.Execute.$anonfun$submit$1(Execute.scala:283)
	at sbt.ConcurrentRestrictions$$anon$4.$anonfun$submitValid$1(ConcurrentRestrictions.scala:265)
	at sbt.CompletionService$$anon$2.call(CompletionService.scala:65)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: org.apache.pekko.pattern.AskTimeoutException: Recipient [Actor[pekko://flink/user/rpc#-782740756]] had already been terminated. Message of type [org.apache.flink.runtime.rpc.pekko.SupervisorActor$StartRpcActor].