Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[NU-1872] Bump Flink to 1.20 #7137

Draft
wants to merge 3 commits into
base: staging
Choose a base branch
from

fix patch poc

51c43e2
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Draft

[NU-1872] Bump Flink to 1.20 #7137

fix patch poc
51c43e2
Select commit
Loading
Failed to load commit list.
GitHub Actions / REPORT-IntegrationTests-2.13 failed Nov 13, 2024 in 1s

38 passed, 1 failed and 1 skipped

Tests failed

Report Passed Failed Skipped Time
components/openapi/target/it-reports/TEST-pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest.xml 1❌ 7s
components/openapi/target/it-reports/TEST-pl.touk.nussknacker.openapi.functional.OpenAPIServiceSpec.xml 1✅ 6s
designer/processReports/target/it-reports/TEST-pl.touk.nussknacker.processCounts.influxdb.InfluxCountsReporterSpec.xml 3✅ 3s
engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSlotsCountSpec.xml 1✅ 327ms
engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSpec.xml 9✅ 1⚪ 142s
engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingProcessTestRunnerSpec.xml 2✅ 5s
engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.JavaConfigDeploymentManagerSpec.xml 1✅ 13s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeBinTest.xml 1✅ 10s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerAvroTest.xml 1✅ 31s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerJsonTest.xml 1✅ 31s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerProbesTest.xml 2✅ 61s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeBinTest.xml 1✅ 8s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeDockerTest.xml 2✅ 309ms
security/target/it-reports/TEST-pl.touk.nussknacker.ui.security.oauth2.GenericOidcServiceSpec.xml 1✅ 3s
utils/kafka-components-utils/target/it-reports/TEST-pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateDisabledTest.xml 6✅ 2s
utils/kafka-components-utils/target/it-reports/TEST-pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateEnabledTest.xml 6✅ 4s

❌ components/openapi/target/it-reports/TEST-pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest.xml

1 tests were completed in 7s with 0 passed, 1 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest 1❌ 7s

❌ pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest

❌ (It is not a test it is a sbt.testing.SuiteSelector)
	java.util.concurrent.CompletionException: org.apache.pekko.pattern.AskTimeoutException: Recipient [Actor[pekko://flink/user/rpc#-782740756]] had already been terminated. Message of type [org.apache.flink.runtime.rpc.pekko.SupervisorActor$StartRpcActor].

✅ components/openapi/target/it-reports/TEST-pl.touk.nussknacker.openapi.functional.OpenAPIServiceSpec.xml

1 tests were completed in 6s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.openapi.functional.OpenAPIServiceSpec 1✅ 6s

✅ pl.touk.nussknacker.openapi.functional.OpenAPIServiceSpec

✅ service returns customers

✅ designer/processReports/target/it-reports/TEST-pl.touk.nussknacker.processCounts.influxdb.InfluxCountsReporterSpec.xml

3 tests were completed in 3s with 3 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.processCounts.influxdb.InfluxCountsReporterSpec 3✅ 3s

✅ pl.touk.nussknacker.processCounts.influxdb.InfluxCountsReporterSpec

✅ invokes counts for point in time data
✅ invokes query for date range
✅ should detect restarts one SingleDifference mode

✅ engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSlotsCountSpec.xml

1 tests were completed in 327ms with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSlotsCountSpec 1✅ 327ms

✅ pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSlotsCountSpec

✅ deploy scenario with too low task manager slots counts

✅ engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSpec.xml

10 tests were completed in 142s with 9 passed, 0 failed and 1 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSpec 9✅ 1⚪ 142s

✅ pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSpec

✅ deploy scenario in running flink
⚪ continue on timeout exception during scenario deploy
✅ cancel of not existing job should not fail
✅ be able verify&redeploy kafka scenario
✅ save state when redeploying
✅ snapshot state and be able to deploy using it
✅ should stop scenario and deploy it using savepoint
✅ fail to redeploy if old is incompatible
✅ fail to redeploy if result produced by aggregation is incompatible
✅ extract scenario definition

✅ engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingProcessTestRunnerSpec.xml

2 tests were completed in 5s with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.management.streaming.FlinkStreamingProcessTestRunnerSpec 2✅ 5s

✅ pl.touk.nussknacker.engine.management.streaming.FlinkStreamingProcessTestRunnerSpec

✅ should run scenario in test mode
✅ should return correct error messages

✅ engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.JavaConfigDeploymentManagerSpec.xml

1 tests were completed in 13s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.management.streaming.JavaConfigDeploymentManagerSpec 1✅ 13s

✅ pl.touk.nussknacker.engine.management.streaming.JavaConfigDeploymentManagerSpec

✅ deploy java scenario in running flink

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeBinTest.xml

1 tests were completed in 10s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeBinTest 1✅ 10s

✅ pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeBinTest

✅ should run scenario and pass data to output

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerAvroTest.xml

1 tests were completed in 31s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerAvroTest 1✅ 31s

✅ pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerAvroTest

✅ avro ping-pong should work

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerJsonTest.xml

1 tests were completed in 31s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerJsonTest 1✅ 31s

✅ pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerJsonTest

✅ json ping-pong should work

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerProbesTest.xml

2 tests were completed in 61s with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerProbesTest 2✅ 61s

✅ pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerProbesTest

✅ readiness probe
✅ liveness probe

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeBinTest.xml

1 tests were completed in 8s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeBinTest 1✅ 8s

✅ pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeBinTest

✅ binary version should handle ping pong via http

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeDockerTest.xml

2 tests were completed in 309ms with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeDockerTest 2✅ 309ms

✅ pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeDockerTest

✅ docker image should handle ping pong via http
✅ should get scenario definition via http

✅ security/target/it-reports/TEST-pl.touk.nussknacker.ui.security.oauth2.GenericOidcServiceSpec.xml

1 tests were completed in 3s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.ui.security.oauth2.GenericOidcServiceSpec 1✅ 3s

✅ pl.touk.nussknacker.ui.security.oauth2.GenericOidcServiceSpec

✅ Basic OpenIDConnect flow

✅ utils/kafka-components-utils/target/it-reports/TEST-pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateDisabledTest.xml

6 tests were completed in 2s with 6 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateDisabledTest 6✅ 2s

✅ pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateDisabledTest

✅ should validate existing source topic
✅ should validate not existing source topic
✅ should validate existing sink topic
✅ should validate not existing sink topic
✅ should not validate not existing topic when validation disabled
✅ should fetch topics every time when not valid using cache

✅ utils/kafka-components-utils/target/it-reports/TEST-pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateEnabledTest.xml

6 tests were completed in 4s with 6 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateEnabledTest 6✅ 4s

✅ pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateEnabledTest

✅ should validate existing source topic
✅ should not validate not existing source topic
✅ should validate existing sink topic
✅ should validate not existing sink topic
✅ should not validate not existing topic when validation disabled
✅ should use cache when validating

Annotations

Check failure on line 59 in engine/flink/test-utils/src/main/scala/pl/touk/nussknacker/engine/flink/test/FlinkMiniClusterHolder.scala

See this annotation in the file changed.

@github-actions github-actions / REPORT-IntegrationTests-2.13

pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest ► (It is not a test it is a sbt.testing.SuiteSelector)

Failed test found in:
  components/openapi/target/it-reports/TEST-pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest.xml
Error:
  java.util.concurrent.CompletionException: org.apache.pekko.pattern.AskTimeoutException: Recipient [Actor[pekko://flink/user/rpc#-782740756]] had already been terminated. Message of type [org.apache.flink.runtime.rpc.pekko.SupervisorActor$StartRpcActor].
Raw output
java.util.concurrent.CompletionException: org.apache.pekko.pattern.AskTimeoutException: Recipient [Actor[pekko://flink/user/rpc#-782740756]] had already been terminated. Message of type [org.apache.flink.runtime.rpc.pekko.SupervisorActor$StartRpcActor].
	at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:331)
	at java.base/java.util.concurrent.CompletableFuture.uniApplyNow(CompletableFuture.java:670)
	at java.base/java.util.concurrent.CompletableFuture.uniApplyStage(CompletableFuture.java:658)
	at java.base/java.util.concurrent.CompletableFuture.thenApplyAsync(CompletableFuture.java:2099)
	at scala.concurrent.java8.FuturesConvertersImpl$CF.thenApply(FutureConvertersImpl.scala:35)
	at org.apache.flink.runtime.rpc.pekko.SupervisorActor.startRpcActor(SupervisorActor.java:205)
	at org.apache.flink.runtime.rpc.pekko.PekkoRpcService.registerRpcActor(PekkoRpcService.java:354)
	at org.apache.flink.runtime.rpc.pekko.PekkoRpcService.startServer(PekkoRpcService.java:268)
	at org.apache.flink.runtime.rpc.RpcEndpoint.<init>(RpcEndpoint.java:147)
	at org.apache.flink.runtime.rpc.RpcEndpoint.<init>(RpcEndpoint.java:162)
	at org.apache.flink.runtime.taskexecutor.TaskExecutor.<init>(TaskExecutor.java:336)
	at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.startTaskManager(TaskManagerRunner.java:674)
	at org.apache.flink.runtime.minicluster.MiniCluster.startTaskManager(MiniCluster.java:767)
	at org.apache.flink.runtime.minicluster.MiniCluster.startTaskManagers(MiniCluster.java:748)
	at org.apache.flink.runtime.minicluster.MiniCluster.start(MiniCluster.java:459)
	at org.apache.flink.runtime.testutils.MiniClusterResource.startMiniCluster(MiniClusterResource.java:248)
	at org.apache.flink.runtime.testutils.MiniClusterResource.before(MiniClusterResource.java:110)
	at org.apache.flink.test.util.MiniClusterWithClientResource.before(MiniClusterWithClientResource.java:64)
	at pl.touk.nussknacker.engine.flink.test.FlinkMiniClusterHolderImpl.start(FlinkMiniClusterHolder.scala:59)
	at pl.touk.nussknacker.engine.flink.test.FlinkSpec.beforeAll(FlinkSpec.scala:24)
	at pl.touk.nussknacker.engine.flink.test.FlinkSpec.beforeAll$(FlinkSpec.scala:21)
	at pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest.beforeAll(OpenApiScenarioIntegrationTest.scala:29)
	at org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:212)
	at org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210)
	at org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208)
	at pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest.org$scalatest$BeforeAndAfter$$super$run(OpenApiScenarioIntegrationTest.scala:29)
	at org.scalatest.BeforeAndAfter.run(BeforeAndAfter.scala:273)
	at org.scalatest.BeforeAndAfter.run$(BeforeAndAfter.scala:271)
	at pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest.run(OpenApiScenarioIntegrationTest.scala:29)
	at org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321)
	at org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517)
	at sbt.TestRunner.runTest$1(TestFramework.scala:153)
	at sbt.TestRunner.run(TestFramework.scala:168)
	at sbt.TestFramework$$anon$3$$anonfun$$lessinit$greater$1.$anonfun$apply$1(TestFramework.scala:336)
	at sbt.TestFramework$.sbt$TestFramework$$withContextLoader(TestFramework.scala:296)
	at sbt.TestFramework$$anon$3$$anonfun$$lessinit$greater$1.apply(TestFramework.scala:336)
	at sbt.TestFramework$$anon$3$$anonfun$$lessinit$greater$1.apply(TestFramework.scala:336)
	at sbt.TestFunction.apply(TestFramework.scala:348)
	at sbt.Tests$.processRunnable$1(Tests.scala:475)
	at sbt.Tests$.$anonfun$makeSerial$1(Tests.scala:481)
	at sbt.std.Transform$$anon$3.$anonfun$apply$2(Transform.scala:47)
	at sbt.std.Transform$$anon$4.work(Transform.scala:69)
	at sbt.Execute.$anonfun$submit$2(Execute.scala:283)
	at sbt.internal.util.ErrorHandling$.wideConvert(ErrorHandling.scala:24)
	at sbt.Execute.work(Execute.scala:292)
	at sbt.Execute.$anonfun$submit$1(Execute.scala:283)
	at sbt.ConcurrentRestrictions$$anon$4.$anonfun$submitValid$1(ConcurrentRestrictions.scala:265)
	at sbt.CompletionService$$anon$2.call(CompletionService.scala:65)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: org.apache.pekko.pattern.AskTimeoutException: Recipient [Actor[pekko://flink/user/rpc#-782740756]] had already been terminated. Message of type [org.apache.flink.runtime.rpc.pekko.SupervisorActor$StartRpcActor].