Merge pull request #978: Release 0.15.0

Author: je-ik

README.md

@@ -201,7 +201,7 @@ First, let's introduce some glossary:
       <plugin>
         <groupId>cz.o2.proxima</groupId>
         <artifactId>proxima-compiler-java-maven-plugin</artifactId>
-        <version>0.14.0</version>
+        <version>0.15.0</version>
         <configuration>
           <outputDir>${project.build.directory}/generated-sources/model</outputDir>
           <javaPackage>cz.o2.proxima.testing.model</javaPackage>
@@ -223,7 +223,7 @@ First, let's introduce some glossary:
           <dependency>
             <groupId>${project.groupId}</groupId>
             <artifactId>proxima-direct-compiler-plugin</artifactId>
-            <version>0.14.0</version>
+            <version>0.15.0</version>
           </dependency>
           <!--
             The following dependencies define additional
@@ -238,12 +238,12 @@ First, let's introduce some glossary:
           <dependency>
             <groupId>${project.groupId}</groupId>
             <artifactId>proxima-scheme-proto</artifactId>
-            <version>0.14.0</version>
+            <version>0.15.0</version>
           </dependency>
           <dependency>
             <groupId>${project.groupId}</groupId>
             <artifactId>proxima-scheme-proto-testing</artifactId>
-            <version>0.14.0</version>
+            <version>0.15.0</version>
           </dependency>
         </dependencies>
       </plugin>
@@ -260,7 +260,7 @@ First, let's introduce some glossary:
   ```
 
 ## Platform's _DataOperators_
- The platform offers various modes of access to data. As of version 0.14.0, these types are:
+ The platform offers various modes of access to data. As of version 0.15.0, these types are:
   * direct
   * Apache Beam
   * Apache Flink

RELEASE-NOTES.md

@@ -1,44 +1,77 @@
- - Merge pull request [#895](https://github.com/datadrivencz/proxima-platform/pull/895): [proxima-beam-core] tune CommitLogRead
- - Merge pull request [#894](https://github.com/datadrivencz/proxima-platform/pull/894): [proxima-direct-core] close writers outside of lock
- - Merge pull request [#893](https://github.com/datadrivencz/proxima-platform/pull/893): [proxima-scheme-proto] add toString() to ProtoSerializerFactory
- - Merge pull request [#892](https://github.com/datadrivencz/proxima-platform/pull/892): [proxima-beam-tools] remove hard dependency on Direct and FlinkRunner
- - Merge pull request [#891](https://github.com/datadrivencz/proxima-platform/pull/891): [proxima-compiler] add Model.wrap(Repository)
- - Merge pull request [#411](https://github.com/datadrivencz/proxima-platform/pull/411): [beam-core]: Introduction of ProximaIO.write
- - Merge pull request [#890](https://github.com/datadrivencz/proxima-platform/pull/890): Fix beam CommitLogRead semantics and performance
- - Merge pull request [#889](https://github.com/datadrivencz/proxima-platform/pull/889): [proxima-beam] bump beam to 2.55.0
- - Merge pull request [#888](https://github.com/datadrivencz/proxima-platform/pull/888): [proxima-direct-core] allow non-transactional attributes in transaction
- - Merge pull request [#887](https://github.com/datadrivencz/proxima-platform/pull/887): [proxima-direct-core] Optimize transaction processing
- - Merge pull request [#886](https://github.com/datadrivencz/proxima-platform/pull/886): Transaction duplicate
- - Merge pull request [#885](https://github.com/datadrivencz/proxima-platform/pull/885): [proxima-direct-transaction-manager] #327 allow transaction reopen after abort
- - Merge pull request [#884](https://github.com/datadrivencz/proxima-platform/pull/884): [proxima-direct-transaction-manager] #326 add TransactionMonitoringPolicy
- - Merge pull request [#883](https://github.com/datadrivencz/proxima-platform/pull/883): [proxima-direct-io-kafka] remove unnecessary deserialization
- - Merge pull request [#882](https://github.com/datadrivencz/proxima-platform/pull/882): [proxima-direct-transaction-manager] optimize wildcard update performance
- - Merge pull request [#881](https://github.com/datadrivencz/proxima-platform/pull/881): [proxima-tools] bump groovy to 4.0.19
- - Merge pull request [#880](https://github.com/datadrivencz/proxima-platform/pull/880): [proxima-direct-io-kafka] throttle warning about stale uncommitted offset
- - Merge pull request [#879](https://github.com/datadrivencz/proxima-platform/pull/879): [proxima-direct-ingest-server] #325 fix ConcurrentModificationException in Metrics
- - Merge pull request [#878](https://github.com/datadrivencz/proxima-platform/pull/878): [proxima-direct-core] refactor WatermarkFactory to setup() and create()
- - Merge pull request [#877](https://github.com/datadrivencz/proxima-platform/pull/877): [proxima-beam] bump beam to 2.54.0
- - Merge pull request [#876](https://github.com/datadrivencz/proxima-platform/pull/876): [proxima-direct-transaction-manager] #324 wait for watermark before commit
- - Merge pull request [#875](https://github.com/datadrivencz/proxima-platform/pull/875): [proxima-direct-io-kafka] Log by default stale non-committed offsets
- - Merge pull request [#874](https://github.com/datadrivencz/proxima-platform/pull/874): [proxima-core] Add ContextualTransformation#onRestart
- - Merge pull request [#873](https://github.com/datadrivencz/proxima-platform/pull/873): [proxima-direct-io-kafka] Log exception when failed commit called without Exception
- - Merge pull request [#872](https://github.com/datadrivencz/proxima-platform/pull/872): [proxima-direct-core] #323 asynchronous transaction update
- - Merge pull request [#871](https://github.com/datadrivencz/proxima-platform/pull/871): [infra] bump autoservice
- - Merge pull request [#870](https://github.com/datadrivencz/proxima-platform/pull/870): [proxima-direct-ingest-server] add latency metrics to IngestService
- - Merge pull request [#869](https://github.com/datadrivencz/proxima-platform/pull/869): [proxima-direct-ingest-client] improve logging
- - Merge pull request [#868](https://github.com/datadrivencz/proxima-platform/pull/868): [proxima-direct-io-pubsub] bump pubsub client library
- - Merge pull request [#867](https://github.com/datadrivencz/proxima-platform/pull/867): [proxima-direct-ingest-server] upgrade failsafe
- - Merge pull request [#866](https://github.com/datadrivencz/proxima-platform/pull/866): [proxima-core] ensure all metrics are registered
- - Merge pull request [#865](https://github.com/datadrivencz/proxima-platform/pull/865): [proxima-direct-core] handle TransactionRejectedException in validator
- - Merge pull request [#864](https://github.com/datadrivencz/proxima-platform/pull/864): [proxima-beam] bump beam to 2.53.0
- - Merge pull request [#862](https://github.com/datadrivencz/proxima-platform/pull/862): 321 transaction manager metrics
- - Merge pull request [#863](https://github.com/datadrivencz/proxima-platform/pull/863): [proxima-direct-core] O2-Czech-Republic#220 remove Serializable from LogObserver
- - Merge pull request [#861](https://github.com/datadrivencz/proxima-platform/pull/861): [proxima-core] add MetricFactory for metric creation and registration
- - Merge pull request [#860](https://github.com/datadrivencz/proxima-platform/pull/860): [proxima-direct-transaction-manager] O2-Czech-Republic#320 reject transactions with multiple seqIds for same KeyAttribute
- - Merge pull request [#859](https://github.com/datadrivencz/proxima-platform/pull/859): [infra] Happy new year
- - Merge pull request [#858](https://github.com/datadrivencz/proxima-platform/pull/858): [proxima-tools] bump groovy to 4.0.17
- - Merge pull request [#857](https://github.com/datadrivencz/proxima-platform/pull/857): [proxima] fix version references from 0.12
- - Merge pull request [#856](https://github.com/datadrivencz/proxima-platform/pull/856): [proxima-beam-core] add SchemaStreamElementCoder
- - Merge pull request [#855](https://github.com/datadrivencz/proxima-platform/pull/855): [proxima-core] rename parameter 'ingest' to 'element'
- - Merge pull request [#854](https://github.com/datadrivencz/proxima-platform/pull/854): [proxima-beam-core] remove unused sources
- - Merge pull request [#853](https://github.com/datadrivencz/proxima-platform/pull/853): [proxima] v0.14-SNAPSHOT
+ - Merge pull request [#977](https://github.com/datadrivencz/proxima-platform/pull/977): [beam] do not use String.format for logging errors in ProximaIO
+ - Merge pull request [#976](https://github.com/datadrivencz/proxima-platform/pull/976): [compiler] remove GENERATED_FROM string from compiled model
+ - Merge pull request [#975](https://github.com/datadrivencz/proxima-platform/pull/975): [infra] revert protobufs to 3.x
+ - Merge pull request [#974](https://github.com/datadrivencz/proxima-platform/pull/974): [proxima-beam] bump beam to 2.64.0
+ - Merge pull request [#973](https://github.com/datadrivencz/proxima-platform/pull/973): [beam-tools] add option to disable stable input for remote collect
+ - Merge pull request [#972](https://github.com/datadrivencz/proxima-platform/pull/972): [beam-core] Use atomic references instead of volatile fields
+ - Merge pull request [#971](https://github.com/datadrivencz/proxima-platform/pull/971): [direct-io-kafka] fix bounded read
+ - Merge pull request [#970](https://github.com/datadrivencz/proxima-platform/pull/970): [proxima-beam-tools] fix JsonElement registration
+ - Merge pull request [#969](https://github.com/datadrivencz/proxima-platform/pull/969): [direct-io-kafka] fix stopAtCurrent when reading topic
+ - Merge pull request [#968](https://github.com/datadrivencz/proxima-platform/pull/968): [proxima-beam-tools] register json objects to kryo
+ - Merge pull request [#967](https://github.com/datadrivencz/proxima-platform/pull/967): [direct-io-gcloud-storage] handle StorageExceptions with JsonResponse cause
+ - Merge pull request [#966](https://github.com/datadrivencz/proxima-platform/pull/966): [direct-io-kafka] idle watermark robustness
+ - Merge pull request [#965](https://github.com/datadrivencz/proxima-platform/pull/965): Fix zstd
+ - Merge pull request [#963](https://github.com/datadrivencz/proxima-platform/pull/963): Kafka watermarking
+ - Merge pull request [#962](https://github.com/datadrivencz/proxima-platform/pull/962): [proxima-direct-io-kafka] #350 additional fixes of watermarks
+ - Merge pull request [#961](https://github.com/datadrivencz/proxima-platform/pull/961): [proxima-direct-io-kafka] #350 check endOffsets to mark partition idle
+ - Merge pull request [#960](https://github.com/datadrivencz/proxima-platform/pull/960): [direct-io-cassandra] Upgrade CQL client
+ - Merge pull request [#959](https://github.com/datadrivencz/proxima-platform/pull/959): [proxima-direct-core] fix LocalCachedPartitionedView.scanWildcard off-by-one error
+ - Merge pull request [#958](https://github.com/datadrivencz/proxima-platform/pull/958): [proxima-direct-io-cassandra] unsynchronize CassandraWriter
+ - Merge pull request [#957](https://github.com/datadrivencz/proxima-platform/pull/957): [proxima-direct-core] check prefix of cached scanWildcard's offset
+ - Merge pull request [#956](https://github.com/datadrivencz/proxima-platform/pull/956): [ingest-server] strip '.*' from wildcard prefix
+ - Merge pull request [#955](https://github.com/datadrivencz/proxima-platform/pull/955): [proxima-direct-ingest-server] fix single write ingest transactions
+ - Merge pull request [#954](https://github.com/datadrivencz/proxima-platform/pull/954): [transaction-manager] compute transaction latency metric
+ - Merge pull request [#953](https://github.com/datadrivencz/proxima-platform/pull/953): [proxima-direct-core] allow creation of committed transaction in caching
+ - Merge pull request [#952](https://github.com/datadrivencz/proxima-platform/pull/952): [transactions] enforce timeout on sync()
+ - Merge pull request [#951](https://github.com/datadrivencz/proxima-platform/pull/951): Revert "[proxima-beam-core] remove fork of CalendarWindows"
+ - Merge pull request [#950](https://github.com/datadrivencz/proxima-platform/pull/950): [infra] upgrade setup-java to v4
+ - Merge pull request [#949](https://github.com/datadrivencz/proxima-platform/pull/949): [infra] Happy new year!
+ - Merge pull request [#948](https://github.com/datadrivencz/proxima-platform/pull/948): [proxima-direct-core] fix LocalCachedPartitionedView restart after error
+ - Merge pull request [#947](https://github.com/datadrivencz/proxima-platform/pull/947): [proxima-beam-core] remove fork of CalendarWindows
+ - Merge pull request [#946](https://github.com/datadrivencz/proxima-platform/pull/946): watermark shift
+ - Merge pull request [#945](https://github.com/datadrivencz/proxima-platform/pull/945): [proxima-beam-core] #344 add FilterLatecomers transform
+ - Merge pull request [#944](https://github.com/datadrivencz/proxima-platform/pull/944): [proxima-beam-core] state expander: drop elements with timestamp behind state write time
+ - Merge pull request [#943](https://github.com/datadrivencz/proxima-platform/pull/943): [proxima-direct-core] Discard invalid cached response observer in TransactionResourceManager
+ - Merge pull request [#942](https://github.com/datadrivencz/proxima-platform/pull/942): [proxima-beam-core] debugging external state expander
+ - Merge pull request [#941](https://github.com/datadrivencz/proxima-platform/pull/941): [proxima-beam] bump beam to 2.61.0
+ - Merge pull request [#940](https://github.com/datadrivencz/proxima-platform/pull/940): [tools] bump groovy to 4.0.24
+ - Merge pull request [#939](https://github.com/datadrivencz/proxima-platform/pull/939): [proxima-beam-tools] fix logging of dynamic jar
+ - Merge pull request [#938](https://github.com/datadrivencz/proxima-platform/pull/938): [proxima-beam-core] O2-Czech-Republic#339 expander fixes
+ - Merge pull request [#937](https://github.com/datadrivencz/proxima-platform/pull/937): [proxima-beam] bump beam to 2.60.0
+ - Merge pull request [#936](https://github.com/datadrivencz/proxima-platform/pull/936): [proxima-direct-core] O2-Czech-Republic#341 fix DUPLICATE response handling
+ - Merge pull request [#935](https://github.com/datadrivencz/proxima-platform/pull/935): [proxima-direct] O2-Czech-Republic#341 fix transaction idempotency
+ - Merge pull request [#934](https://github.com/datadrivencz/proxima-platform/pull/934): [proxima-direct-core] O2-Czech-Republic#340 do not terminate transaction after sync()
+ - Merge pull request [#932](https://github.com/datadrivencz/proxima-platform/pull/932): [proxima-direct-cassandra] reinitialize cluster after failed session creation
+ - Merge pull request [#931](https://github.com/datadrivencz/proxima-platform/pull/931): [proxima-beam] bump beam to 2.59.0
+ - Merge pull request [#930](https://github.com/datadrivencz/proxima-platform/pull/930): [tools[ bump groovy to 4.0.23
+ - Merge pull request [#929](https://github.com/datadrivencz/proxima-platform/pull/929): [proxima-direct-core] Allow committing transaction without updating
+ - Merge pull request [#927](https://github.com/datadrivencz/proxima-platform/pull/927): [rpc] fix typo in comment
+ - Merge pull request [#926](https://github.com/datadrivencz/proxima-platform/pull/926): [proxima-beam] bump beam to 2.58.0
+ - Merge pull request [#925](https://github.com/datadrivencz/proxima-platform/pull/925): Bulk scanning
+ - Merge pull request [#924](https://github.com/datadrivencz/proxima-platform/pull/924): [proxima-direct-transaction-manager] #337 ensure transaction server terminates on errors
+ - Merge pull request [#923](https://github.com/datadrivencz/proxima-platform/pull/923): [ingest-client] add scanning to IngestClient
+ - Merge pull request [#922](https://github.com/datadrivencz/proxima-platform/pull/922): [tools] bump groovy to 4.0.21
+ - Merge pull request [#921](https://github.com/datadrivencz/proxima-platform/pull/921): [proxima-beam] bump beam to 2.57.0
+ - Merge pull request [#920](https://github.com/datadrivencz/proxima-platform/pull/920): [proxima-direct-io-cassandra] small polishing
+ - Merge pull request [#919](https://github.com/datadrivencz/proxima-platform/pull/919): [proxima-direct-io-cassandra] #331 fix deserialization of values written with serializer v2
+ - Merge pull request [#918](https://github.com/datadrivencz/proxima-platform/pull/918): [proxima-direct-io-pubsub] verify pubsub bulks before writing
+ - Merge pull request [#916](https://github.com/datadrivencz/proxima-platform/pull/916): [proxima-direct-transaction-manager] Add timeout for the server to terminate after error
+ - Merge pull request [#915](https://github.com/datadrivencz/proxima-platform/pull/915): [docs] fix return value in observe() docs
+ - Merge pull request [#914](https://github.com/datadrivencz/proxima-platform/pull/914): [proxima-direct-io-kafka] #334 add ValueAsStringSerializer
+ - Merge pull request [#913](https://github.com/datadrivencz/proxima-platform/pull/913): [proxima-direct-io-pubsub] synchronize pubsub bulk periodic flush
+ - Merge pull request [#912](https://github.com/datadrivencz/proxima-platform/pull/912): [docs] fix comments
+ - Merge pull request [#909](https://github.com/datadrivencz/proxima-platform/pull/909): Pubsub bulk (#333)
+ - Merge pull request [#911](https://github.com/datadrivencz/proxima-platform/pull/911): [infra] enable JUnit 5 tests
+ - Merge pull request [#910](https://github.com/datadrivencz/proxima-platform/pull/910): [proxima] set LOG_LEVEL from env to tests
+ - Merge pull request [#908](https://github.com/datadrivencz/proxima-platform/pull/908): [proxima-direct-transaction-manager] fix updating transaction with misssing wildcard attribute
+ - Merge pull request [#907](https://github.com/datadrivencz/proxima-platform/pull/907): [docs] Add basic documentation for ACID transactions
+ - Merge pull request [#906](https://github.com/datadrivencz/proxima-platform/pull/906): [docs] skeleton of documentation for BeamDataOperator
+ - Merge pull request [#905](https://github.com/datadrivencz/proxima-platform/pull/905): [proxima-direct-core] add ProcessingTimeShiftingWatermarkIdlePolicy
+ - Merge pull request [#904](https://github.com/datadrivencz/proxima-platform/pull/904): [proxima-beam] bump beam to 2.56.0
+ - Merge pull request [#903](https://github.com/datadrivencz/proxima-platform/pull/903): [proxima-docs] add skeleton of docs for DirectDataOperator
+ - Merge pull request [#902](https://github.com/datadrivencz/proxima-platform/pull/902): [transactions] enforce nonzero stamp in commit
+ - Merge pull request [#900](https://github.com/datadrivencz/proxima-platform/pull/900): [proxima-direct-transaction] #329 commit via replication coordinator
+ - Merge pull request [#901](https://github.com/datadrivencz/proxima-platform/pull/901): [proxima-beam-core] avoid ConcurrentModificationException in ProximaIO
+ - Merge pull request [#898](https://github.com/datadrivencz/proxima-platform/pull/898): [proxima-beam] use ProximaIO for BeamStream#write
+ - Merge pull request [#899](https://github.com/datadrivencz/proxima-platform/pull/899): [proxima-direct-transaction-manager] fix flaky test
+ - Merge pull request [#897](https://github.com/datadrivencz/proxima-platform/pull/897): [proxima-core] Improve reporting of missing PRIMARY family for attribute

build.gradle

@@ -26,7 +26,7 @@ plugins {
   id "org.sonarqube" version "4.0.0.2929"
 }
 
-version = '0.15-SNAPSHOT'
+version = '0.16-SNAPSHOT'
 
 group = 'cz.o2.proxima'
 

docs/src/config.yaml

@@ -57,7 +57,7 @@ params:
   BookPortableLinks: true
   BookServiceWorker: true
   proxima:
-    version: 0.14.0
+    version: 0.15.0
 
 deployment:
   order: [".jpg$", ".gif$", ".png$"]

docs/src/content/book/generator.md

@@ -135,7 +135,7 @@ will generate the `Model.java` class to the current working directory:
 
 Note that if your configuration file uses other dependecies (like scheme-proto in the maven example above) you need to specify these on the classpath and run the class `cz.o2.proxima.generator.ModelGenerator` manually:
 ```shell
- $ java -cp proxima-compiler-java-cli-0.14.0.jar:<other_jars> \
+ $ java -cp proxima-compiler-java-cli-0.15.0.jar:<other_jars> \
      cz.o2.proxima.generator.ModelGenerator \
      -p cz.o2.proxima.test -f <path_to_config>
 ```

setup.py

@@ -21,7 +21,7 @@
 from setuptools import setup
 
 def get_version():
-  return "0.14.0"
+  return "0.15.0"
 
 def build_ingest_rpc(name):