Skip to content

Cask Data Application Platform v3.0.1

Compare
Choose a tag to compare
@sreevatsanraman sreevatsanraman released this 23 Jun 20:21
· 25694 commits to develop since this release
  • In the CDAP UI, mandatory parameters for Application Template creation are marked with asterisks, and if a user tries to create a template without one of those parameters, the missing parameter is highlighted (CDAP-2499).
  • Added a tool (HBaseQueueDebugger) that counts consumed and unconsumed entries in a flowlet queue (CDAP-2105).
  • The currently executing node of a workflow is now highlighted in the CDAP UI (CDAP-2615).
  • The list of datasets and the run histories in the CDAP UI are now paginated (CDAP-2626, CDAP-2627).
  • Added improvements to the CDAP UI when creating Application Templates (CDAP-2601, CDAP-2602, CDAP-2603, CDAP-2605, CDAP-2606, CDAP-2607, CDAP-2610).
  • Improved the error messages returned when there are problems creating Application Templates in the CDAP UI (CDAP-2597).
  • Added the Apache Flume agent flume-ng to the CDAP SDK VM (CDAP-2612).
  • Added the ability to copy and paste to the CDAP SDK VM (CDAP-2611).
  • Pre-downloaded the example dependencies into the CDAP SDK VM to speed building of the CDAP examples (CDAP-2613).
  • Fixed a problem with the HBase store and flows with multiple queues, where one queue name is a prefix of another queue name (CDAP-1996).
  • Fixed a problem with namespaces with underscores in the name crashing the Hadoop HBase region servers (CDAP-2110).
  • Removed the requirement to specify the JDBC driver class property twice in the adaptor configuration for Database Sources and Sinks (CDAP-2453).
  • Fixed a problem in CDAP Distributed where the status of running program always returns as “STOPPED” when the CDAP Master is restarted (CDAP-2489).
  • Fixed a problem with invalid RunRecords for Spark and MapReduce programs that are run as part of a Workflow (CDAP-2490).
  • Fixed a problem with the CDAP Master not being HA (highly available) when a leadership change happens (CDAP-2495).
  • Fixed a problem with upgrading of queues with the UpgradeTool (CDAP-2502).
  • Fixed a problem with ObjectMappedTables not deleting missing fields when updating a row (CDAP-2523, CDAP-2524).
  • Fixed a problem with a stream not being created properly when deploying an application after the default namespace was deleted (CDAP-2537).
  • Fixed a problem with the Applicaton Template Kafka Source not using the persisted offset when the Adapter is restarted (CDAP-2547).
  • A problem with CDAP using its own transaction snapshot codec, leading to huge snapshot files and OutOfMemory exceptions, and transaction snapshots that can’t be read using Tephra’s tools, has been resolved by replacing the codec with Tephra’s SnapshotCodecV3 (CDAP-2563, CDAP-2946, TEPHRA-101).
  • Fixed a problem with CDAP Master not being resilient in the handling of Zookeeper exceptions (CDAP-2569).
  • Fixed a problem with RunRecords not being cleaned up correctly after certain exceptions (CDAP-2584).
  • Fixed a problem with the CDAP Maven archetype having an incorrect CDAP version in it (CDAP-2634).
  • Fixed a problem with the description of the TwitterSource not describing its output (CDAP-2648).
  • Fixed a problem with the Twitter Source not handling missing fields correctly and as a consequence producing tweets (with errors) that were then not stored on disk (CDAP-2653).
  • Fixed a problem with the TwitterSource not calculating the time of tweet correctly (CDAP-2656).
  • Fixed a problem with the JMS Real-time Source failing to load required plugin sources (CDAP-2661).
  • Fixed a problem with executing Hive queries on a distributed CDAP due to a failure to load Grok classes (CDAP-2678).
  • Fixed a problem with CDAP Program jars not being cleaned up from the temporary directory (CDAP-2698).
  • Fixed a problem with ProjectionTransforms not handling input data fields with null values correctly (CDAP-2719).
  • Fixed a problem with the CDAP SDK running out of memory when MapReduce jobs are run repeatedly (CDAP-2743).
  • Fixed a problem with not using CDAP RunIDs in the in-memory version of the CDAP SDK (CDAP-2769).
  • Fixed a problem with the CDAP CLI not printing an error if it is unable to connect to a CDAP instance (CDAP-2529).
  • Fixed a problem with extra whitespace in commands entered into the CDAP CLI causing errors (CDAP-2538).
  • Updated the messages displayed when starting the CDAP Standalone SDK as to components and the JVM required (CDAP-2445).
  • Fixed a problem with the creation of the default namespace upon starting the CDAP SDK (CDAP-2587).
  • Fixed a problem with using the default namespace on the CDAP SDK Virtual Machine Image (CDAP-2500).
  • Fixed a problem with the VirtualBox VM retaining a MAC address obtained from the build host (CDAP-2640).
  • Fixed a problem with incorrect flow metrics showing in the CDAP UI (CDAP-2494).
  • Fixed a problem in the CDAP UI with the properties in the Projection Transform being displayed inconsistently (CDAP-2525).
  • Fixed a problem in the CDAP UI not automatically updating the number of flowlet instances (CDAP-2534).
  • Fixed a problem in the CDAP UI with a window resize preventing clicking of the Adapter Template drop down menu (CDAP-2573).
  • Fixed a problem with the CDAP UI not performing validation of mandatory parameters before the creation of an adapter (CDAP-2575).
  • Fixed a problem with an incorrect version of CDAP being shown in the CDAP UI (CDAP-2586).
  • Reduced the number of clicks required to navigate and perform actions within the CDAP UI (CDAP-2622, CDAP-2625).
  • Fixed a problem with an additional forward-slash character in the URL causing a “page not found error” in the CDAP UI (CDAP-2624).
  • Fixed a problem with the error dropdown of the CDAP UI not scrolling when it has a large number of errors (CDAP-2633).
  • Fixed a problem in the CDAP UI with the Twitter Source’s consumer key secret not being treated as a password field (CDAP-2649).
  • Fixed a problem with the CDAP UI attempting to create an adapter without a name (CDAP-2652).
  • Fixed a problem with the CDAP UI not being able to find the ETL plugin templates on distributed CDAP (CDAP-2655).
  • Fixed a problem with the CDAP UI’s System Dashboard chart having a y-axis starting at “-200” (CDAP-2699).
  • Fixed a problem with the rendering of stack trace logs in the CDAP UI (CDAP-2745).
  • Fixed a problem with the CDAP UI not working with secure CDAP instances, either clusters or standalone (CDAP-2770).
  • Fixed a problem with the coloring of completed runs of Workflow DAGs in the CDAP UI (CDAP-2781).
  • Fixed errors with the documentation examples of the ETL Plugins (CDAP-2503).
  • Documented the licenses of all shipped CDAP UI components (CDAP-2582).
  • Corrected issues with the building of Javadocs used on the website and removed Javadocs previously included in the SDK (CDAP-2730).
  • Added a recommended version (v.12.0) of Node.js to the documentation (CDAP-2762).