2.3.0-Release Notes
This is the second release of the Apache Trafodion project.
Build instructions are available in the Trafodion Contributor Guide.
New Features
| Feature | Jira ID |
|---|---|
| support adding/retrieving comments to SQL objects | TRAFODION-1915 |
| support functions in the column default definition | TRAFODION-2335 |
| support to load json file | TRAFODION-2335 |
| Add new Trafodion LOB Guide to documentation build and web site | TRAFODION-2771 |
| Script to help resolve merge conflicts particularly in regression test results | TRAFODION-2835 |
| Refactor Trafodion implementation of hdfs scan for text formatted hive tables | TRAFODION-2917 |
| add create option storage policy | TRAFODION-3026 |
| Trafodion to support compressed Hive Text formatted tables | TRAFODION-3065 |
| cp command does not support writting to bad file | TRAFODION-3252 |
Improvements
| Feature | Jira ID |
|---|---|
| LP Bug: 1444549 - DCS floating IP should set internal interface | TRAFODION-1176 |
| Implement T2 Driver's Rowsets ability to enhance the batch insert performance | TRAFODION-1628 |
| 'initialized trafodion' failed on CentOS 7.2 | TRAFODION-1869 |
| Have jdbc drivers available on Maven Repository | TRAFODION-1957 |
| add encryption functions for Trafodion | TRAFODION-2228 |
| Documentation update for REST and DCS | TRAFODION-2307 |
| Memory leak in the compiler part of the code in Trafodion | TRAFODION-2727 |
| Provide an improved memory quota assignment for big memory operators (BMO) | TRAFODION-2733 |
| Native hbase table access via Trafodion improvements/issues | TRAFODION-2737 |
| LOB support in JDBC Type 2 | TRAFODION-2741 |
| UPDATE STATS unnecessarily creates LOB columns in sample tables | TRAFODION-2781 |
| Trafodion core code base needs to be thread safe | TRAFODION-2821 |
| export will scan full table with splitby column | TRAFODION-2830 |
| Enable Trafodion SQL processes to configure garbage collector in its embedded JVM | TRAFODION-2836 |
| Remove incubating from trafodion web pages | TRAFODION-2857 |
| Foundation infrastructure changes needed to support operating in Cloudera Manager environment | TRAFODION-2882 |
| Preliminary Trafodion Foundation Scalability Enhancements | TRAFODION-2883 |
| Trafodion Foundation Scalability Enhancements | TRAFODION-2884 |
| Streamline setjmp/longjmp concepts in Trafodion | TRAFODION-2888 |
| optionally add leading space when get a number column to display | TRAFODION-2904 |
| Link to JIRA should use https: | TRAFODION-2926 |
| Add news articles about Trafodion to Trafodion web site | TRAFODION-2928 |
| Remove the 64K hard limit for process ids in RMS infrastructure | TRAFODION-2963 |
| Secure *.apache.org links | TRAFODION-2994 |
| Several scripts incorrectly use cut -b 1-5 to extract pid information | TRAFODION-3013 |
| Add more enum files to analyzeMessageGuide.py | TRAFODION-3023 |
| Query with nested subqueries chooses bad plan | TRAFODION-3031 |
| removee 'mt_' column family | TRAFODION-3059 |
| Installer needs to support RH7 / Centos7 | TRAFODION-3075 |
| enhance the 'get table' utility to return number of rows | TRAFODION-3101 |
| Remove some obsolete cruft from the SQL parser and related modules | TRAFODION-3135 |
| Remove obsolete code from UPDATE STATISTICS | TRAFODION-3138 |
| Make 'hbase_options' as default setting and use cqd to change the default setting | TRAFODION-3145 |
| add sys_guid function | TRAFODION-3147 |
| Docker files should show correct version | TRAFODION-3200 |
Sub-task
| Feature | Jira ID |
|---|---|
| Preliminary Trafodion Foundation Scalability Enhancements | TRAFODION-2883 |
| Trafodion Foundation Scalability Enhancements | TRAFODION-2884 |
Fixes
| Feature | Jira ID |
|---|---|
| ODB doesn't terminate connections with DB when execution is interrupted | TRAFODION-1117 |
| volatile table is not dropped after hpdci session ends | TRAFODION-138 |
| DCS - SQLProcedures and SQLProcedureColumns need to be supported | TRAFODION-206 |
| SPJ w result set failed with ERROR[11220], SQLCODE of -29261, SQLSTATE of HY000 | TRAFODION-533 |
| select (insert) with prepared stmt fails with rowset | TRAFODION-598 |
| ODBC SQLRowCount function returns wrong row number | TRAFODION-735 |
| ODBC: Several values returned by SQLColumns are incorrect | TRAFODION-994 |
| UDF: Lack of checking for scalar UDF input/output values | TRAFODION-1145 |
| Drop schema cascade returns error 1069 | TRAFODION-1212 |
| Hybrid Query Cache: query with equals predicate on INTERVAL datatype should not have a non-parameterized literal. | TRAFODION-1221 |
| SPJ with resultset doesnt work thru T2 driver | TRAFODION-1258 |
| Linux ODBC Driver is not able to create certificate file with long name length (over 30 bytes). | TRAFODION-1442 |
| executor/TEST106 hangs at drop table at times | TRAFODION-1923 |
| Instance will be down when the zookeeper on name node has been down | TRAFODION-2664 |
| DCS server can't be restarted after switch to backup-master | TRAFODION-2877 |
| DCS-ODBC-Getting 'Invalid server handle' after bound hstmt is used for a while. | TRAFODION-157 |
| windows ODBC driver internal hp keyword cleanup | TRAFODION-427 |
| Status array returned by batch operations contains wrong return value for T2 | TRAFODION-480 |
| [Trafci] An internal error occurred in the code generator in file ../generator/GenRelDCL.cpp at line 314 | TRAFODION-510 |
| In full explain output, begin/end key for char/varchar key column should be min/max if there is no predica | TRAFODION-1053 |
| Accessing hive table with ucs2 encoded field returns 0 rows. | TRAFODION-1165 |
| Hybrid Query Cache: sqlci may err with JRE SIGSEGV. | TRAFODION-1173 |
| DCS floating IP should set internal interface | TRAFODION-1176 |
| sqgen may NOT copy all script files to all nodes | TRAFODION-1186 |
| Self-referencing update updates the column to a wrong value | TRAFODION-1575 |
| Generate constraint expression for update/merge commands | TRAFODION-1610 |
| UPDATE STATISTICS allocates memory even when a SAMPLE table is used | TRAFODION-1715 |
| Inserting NULL for all key columns in a table causes a failure | TRAFODION-1801 |
| Range delete on tables with nullable key columns deletes fewer rows | TRAFODION-1803 |
| support Trafodion running on CentOS 7 | TRAFODION-1861 |
| Have jdbc drivers available on Maven Repository | TRAFODION-1957 |
| [offline backup&restore] TrafexportSnapshot ran into NoClassDefFoundError on HDP2.4 | TRAFODION-1966 |
| Trafodion cannot adjust your working status in time when network broken. | TRAFODION-2077 |
| JVM exception for TMUDF | TRAFODION-2182 |
| After a region split the transactions to check against list is not fully populated | TRAFODION-2305 |
| Documentation update for REST and DCS | TRAFODION-2307 |
| JDBC T4 support read LOB | TRAFODION-2308 |
| TransactionState.hasConflict returns true if it gets a null pointer exception | TRAFODION-2348 |
| Update Messages Guide for some messages from 1100-1199 | TRAFODION-2398 |
| TRAFCI gui installer does not work | TRAFODION-2462 |
| Alter table hbase options is not transaction enabled. | TRAFODION-2472 |
| SQL POM file needs changes to be able to stage on Nexus repository | TRAFODION-2545 |
| add more debug info for SQL Error 8402 | TRAFODION-2590 |
| ESP cores seen during daily builds after hive tests run | TRAFODION-2597 |
| Error 9252 during update statistics of an encrypted Trafodion table | TRAFODION-2617 |
| Docker | TRAFODION-2627 |
| Merge returns internal error when the table has a constraint | TRAFODION-2630 |
| MDAM costing overestimates I/O cost | TRAFODION-2645 |
| The SQLite Trafodion Configuration database storage method can become stale. | TRAFODION-2650 |
| The monitor to monitor process communication cannot handle a network reset | TRAFODION-2651 |
| elastic - sqcheck cannot display configured TM/RMS count when instance is down | TRAFODION-2660 |
| when I copy data from oracle table to trafodion table with max for limit rows， but the result rows in trafodion table is differ with max rows , and without any error. | TRAFODION-2670 |
| Create index sees error 2006 internal assertion (keyColOffset == totalKeyLength) | TRAFODION-2674 |
| odb load source with src=-file is failure | TRAFODION-2677 |
| odb crash when extracting data to xml file | TRAFODION-2679 |
| misleading error message for 'get schemas' when MD tables in hbase is not avialble | TRAFODION-2693 |
| installers should secure bulkload hdfs dir for hbase upload | TRAFODION-2697 |
| [ODBC]The maxlength for LargeInt was fixed to 8 | TRAFODION-2701 |
| [ODBC] The SQL type is set to CHAR (n) CHARACTER SET USC2, SQLGetData to read data multiple times returns the wrong length value | TRAFODION-2702 |
| Using multi-threads app with linux-odbc to connect trafodion will make dcs down | TRAFODION-2709 |
| odb didn't extract data from database to correct xml file | TRAFODION-2712 |
| Query compilation gets stuck at listSnapshots() at times | TRAFODION-2716 |
| Trafci insert with parameters can insert a string which length is larger than the column's length. | TRAFODION-2719 |
| When setting max property , copy data from mysql to trafodion failed | TRAFODION-2721 |
| Memory leak in the compiler part of the code in Trafodion | TRAFODION-2727 |
| Parallel plan not chosen for native HBase table | TRAFODION-2729 |
| UPDATE STATS fails sometimes when a column name is a SQL keyword | TRAFODION-2732 |
| Provide an improved memory quota assignment for big memory operators (BMO) | TRAFODION-2733 |
| Missing predicates on salt columns when using an index join | TRAFODION-2736 |
| Native hbase table access via Trafodion improvements/issues | TRAFODION-2737 |
| RMS semaphore handling need to log the error for easy resolution of the issue | TRAFODION-2739 |
| Linux and Windows ODBC need to support LOB | TRAFODION-2742 |
| Monitor exhibits memory corruption in large cluster configuration > 30 nodes | TRAFODION-2746 |
| UPDATE STATS mc histogram failure when column has reserved word name | TRAFODION-2749 |
| Use of rowset with large memory leads to various errors at runtime | TRAFODION-2759 |
| hbase cache blocks is OFF for broad table with narrow index | TRAFODION-2760 |
| Error when all TMUDF columns are eliminated | TRAFODION-2761 |
| MDAM is not considered when sometimes it should be | TRAFODION-2765 |
| HIVE: Inserted row into a hive table has gone missing | TRAFODION-2766 |
| "Table not found" errors not being handled correctly by AQR for hive access | TRAFODION-2770 |
| Add new Trafodion LOB Guide to documentation build and web site | TRAFODION-2771 |
| Insert does not raise duplicate row error for hbase format table with defaulted first column | TRAFODION-2775 |
| Mdam plans with more than one disjunct sometimes cause either a compiler core or have an incorrect predicate | TRAFODION-2776 |
| Fix latent bug unmasked by JIRA TRAFODION-2765 fix | TRAFODION-2777 |
| Unexpected assert when retrieving the current users roles | TRAFODION-2779 |
| Mxosrvr dumps core when connection idle timer expires at times | TRAFODION-2780 |
| mxosrvr dumps core generated when loading data from Oracle to Trafodion at times | TRAFODION-2785 |
| Enabling Authentication fails to change setting | TRAFODION-2800 |
| Salting + heuristics prevent MDAM plan on base table from being considered | TRAFODION-2813 |
| Drop table fails with error 4247 when certain CQDs are set | TRAFODION-2819 |
| Trafodion core code base needs to be thread safe | TRAFODION-2821 |
| MERGE on a view defined using [first n] or [any n] does not work | TRAFODION-2822 |
| odb export will scan full table with splitby column | TRAFODION-2830 |
| Add missing error check in NATableDB::get | TRAFODION-2838 |
| compGeneral/TEST023 leaves a bunch of stuff in /home/xxx/cbfs directory | TRAFODION-2839 |
| ORDER BY clause on a view circumvents [first n] updatability check | TRAFODION-2840 |
| Internal error (or core) on full outer join on an aggregate | TRAFODION-2843 |
| Update Messages Guide for some messages in the range 1200-1299 | TRAFODION-2852 |
| Memory leak of ComDiagsArea in Context | TRAFODION-2853 |
| Load encounter Operating system error 201 | TRAFODION-2854 |
| Remove incubating from trafodion web pages | TRAFODION-2857 |
| Remove incubating reference(s) from code base | TRAFODION-2861 |
| Update Messages Guide for some messages in the range 1300-1399 | TRAFODION-2865 |
| Trafodion DISCLAIMER should reflect the fact that Trafodion is TLP | TRAFODION-2869 |
| DCS can not be normal visit. | TRAFODION-2870 |
| Core dump due to reference to deallocated memory for EstLogProp object | TRAFODION-2879 |
| Update Messages Guide for some messages in the range 1500-1599 | TRAFODION-2880 |
| Multiple node failures occur during HA testing | TRAFODION-2881 |
| Foundation infrastructure changes needed to support operating in Cloudera Manager environment | TRAFODION-2882 |
| dcsserver can't restart while master switching to backup-master | TRAFODION-2885 |
| Streamline setjmp/longjmp concepts in Trafodion | TRAFODION-2888 |
| Update Messages Guide for range 1700-1999 and some other cleanups | TRAFODION-2895 |
| Internal error in stored procedures when a warning is generated in SQL | TRAFODION-2896 |
| main branch break by mistake merge, fix it | TRAFODION-2898 |
| Catalog API SQLColumns does not support ODBC2.x | TRAFODION-2899 |
| optionally add leading space when get a number column to display | TRAFODION-2904 |
| query id contains null if exec spj through trafci | TRAFODION-2905 |
| create table with wrong char length hang and crash | TRAFODION-2908 |
| Non-deterministic scalar UDFs not executed once per row | TRAFODION-2912 |
| Tweak some MDAM-related heuristics | TRAFODION-2913 |
| Refactor Trafodion implementation of hdfs scan for text formatted hive tables | TRAFODION-2917 |
| various regression tests fail due to TRAFODION-2805 fix | TRAFODION-2918 |
| calling int[] executeBatch() method execute create/drop/delete/insert/update/upsert statement always return -2 | TRAFODION-2922 |
| Keep log information for UPDATE STATISTICS in case of errors | TRAFODION-2927 |
| Add news articles about Trafodion to Trafodion web site | TRAFODION-2928 |
| ConnectionTimeout value for jdbc can't lager than 32768 | TRAFODION-2933 |
| In HA env, one node lose network, when recover, trafci can't use | TRAFODION-2940 |
| Remove the 64K hard limit for process ids in RMS infrastructure | TRAFODION-2963 |
| New MDAM costing code incorrectly assumes key column is always on the left | TRAFODION-2964 |
| Hash partial groupby does not report a row count in operator statistics | TRAFODION-2965 |
| New MDAM costing code does not always respect CQS forcing MDAM | TRAFODION-2966 |
| UPDATE STATISTICS sometimes cores in CommonLogger::buildMsgBuffer | TRAFODION-2967 |
| Subquery with [first 1] in select list results in Normalizer internal error | TRAFODION-2969 |
| Some predefined UDFs should be regular UDFs so we can revoke rights | TRAFODION-2974 |
| Correct the descriptions of how to launch ODBC in Trafodion Client Installation Guide | TRAFODION-2976 |
| Trafodion allows creating objects with longer key lengths than HBase supports | TRAFODION-2977 |
| Query fails with an internal error in the generator | TRAFODION-2983 |
| Add documentation of systimestamp and sysdate in sql manual | TRAFODION-2987 |
| CREATE TABLE LIKE fails with long numeric default value | TRAFODION-2990 |
| https links in code | TRAFODION-2995 |
| sleep execution code cannot build on CentOS 7 | TRAFODION-2998 |
| make UUID non reserved keyword | TRAFODION-2999 |
| MERGE DELETE on table with unique index fails with error 4002 | TRAFODION-3000 |
| UPDATE STATS fails on certain INTERVAL columns | TRAFODION-3002 |
| SQL dense buffers structure contain a size limit due to an incorrect cast | TRAFODION-3004 |
| CREATE INDEX on certain long chars fails with Java exceptions | TRAFODION-3005 |
| merge R2.2 changes into main branch | TRAFODION-3014 |
| retrieve a value from numeric type get no result if using xx='value' | TRAFODION-3015 |
| windows odbc driver add support UTF8 output | TRAFODION-3016 |
| Select of UPPER on upshifted column in join predicate cores | TRAFODION-3018 |
| compGeneral/TESTTOK2 failed due to unneeded parser production. | TRAFODION-3020 |
| set operator not cacheable | TRAFODION-3021 |
| Add more enum files to analyzeMessageGuide.py | TRAFODION-3023 |
| order by clause in subquery does not work | TRAFODION-3025 |
| add create option storage policy | TRAFODION-3026 |
| Control query shape (CQS) does not work for Hive insert and unload | TRAFODION-3028 |
| Query with nested subqueries chooses bad plan | TRAFODION-3031 |
| RAND() function is not always random | TRAFODION-3042 |
| Inaccurate conditions of judgment cause low efficiency | TRAFODION-3049 |
| Inefficient plan when joining on VARCHAR columns | TRAFODION-3050 |
| Core in pCode evaluator for query on million-row non-partitioned table | TRAFODION-3052 |
| seatrans pom files need to update | TRAFODION-3053 |
| update pom.xml.cdh | TRAFODION-3054 |
| Linux ODBC add Ansi function support | TRAFODION-3058 |
| removee "mt_" column family | TRAFODION-3059 |
| eliminate building errors on CentOS7 | TRAFODION-3061 |
| Deeply nested subqueries may have warning 2053 at compile time | TRAFODION-3066 |
| DATEDIFF function gives strange results when executed on interval data types | TRAFODION-3071 |
| Installer needs to support RH7 / Centos7 | TRAFODION-3075 |
| update pom.xml.hdp for protobuf compile | TRAFODION-3076 |
| Trafodion compiles fail on CentOS7 | TRAFODION-3083 |
| Multi-value BETWEEN on interval key column gives wrong result | TRAFODION-3088 |
| Incorrect rowcount reported after commit conflict error | TRAFODION-3092 |
| At times the query involving sequence function fail and dumps core | TRAFODION-3097 |
| enhance the 'get table' utility to return number of rows | TRAFODION-3101 |
| selct count(0) with long varchar hitting jvm OOM error | TRAFODION-3107 |
| new checkin broken CentOS 7 code building | TRAFODION-3111 |
| INTERVAL SECOND(m,n) in multi-column key results in 6003 warnings | TRAFODION-3128 |
| Error message incorrect when describing non existing procedure | TRAFODION-1112 |
| Change core file names in Sandbox | TRAFODION-1246 |
| Revoke privilege return dependent grant ERROR[1037] | TRAFODION-1276 |
| support adding/retrieving comments to SQL objects | TRAFODION-1915 |
| sqps and sqcheck display wrong information after node reintegrated | TRAFODION-1958 |
| support functions in the column default definition | TRAFODION-2335 |
Tasks
| Feature | Jira ID |
|---|---|
| SQL POM file needs changes to be able to stage on Nexus repository | TRAFODION-2545 |
| Remove usage of TRAF_EXCLUDE_LIST | TRAFODION-2907 |
| merge R2.2 changes into main branch | TRAFODION-3014 |
| compGeneral/TESTTOK2 failed due to unneeded parser production. | TRAFODION-3020 |
| set operator not cacheable | TRAFODION-3021 |
| order by clause in subquery does not work | TRAFODION-3025 |
Documentation Updates
| Feature | Jira ID |
|---|---|
| Correct the descriptions of how to launch ODBC in *Trafodion Client Installation Guide | TRAFODION-2976 |
| minor issues in adoc found during mvn site | TRAFODION-2986 |
| Add documentation of systimestamp and sysdate in sql manual | TRAFODION-2987 |
Supported Platforms
| Operating Systems | RedHat / CentOS 6.5 – 6.8 |
| Hadoop Distributions | Cloudera distributions CDH 5.4 – 5.7 Hortonworks distributions HDP 2.3 – 2.4 Apache Hadoop with Apache HBase 1.0 – 1.1 |
| Java Version | JDK 1.7, version 1.7.0_67 or newer |
| GCC Compiler | GCC 4.4 |