ETL Framework and ETL Server Release Notes

5.7-86126 (released 06/03/2017)

Added:

  1. Ability to connect to the web services, which are using one-step OAuth1 authentication
  2. Ability to read Excel spreadsheets using worksheet index (in addition to the worksheet name)
  3. Ability to use JavaScript preprocessor when reading text documents in the XML, CSV and JSON formats

Improved and fixed:

  1. Bug fixes and performance improvements in the ETL engine

5.7-85697 (released 05/21/2017)

Added:

  1. Ability to run SQL on any data set, including files and responses from the web services
  2. Ability to use XLS style-sheet as a connection parameter to transform any XML
  3. New parameters for CSV, XML and JSON formats
  4. New API endpoints (REST API Doc)

Improved and fixed:

  1. Bug fixes and performance improvements in the ETL engine
  2. Third-party libraries upgraded to the latest versions
  3. Improved SQL parsing for all supported SQL dialects
  4. Improved CSV, JSON and XML parsing

5.5-80987 (released 02/10/2017)

Added:

  1. Connector for HL7 2.x and HL7 FHIR
  2. Connector for HL7 MLLP
  3. Connector for Google Analytics
  4. Connector for Google Cloud Storage
  5. Support for OAUTH2 (token-based) authentication in HTTP connector
  6. Support for change replication in ETL engine
  7. Ability to use wild-card file names for the source
  8. Ability to add configurable suffix to the destination file name
  9. Simplified APIs for accessing and modifying data set fields (including nested)
  10. New parameters for XML and JSON formats
  11. MkDir command added to the File Manager ETL task

Improved and fixed:

  1. Bug fixes and performance improvements in the ETL engine
  2. Third-party libraries upgraded to the latest versions
  3. Significantly improved SQL parsing for all supported SQL dialects
  4. Improved JSON and XML parsing
  5. Fixed memory leak in Redis connector

5.0-72776 (released 10/30/2016)

Changes:

  1. Bug fixes
  2. Performance improvements

5.0-72473 (released 09/18/2016)

Added:

  1. ETL Server
  2. Over 10 new transformations
  3. Connectivity to Snowflake, Amazon S3, Redis, POP3 and SMPT
  4. Support for GZIP and password protected ZIP files
  5. Support for merge (upsert) SQL statements for MS SQL Server, PostgreSQL and MySQL

Improved and fixed:

  1. Performance when using JavaScript transformations improved by at least 500%
  2. Performance when using bind variables improved by at least 50%
  3. Improved support for native database data types for all supported SQL dialects
  4. Improved support for REST and SOAP web services
  5. Fixed 200+ bugs

4.0-35512 (released 09/02/2015)

Changed:

  1. Improved support for CSV, JSON, Excel and HTML formats
  2. Improved support for character encoding
  3. Improved support for date and time data types for MySQL database
  4. Fixed bug which was preventing from running “after” tasks
  5. Fixed bug with interactive filter and inline filter transformation when using column names with spaces
  6. Fixed bug with interactive ordering and “group by” transformation when using column names with spaces
  7. Fixed bug with inline validation when using column names with spaces
  8. Latest Java version is bundled with Windows distro
  9. New editions have been introduced and prices have been updated

Added:

  1. Ability to disable task
  2. Conditional tasks
  3. Ability to set character encoding for HTTP request body
  4. Support for zip files with passwords
  5. Ability to split datasets by “group by” columns and number of records at the same time
  6. Ability to ignore exceptions occurred when executing inner scenarios
  7. New ETL code snippets and examples

4.0-31374 (released 03/01/2015)

Changed:

  1. Improved support for proxy servers
  2. Significantly improved SQL parsing for all supported SQL dialects
  3. Improved support for key-value denormalization transformation
  4. Latest Java version is bundled with Windows distro
  5. Bug fixes and performance improvements

Added:

  1. Support for NTLM-based authentication
  2. Ability to merge CSV files of the different structure
  3. Ability to stream data when performing merge of the CSV files

4.0-29149 (released 02/10/2015)

Changed:

  1. Improved performance and reliability of the ETL engine by adding context-sensitive optimizer
  2. Improved support for Web services
  3. Improved support for XML files
  4. Improved support for JSON files
  5. Improved support for Excel XLSX files
  6. Improved logging and error reporting
  7. Bug fixes and stability improvements

Added:

  1. Support for SOAP-based Web Services
  2. Ability to configure connections for the REST and SOAP Web Services
  3. Ability to execute XQuery on XML-based datasets
  4. Ability to perfrom normaliztion and denormalization of the key-value datasets
  5. Ability to execute JavaScript anywhere in the ETL scenario
  6. Ability to populate dataset inline, from any fragment of text, using given connector, such as JSON, XML, etc
  7. Ability to tokenize connection URL and Properties as well as task variables
  8. Ability to use pre-defined header and footer in the File Merge task
  9. Ability to pass configuration file name as a command line argument
  10. New examples

4.0-22541 (released 12/24/2014)

Changed:

  1. JRE 1.8 is now bundled with Windows version of the ETL Framework
  2. Features of the older version of JavaScript engine (Rhino) are now supported by the ETL Framework when running on JRE 1.8
  3. Improved performance of the ETL engine
  4. Improved handling of the HTTP(s) connections
  5. Improved support for REST based Web services, specifically PUT and DELETE requests

Added:

  1. Ability to partition dataset based on combination of key columns or maximum number of rows
  2. Ability to merge text files into the single file
  3. New examples

4.0-21700 (released 10/02/2014)

Fixed:

  1. Excel XLS and XLSX workbooks were not created when some columns presented in the source were excluded from the destination
  2. Delimited and fixed length text files were not properly created when some columns presented in the source were excluded from the destination

Added:

  1. Ability to skip empty rows when reading delimited and fixed length text files

4.0-21225 (released 08/31/2014)

Fixed:

  1. Wrong classpath in the Eclipse project for the ETL Framework with a full source code
  2. Batch files were not executed by ETL engine on Windows 7 and below under non Administrator account
  3. In some cases ETL Engine was not reporting location of the run-time exception

Added:

  1. New modules to the build scrips used by the ETL Framework with a full source code
  2. New global variables are now available when executing programs in scripting languages from the ETL engine
  3. Improved performance of the ETL engine when running programs in scripting languages
  4. Adility to set a data source agnostic limit on number of rows to extract

4.0-18030 (released 07/31/2014)

This is a recommended update for all 3.x users, fixing minor bugs.