Data Explorer Release Notes

5.7-86126 (released 06/03/2017)

Added:

  1. Ability to connect to the web services, which are using one-step OAuth1 authentication
  2. Ability to read Excel spreadsheets using worksheet index (in addition to the worksheet name)
  3. Ability to use JavaScript preprocessor when reading text documents in the XML, CSV and JSON formats

Improved and fixed:

  1. Bug fixes and performance improvements in the ETL engine

5.7-85697 (released 05/21/2017)

Added:

  1. Ability to run SQL on any data set, including files and responses from the web services
  2. Ability to use XLS style-sheet as a connection parameter to transform any XML
  3. New parameters for CSV, XML and JSON formats

Improved and fixed:

  1. Bug fixes and performance improvements in the ETL engine
  2. Third-party libraries upgraded to the latest versions
  3. Improved SQL parsing and code formatting for all supported SQL dialects
  4. Improved CSV, JSON and XML parsing

5.5-80987 (released 02/10/2017)

Added:

  1. Connector for HL7 2.x and HL7 FHIR
  2. Connector for HL7 MLLP
  3. Connector for Google Analytics
  4. Connector for Google Cloud Storage
  5. Support for OAUTH2 (token-based) authentication in HTTP connector
  6. Support for change replication in ETL engine
  7. Ability to use wild-card file names for the source
  8. Ability to add configurable suffix to the destination file name
  9. Simplified APIs for accessing and modifying data set fields (including nested)
  10. New parameters for XML and JSON formats
  11. MkDir command added to the File Manager ETL task

Improved and fixed:

  1. Bug fixes and performance improvements in the ETL engine
  2. Third-party libraries upgraded to the latest versions
  3. Significantly improved SQL parsing and code formatting for all supported SQL dialects
  4. Improved JSON and XML parsing
  5. Fixed memory leak in Redis connector
  6. Improved visual query builder

5.0-72776 (released 10/30/2016)

Changes:

  1. Bug fixes
  2. Performance improvements

5.0-72473 (released 09/18/2016)

Added:

  1. New modern Look and Feel
  2. Over 10 new transformations
  3. Connectivity to Snowflake, Amazon S3, Redis, POP3 and SMPT
  4. Support for GZIP and password protected ZIP files
  5. Support for merge (upsert) SQL statements for MS SQL Server, PostgreSQL and MySQL

Improved and fixed:

  1. Performance when using JavaScript transformations improved by at least 500%
  2. Performance when using bind variables improved by at least 50%
  3. Improved support for native database data types for all supported SQL dialects
  4. Improved support for REST and SOAP web services
  5. Significantly improved SQL parsing and code formatting for all supported SQL dialects
  6. Fixed 200+ bugs

4.0-35512 (released 09/02/2015)

Changed:

  1. Improved support for CSV, JSON, Excel and HTML formats
  2. Improved support for character encoding
  3. Improved support for date and time data types for MySQL database
  4. Fixed bug which was preventing from running “after” tasks
  5. Fixed bug with interactive filter and inline filter transformation when using column names with spaces
  6. Fixed bug with interactive ordering and “group by” transformation when using column names with spaces
  7. Fixed bug with inline validation when using column names with spaces
  8. Latest Java version is bundled with Windows distro
  9. New editions have been introduced and prices have been updated

Added:

  1. Ability to disable task
  2. Conditional tasks
  3. Ability to set character encoding for HTTP request body
  4. Support for zip files with passwords
  5. Ability to split datasets by “group by” columns and number of records at the same time
  6. Ability to ignore exceptions occurred when executing inner scenarios
  7. New ETL code snippets and examples

4.0-31374 (released 03/01/2015)

Changed:

  1. Improved support for proxy servers
  2. Significantly improved SQL parsing and code formatting for all supported SQL dialects
  3. Improved user experience when working with ETL Designer
  4. Improved support for Mac OS
  5. Improved support for key-value denormalization transformation
  6. Latest Java version is bundled with Windows distro
  7. Bug fixes and performance improvements

Added:

  1. Support for NTLM-based authentication
  2. Ability to merge CSV files of the different structure
  3. Ability to stream data when performing merge of the CSV files

4.0-29149 (released 02/10/2015)

Changed:

  1. Improved performance and reliability of the ETL engine by adding context-sensitive optimizer
  2. Improved support for Web services
  3. Improved support for XML files
  4. Improved support for JSON files
  5. Improved support for Excel XLSX files
  6. Improved user experience when working with ETL Designer
  7. Improved XML code formatter
  8. Improved user experience when working with files
  9. Improved logging and error reporting
  10. Bug fixes and stability improvements

Added:

  1. Support for SOAP-based Web Services
  2. Ability to configure connections for the REST and SOAP Web Services
  3. Ability to execute XQuery on XML-based datasets
  4. Support for XQuery added to the ETL Designer
  5. Ability to perfrom normaliztion and denormalization of the key-value datasets
  6. Support for key-value normaliztion and denormalization tasks added to the ETL Designer
  7. Ability to execute JavaScript anywhere in the ETL scenario
  8. Ability to populate dataset inline, from any fragment of text, using given connector, such as JSON, XML, etc
  9. Ability to use pre-defined header and footer in the File Merge task
  10. Ability to tokenize connection URL and Properties as well as task variables
  11. JavaScript, JSON, HTML and CSS code formatters
  12. New ETL code snippets and examples

4.0-22541 (released 12/24/2014)

Changed:

  1. JRE 1.8 is now bundled with Windows version of the Data Explorer
  2. Features of the older version of JavaScript engine (Rhino) are now supported by the Data Explorer when running on JRE 1.8
  3. Improved performance of the ETL engine
  4. Improved handling of the HTTP(s) connections
  5. Improved support for REST based Web services, specifically PUT and DELETE requests
  6. Improved user experience when working with long URLs and dataset names
  7. Improved user experience when working ETL Designer, specifically handling of the XML special characters
  8. Improved update notifications
  9. Improved automatic update

Added:

  1. Ability to partition dataset based on combination of key columns or maximum number of rows
  2. Support for partitioning task added to the ETL Designer
  3. Ability to merge text files into the single file
  4. Support for file merge task added to the ETL Designer
  5. New ETL code snippets and examples

4.0-21700 (released 10/02/2014)

Fixed:

  1. Excel XLS and XLSX workbooks were not created when some columns presented in the source were excluded from the destination
  2. Delimited and fixed length text files were not properly created when some columns presented in the source were excluded from the destination
  3. When Connection parametrs were updated in the Objects Browser, Data Integration Studio was not properly creating corresponding connection
  4. Oracle error "ORA-12899: value too large" when running explain plan for the large queries

Added:

  1. Ability to skip empty rows when reading delimited and fixed length text files
  2. Support for skiping empty rows added to the ETL Designer and Text Connection Properties Editor

4.0-21225 (released 08/31/2014)

Fixed:

  1. Some UI elements were not properly rendered on high-DPI monitors
  2. Batch files were not executed by ETL engine on Windows 7 and below under non Administrator account
  3. When using ETL designer it wasn't possible to edit conditional sources and destinations
  4. In some cases ETL Engine was not reporting location of the run-time exception
  5. Body of the Oracle stored procedures which don't belong to any package were not displayed in the Objects Browser
  6. Screen flickering when closing modal dialog windows

Added:

  1. New global variables are now available when executing programs in scripting languages from the ETL engine
  2. Improved performance of the ETL engine when running programs in scripting languages
  3. Adility to set a data source agnostic limit on number of rows to extract
  4. It is now possible to copy selected fragment of code from the SQL History
  5. It is now possible to select and copy multiple items from the SQL History
  6. It is now possible to copy fragments of code from the SQL History and Code Snippets to the cursor position in the editor (in opposite to replacing entite editor's buffer)

4.0-18030 (released 07/31/2014)

This is a recommended update for all 3.x users, fixing minor bugs.