Release Notes

2021-07-18 - v1.18.5

Improvements:

• added 'trust all certs' option to S3 file systems
• Ability to select entire rows or columns in data preview grid
• Ability to add references to vars in output fields (calculator step - entry vars - context menu)

2021-07-04 - v1.18.4

New Features:

• Value Mapper Step

Improvements:

• Improved for S3 compatible file systems.

2021-06-29 - v1.18.3

Improvements:

• Ability to add endpoint override to S3 filesystem - allows using S3-compatible services

2021-06-27 - v1.18.2

New Features:

• Support for S3 file system

2021-06-18 - v1.17.4

New Features:

• Support for data driven columns in Excel Output step

Improvements:

• Detecting data source structure in CSV Input, Excel Input, and SQL Input steps no longer fails when existing output fields are misconfigured

2021-06-06 - v1.17.3

New Features:

• CSV Input, Excel Input, and SQL Input field detection offers configuration dialog to handle new/existing/not_found fields

2021-05-30 - v1.17.2

New Features:

• Google BigQuery Input Step - Run standard SQL queries against BigQuery datasets

2021-05-22 - v1.17.1

New Features:

• Google BigQuery Table Input Step

2021-05-16 - v1.16.2

New Features:

• Adds ability to save http request results as binary
• Improves compatibility with SFTP servers

Fixes:

• UI fixes on Windows

2021-04-24 - v1.16.1

New Features:

• Added NTLM Authentication to HTTP Step
• Added support for Google Service Accounts OAuth authentication

Fixes:

• Excel input spte now generates empty rows in case they are physically missing from xlsx
• Minor UI fixes on Windows

2021-03-26 - v1.15.1

Enhancements:

• Improved column detection in Excel Input Step
• Sheet Picker in Excel Input Step

2021-03-19 - v1.15.0

New Features:

• Excel input step

2021-03-08 - v1.14.4

Fixes:

• fixed problem creating temp files on windows OS (affects sort, block, join steps)
• step previews respect TWEAKSTREET_HOME setting
• inconsistent response to undo/redo keyboard shortcuts on windows
• misc UI fixes

2021-02-14 - v1.14.3

New Features:

• Support for TWEAKSTREET_HOME environment variable

2021-01-31 - v1.14.2

New Features:

• GZIP and BZIP2 compression on CSV Output step
• Index Distinct step reports duplicate values

Fixes:

• Allow multiple header entries for messages in Kafka producer
• UI stability improvements

2021-01-17 - v1.14.1

New Features:

• Kafka Producer Step

2020-12-13 - v1.13.0

New Features:

• Freemarker template engine step

2020-12-05 - v1.12.0

New Features:

• Mustache template engine step

2020-11-28 - v1.11.5

Hotfix:

• Fixes local search result links in bundled documentation

2020-11-27 - v1.11.4

New Features:

• UI for additional data processing functions
• Searchable Documentation

2020-11-20 - v1.11.3

New Features:

• UI for additional data processing functions

2020-11-13 - v1.11.2

New Features:

• UI for time processing functions
• UI for data processing functions

2020-11-07 - v1.11.1

New Features:

• UI for string processing functions

2020-10-30 - v1.11.0

New Features:

• SAS File Input step
• UI for string splitter function

Enhancements:

• Ability to preview/run all steps individually in control flows and data flows
• Default serverTimezone property for MySQL 5.x connections
• Additional predefined datetime parsing formats

Fixes:

• Fixes possible UI crash when viewing step properties in a running job

2020-10-24 - v1.10.2

Enhancements:

• Ability to preview data on input steps like CSV Input, SQL Input, MongoDB Find, etc.

2020-10-20 - v1.10.1

Enhancements:

• Performance improvements in data flows

2020-10-19 - v1.10.0

New Features:

• Wait until input finished step

2020-10-17 - v1.9.2

Enhancements:

• Data Preview on Steps in addition to Hops

2020-10-09 - v1.9.1

New Features:

• Configurable logging interval
• File content preview on CSV and Read File steps
• Boolean value parser

Enhancements:

• Sort step performance improvement
UI Enhancements:
• Shortcut Cmd/Ctrl+E evaluates selected var rows
• Shortcut Cmd/Ctrl+DblClick opens referenced flow in Run Flow step
• Double clicking a hop in Job view opens data preview

2020-10-02 - v1.9.0

New Features:

• MongoDB Find step
• MongoDB Aggregate step
• MongoDB Insert step
• MongoDB Update or Replace step
• MongoDB Delete step
• Random List Generator
• Random Dict Generator

2020-09-25 - v1.8.1

New Features:

• MongoDB support
• MongoDB Command step

2020-09-22 - v1.8.0

New Features:

• Random Data generating step
• Random number generator
• Random datetime generator
• Random string generator
• Random word generator
• Random text generator
• Random person generator
• Random workplace generator
• Random list item generator
• Random color generator
• Random vehicle generator
• Random address generator

2020-09-11 - v1.7.1

Enhancements:

• improved cross-file auto-complete with documentation tooltips

2020-09-04 - v1.7.0

New Features:

• Diff on Sorted Keys step

Enhancements:

• adds data.choice, data.sample, and math.rands functions

Fixes:

• Fixed multi-threaded evaluation of lists

2020-08-28 - v1.6.0

New Features:

• Create modules and config modules in the GUI

Enhancements:

• Distinct display of data flow steps that finish successfully without processing a single row
• Improved display of current config module in lower right corner of status bar
• Added useCompression=true to mysql 5 and 8 connections by default
• Added serverTimezone property to mysql 8 connections by default

Fixes:

• Fixed display of datetime values in data preview

2020-08-21 - v1.5.1

Enhancements:

• F1 key brings up help for currently open step dialog
• Added keyboard shortcut for expression evaulation
• Improved UX of splitting panes
• Added "Reveal in File Manager" functionality on file tabs
• Added "Copy Path" functionality on file tabs
• Dragging tabs and files into edge regions of a pane allows to open into a split
• Improved search results for expression conversions in command palette

2020-08-14 - v1.5.0

Enhancements:

• Ability to add documentation to steps and flows
• Improved search results for steps in command palette
• Improved layout when inspecting data cells in hops
• More succinct display of datetime values in data cells
• Improved contrast color for active line in command palette

2020-08-08 - v1.4.1

Enhancements:

• error hops are always rendered with name - not just color
• Write to File step supports writing binary content
• hop tooltip displays which step created or last modified a field

Fixes:

• SQL Insert step - Fetch SQL button produces error

2020-07-31 - v1.4.0

New:

• Breaker step - Aborts a data flow after reaching a threshold of rows passed
• Look ahead/behind step - Makes previous and next rows available in data flows
• Rows exist step - Generates a single row in a separate branch if row stream is empty
• Configurable max size of preview field data when running flows

2020-07-27 - v1.3.0

New:

• Read Excel File step

Fixes:

• Fixes UI issue with focus when changing between tabs
• Better visibility for grid dots on canvas

2020-07-20 - v1.2.1

Fixes:

• Better error message when Generic Jdbc Connection does not produce a connection
• Fixes issue with Find Files step accepting settings from field references
• Fixes issue with properly discarding stderr output in Run Process step

2020-07-17 - v1.2.0

New:

• Python Step - calls a Python function for every input row

2020-07-10 - v1.1.4

New:

• Support for data driven output columns on:
  • CSV Output
  • ORC Output
  • SQL Insert
• Experimental support for Python

2020-06-27 - v1.1.2

New:

• Experimental support for Hive and ORC files

2020-06-23 - v1.1.0

New:

• SHA and MD5 functions available through a function widget
• SHA and MD5 functions availabe in tweakstreet/crypto module

2020-06-15 - v1.0.2

New:

• portable *.zip distribution available for Windows
• portable *.tar.gz distribution available for Linux

Fixes:

• fix race condition when opening files on startup
• fixes encoding issues on windows