Skip to content

Releases: opencultureconsulting/openrefine-batch

v1.5

26 Oct 16:58
Compare
Choose a tag to compare
  • updated OpenRefine version (dev snapshot 2017-10-26 + pull request 1290)

v1.4

02 Aug 12:19
Compare
Choose a tag to compare
  • replaced python client with one-file-executable (generated with pyinstaller for linux 64-bit)
  • updated OpenRefine version (dev snapshot 2017-08-02)

v1.3

22 Jun 11:40
Compare
Choose a tag to compare
  • use openrefine fork with added options for initial java heap space and autosave period
  • set autosave period to 180 minutes

v1.2

21 Jun 12:19
Compare
Choose a tag to compare
  • small performance improvement (ca. 3-5%) by changing the default initial heap space to max heap space.

v1.1

20 Jun 12:53
Compare
Choose a tag to compare
  • now defaults to OpenRefine 2.7 stable (released 2017-06-18)
  • added check if wget supports option --show-progress (since wget 1.16)
  • added memoryload statistics to openrefine-batch-docker.sh

v1.0

14 Mar 22:20
Compare
Choose a tag to compare

Rebuilt the whole script to do everything with bash builtins. A variation of the new script that still uses docker is available as new file openrefine-batch-docker.sh.

This release uses OpenRefine v2.7 Release Candidate 2 (2017-03-03) by default.

additional improvements:

  • getopts for parsing of arguments
  • runtime tracking
  • improved logging with additional if statement (skip transform and export steps if no config files are present and export is not set)
  • improved cleanup: delete duplicates from copied projects

v0.6.1

01 Mar 19:49
Compare
Choose a tag to compare
  • added support for empty directories

v0.6

01 Mar 17:09
Compare
Choose a tag to compare
  • extended restart options for memory management: restartfile (restart docker after each project (e.g. input file)) and restarttransform (restart docker container after each transformation)
  • added option to make export optional
  • fixed bug in cross function (added a restart step to advertise copied projects to openrefine server)
  • improved logging and documentation

v0.5

27 Feb 22:35
Compare
Choose a tag to compare
  • fixed duplicate printing of openrefine server messages (caused by multiple calls of docker attach)
  • silenced find error messages
  • ps statistics now sorted
  • always export files (even if no transformation rules are found)
  • cross function input: replaced cp with rsync to exclude useless project-history

v0.4

27 Feb 17:13
Compare
Choose a tag to compare
  • added option to restart server after each transformation