- PR #896: Add
/readyzendpoint for easy ready-to-respond checks.
- PR #885: Improved responses on HTTP 500.
- PR #888: Expose stats about BoltDB on the
status/endpoint. - PR #889: Add OS-level information to
status/output. - PR #892: More Snapshot metrics.
- PR #894: Support timeout on
nodes/endpoint. - PR #895: Start HTTP service before attempting any join operation.
- PR #882: Some minor improvements related to on-disk SQLite use.
- PR #883: Add missing returns after HTTP errors.
- PR #884: Serialize on-disk databases by simply reading SQLite file.
- PR #880: Increase maximum in-memory database size to 2GiB, via upgraded dependencies.
- PR #879: Set timeout when fetching node API address.
- PR #878: CLI supports setting read consistency level.
- PR #876: Add round-trip time to each node to
nodes/endpoint output. - PR #877: Add Error information to
nodes/endpoint output.
This release introduces transparent request forwarding, which simplifies interacting with rqlite clusters. Client requests that must be served by the leader will no longer return HTTP 301, and will be forwarded transparently to the leader if necessary. Client software does not need to change to take advantage of this new functionality.
Systems running earlier 6.x software can be upgraded to this release without doing any special, but all nodes in the new cluster must be running this release. This release cannot communicate with nodes running earlier 6.x software.
- PR #859: Support transparent Execute and Query request forwarding. Fixes issue #330.
- PR #873: Support explicitly specifying SQLite on-disk file path.
- PR #863: Add gauge-like metric for Snapshot timings.
- PR #854: Use a connection pool for internode communications.
- PR #867: Add cluster status to Status output.
- PR #869: Cluster client uses resolved address, and improved status output.
- PR #851, PR #855: rqlite CLI properly supports PRAGMA directives.
- PR #853: Support enabling Foreign Key constraints via command-line options.
- PR #857: Use Protobufs as core data model.
- PR #858: Create dedicated client for talking to a cluster service.
- PR #862: Add detailed SQLite memory statistics to status output.
This release makes significant changes to SQLite database connection handling, resulting in proper support for high-performance concurrent reads of in-memory databases (an in-memory SQLite database is the default option for rqlite).
- PR #848: Enable DBSTAT table and JSON1 support. Fixes issue #843.
- PR #841: Remove support for specifying SQLite DSN.
- PR #842: Use
vfs=memdballowing proper concurrent reads of in-memory databases. Special thanks to @rittneje. - PR #842: Use read-only database connections for read queries, ensuring write SQL commands are not executed on the wrong endpoint.
- PR #842: Remove explicit support for Foreign Key constraint control and journal mode. Those controls are best left to the rqlite system now.
- PR #845: Add SQLite compile-time options to status output.
- PR #846: New DB and FSM indexes to track state.
This release addresses a significant issue related to SQLite connection handling and multithreading. All users should upgrade to this version.
- PR #827: Upgrade dependencies, including SQLite to 3.36.
- PR #835: Use Go standard libary sql/database abstraction. Fixes issue #830.
- PR #835: Use SQLite connection pool and add pool statistics to status output.
- PR #836: Add current SQLite journal mode to status output.
- PR #839: Limit in-memory connection pool to 1 connection.
- PR #840: Upgrade to rqlite/go-sqlite3 v1.20.4. See this issue.
- PR #822: Don't ignore
-joineven if previous state exists. Fixes issue #818.
This release implements a significant design change, which improves rqlite cluster reliability. With this change a rqlite node can more reliably direct read and write requests to the correct node.
In the 5.0 series, Follower nodes learned the HTTP API address of the cluster Leader via information - known as Metadata - that each node wrote to the Raft log. This Metadata was then available to each node in the cluster, if that node needed to redirect queries to the cluster Leader (assuming that node wasn't the Leader at that time). However that design was somewhat complex, and required the tracking of extra state, in addition to the SQLite database. It also meant that if the Metadata got out of sync with the Raft state, the cluster could be in a degraded state.
In this new design, a node now queries the Leader as needed, when that node needs to learn the Leader's HTTP API address. As a result, the Metadata component has been removed from rqlite, since it is no longer needed. And without any possibility of discrepancy between Metadata and Raft state, a whole class of potential bugs is removed. Any request for the Leader HTTP API address means the requesting node node connects to a TCP port already open on the Leader for Raft connections, so does not introduce any new failure modes. This multiplexing of the Raft TCP port is performed via the mux package.
This new design does mean that nodes running earlier software cannot communicate with 6.0 nodes, as 6.0 software no longer performs Metadata updates. As a result, rqlite clusters running 5.x software or earlier must be explicitly upgraded. To upgrade from an earlier version to this release you should backup your Leader node, and restore the database dump into a new 6.0 cluster.
The data API and cluster-management API remain unchanged however, so client code that communicates with rqlite should not need any changes.
- PR #796:
nodes/API reports real-time status of other nodes in cluster. Fixes issue #768. - PR #802: Add
.sysdumpcommand to rqlite CLI. - PR #807: rqlite CLI displays build information. Fixes issue #768.
- PR #792: Fetch leader HTTP API addresses on demand.
- PR #797: Remove
redirectkey from HTTP status output.
- PR #791: Reinstate node CA cert support which was erroneously removed in an earlier change.
- PR #788: Upgrade to SQLite 3.35.4.
- PR #790: Upgrade dependencies, including Hashicorp Raft to v1.3.0.
- PR #783: Create GZIP writer for every compression request. Fixes issue #781.
- PR #776, PR #777: Support specifying Dialer's local address when performing Join request. Fixes issue #774. Thanks @osxlinux
- PR #782: Better error messages for command unmarshaling.
- PR #772: Log launch command.
- PR #769: Upgrade to rqlite/go-sqlite3 1.20.1, to address a significant memory leak.
- PR #742: Add one-shot option to rqbench.
- PR #745: TLS version 1.0 and 1.1 disabled by default, but can be re-enabled at the command line. Fixes issue #743.
- PR #738: Don't use temp file when snapshotting database.
- PR #739: Don't use temp file when restoring an in-memory database.
- PR #738: Switch to rqlite fork of mattn/go-sqlite3. The SQLite C code remains unchanged.
- PR #741: Tighten up Store-level locking.
- PR #747: Time snapshot, restore, and startup times.
- PR #750: Build on-disk databases in-memory first. Fixes issue #731.
- PR #754: Support Noop commands in Raft Log.
- PR #759, PR #760: Close BoltDB on Store close.
- PR #757: More extensive system-level testing of Snapshot and Restore.
- PR #762: Convert Raft stats to numbers where possible. Fixes issue #763.
- PR #764: Add total Raft directory size to Store stats.
- PR #764: Close SQLite database only after Raft has been shut down.
- PR #765: Add auth-ok and auth-fail events to stats.
- PR #734: Better control over waiting for Leader at startup, via command line options.
- PR #724: rqlite CLI displays node version at startup.
- PR #726: Count number of legacy commands unmarshaled.
- PR #733: Clearer Raft log status during startup.
- PR #735: Implement policy over trailing Raft logs.
- PR #716: Support HTTP/2 protocol over TLS. Fixes issue #516.
- PR #711, PR# 712: Ignore join addresses if node already part of cluster. Fixes issue #710.
- PR #715: Compress SQLite database in Raft snapshot.
- PR #717: Add SQLite database page-centric size to status output.
- PR #719: Exit if any arguments passed at command line after data directory. Fixes issue #718.
- PR #696: Benchmarking tool now supports query testing.
- PR #694: Display, in the CLI, the HTTP response body on HTTP status 503.
- PR #703: Fix potential panic during request parsing.
- PR #705: Use Protobuf for encoding Raft Log commands.
- PR #692: Support setting Raft leader lease timeout.
- PR #693: Upgrade Go mod dependencies, including upgrading Hashicorp Raft to v1.2.0.
- PR #680, PR #681: Add missing calls to set BasicAuth in CLI. Fixes issue #678.
- PR #682: Explicitly handle "no leader" during backup, and return redirect if necessary.
- PR #683: Restore request should re-read file every attempt.
- PR #673: Support parameterized statements. Fixes issue #140.
- PR #672: Fix issue causing HTTPS-only redirects.
This release should not be used, due to a HTTP redirection bug.
- PR #660: Raft log size on disk now reported via status endpoint.
- PR #670: Add utilities for testing encrypted nodes.
- PR #671: Set Location for HTTP redirect properly for secure nodes.
- PR #654: Allow number of Join attempts and Join interval to be specified at startup. Fixes issue #653.
- PR #641: rqlite CLI now supports node removal.
This release fixes a very significant bug, whereby snapshotting was never occuring due to a zero snapshot-interval being passed to the Raft subsystem. This meant that the Raft log would grow without bound, and could result in very long start-up times if the Raft log was very large.
- PR #637: Allow the Raft snapshotting check interval to be set at launch time.
- PR #637: Set the Raft snapshot check interval to 30 seconds by default.
- PR #636: Check consistency level before freshness check. Thanks @wangfenjin
- PR #613: Support read-only, non-voting nodes. These provide read scalability for the system.
- PR #614: Support specifying minimum leader freshness with None consistency queries.
- PR #620: Log level can be specified for Raft module.
This release uses a new Raft consensus version, with the move to Hashicorp Raft v1. As a result the Raft system in 5.0 is not compatible with the 4.0 series. To upgrade from an earlier version to this release you should backup your 4.0 leader node, and restore the database dump into a new 5.0 cluster.
The rqlite server also supports explicitly setting the node ID. While it's not required to set this, it's recommended for production clusters. See the cluster documentation for more details.
The HTTP Query and Insert API remains unchanged in the 5.0 series relative to the 4.0 series.
- PR #597: Don't ignore any Join error, instead return it.
- PR #598: Ensure backup is correctly closed.
- PR #600: Move to Hashicorp Raft v1.1.1.
- PR #601: By default use Raft network address as node ID.
- PR #602: Add method to Store that returns leader ID.
- PR #603: Fix up status key name style.
- PR #604: JSON types are also text.
- PR #605: Broadcast Store meta via consensus.
- PR #607: Various Redirect fixes.
- PR #609: Simplify rqlite implementation.
- PR #610: Write node backup directly to HTTP response writer. Thanks @sum12.
- PR #611: Add varadic perm check functions to auth store.
This release adds significant new functionality to the command-line tool, including much more control over backup and restore of the database. Visit the Releases page to download this release.
- PR #592: Add dump database command (to SQL text file) to CLI.
- PR #585: Add backup command (to SQLite file) to CLI: Thanks @eariassoto.
- PR #589: Add restore command (from SQLite file) to CLI. Thanks @eariassoto.
- PR #584: Support showing query timings in the CLI. Thanks @joaodrp.
- PR #586: rqlite CLI now supports command-recall via cursor key. Thanks @rhnvrm.
- PR #564: rqlite server supports specifying trusted root CA certificate. Thanks @zmedico.
- PR #593: rqlite CLI now supports HTTP proxy (via Environment). Thanks @paulstuart
- PR #587: Add expvar statistics to store.
- PR #591: Store layer supports generating SQL format backups.
- PR #590: DB layer supports generating SQL format backups.
- PR #588: Abort transaction if load from backup operation fails.
- If joining a cluster via HTTP fails, try HTTPS. Fixes issue #577.
- PR #551: rqlite CLI supports specifying trusted root CA certificate. Thanks @zmedico.
- Allow the Raft election timeout to be set.
- Allow a node to be re-added with same IP address and port, even though it was previously removed. Fixes issue #534.
- PR #397, PR #399: Support hashed passwords. Fixes issue #395. Thanks @sum12.
- PR #389: Log Store directory path on startup.
- PR #392: Return redirect if node removal attempted on follower. Fixes issue #391.
- PR #383: Fix unit tests after underlying SQLite master table changes.
- PR #384: "status" perm required to access Go runtime information.
- PR #367: Remove superflous leading space at CLI prompt.
- PR #368: CLI displays clear error message when not authorized.
- PR #370: CLI does not need to indent JSON when making requests.
- PR #373, PR #374: Add simple INSERT-only benchmarking tool.
- PR #342: Add missing Store parameters to diagnostic output.
- PR #343: Support fetching expvar information via CLI.
- PR #344: Make read-consistency query param value case-insensitive.
- PR #345: Add unit test coverage for status and expvar endpoints.
- PR #337: Include any query params with 301 redirect URL.
- PR #316: CLI doesn't need pretty nor timed responses from node.
- PR #334: Set Content-Type to "application/octet-stream" for backup endpoint. Fixes issue #333.
The 4.0 release has renamed command-line options relative to earlier releases. This means that previous commands used to launch rqlited will not work. However the command-line changes are cosmetic, and each previous option maps 1-to-1 to a renamed option. Otherwise deployments of earlier releases can be upgraded to the 4.0 series without any other work.
- PR #309: Tweak start-up logo.
- PR #308: Move to clearer command-line options.
- PR #307: Support node-to-node encryption. Fixes issue #93.
- PR #310: HTTP service supports registration of Status providers; Mux is first client.
- PR #315: Add status and help commands to CLI.
- PR #304: Switch to Go 1.8.1.
- PR #296: Log Go version at startup.
- PR #294: Support multiple explicit join addresses.
- PR #297: CLI should explicitly handle redirects due to Go1.8. Fixes issue #295.
- PR #291: Don't access Discovery Service if node already part of cluster.
- PR #286: Tweak help output.
- PR #283: Main code should log to stderr.
- PR #280, PR #281: Integrate with new Discovery Service.
- PR #282: Retry cluster-join attempts on failure.
- PR #289: rqlite HTTP clients should not automatically follow redirects.
- PR #268: Allow Store to wait for application of initial logs. Fixes issue #260.
- PR #272: Add commit, branch, GOOS, and GOARCH, to output of
--version. - PR #274: Use Hashicorp function to read peers. Thanks @WanliTian
- PR #278: Add support for dot-commands
.tablesand.schemato rqlite CLI. Fixes issue #277.
- PR #253: Handle nil row returned by SQL execer. Fixes issue #253.
- PR #258: Remove check that all queries begin with SELECT. Fixes issue #255.
- PR #247: Simplify loading of SQLite dump files via single command execution. Fixes issue #246.
- PR #247: Correct SQLite dump load authentication check.
- PR #239: Add an API to the
Storelayer for custom peers storage and logging. Thanks @tych0 - PR #221: Start full support for various SQLite text types. Fix issue #240.
- PR #242: Support direct copying of the database via the Store. Thanks @tych0.
- PR #243: Use Store logging everywhere in the Store package.
- PR #230: Move Chinook test data to idiomatic testdata directory.
- PR #232, PR #233: rqlite CLI now supports accessing secured rqlited nodes. Thanks @tych0.
- PR #235: Return correct error, if one occurs, during backup. Thanks @tych0.
- PR #237, PR #238: Support observing Raft changes. Thanks @tych0
- With this release rqlite is moving to Go 1.7.
- PR #206, #217: Support loading data directly from SQLite dump files.
- PR #209: Tweak help output.
- PR #229: Remove explicit control of foreign key constraints.
- PR #207: Database supports returning foreign key constraint status.
- PR #211: Diagnostics show actual foreign key constraint state.
- PR #212: Add database configuration to diagnostics output.
- PR #224, PR #225: Add low-level database layer expvar stats.
- PR #195: Set Content-type "application/json" on all HTTP responses.
- PR #193: Allow joining a cluster through any node, not just the leader.
- PR #187: Support memory profiling.
- Go cyclo complexity changes.
- With this release Windows compatibility is checked with every build.
- PR #185: Enable foreign key constraints by default.
- PR #175: Simplify error handling of Update Peers API.
- PR #170: Log any failure to call
Serve()on HTTP service. - Go lint fixes.
- Go cyclo complexity changes.
- PR #159: All HTTP responses set X-RQLITE-VERSION.
- PR #151: Support configurable Raft heartbeat timeout.
- PR #149: Support configurable Raft snapshot thresholds.
- PR #148: Support pprof information over HTTP.
- PR #154: CLI now redirects to leader if necessary.
- PR #155: CLI now handles "no rows" correctly.
- PR #143: Use DELETE as HTTP method to remove nodes.
- PR #142: Use correct HTTP methods on all endpoints.
- PR #137: Use resolved version of joining node's address.
- PR #136: Better errors on join failures.
- PR #133: Add Peers to status output.
- PR #132: Support removing a node from a cluster.
- PR #131: Only convert []byte from database to string if "text". Thanks @bkeroackdsc
- PR #129: Verify all statements sent to query endpoint begin with "SELECT".
- PR #141: Store methods to expose node Raft state. Thanks @bkeroack
- PR #117: Use Raft advertise address, if exists, during join.
The Raft log format in 3.0 is not compatible with the 2.0 series. To upgrade from an earlier version to this release you should backup your 2.0 leader node, and replay the database dump into a new 3.0 cluster. The HTTP API remains unchanged however.
- PR #116: Allow HTTP advertise address to be set.
- PR #115: Support advertising address different than Raft bind address.
- PR #113: Switch to in-memory SQLite databases by default.
- PR #109: Nodes broadcast meta to cluster via Raft.
- PR #109, PR #111: Leader redirection
- PR #104: Handle the
-joinoption sensibly when already member of cluster.
- PR #95: Correctly set HTTP authentication.
- PR #84: Encrypted API (HTTPS) now supported.
- PR #85: BasicAuth support.
- PR #85: User-level permissions support.
- Print rqlited logo on start-up.
- End-to-end single-node and multi-node unit tests.
- PR #76: Obey timing information display at database level.
- PR #77: Add version information to binary.
timingsURL param to control presence of timing information in response.- PR #74: Use SQLite connection directly. Thanks @zmedico.
- Update operations return last-inserted ID.
- Column-oriented API responses.
- Types in API response body.
- Query times in addition to sum of query times.
- New Raft consensus module, built on Hashicorp's implementation.
- Hot backup support.
- Selectable read-consistency levels of none, weak, and strong.
- SQLite file size added to HTTP API status endpoint.
- expvar support added to HTTP server.
Check out this tag for full details.