Releases: brimdata/super
v1.9.0
Quick Start
Visit the Brim Data download page to find the package for your platform.
Zed is distributed as a TGZ/ZIP file of command line executables for each supported platform. To install, unpack with with the appropriate utility for your platform. For example, on Linux:
curl -OL https://github.com/brimdata/zed/releases/download/v1.9.0/zed-v1.9.0.linux-amd64.tar.gz
tar xzvf zed-v1.9.0.linux-amd64.tar.gz
If you've installed the Zui desktop app and want to work with its Zed lake from the command line, we recommend using the Zed executables included with the app to ensure compatibility. See this Zui docs article for their location.
Release Notes
- The Zed Language Overview docs have been split into multiple sections (#4576)
- Add support for user-defined operators (#4417, #4635, #4646, #4644, #4663, #4674, #4698, #4702, #4716)
- Add experimental support to the
get
operator for customized methods, headers, and body (#4572) - Allow float decorators on integers in ZSON (#4654)
- The shaping docs have been expanded with a new section on error handling (#4686)
zq
no longer attaches positional command line file inputs directly tojoin
inputs (usefile
within a Zed program instead) (#4689)- Zeek-related docs have been moved to the Integrations area of the Zed docs site (#4694, #4696)
zed create
now has a-use
flag to set the newly-created pool as the default pool for future operations (#4656)- Fix an issue where the Zed Python client was incorrectly returning
False
for allbool
values (#4706) - Fix an issue where the
!=
operator was not returning correct results when comparing certain types (#4704)
v1.8.1
Quick Start
Visit the Brim Data download page to find the package for your platform.
Zed is distributed as a TGZ/ZIP file of command line executables for each supported platform. To install, unpack with with the appropriate utility for your platform. For example, on Linux:
curl -OL https://github.com/brimdata/zed/releases/download/v1.8.1/zed-v1.8.1.linux-amd64.tar.gz
tar xzvf zed-v1.8.1.linux-amd64.tar.gz
If you've installed the Zui desktop app and want to work with its Zed lake from the command line, we recommend using the Zed executables included with the app to ensure compatibility. See this Zui docs article for their location.
Release Notes
- Send an HTTP 400 response instead of HTTP 500 for attempted deletes that find nothing to delete (#4618)
- Send an HTTP 400 response instead of HTTP 500 for queries that parse ok but fail to compile, such as searches lacking a leading
from
(#4620) - Fix an issue where some regexps were not matching pool names when used in a
from
(#4619)
v1.8.0
Quick Start
Visit the Brim Data download page to find the package for your platform.
Zed is distributed as a TGZ/ZIP file of command line executables for each supported platform. To install, unpack with with the appropriate utility for your platform. For example, on Linux:
curl -OL https://github.com/brimdata/zed/releases/download/v1.8.0/zed-v1.8.0.linux-amd64.tar.gz
tar xzvf zed-v1.8.0.linux-amd64.tar.gz
If you've installed the Zui desktop app and want to work with its Zed lake from the command line, we recommend using the Zed executables included with the app to ensure compatibility. See this Zui docs article for their location.
Release Notes
- Improve
sort
performance forduration
andtime
types (#4469) - Improve performance and reduce memory used by
zed load
andsort
on multi-GB inputs (#4476, #4484) - Fix an issue where meta-queries were incorrectly returning results (#4474)
- The
join
operator now has an additional syntax that uses subqueries, which is more reminiscent of SQL (#4467, #4473, #4492, #4502) - Improve performance when a Zed lake scan is not order sensitive (#4526)
- The lake API documentation now includes both request & response MIME types (#4512)
- Add more usage examples for the
pass
operator in documentation (#4541) cast()
errors are now structured and contain more detail (#4548)- A different Parquet library is now used, which allows for reading more dialects (#4547)
- Fix an issue where reading certain ZNG files via auto-detect caused a panic (#4569)
- Add a
load
operator that can be invoked in a Zed pipeline to commit data to a pool (#4471) - Fix an issue where certain ZNG files could not be read and caused a
control
error (#4579) - Fix an issue where
zed serve
would exit if it tried to write to a closed socket (#4587) - Improve JSON output for Zed maps (#4589)
- Add the
zed vacuum
command (#4577, #4598, #4600)
v1.7.0
Quick Start
Visit the Brim Data download page to find the package for your platform.
Zed is distributed as a TGZ/ZIP file of command line executables for each supported platform. To install, unpack with with the appropriate utility for your platform. For example, on Linux:
curl -OL https://github.com/brimdata/zed/releases/download/v1.7.0/zed-v1.7.0.linux-amd64.tar.gz
tar xzvf zed-v1.7.0.linux-amd64.tar.gz
If you've installed the Zui desktop app and want to work with its Zed lake from the command line, we recommend using the Zed executables included with the app to ensure compatibility. See this Zui docs article for their location.
Release Notes
- Add
regexp_replace()
function for replacing regular expression matches in a string (#4435, #4449) - Add documentation showing how to configure Auth0 for authenticated access to a Zed lake service (#4439)
- Fix an issue where elements of map could not be accessed if the key was of a union type (#4447)
- Allow
head
operator to accept an expression (#4451) - Allow
tail
operator to accept an expression (#4464)
v1.6.0
Note: Changes to the Zed lake storage format
This release includes a change to the Zed lake storage format that is not backward compatible. To migrate your pools to the new format there is a Zed lake migration kit and specific guidance for users of the Zed CLI tools.
Quick Start
Visit the Brim Data download page to find the package for your platform.
Zed is distributed as a TGZ/ZIP file of command line executables for each supported platform. To install, unpack with with the appropriate utility for your platform. For example, on Linux:
curl -OL https://github.com/brimdata/zed/releases/download/v1.6.0/zed-v1.6.0.linux-amd64.tar.gz
tar xzvf zed-v1.6.0.linux-amd64.tar.gz
If you've installed the Zui desktop app and want to work with its Zed lake from the command line, we recommend using the Zed executables included with the app to ensure compatibility. See this Zui docs article for their location.
Release Notes
- Zed lake storage format is now at version 3 (#4386, #4415)
- Allow loading and responses in VNG format over the lake API (#4345)
- Fix an issue where record spread expressions could cause a crash (#4359)
- Fix an issue where the Zed service
/version
endpoint returned "unknown" if it had been built viago install
(#4371) - Branch-level meta-queries on the
main
branch no longer require an explicit@main
reference (#4377, #4394) - Add
-defaultfmt
flag tozed serve
to specify the lake API's default response format (#4379, #4396) - Zed queries now appear in the lake log when
zed serve
is run at-log.level debug
(#4385) - Fix an issue where elements of complex named types could not be accessed (#4391)
- Add docs for the
pass
operator and an example ofjoin
on more than two inputs (#4403) - When the result of
summarize
is a single value and there is no field name specified, the output is now that single value rather than a single-field record containing that value (#4420)
v1.5.0
Quick Start
Visit the Brim Data download page to find the package for your platform.
Zed is distributed as a TGZ/ZIP file of command line executables for each supported platform. To install, unpack with with the appropriate utility for your platform. For example, on Linux:
curl -OL https://github.com/brimdata/zed/releases/download/v1.5.0/zed-v1.5.0.linux-amd64.tar.gz
tar xzvf zed-v1.5.0.linux-amd64.tar.gz
If you've installed the Brim desktop app and want to work with its Zed lake from the command line, we recommend using the Zed executables included with the app to ensure compatibility. See this Brim wiki article for their location.
Release Notes
- Add
float16
primitive type (#4301) - Add segment compression to the VNG format (#4299)
- Add
-unbuffered
flag tozed
andzq
(#4320) - Add
-csv.delim
flag tozed
andzq
for reading CSV with non-comma delimiter (#4325) - Add
csv.delim
query parameter to lake API for reading CSV with non-comma delimiter (#4333) - Add
-cors.origin
flag tozed serve
, which defaults to a wildcard (#4334) - Use
zng.
prefix for ZNG-related flags inzed
andzq
(#4336) - Fix an issue where type decorators of union values were leaking into CSV output (#4338)
v1.4.0
Quick Start
Visit the Brim Data download page to find the package for your platform.
Zed is distributed as a TGZ/ZIP file of command line executables for each supported platform. To install, unpack with with the appropriate utility for your platform. For example, on Linux:
curl -OL https://github.com/brimdata/zed/releases/download/v1.4.0/zed-v1.4.0.linux-amd64.tar.gz
tar xzvf zed-v1.4.0.linux-amd64.tar.gz
If you've installed the Brim desktop app and want to work with its Zed lake from the command line, we recommend using the Zed executables included with the app to ensure compatibility. See this Brim wiki article for their location.
Release Notes
- The ZST format is now called VNG (#4256)
- Allow loading of "line" format over the lake API (#4229)
- Allow loading of Parquet format over the lake API (#4235)
- Allow loading of Zeek TSV format over the lake API (#4246)
- Auto-detect Parquet and VNG formats (#4270)
- Add support for Arrow IPC stream format (#4252)
- Add pool level configuration to
zed manage
(#4234) - The
mask
argument of thenetwork_of()
function now accepts anip
-type netmask instead of anet
type (#4247, #4253) - Drop support for the older "zng21" format (#4255)
- Add support for user-defined functions (UDFs) to the Zed language (#4264)
- Add journal snapshots, significantly improving performance when a pool contains many small commits (#4274)
v1.3.0
Quick Start
Visit the Brim Data download page to find the package for your platform.
Zed is distributed as a TGZ/ZIP file of command line executables for each supported platform. To install, unpack with with the appropriate utility for your platform. For example, on Linux:
curl -OL https://github.com/brimdata/zed/releases/download/v1.3.0/zed-v1.3.0.linux-amd64.tar.gz
tar xzvf zed-v1.3.0.linux-amd64.tar.gz
If you've installed the Brim desktop app and want to work with its Zed lake from the command line, we recommend using the Zed executables included with the app to ensure compatibility. See this Brim wiki article for their location.
Release Notes
- Optimize performance of filters on pool key fields (#3930)
- Improve handling of errors during shaping (#4067, #4069)
- Allow use of a pool name regexp/glob pattern with the
from
operator (#4072, #4075) - Add
levenshtein()
function for fuzzy string matching (#4104) - Allow use of any filter with
zed delete -where
(#4100, #4124, #4126, #4125, #4127) - Add
regexp()
function for regular expression searches and capture groups (#4145, #4158) - Add
coalesce()
function for locating non-null/non-error values (#4172) - Add
line
format for sourcing newline-delimited input as strings (#4175) - Add
map()
aggregation function for constructing maps (#4173)
v1.2.0
Quick Start
Visit the Brim Data download page to find the package for your platform.
Zed is distributed as a TGZ/ZIP file of command line executables for each supported platform. To install, unpack with with the appropriate utility for your platform. For example, on Linux:
curl -OL https://github.com/brimdata/zed/releases/download/v1.2.0/zed-v1.2.0.linux-amd64.tar.gz
tar xzvf zed-v1.2.0.linux-amd64.tar.gz
If you've installed the Brim desktop app and want to work with its Zed lake from the command line, we recommend using the Zed executables included with the app to ensure compatibility. See this Brim wiki article for their location.
Release Notes
- Compress index values (#3974)
- Replace
-znglz4blocksize
flag with-zngcompress
and-zngframethresh
forzed
andzq
(#3967) - Add
-splitsize
flag tozed
andzq
(#3957) - Add
-aggmem
flag tozed
andzq
(#3921) - Add
zed compact
(#3940) - Remove
-repl
flag fromzc
(#3945) - Always default to ZNG output for
-split
flag tozed
andzq
(#3938) - Number
-split
flag files sequentially forzed
andzq
(#3937) - Remove index support for relative comparisons (#3932)
- Support
...
spread operator in array expressions and set expressions (#3910) - Python client: rework
zed.Client.query_raw()
to handle any format (#3911) - Add support for Parquet API responses (#3909)
- Support the indexing operation on sets (#3908)
- Add
nullsMax
argument tocompare() function
(#3898)
v1.1.0
Quick Start
Visit the Brim Data download page to find the package for your platform.
Zed is distributed as a TGZ/ZIP file of command line executables for each supported platform. To install, unpack with with the appropriate utility for your platform. For example, on Linux:
curl -OL https://github.com/brimdata/zed/releases/download/v1.1.0/zed-v1.1.0.linux-amd64.tar.gz
tar xzvf zed-v1.1.0.linux-amd64.tar.gz
If you've installed the Brim desktop app and want to work with its Zed lake from the command line, we recommend using the Zed executables included with the app to ensure compatibility. See this Brim wiki article for their location.
Release Notes
- Allow
-configdir
,-lake
,-q
, and-use
flags beforezed
subcommands (#3852) - Add
assert
operator (#3858) - Honor
from
operator'sformat
option (#3845) - Add
compare()
function (#3832) - Pretty-print ZSON type values (#3819)
- Allow conversion of time values to other numeric types (#3816)
- Remove scaling from duration and time conversions (#3809)
- Add
over
expressions (#3797) - Add
-where
flag tozed delete
(#3791) - Allow base62 object IDs in lake API request bodies (#3783)
- Remove
let
operator andover
operator'sas
clause (#3785)