Feast v0.5.0

v0.5.0 (2020-05-19)

Summary:

Feast v0.5 is a technical release. We have removed the concept of feature set versions, and now allow feature sets to be updated. We've also modularized the storage APIs, added support for Redis Cluster, added job management APIs, and cleared other smaller technical debts.

Full Changelog

Breaking changes:

• Add .proto to packages of Protobuf generated Java classes #700 (woop)
• Add support for feature set updates and remove versions #676 (zhilingc)
• Feast configuration files refactored #611 (woop)
• HTTP /healthz endpoint of Feast Core removed, replaced with a gRPC health probe implementation
  #680 (zhilingc)

See Feast 0.5 Release Issue for more details.

Implemented enhancements:

• Add general storage API and refactor existing store implementations #567 (zhilingc)
• Add support for feature set updates and remove versions #676 (zhilingc)
• Add unique ingestion id for all batch ingestions #656 (zhilingc)
• Add storage interfaces #529 (zhilingc)
• Add BigQuery storage implementation #546 (zhilingc)
• Add Redis storage implementation #547 (zhilingc)
• Add Support for Redis Cluster #502 (lavkesh)
• Add Ingestion Job management API for Feast Core #548 (mrzzy)
• Add feature and feature set labels for metadata #536 (imjuanleonard)
• Update Python SDK so FeatureSet can import Schema from Tensorflow metadata #450 (davidheryanto)

Fixed bugs:

• Add feature set status JOB_STARTING to denote feature sets waiting for job to get to RUNNING state #714 (zhilingc)
• Remove feature set status check for job update requirement #708 (khorshuheng)
• Fix Feast Core docker image #703 (khorshuheng)
• Include server port config on the generated application.yml #696 (khorshuheng)
• Fix typo in all types parquet yml file (e2e test) #683 (khorshuheng)
• Add grpc health probe implementation to core #680 (zhilingc)
• Ensure that generated python code are considered as module #679 (khorshuheng)
• Fix DataflowJobManager to update existing job instance instead of creating new one #678 (zhilingc)
• Fix config validation for feast.jobs.metrics.host #662 (davidheryanto)
• Docker compose bug fix #661 (woop)
• Swap join columns #647 (zhilingc)
• Fix Feast Serving not registering its store in Feast Core #641 (mrzzy)
• Kafka producer should raise an exception when it fails to connect to broker #636 (junhui096)

Merged pull requests:

• Change organization from gojek to feast-dev #712 (woop)
• Extract feature set update tests so CI doesn't run it #709 (zhilingc)
• Ensure that batch retrieval tests clean up after themselves #704 (zhilingc)
• Apply default project to rows without project during ingestion #701 (zhilingc)
• Update tests to correct compute region #699 (terryyylim)
• Make Projects optional & Update Feature References #693 (mrzzy)
• Add Java code coverage reporting #686 (ches)
• Update e2e tests to allow non-SNAPSHOT testing #672 (woop)
• Move TFDV stats to higher-numbered protobuf fields #669 (ches)
• Clean up Docker Compose and add test #668 (woop)
• Enable Prow e2e tests by default #666 (woop)
• Add label checking to Prow #665 (woop)
• Upgrade Github Checkout action to v2 #660 (khorshuheng)
• Fix Redis cluster e2e #659 (terryyylim)
• Split Field model into distinct Feature and Entity objects #655 (zhilingc)
• Use Runner enum type instead of string for Job model #651 (ches)
• JobUpdateTask cleanups #650 (ches)
• Update approvers list #648 (khorshuheng)
• Update end-to-end test config #645 (zhilingc)
• Fix bigquery config for serving store #644 (zhilingc)
• Fix Dataflow translator bug #643 (zhilingc)
• Fix subscription config and doctests #634 (woop)
• Correct links to why-feast and concepts doc site #627 (anderseriksson)
• Make error on retrieval of nonexistent feature humanly readable #625 (mrzzy)
• Generate golang code for non-serving protos #618 (zhilingc)
• Regenerate golang code, fix proto comparisons #616 (zhilingc)
• Fix doc building #603 (woop)
• Pin Jupyter Notebook version #597 (imjuanleonard)
• Create project if not exists on applyFeatureSet #596 (Joostrothweiler)
• Apply a fixed window before writing row metrics #590 (davidheryanto)
• Allow tests to run on non-master branches #588 (woop)

Feast v0.3.7

v0.3.7 (2020-05-01)

Full Changelog

Implemented enhancements:

• Add Cassandra Store #360 (smadarasmi)
• Introduce datatypes-java module, making compiled protobuf types and their source .proto definitions available in a Maven artifact separate from feast-sdk #407 (ches)

Fixed bugs:

• v0.3 backport: Add index for join table for jobs-featuresets relation #654 (ches)

Merged pull requests:

• Moved end-to-end test scripts from .prow to infra #657 (khorshuheng)

Feast v0.4.7

Upgrade Note
Release v0.4.7 changes the way features are stored in Redis, which solves a problem with memory usage growing out of control. Please see this issue #515 for more details.

Full Changelog

Merged pull requests:

• Add log4j-web jar to core and serving. #498 (Yanson)
• Fix Redis ingestion retries. #501 (lavkesh)
• Encode feature row before storing in Redis #530 (khorshuheng)
• Remove transaction when listing projects #522 (davidheryanto)
• Remove unused ingestion deps #520 (ches)
• Parameterize end to end test scripts. #433 (Yanson)
• Change Redis client library from Jedis to Lettuce #485 (lavkesh)

Feast v0.4.6

v0.4.6 (2020-02-26)

Full Changelog

Merged pull requests:

• Rename metric name for request latency in feast serving #488 (davidheryanto)
• Allow use of secure gRPC in Feast Python client #459 (Yanson)
• Extend WriteMetricsTransform in Ingestion to write feature value stats to StatsD #486 (davidheryanto)
• Remove Redis transaction from Ingestion to Redis store #480 (imjuanleonard)
• Fix fastavro version used in Feast to avoid Timestamp delta error #490 (davidheryanto)
• Fail Spotless formatting check before tests execute #487 (ches)
• Reduce refresh rate of specification refresh in Serving to 10 seconds #481 (woop)

Feast v0.4.5

v0.4.5 (2020-02-14)

Full Changelog

Merged pull requests:

• Use bzip2 compressed feature set json as pipeline option #466 (khorshuheng)
• Make redis key creation more determinisitic #471 (zhilingc)
• Helm Chart Upgrades #458 (Yanson)
• Exclude version from grouping #441 (khorshuheng)
• Use concrete class for AvroCoder compatibility #465 (zhilingc)
• Fix typo in split string length check #464 (zhilingc)
• Update README.md and remove versions from Helm Charts #457 (woop)
• Deduplicate example notebooks #456 (woop)
• Allow users not to set max age for batch retrieval #446 (zhilingc)

Feast v0.4.4

v0.4.4 (2020-01-28)

Full Changelog

Closed issues:

• Improve Python SDK feature set listing #296
• Ingestion dependency not found when starting Core server locally (CONTRIBUTING.md) #294
• Add support for ingesting from BigQuery SQL statement / View #6

Merged pull requests:

• Change RedisBackedJobService to use a connection pool #439 (zhilingc)
• Update GKE installation and chart values to work with 0.4.3 #434 (lgvital)
• Remove "resource" concept and the need to specify a kind in feature sets #432 (woop)
• Add retry options to BigQuery #431 (Yanson)
• Fix logging #430 (Yanson)
• Add documentation for bigquery batch retrieval #428 (zhilingc)
• Publish datatypes/java along with sdk/java #426 (ches)
• Update basic Feast example to Feast 0.4 #424 (woop)
• Introduce datatypes/java module for proto generation #391 (ches)
• Allow user to override job options #377 (khorshuheng)

Feast v0.4.3

v0.4.3 (2020-01-08)

Full Changelog

Fixed bugs:

• Redis ingestion retries throwing NullPointerException on remote runners #417 (khorshuheng)

Feast v0.4.2

v0.4.2 (2020-01-07)

Full Changelog

Fixed bugs:

• Missing argument in error string in ValidateFeatureRowDoFn #401

Merged pull requests:

• Define maven revision property when packaging jars in Dockerfile so the images are built successfully #410 (davidheryanto)
• Deduplicate rows in subquery #409 (zhilingc)
• Filter out extra fields, deduplicate fields in ingestion #404 (zhilingc)
• Automatic documentation generation for gRPC API #403 (woop)
• Update feast core default values to include hibernate merge strategy #400 (zhilingc)
• Move cli into feast package #398 (zhilingc)
• Use Nexus staging plugin for Maven Central deployment #394 (khorshuheng)
• Handle retry for redis io flow #274 (khorshuheng)

Feast v0.3.6

v0.3.6 (2020-01-03)

Merged pull requests:

Full Changelog

• Add support for file paths for providing entity rows during batch retrieval #375 (voonhous)

Feast v0.4.1

v0.4.1 (2019-12-30)

Full Changelog

Merged pull requests:

• Add project-related commands to CLI #397 (zhilingc)