Skip to content
This repository was archived by the owner on Nov 10, 2022. It is now read-only.

Commit 3b211ba

Browse files
authored
Update roadmap to include Snowflake + Trino. Also fix docs + update FAQ (feast-dev#2175)
* Update roadmap to include Snowflake + Trino. Also fix some Gitbook artifacts / bugs on feature server documentation and add FAQ question on mixing clouds in Feast Signed-off-by: Danny Chiao <[email protected]> * Fix readme by running compile-templates Signed-off-by: Danny Chiao <[email protected]>
1 parent 680a7af commit 3b211ba

File tree

7 files changed

+36
-35
lines changed

7 files changed

+36
-35
lines changed

README.md

Lines changed: 8 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -142,7 +142,7 @@ The list below contains the functionality that contributors are planning to deve
142142
* [x] [Hive (community plugin)](https://github.com/baineng/feast-hive)
143143
* [x] [Postgres (community plugin)](https://github.com/nossrannug/feast-postgres)
144144
* [x] Kafka source (with [push support into the online store](reference/alpha-stream-ingestion.md))
145-
* [ ] Snowflake source (Planned for Q4 2021)
145+
* [x] [Snowflake source (community plugin)](https://github.com/sfc-gh-madkins/feast-snowflake)
146146
* [ ] HTTP source
147147
* **Offline Stores**
148148
* [x] [Redshift](https://docs.feast.dev/reference/offline-stores/redshift)
@@ -152,8 +152,8 @@ The list below contains the functionality that contributors are planning to deve
152152
* [x] [Postgres (community plugin)](https://github.com/nossrannug/feast-postgres)
153153
* [x] [In-memory / Pandas](https://docs.feast.dev/reference/offline-stores/file)
154154
* [x] [Custom offline store support](https://docs.feast.dev/how-to-guides/adding-a-new-offline-store)
155-
* [ ] Snowflake (Planned for Q4 2021)
156-
* [ ] Trino (Planned for Q4 2021)
155+
* [x] [Snowflake (community plugin)](https://github.com/sfc-gh-madkins/feast-snowflake)
156+
* [x] [Trino (communiuty plugin)](https://github.com/Shopify/feast-trino)
157157
* **Online Stores**
158158
* [x] [DynamoDB](https://docs.feast.dev/reference/online-stores/dynamodb)
159159
* [x] [Redis](https://docs.feast.dev/reference/online-stores/redis)
@@ -171,12 +171,12 @@ The list below contains the functionality that contributors are planning to deve
171171
* [ ] Streaming ingestion on GCP
172172
* **Feature Engineering**
173173
* [x] On-demand Transformations (Alpha release. See [RFC](https://docs.google.com/document/d/1lgfIw0Drc65LpaxbUu49RCeJgMew547meSJttnUqz7c/edit#))
174-
* [ ] Batch transformation (SQL)
174+
* [ ] Batch transformation (SQL. In progress. See [RFC](https://docs.google.com/document/d/1964OkzuBljifDvkV-0fakp2uaijnVzdwWNGdz7Vz50A/edit))
175175
* [ ] Streaming transformation
176176
* **Deployments**
177177
* [x] AWS Lambda (Alpha release. See [RFC](https://docs.google.com/document/d/1eZWKWzfBif66LDN32IajpaG-j82LSHCCOzY6R7Ax7MI/edit))
178+
* [x] Kubernetes (See [guide](https://docs.feast.dev/how-to-guides/running-feast-in-production#4.3.-java-based-feature-server-deployed-on-kubernetes))
178179
* [ ] Cloud Run
179-
* [ ] Kubernetes
180180
* [ ] KNative
181181
* **Feature Serving**
182182
* [x] Python Client
@@ -187,18 +187,17 @@ The list below contains the functionality that contributors are planning to deve
187187
* [ ] Go Client
188188
* [ ] Delete API
189189
* [ ] Feature Logging (for training)
190-
* **Data Quality Management**
191-
* [ ] Data profiling and validation (Great Expectations) (Planned for Q4 2021)
190+
* **Data Quality Management (See [RFC](https://docs.google.com/document/d/110F72d4NTv80p35wDSONxhhPBqWRwbZXG4f9mNEMd98/edit))**
191+
* [ ] Data profiling and validation (Great Expectations) (Planned for Q1 2022)
192192
* [ ] Metric production
193193
* [ ] Training-serving skew detection
194194
* [ ] Drift detection
195-
* [ ] Alerting
196195
* **Feature Discovery and Governance**
197196
* [x] Python SDK for browsing feature registry
198197
* [x] CLI for browsing feature registry
199198
* [x] Model-centric feature tracking (feature services)
200199
* [ ] REST API for browsing feature registry
201-
* [ ] Feast Web UI (Planned for Q4 2021)
200+
* [ ] Feast Web UI
202201
* [ ] Feature versioning
203202
* [ ] Amundsen integration
204203

docs/getting-started/faq.md

Lines changed: 12 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,11 @@
11
# FAQ
22

3+
{% hint style="info" %}
4+
**Don't see your question?**
5+
6+
We encourage you to ask questions on [Slack](https://slack.feast.dev) or [Github](https://github.com/feast-dev/feast). Even better, once you get an answer, add the answer to this FAQ via a [pull request](../project/development-guide.md)!
7+
{% endhint %}
8+
39
## Getting started
410

511
### Do you have any examples of how Feast should be used?
@@ -44,7 +50,7 @@ Please see a detailed comparison of Feast vs. Tecton [here](https://www.tecton.a
4450

4551
### What are the performance/latency characteristics of Feast?
4652

47-
Feast is designed to work at scale and support low latency online serving. Benchmarks to be released soon, and active work is underway to support very latency sensitive use cases.
53+
Feast is designed to work at scale and support low latency online serving. Benchmarks ([RFC](https://docs.google.com/document/d/12UuvTQnTTCJhdRgy6h10zSbInNGSyEJkIxpOcgOen1I/edit)) will be released soon, and active work is underway to support very latency sensitive use cases.
4854

4955
### Does Feast support embeddings and list features?
5056

@@ -61,6 +67,10 @@ Yes. Specifically:
6167

6268
The list of supported offline and online stores can be found [here](../reference/offline-stores/) and [here](../reference/online-stores/), respectively. The [roadmap](../roadmap.md) indicates the stores for which we are planning to add support. Finally, our Provider abstraction is built to be extensible, so you can plug in your own implementations of offline and online stores. Please see more details about custom providers [here](../how-to-guides/creating-a-custom-provider.md).
6369

70+
### Does Feast support using different clouds for offline vs online stores?
71+
72+
Yes. Using a GCP or AWS provider in `feature_store.yaml` primarily sets default offline / online stores and configures where the remote registry file can live (Using the AWS provider also allows for deployment to AWS Lambda). You can override the offline and online stores to be in different clouds if you wish.
73+
6474
### How can I add a custom online store?
6575

6676
Please follow the instructions [here](../how-to-guides/adding-support-for-a-new-online-store.md).
@@ -100,10 +110,4 @@ For more details on contributing to the Feast community, see [here](../community
100110

101111
### What are the plans for Feast Core, Feast Serving, and Feast Spark?
102112

103-
Feast Core and Feast Serving were both part of Feast Java. We plan to support Feast Serving. We will not support Feast Core; instead we will support our object store based registry. We will not support Feast Spark. For more details on what we plan on supporting, please see the [roadmap](../roadmap.md).
104-
105-
{% hint style="info" %}
106-
**Don't see your question?**
107-
108-
We encourage you to ask questions on [Slack](https://slack.feast.dev) or [Github](https://github.com/feast-dev/feast). Even better, once you get an answer, add the answer to this FAQ via a [pull request](../project/development-guide.md)!
109-
{% endhint %}
113+
Feast Core and Feast Serving were both part of Feast Java. We plan to support Feast Serving. We will not support Feast Core; instead we will support our object store based registry. We will not support Feast Spark. For more details on what we plan on supporting, please see the [roadmap](../roadmap.md).

docs/getting-started/quickstart.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ In this tutorial we will
99

1010
You can run this tutorial in Google Colab or run it on your localhost, following the guided steps below.
1111

12-
![](../.gitbook/assets/colab\_logo\_32px.png)[**Run in Google Colab**](https://colab.research.google.com/github/feast-dev/feast/blob/master/examples/quickstart/quickstart.ipynb)****
12+
![](../.gitbook/assets/colab\_logo\_32px.png)[**Run in Google Colab**](https://colab.research.google.com/github/feast-dev/feast/blob/master/examples/quickstart/quickstart.ipynb)
1313

1414
## Overview
1515

docs/getting-started/third-party-integrations.md

Lines changed: 5 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@
33
We integrate with a wide set of tools and technologies so you can make Feast work in your existing stack. Many of these integrations are maintained as plugins to the main Feast repo.
44

55
{% hint style="info" %}
6-
Don't see your offline store or online store of choice here? Check our our guides to make a custom one!
6+
Don't see your offline store or online store of choice here? Check out our guides to make a custom one!
77

88
* [Adding a new offline store](../how-to-guides/adding-a-new-offline-store.md)
99
* [Adding a new online store](../how-to-guides/adding-support-for-a-new-online-store.md)
@@ -20,7 +20,7 @@ Don't see your offline store or online store of choice here? Check our our guide
2020
* [x] [Hive (community plugin)](https://github.com/baineng/feast-hive)
2121
* [x] [Postgres (community plugin)](https://github.com/nossrannug/feast-postgres)
2222
* [x] Kafka source (with [push support into the online store](https://docs.feast.dev/reference/alpha-stream-ingestion))
23-
* [ ] Snowflake source (Planned for Q4 2021)
23+
* [x] [Snowflake source (community plugin)](https://github.com/sfc-gh-madkins/feast-snowflake)
2424
* [ ] HTTP source
2525

2626
### Offline Stores
@@ -32,8 +32,8 @@ Don't see your offline store or online store of choice here? Check our our guide
3232
* [x] [Postgres (community plugin)](https://github.com/nossrannug/feast-postgres)
3333
* [x] [In-memory / Pandas](https://docs.feast.dev/reference/offline-stores/file)
3434
* [x] [Custom offline store support](https://docs.feast.dev/how-to-guides/adding-a-new-offline-store)
35-
* [ ] Snowflake (Planned for Q4 2021)
36-
* [ ] Trino (Planned for Q4 2021)
35+
* [x] [Snowflake source (community plugin)](https://github.com/sfc-gh-madkins/feast-snowflake)
36+
* [x] [Trino (communiuty plugin)](https://github.com/Shopify/feast-trino)
3737

3838
### Online Stores
3939

@@ -50,12 +50,11 @@ Don't see your offline store or online store of choice here? Check our our guide
5050
### **Deployments**
5151

5252
* [x] AWS Lambda (Alpha release. See [guide](../reference/alpha-aws-lambda-feature-server.md) and [RFC](https://docs.google.com/document/d/1eZWKWzfBif66LDN32IajpaG-j82LSHCCOzY6R7Ax7MI/edit))
53+
* [x] Kubernetes (See [guide](https://docs.feast.dev/how-to-guides/running-feast-in-production#4.3.-java-based-feature-server-deployed-on-kubernetes))
5354
* [ ] Cloud Run
54-
* [ ] Kubernetes
5555
* [ ] KNative
5656

5757

58-
5958
## Standards
6059

6160
In order for a plugin integration to be highlighted on this page, it must meet the following requirements:

docs/reference/alpha-aws-lambda-feature-server.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@
33
**Warning**: This is an _experimental_ feature. It's intended for early testing and feedback, and could change without warnings in future releases.
44

55
{% hint style="info" %}
6-
To enable this feature, run**`feast alpha enable aws_lambda_feature_server`**
6+
To enable this feature, run **`feast alpha enable aws_lambda_feature_server`**
77
{% endhint %}
88

99
## Overview

docs/reference/feature-server.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@
33
**Warning**: This is an _experimental_ feature. It's intended for early testing and feedback, and could change without warnings in future releases.
44

55
{% hint style="info" %}
6-
To enable this feature, run**`feast alpha enable python_feature_server`**
6+
To enable this feature, run **`feast alpha enable python_feature_server`**
77
{% endhint %}
88

99
## Overview

docs/roadmap.md

Lines changed: 8 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -14,7 +14,7 @@ The list below contains the functionality that contributors are planning to deve
1414
* [x] [Hive (community plugin)](https://github.com/baineng/feast-hive)
1515
* [x] [Postgres (community plugin)](https://github.com/nossrannug/feast-postgres)
1616
* [x] Kafka source (with [push support into the online store](reference/alpha-stream-ingestion.md))
17-
* [ ] Snowflake source (Planned for Q4 2021)
17+
* [x] [Snowflake source (community plugin)](https://github.com/sfc-gh-madkins/feast-snowflake)
1818
* [ ] HTTP source
1919
* **Offline Stores**
2020
* [x] [Redshift](https://docs.feast.dev/reference/offline-stores/redshift)
@@ -24,8 +24,8 @@ The list below contains the functionality that contributors are planning to deve
2424
* [x] [Postgres (community plugin)](https://github.com/nossrannug/feast-postgres)
2525
* [x] [In-memory / Pandas](https://docs.feast.dev/reference/offline-stores/file)
2626
* [x] [Custom offline store support](https://docs.feast.dev/how-to-guides/adding-a-new-offline-store)
27-
* [ ] Snowflake (Planned for Q4 2021)
28-
* [ ] Trino (Planned for Q4 2021)
27+
* [x] [Snowflake (community plugin)](https://github.com/sfc-gh-madkins/feast-snowflake)
28+
* [x] [Trino (communiuty plugin)](https://github.com/Shopify/feast-trino)
2929
* **Online Stores**
3030
* [x] [DynamoDB](https://docs.feast.dev/reference/online-stores/dynamodb)
3131
* [x] [Redis](https://docs.feast.dev/reference/online-stores/redis)
@@ -43,12 +43,12 @@ The list below contains the functionality that contributors are planning to deve
4343
* [ ] Streaming ingestion on GCP
4444
* **Feature Engineering**
4545
* [x] On-demand Transformations (Alpha release. See [RFC](https://docs.google.com/document/d/1lgfIw0Drc65LpaxbUu49RCeJgMew547meSJttnUqz7c/edit#))
46-
* [ ] Batch transformation (SQL)
46+
* [ ] Batch transformation (SQL. In progress. See [RFC](https://docs.google.com/document/d/1964OkzuBljifDvkV-0fakp2uaijnVzdwWNGdz7Vz50A/edit))
4747
* [ ] Streaming transformation
4848
* **Deployments**
4949
* [x] AWS Lambda (Alpha release. See [RFC](https://docs.google.com/document/d/1eZWKWzfBif66LDN32IajpaG-j82LSHCCOzY6R7Ax7MI/edit))
50+
* [x] Kubernetes (See [guide](https://docs.feast.dev/how-to-guides/running-feast-in-production#4.3.-java-based-feature-server-deployed-on-kubernetes))
5051
* [ ] Cloud Run
51-
* [ ] Kubernetes
5252
* [ ] KNative
5353
* **Feature Serving**
5454
* [x] Python Client
@@ -59,17 +59,16 @@ The list below contains the functionality that contributors are planning to deve
5959
* [ ] Go Client
6060
* [ ] Delete API
6161
* [ ] Feature Logging (for training)
62-
* **Data Quality Management**
63-
* [ ] Data profiling and validation (Great Expectations) (Planned for Q4 2021)
62+
* **Data Quality Management (See [RFC](https://docs.google.com/document/d/110F72d4NTv80p35wDSONxhhPBqWRwbZXG4f9mNEMd98/edit))**
63+
* [ ] Data profiling and validation (Great Expectations) (Planned for Q1 2022)
6464
* [ ] Metric production
6565
* [ ] Training-serving skew detection
6666
* [ ] Drift detection
67-
* [ ] Alerting
6867
* **Feature Discovery and Governance**
6968
* [x] Python SDK for browsing feature registry
7069
* [x] CLI for browsing feature registry
7170
* [x] Model-centric feature tracking (feature services)
7271
* [ ] REST API for browsing feature registry
73-
* [ ] Feast Web UI (Planned for Q4 2021)
72+
* [ ] Feast Web UI
7473
* [ ] Feature versioning
7574
* [ ] Amundsen integration

0 commit comments

Comments
 (0)