Update roadmap to include Snowflake + Trino. Also fix docs + update FAQ (#2175)

* Update roadmap to include Snowflake + Trino. Also fix some Gitbook artifacts / bugs on feature server documentation and add FAQ question on mixing clouds in Feast

Signed-off-by: Danny Chiao <[email protected]>

* Fix readme by running compile-templates

Signed-off-by: Danny Chiao <[email protected]>

Author: adchia

README.md

@@ -142,7 +142,7 @@ The list below contains the functionality that contributors are planning to deve
   * [x] [Hive (community plugin)](https://github.com/baineng/feast-hive)
   * [x] [Postgres (community plugin)](https://github.com/nossrannug/feast-postgres)
   * [x] Kafka source (with [push support into the online store](reference/alpha-stream-ingestion.md))
-  * [ ] Snowflake source (Planned for Q4 2021)
+  * [x] [Snowflake source (community plugin)](https://github.com/sfc-gh-madkins/feast-snowflake)
   * [ ] HTTP source
 * **Offline Stores**
   * [x] [Redshift](https://docs.feast.dev/reference/offline-stores/redshift)
@@ -152,8 +152,8 @@ The list below contains the functionality that contributors are planning to deve
   * [x] [Postgres (community plugin)](https://github.com/nossrannug/feast-postgres)
   * [x] [In-memory / Pandas](https://docs.feast.dev/reference/offline-stores/file)
   * [x] [Custom offline store support](https://docs.feast.dev/how-to-guides/adding-a-new-offline-store)
-  * [ ] Snowflake (Planned for Q4 2021)
-  * [ ] Trino (Planned for Q4 2021)
+  * [x] [Snowflake (community plugin)](https://github.com/sfc-gh-madkins/feast-snowflake)
+  * [x] [Trino (communiuty plugin)](https://github.com/Shopify/feast-trino)
 * **Online Stores**
   * [x] [DynamoDB](https://docs.feast.dev/reference/online-stores/dynamodb)
   * [x] [Redis](https://docs.feast.dev/reference/online-stores/redis)
@@ -171,12 +171,12 @@ The list below contains the functionality that contributors are planning to deve
   * [ ] Streaming ingestion on GCP
 * **Feature Engineering**
   * [x] On-demand Transformations (Alpha release. See [RFC](https://docs.google.com/document/d/1lgfIw0Drc65LpaxbUu49RCeJgMew547meSJttnUqz7c/edit#))
-  * [ ] Batch transformation (SQL)
+  * [ ] Batch transformation (SQL. In progress. See [RFC](https://docs.google.com/document/d/1964OkzuBljifDvkV-0fakp2uaijnVzdwWNGdz7Vz50A/edit))
   * [ ] Streaming transformation
 * **Deployments**
   * [x] AWS Lambda (Alpha release. See [RFC](https://docs.google.com/document/d/1eZWKWzfBif66LDN32IajpaG-j82LSHCCOzY6R7Ax7MI/edit))
+  * [x] Kubernetes (See [guide](https://docs.feast.dev/how-to-guides/running-feast-in-production#4.3.-java-based-feature-server-deployed-on-kubernetes))
   * [ ] Cloud Run
-  * [ ] Kubernetes
   * [ ] KNative
 * **Feature Serving**
   * [x] Python Client
@@ -187,18 +187,17 @@ The list below contains the functionality that contributors are planning to deve
   * [ ] Go Client
   * [ ] Delete API
   * [ ] Feature Logging (for training)
-* **Data Quality Management**
-  * [ ] Data profiling and validation (Great Expectations) (Planned for Q4 2021)
+* **Data Quality Management (See [RFC](https://docs.google.com/document/d/110F72d4NTv80p35wDSONxhhPBqWRwbZXG4f9mNEMd98/edit))**
+  * [ ] Data profiling and validation (Great Expectations) (Planned for Q1 2022)
   * [ ] Metric production
   * [ ] Training-serving skew detection
   * [ ] Drift detection
-  * [ ] Alerting
 * **Feature Discovery and Governance**
   * [x] Python SDK for browsing feature registry
   * [x] CLI for browsing feature registry
   * [x] Model-centric feature tracking (feature services)
   * [ ] REST API for browsing feature registry
-  * [ ] Feast Web UI (Planned for Q4 2021)
+  * [ ] Feast Web UI
   * [ ] Feature versioning
   * [ ] Amundsen integration
 

docs/getting-started/faq.md

@@ -1,5 +1,11 @@
 # FAQ
 
+{% hint style="info" %}
+**Don't see your question?**
+
+We encourage you to ask questions on [Slack](https://slack.feast.dev) or [Github](https://github.com/feast-dev/feast). Even better, once you get an answer, add the answer to this FAQ via a [pull request](../project/development-guide.md)!
+{% endhint %}
+
 ## Getting started
 
 ### Do you have any examples of how Feast should be used?
@@ -44,7 +50,7 @@ Please see a detailed comparison of Feast vs. Tecton [here](https://www.tecton.a
 
 ### What are the performance/latency characteristics of Feast?
 
-Feast is designed to work at scale and support low latency online serving. Benchmarks to be released soon, and active work is underway to support very latency sensitive use cases.
+Feast is designed to work at scale and support low latency online serving. Benchmarks ([RFC](https://docs.google.com/document/d/12UuvTQnTTCJhdRgy6h10zSbInNGSyEJkIxpOcgOen1I/edit)) will be released soon, and active work is underway to support very latency sensitive use cases.
 
 ### Does Feast support embeddings and list features?
 
@@ -61,6 +67,10 @@ Yes. Specifically:
 
 The list of supported offline and online stores can be found [here](../reference/offline-stores/) and [here](../reference/online-stores/), respectively. The [roadmap](../roadmap.md) indicates the stores for which we are planning to add support. Finally, our Provider abstraction is built to be extensible, so you can plug in your own implementations of offline and online stores. Please see more details about custom providers [here](../how-to-guides/creating-a-custom-provider.md).
 
+### Does Feast support using different clouds for offline vs online stores?
+
+Yes. Using a GCP or AWS provider in `feature_store.yaml` primarily sets default offline / online stores and configures where the remote registry file can live (Using the AWS provider also allows for deployment to AWS Lambda). You can override the offline and online stores to be in different clouds if you wish.
+
 ### How can I add a custom online store?
 
 Please follow the instructions [here](../how-to-guides/adding-support-for-a-new-online-store.md).
@@ -100,10 +110,4 @@ For more details on contributing to the Feast community, see [here](../community
 
 ### What are the plans for Feast Core, Feast Serving, and Feast Spark?
 
-Feast Core and Feast Serving were both part of Feast Java. We plan to support Feast Serving. We will not support Feast Core; instead we will support our object store based registry. We will not support Feast Spark. For more details on what we plan on supporting, please see the [roadmap](../roadmap.md).
-
-{% hint style="info" %}
-**Don't see your question?**
-
-We encourage you to ask questions on [Slack](https://slack.feast.dev) or [Github](https://github.com/feast-dev/feast). Even better, once you get an answer, add the answer to this FAQ via a [pull request](../project/development-guide.md)!
-{% endhint %}
+Feast Core and Feast Serving were both part of Feast Java. We plan to support Feast Serving. We will not support Feast Core; instead we will support our object store based registry. We will not support Feast Spark. For more details on what we plan on supporting, please see the [roadmap](../roadmap.md).

docs/getting-started/quickstart.md

@@ -9,7 +9,7 @@ In this tutorial we will
 
 You can run this tutorial in Google Colab or run it on your localhost, following the guided steps below.
 
-![](../.gitbook/assets/colab\_logo\_32px.png)[**Run in Google Colab**](https://colab.research.google.com/github/feast-dev/feast/blob/master/examples/quickstart/quickstart.ipynb)****
+![](../.gitbook/assets/colab\_logo\_32px.png)[**Run in Google Colab**](https://colab.research.google.com/github/feast-dev/feast/blob/master/examples/quickstart/quickstart.ipynb)
 
 ## Overview
 

docs/getting-started/third-party-integrations.md

@@ -3,7 +3,7 @@
 We integrate with a wide set of tools and technologies so you can make Feast work in your existing stack. Many of these integrations are maintained as plugins to the main Feast repo.
 
 {% hint style="info" %}
-Don't see your offline store or online store of choice here? Check our our guides to make a custom one!
+Don't see your offline store or online store of choice here? Check out our guides to make a custom one!
 
 * [Adding a new offline store](../how-to-guides/adding-a-new-offline-store.md)
 * [Adding a new online store](../how-to-guides/adding-support-for-a-new-online-store.md)
@@ -20,7 +20,7 @@ Don't see your offline store or online store of choice here? Check our our guide
 * [x] [Hive (community plugin)](https://github.com/baineng/feast-hive)
 * [x] [Postgres (community plugin)](https://github.com/nossrannug/feast-postgres)
 * [x] Kafka source (with [push support into the online store](https://docs.feast.dev/reference/alpha-stream-ingestion))
-* [ ] Snowflake source (Planned for Q4 2021)
+* [x] [Snowflake source (community plugin)](https://github.com/sfc-gh-madkins/feast-snowflake)
 * [ ] HTTP source
 
 ### Offline Stores
@@ -32,8 +32,8 @@ Don't see your offline store or online store of choice here? Check our our guide
 * [x] [Postgres (community plugin)](https://github.com/nossrannug/feast-postgres)
 * [x] [In-memory / Pandas](https://docs.feast.dev/reference/offline-stores/file)
 * [x] [Custom offline store support](https://docs.feast.dev/how-to-guides/adding-a-new-offline-store)
-* [ ] Snowflake (Planned for Q4 2021)
-* [ ] Trino (Planned for Q4 2021)
+* [x] [Snowflake source (community plugin)](https://github.com/sfc-gh-madkins/feast-snowflake)
+* [x] [Trino (communiuty plugin)](https://github.com/Shopify/feast-trino)
 
 ### Online Stores
 
@@ -50,12 +50,11 @@ Don't see your offline store or online store of choice here? Check our our guide
 ### **Deployments**
 
 * [x] AWS Lambda (Alpha release. See [guide](../reference/alpha-aws-lambda-feature-server.md) and [RFC](https://docs.google.com/document/d/1eZWKWzfBif66LDN32IajpaG-j82LSHCCOzY6R7Ax7MI/edit))
+* [x] Kubernetes (See [guide](https://docs.feast.dev/how-to-guides/running-feast-in-production#4.3.-java-based-feature-server-deployed-on-kubernetes))
 * [ ] Cloud Run
-* [ ] Kubernetes
 * [ ] KNative
 
 
-
 ## Standards
 
 In order for a plugin integration to be highlighted on this page, it must meet the following requirements:

docs/reference/alpha-aws-lambda-feature-server.md

@@ -3,7 +3,7 @@
 **Warning**: This is an _experimental_ feature. It's intended for early testing and feedback, and could change without warnings in future releases.
 
 {% hint style="info" %}
-To enable this feature, run**`feast alpha enable aws_lambda_feature_server`**
+To enable this feature, run **`feast alpha enable aws_lambda_feature_server`**
 {% endhint %}
 
 ## Overview

docs/reference/feature-server.md

@@ -3,7 +3,7 @@
 **Warning**: This is an _experimental_ feature. It's intended for early testing and feedback, and could change without warnings in future releases.
 
 {% hint style="info" %}
-To enable this feature, run**`feast alpha enable python_feature_server`**
+To enable this feature, run **`feast alpha enable python_feature_server`**
 {% endhint %}
 
 ## Overview

docs/roadmap.md

@@ -14,7 +14,7 @@ The list below contains the functionality that contributors are planning to deve
   * [x] [Hive (community plugin)](https://github.com/baineng/feast-hive)
   * [x] [Postgres (community plugin)](https://github.com/nossrannug/feast-postgres)
   * [x] Kafka source (with [push support into the online store](reference/alpha-stream-ingestion.md))
-  * [ ] Snowflake source (Planned for Q4 2021)
+  * [x] [Snowflake source (community plugin)](https://github.com/sfc-gh-madkins/feast-snowflake)
   * [ ] HTTP source
 * **Offline Stores**
   * [x] [Redshift](https://docs.feast.dev/reference/offline-stores/redshift)
@@ -24,8 +24,8 @@ The list below contains the functionality that contributors are planning to deve
   * [x] [Postgres (community plugin)](https://github.com/nossrannug/feast-postgres)
   * [x] [In-memory / Pandas](https://docs.feast.dev/reference/offline-stores/file)
   * [x] [Custom offline store support](https://docs.feast.dev/how-to-guides/adding-a-new-offline-store)
-  * [ ] Snowflake (Planned for Q4 2021)
-  * [ ] Trino (Planned for Q4 2021)
+  * [x] [Snowflake (community plugin)](https://github.com/sfc-gh-madkins/feast-snowflake)
+  * [x] [Trino (communiuty plugin)](https://github.com/Shopify/feast-trino)
 * **Online Stores**
   * [x] [DynamoDB](https://docs.feast.dev/reference/online-stores/dynamodb)
   * [x] [Redis](https://docs.feast.dev/reference/online-stores/redis)
@@ -43,12 +43,12 @@ The list below contains the functionality that contributors are planning to deve
   * [ ] Streaming ingestion on GCP
 * **Feature Engineering**
   * [x] On-demand Transformations (Alpha release. See [RFC](https://docs.google.com/document/d/1lgfIw0Drc65LpaxbUu49RCeJgMew547meSJttnUqz7c/edit#))
-  * [ ] Batch transformation (SQL)
+  * [ ] Batch transformation (SQL. In progress. See [RFC](https://docs.google.com/document/d/1964OkzuBljifDvkV-0fakp2uaijnVzdwWNGdz7Vz50A/edit))
   * [ ] Streaming transformation
 * **Deployments**
   * [x] AWS Lambda (Alpha release. See [RFC](https://docs.google.com/document/d/1eZWKWzfBif66LDN32IajpaG-j82LSHCCOzY6R7Ax7MI/edit))
+  * [x] Kubernetes (See [guide](https://docs.feast.dev/how-to-guides/running-feast-in-production#4.3.-java-based-feature-server-deployed-on-kubernetes))
   * [ ] Cloud Run
-  * [ ] Kubernetes
   * [ ] KNative
 * **Feature Serving**
   * [x] Python Client
@@ -59,17 +59,16 @@ The list below contains the functionality that contributors are planning to deve
   * [ ] Go Client
   * [ ] Delete API
   * [ ] Feature Logging (for training)
-* **Data Quality Management**
-  * [ ] Data profiling and validation (Great Expectations) (Planned for Q4 2021)
+* **Data Quality Management (See [RFC](https://docs.google.com/document/d/110F72d4NTv80p35wDSONxhhPBqWRwbZXG4f9mNEMd98/edit))**
+  * [ ] Data profiling and validation (Great Expectations) (Planned for Q1 2022)
   * [ ] Metric production
   * [ ] Training-serving skew detection
   * [ ] Drift detection
-  * [ ] Alerting
 * **Feature Discovery and Governance**
   * [x] Python SDK for browsing feature registry
   * [x] CLI for browsing feature registry
   * [x] Model-centric feature tracking (feature services)
   * [ ] REST API for browsing feature registry
-  * [ ] Feast Web UI (Planned for Q4 2021)
+  * [ ] Feast Web UI
   * [ ] Feature versioning
   * [ ] Amundsen integration