Repository navigation
Commit 5f1fa0d
feat: Add enabled/disabled toggle for feature views (#6401)
* feat: Add enabled/disabled toggle for feature views
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* feat: Add demo noteboooks for users
Signed-off-by: ntkathole <nikhilkathole2683@gmail.com>
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* feat: Add CLI enable/disable commands and registry metadata support
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* Added features
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* fix(compute-engine/local): Honor field_mapping on join keys in dedup + join nodes (#6395)
* fix: Apply field mapping to join keys in local compute engine nodes
When a batch source defines a `field_mapping` that renames an entity join
key (e.g. `USERID` -> `user_id`), the source-read node renames the columns
on the pulled Arrow table to their mapped names. Downstream `LocalDedupNode`
and `LocalJoinNode` then look up the *pre-mapping* names from
`column_info.join_keys`, which raises `KeyError: Index(['USERID'])` during
materialization (or returns an empty join).
Add a `join_keys_columns` property on `ColumnInfo` that mirrors the existing
`timestamp_column` / `created_timestamp_column` properties — returning join
keys translated through `field_mapping` — and use it from the dedup and
join nodes.
Fixes #5942.
Signed-off-by: 1fanwang <1fannnw@gmail.com>
* test: also cover LocalJoinNode field_mapping case
Signed-off-by: 1fanwang <1fannnw@gmail.com>
---------
Signed-off-by: 1fanwang <1fannnw@gmail.com>
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* feat: Add Prometheus gauges for FeatureStore installation telemetry (#6354)
Signed-off-by: ntkathole <nikhilkathole2683@gmail.com>
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* docs: Rename Atlas Vector Search to MongoDB Vector Search and fix code examples
Signed-off-by: jvincent-mongodb <jeffrey.vincent@mongodb.com>
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* feat(dynamodb): Use ProjectionExpression when requested_features is set
The requested_features parameter was accepted by online_read and
online_read_async but never used -- DynamoDB always fetched all
features stored in the values map regardless. Add a
ProjectionExpression to BatchGetItem requests when requested_features
is provided, reducing data transfer, latency, and read costs.
Fixes #6058
Signed-off-by: Jonathan Wrede <wrede.jonathan00@gmail.com>
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* fix(dynamodb): Fix mypy type for _build_projection_expression return
The return dict contains both str and Dict[str, str] values, so the
return type must be Dict[str, Any] not Dict[str, str].
Signed-off-by: Jonathan Wrede <wrede.jonathan00@gmail.com>
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* fix(bigquery): Enable list inference for parquet loads in offline_write_batch
When pushing features with array/list types (e.g. STRING_LIST) to
BigQuery via offline_write_batch, the data arrives as empty arrays
because BigQuery's parquet loader does not infer list structure by
default. Set parquet_options.enable_list_inference = True on the
LoadJobConfig so array columns are written correctly.
Fixes #5845
Signed-off-by: Jonathan Wrede <wrede.jonathan00@gmail.com>
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* fix(trino): Clean up temporary entity tables after retrieval (#6381)
* fix(trino): Clean up temporary entity tables after retrieval
TrinoOfflineStore.get_historical_features() creates a temporary table
for the entity DataFrame but never drops it, leaking tables
indefinitely. Apply the same context manager pattern used by
BigQuery, Redshift, and Athena offline stores: wrap the query in a
generator that issues DROP TABLE IF EXISTS in a finally block.
Fixes #6306
Signed-off-by: Jonathan Wrede <wrede.jonathan00@gmail.com>
* fix: sort imports for ruff compliance
Signed-off-by: Jonathan Wrede <wrede.jonathan00@gmail.com>
* fix: decouple temp table cleanup from query access
Avoid dropping the temporary entity table on to_sql() calls.
Previously, every method used a context manager that dropped
the table on exit, so calling to_sql() before to_df() would
destroy the table and cause subsequent queries to fail.
Now the query is stored as a plain string and cleanup is
handled by a dedicated _drop_temp_table() method called only
after query execution (to_df, to_trino). A __del__ fallback
ensures cleanup if execution methods are never called. The
_cleaned_up flag makes the drop idempotent.
Signed-off-by: Jonathan Wrede <wrede.jonathan00@gmail.com>
---------
Signed-off-by: Jonathan Wrede <wrede.jonathan00@gmail.com>
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* feat(bigquery): Support DATE-type event timestamp columns (#6362)
* feat(bigquery): Support DATE-type event timestamp columns
When the event_timestamp column in BigQuery is a DATE type, the
generated SQL wraps comparison values in TIMESTAMP(), causing a type
mismatch error. This adds a timestamp_field_type parameter to
BigQuerySource that, when set to "DATE", generates DATE() comparisons
instead.
Closes #2530 (part 2)
Signed-off-by: Jonathan Wrede <wrede.jonathan00@gmail.com>
* fix(bigquery): Use protobuf 4.25.x compatible generated code
The proto files were regenerated with protobuf 6.31.1 / grpcio-tools
1.80.0, which imports runtime_version -- a module that does not exist
in protobuf 4.25.x used by the project. Revert generated code to
4.25.1 format while keeping the new timestamp_field_type field.
Signed-off-by: Jonathan Wrede <wrede.jonathan00@gmail.com>
* fix(bigquery): Add Literal type annotation for cast_style
Mypy infers str from the ternary expression; annotate with the
exact Literal union so the call to get_timestamp_filter_sql passes
type checking.
Signed-off-by: Jonathan Wrede <wrede.jonathan00@gmail.com>
* fix: Make timestamp_field_type default to None in FeatureViewQueryContext
Callers that do not use DATE-typed timestamp fields (e.g. Spark offline
store tests) should not be forced to pass timestamp_field_type. Adding
a default keeps the new field backward-compatible.
Signed-off-by: Jonathan Wrede <wrede.jonathan00@gmail.com>
* fix: Keep timestamp_field_type required in FeatureViewQueryContext
A default value on timestamp_field_type breaks the
SparkFeatureViewQueryContext subclass because its non-default fields
(min_date_partition, max_date_partition) would follow a field with a
default. Instead, keep it required and update the Spark test to pass it.
Signed-off-by: Jonathan Wrede <wrede.jonathan00@gmail.com>
* fix: regenerate protos matching upstream mypy-protobuf style
Reset all non-DataSource generated files to match master.
Only DataSource_pb2.py and DataSource_pb2.pyi contain our
timestamp_field_type additions (field 28). The .pyi stub
is hand-edited to match the existing import style used on
master.
Signed-off-by: Jonathan Wrede <wrede.jonathan00@gmail.com>
---------
Signed-off-by: Jonathan Wrede <wrede.jonathan00@gmail.com>
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* fix: Fixes for ray source
Signed-off-by: ntkathole <nikhilkathole2683@gmail.com>
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* feat: Expose registry endpoints on feature server for MCP access
Mount the existing REST registry routers under /registry on the feature
server so that fastapi_mcp automatically exposes registry introspection
(list/get for entities, feature views, data sources, feature services,
permissions, projects, saved datasets, lineage, search) as MCP tools.
The RegistryServer is created in-process from store.registry — no
external registry server is required. Auth is enforced via
inject_user_details on every mounted router.
Made-with: Cursor
Signed-off-by: Chaitany patel <patelchaitany93@gmail.com>
Made-with: Cursor
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* fix: Revert state propagation to always update in _update_metadata_fields
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* fix: Recompile protos for protobuf 4.x compatibility and fix state machine to be opt-in
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* feat: Add unit tests for state machine and clean up lazy imports in registry
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* fix: Address review comments for feature view state management
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* fix: Resolve integration test failures in apply loop
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* fix: Resolve integration test failures in apply loop
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* Apply suggestion from @ntkathole
Co-authored-by: Nikhil Kathole <nikhilkathole2683@gmail.com>
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* fix: Resolve review comments for feature_store
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* fix: Resolve review comments for feature_views.py
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* feat: Add FeatureStore methods and update describe for enabled/state
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* fix: Add type: ignore comments for mypy on BaseFeatureView attr access
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
* fix: Remove REST API endpoints for enable/disable/set-state (deferred to follow-up PR)
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
---------
Signed-off-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
Signed-off-by: ntkathole <nikhilkathole2683@gmail.com>
Signed-off-by: 1fanwang <1fannnw@gmail.com>
Signed-off-by: jvincent-mongodb <jeffrey.vincent@mongodb.com>
Signed-off-by: Jonathan Wrede <wrede.jonathan00@gmail.com>
Signed-off-by: Chaitany patel <patelchaitany93@gmail.com>
Co-authored-by: RutujaPathade <73137503+RutujaPathade@users.noreply.github.com>
Co-authored-by: ntkathole <nikhilkathole2683@gmail.com>
Co-authored-by: Stefan Wang <1fannnw@gmail.com>
Co-authored-by: jvincent-mongodb <jeffrey.vincent@mongodb.com>
Co-authored-by: Jonathan Wrede <wrede.jonathan00@gmail.com>
Co-authored-by: Jwrede <62910358+Jwrede@users.noreply.github.com>
Co-authored-by: Chaitany patel <patelchaitany93@gmail.com>1 parent c9ae2b4 commit 5f1fa0d
46 files changed
Lines changed: 5177 additions & 5062 deletions
File tree
- protos/feast/core
- sdk/python
- feast
- cli
- infra/registry
- protos/feast
- core
- registry
- serving
- storage
- types
- tests/unit
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
28 | 28 | | |
29 | 29 | | |
30 | 30 | | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
31 | 51 | | |
32 | 52 | | |
33 | 53 | | |
| |||
100 | 120 | | |
101 | 121 | | |
102 | 122 | | |
| 123 | + | |
| 124 | + | |
| 125 | + | |
| 126 | + | |
| 127 | + | |
103 | 128 | | |
104 | 129 | | |
105 | 130 | | |
| |||
117 | 142 | | |
118 | 143 | | |
119 | 144 | | |
| 145 | + | |
| 146 | + | |
| 147 | + | |
120 | 148 | | |
121 | 149 | | |
122 | 150 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
80 | 80 | | |
81 | 81 | | |
82 | 82 | | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
83 | 88 | | |
84 | 89 | | |
85 | 90 | | |
| |||
94 | 99 | | |
95 | 100 | | |
96 | 101 | | |
| 102 | + | |
| 103 | + | |
| 104 | + | |
97 | 105 | | |
98 | 106 | | |
99 | 107 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
108 | 108 | | |
109 | 109 | | |
110 | 110 | | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
| 114 | + | |
| 115 | + | |
111 | 116 | | |
112 | 117 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
24 | 24 | | |
25 | 25 | | |
26 | 26 | | |
27 | | - | |
| 27 | + | |
28 | 28 | | |
29 | 29 | | |
30 | 30 | | |
| |||
53 | 53 | | |
54 | 54 | | |
55 | 55 | | |
| 56 | + | |
56 | 57 | | |
57 | 58 | | |
58 | 59 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
1 | 3 | | |
2 | 4 | | |
3 | 5 | | |
4 | 6 | | |
5 | 7 | | |
6 | 8 | | |
7 | | - | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
8 | 14 | | |
9 | 15 | | |
10 | 16 | | |
| |||
32 | 38 | | |
33 | 39 | | |
34 | 40 | | |
35 | | - | |
36 | | - | |
37 | | - | |
38 | | - | |
39 | | - | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
40 | 48 | | |
41 | 49 | | |
42 | 50 | | |
| |||
59 | 67 | | |
60 | 68 | | |
61 | 69 | | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
62 | 75 | | |
63 | 76 | | |
64 | 77 | | |
65 | 78 | | |
66 | 79 | | |
| 80 | + | |
| 81 | + | |
67 | 82 | | |
68 | 83 | | |
69 | 84 | | |
70 | 85 | | |
71 | 86 | | |
72 | | - | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
| 96 | + | |
| 97 | + | |
| 98 | + | |
| 99 | + | |
| 100 | + | |
| 101 | + | |
| 102 | + | |
| 103 | + | |
| 104 | + | |
| 105 | + | |
| 106 | + | |
| 107 | + | |
| 108 | + | |
| 109 | + | |
| 110 | + | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
| 120 | + | |
| 121 | + | |
| 122 | + | |
| 123 | + | |
| 124 | + | |
| 125 | + | |
| 126 | + | |
| 127 | + | |
| 128 | + | |
| 129 | + | |
| 130 | + | |
| 131 | + | |
| 132 | + | |
| 133 | + | |
| 134 | + | |
| 135 | + | |
| 136 | + | |
| 137 | + | |
| 138 | + | |
| 139 | + | |
| 140 | + | |
| 141 | + | |
| 142 | + | |
| 143 | + | |
| 144 | + | |
| 145 | + | |
| 146 | + | |
| 147 | + | |
| 148 | + | |
| 149 | + | |
| 150 | + | |
| 151 | + | |
| 152 | + | |
| 153 | + | |
| 154 | + | |
| 155 | + | |
| 156 | + | |
| 157 | + | |
| 158 | + | |
| 159 | + | |
| 160 | + | |
| 161 | + | |
| 162 | + | |
| 163 | + | |
| 164 | + | |
| 165 | + | |
| 166 | + | |
| 167 | + | |
| 168 | + | |
| 169 | + | |
| 170 | + | |
| 171 | + | |
| 172 | + | |
| 173 | + | |
| 174 | + | |
| 175 | + | |
| 176 | + | |
| 177 | + | |
| 178 | + | |
| 179 | + | |
| 180 | + | |
| 181 | + | |
| 182 | + | |
| 183 | + | |
| 184 | + | |
| 185 | + | |
| 186 | + | |
| 187 | + | |
| 188 | + | |
| 189 | + | |
| 190 | + | |
| 191 | + | |
| 192 | + | |
73 | 193 | | |
74 | 194 | | |
75 | 195 | | |
| |||
0 commit comments