Visitar URL original
feat: Clickhouse offline store by iamhatesz · Pull Request #4725 · feast-dev/feast · GitHub
Skip to content

feat: Clickhouse offline store #4725

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
franciscojavierarceo merged 25 commits into from
Mar 12, 2025
Merged

feat: Clickhouse offline store #4725

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
aa2c839
Clickhouse offline store - initial working version
iamhatesz Oct 31, 2024
1d0417e
Remove untested `pull_all_from_table_or_query`
iamhatesz Oct 31, 2024
3af1889
Reorder functions
iamhatesz Oct 31, 2024
5d7f173
Remove commented line
iamhatesz Oct 31, 2024
9d9d24a
Fix frozen mypy errors
iamhatesz Oct 31, 2024
8207c44
mypy fixes; remove online source creator
iamhatesz Oct 31, 2024
7aa45d6
Remove commented code
iamhatesz Oct 31, 2024
803752f
Added docs
iamhatesz Oct 31, 2024
7fffc15
Python 3.9 deps
iamhatesz Oct 31, 2024
6e35db8
Python 3.10 deps
iamhatesz Oct 31, 2024
ca9d795
Python 3.11 deps (updated)
iamhatesz Oct 31, 2024
f8a8356
Remove unused ClickhouseOnlineStoreConfig
iamhatesz Oct 31, 2024
a8aa40b
Merge remote-tracking branch 'origin/master' into feast-clickhouse-of…
iamhatesz Feb 11, 2025
7ce7db1
Regenerate requirements.txt files
iamhatesz Feb 11, 2025
bcb90ca
Lint & format fixes
iamhatesz Feb 11, 2025
27a1e6f
Merge remote-tracking branch 'origin/master' into feast-clickhouse-of…
iamhatesz Mar 6, 2025
80bf5d7
Regenerate requirements.txt files
iamhatesz Mar 6, 2025
53839a8
Add clickhouse to pyproject.toml
iamhatesz Mar 7, 2025
9872944
Fix dependencies
iamhatesz Mar 7, 2025
e8e65b1
Simplify names
iamhatesz Mar 7, 2025
c0f19b2
Skip problematic Clickhouse tests
iamhatesz Mar 7, 2025
2d69427
format & lint
iamhatesz Mar 7, 2025
d5c5083
Merge remote-tracking branch 'origin/master' into feast-clickhouse-of…
iamhatesz Mar 12, 2025
3258903
Post-merge `make lock-python-dependencies-all`
iamhatesz Mar 12, 2025
df6ad54
Pin torch to 2.2.2
iamhatesz Mar 12, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge remote-tracking branch 'origin/master' into feast-clickhouse-of… 
…fline-store

# Conflicts:
#	sdk/python/requirements/py3.10-ci-requirements.txt
#	sdk/python/requirements/py3.11-ci-requirements.txt
#	sdk/python/requirements/py3.9-ci-requirements.txt
  • Loading branch information
@iamhatesz
iamhatesz committed Mar 12, 2025
commit d5c508345a2f0bffe5c8b06844ff9d61cacae354
25 changes: 9 additions & 16 deletions sdk/python/requirements/py3.10-ci-requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -96,7 +96,6 @@ cassandra-driver==3.29.2
# via feast (setup.py)
certifi==2025.1.31
# via
# clickhouse-connect
# docling
# elastic-transport
# httpcore
Expand Down Expand Up @@ -127,8 +126,6 @@ click==8.1.8
# pip-tools
# typer
# uvicorn
clickhouse-connect==0.8.15
# via feast (setup.py)
cloudpickle==3.1.1
# via dask
colorama==0.4.6
Expand Down Expand Up @@ -311,6 +308,8 @@ googleapis-common-protos[grpc]==1.69.1
# grpcio-status
great-expectations==0.18.22
# via feast (setup.py)
greenlet==3.1.1
# via sqlalchemy
grpc-google-iam-v1==0.14.1
# via google-cloud-bigtable
grpcio==1.70.0
Expand Down Expand Up @@ -514,9 +513,7 @@ lxml==5.3.1
# python-docx
# python-pptx
lz4==4.4.3
# via
# clickhouse-connect
# trino
# via trino
makefun==1.15.6
# via great-expectations
markdown-it-py==3.0.0
Expand Down Expand Up @@ -921,7 +918,6 @@ python-pptx==1.0.2
# via docling
pytz==2025.1
# via
# clickhouse-connect
# great-expectations
# ibis-framework
# pandas
Expand Down Expand Up @@ -1104,7 +1100,7 @@ starlette==0.46.0
# via fastapi
substrait==0.23.0
# via ibis-substrait
sympy==1.13.1
sympy==1.13.3
# via torch
tabulate==0.9.0
# via
Expand All @@ -1125,7 +1121,7 @@ tifffile==2025.2.18
# via scikit-image
tinycss2==1.4.0
# via bleach
tokenizers==0.21.0
tokenizers==0.19.1
# via transformers
toml==0.10.2
# via feast (setup.py)
Expand All @@ -1147,14 +1143,14 @@ toolz==0.12.1
# dask
# ibis-framework
# partd
torch==2.6.0
torch==2.2.2
# via
# feast (setup.py)
# docling-ibm-models
# easyocr
# safetensors
# torchvision
torchvision==0.21.0
torchvision==0.17.2
# via
# feast (setup.py)
# docling-ibm-models
Expand Down Expand Up @@ -1193,7 +1189,7 @@ traitlets==5.14.3
# nbclient
# nbconvert
# nbformat
transformers==4.49.0
transformers==4.42.4
# via
# docling-core
# docling-ibm-models
Expand Down Expand Up @@ -1285,7 +1281,6 @@ urllib3==2.3.0
# via
# feast (setup.py)
# botocore
# clickhouse-connect
# docker
# elastic-transport
# great-expectations
Expand Down Expand Up @@ -1344,6 +1339,4 @@ yarl==1.18.3
zipp==3.21.0
# via importlib-metadata
zstandard==0.23.0
# via
# clickhouse-connect
# trino
# via trino
25 changes: 9 additions & 16 deletions sdk/python/requirements/py3.11-ci-requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -94,7 +94,6 @@ cassandra-driver==3.29.2
# via feast (setup.py)
certifi==2025.1.31
# via
# clickhouse-connect
# docling
# elastic-transport
# httpcore
Expand Down Expand Up @@ -125,8 +124,6 @@ click==8.1.8
# pip-tools
# typer
# uvicorn
clickhouse-connect==0.8.15
# via feast (setup.py)
cloudpickle==3.1.1
# via dask
colorama==0.4.6
Expand Down Expand Up @@ -304,6 +301,8 @@ googleapis-common-protos[grpc]==1.69.1
# grpcio-status
great-expectations==0.18.22
# via feast (setup.py)
greenlet==3.1.1
# via sqlalchemy
grpc-google-iam-v1==0.14.1
# via google-cloud-bigtable
grpcio==1.70.0
Expand Down Expand Up @@ -507,9 +506,7 @@ lxml==5.3.1
# python-docx
# python-pptx
lz4==4.4.3
# via
# clickhouse-connect
# trino
# via trino
makefun==1.15.6
# via great-expectations
markdown-it-py==3.0.0
Expand Down Expand Up @@ -915,7 +912,6 @@ python-pptx==1.0.2
# via docling
pytz==2025.1
# via
# clickhouse-connect
# great-expectations
# ibis-framework
# pandas
Expand Down Expand Up @@ -1098,7 +1094,7 @@ starlette==0.46.0
# via fastapi
substrait==0.23.0
# via ibis-substrait
sympy==1.13.1
sympy==1.13.3
# via torch
tabulate==0.9.0
# via
Expand All @@ -1119,7 +1115,7 @@ tifffile==2025.2.18
# via scikit-image
tinycss2==1.4.0
# via bleach
tokenizers==0.21.0
tokenizers==0.19.1
# via transformers
toml==0.10.2
# via feast (setup.py)
Expand All @@ -1133,14 +1129,14 @@ toolz==0.12.1
# dask
# ibis-framework
# partd
torch==2.6.0
torch==2.2.2
# via
# feast (setup.py)
# docling-ibm-models
# easyocr
# safetensors
# torchvision
torchvision==0.21.0
torchvision==0.17.2
# via
# feast (setup.py)
# docling-ibm-models
Expand Down Expand Up @@ -1179,7 +1175,7 @@ traitlets==5.14.3
# nbclient
# nbconvert
# nbformat
transformers==4.49.0
transformers==4.42.4
# via
# docling-core
# docling-ibm-models
Expand Down Expand Up @@ -1265,7 +1261,6 @@ urllib3==2.3.0
# via
# feast (setup.py)
# botocore
# clickhouse-connect
# docker
# elastic-transport
# great-expectations
Expand Down Expand Up @@ -1324,6 +1319,4 @@ yarl==1.18.3
zipp==3.21.0
# via importlib-metadata
zstandard==0.23.0
# via
# clickhouse-connect
# trino
# via trino
26 changes: 10 additions & 16 deletions sdk/python/requirements/py3.9-ci-requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -98,7 +98,6 @@ cassandra-driver==3.29.2
# via feast (setup.py)
certifi==2025.1.31
# via
# clickhouse-connect
# docling
# elastic-transport
# httpcore
Expand Down Expand Up @@ -129,8 +128,6 @@ click==8.1.8
# pip-tools
# typer
# uvicorn
clickhouse-connect==0.8.15
# via feast (setup.py)
cloudpickle==3.1.1
# via dask
colorama==0.4.6
Expand Down Expand Up @@ -317,6 +314,8 @@ googleapis-common-protos[grpc]==1.69.1
# grpcio-status
great-expectations==0.18.22
# via feast (setup.py)
greenlet==3.1.1
# via sqlalchemy
grpc-google-iam-v1==0.14.1
# via google-cloud-bigtable
grpcio==1.70.0
Expand Down Expand Up @@ -527,9 +526,7 @@ lxml==5.3.1
# python-docx
# python-pptx
lz4==4.4.3
# via
# clickhouse-connect
# trino
# via trino
makefun==1.15.6
# via great-expectations
markdown-it-py==3.0.0
Expand Down Expand Up @@ -924,6 +921,7 @@ python-dotenv==1.0.1
# via
# environs
# pydantic-settings
# testcontainers
# uvicorn
python-json-logger==3.3.0
# via jupyter-events
Expand All @@ -933,7 +931,6 @@ python-pptx==1.0.2
# via docling
pytz==2025.1
# via
# clickhouse-connect
# great-expectations
# ibis-framework
# pandas
Expand Down Expand Up @@ -1116,7 +1113,7 @@ starlette==0.46.0
# via fastapi
substrait==0.23.0
# via ibis-substrait
sympy==1.13.1
sympy==1.13.3
# via torch
tabulate==0.9.0
# via
Expand All @@ -1137,7 +1134,7 @@ tifffile==2024.8.30
# via scikit-image
tinycss2==1.4.0
# via bleach
tokenizers==0.21.0
tokenizers==0.19.1
# via transformers
toml==0.10.2
# via feast (setup.py)
Expand All @@ -1159,14 +1156,14 @@ toolz==0.12.1
# dask
# ibis-framework
# partd
torch==2.6.0
torch==2.2.2
# via
# feast (setup.py)
# docling-ibm-models
# easyocr
# safetensors
# torchvision
torchvision==0.21.0
torchvision==0.17.2
# via
# feast (setup.py)
# docling-ibm-models
Expand Down Expand Up @@ -1205,7 +1202,7 @@ traitlets==5.14.3
# nbclient
# nbconvert
# nbformat
transformers==4.49.0
transformers==4.42.4
# via
# docling-core
# docling-ibm-models
Expand Down Expand Up @@ -1300,7 +1297,6 @@ urllib3==1.26.20
# via
# feast (setup.py)
# botocore
# clickhouse-connect
# docker
# elastic-transport
# great-expectations
Expand Down Expand Up @@ -1360,6 +1356,4 @@ yarl==1.18.3
zipp==3.21.0
# via importlib-metadata
zstandard==0.23.0
# via
# clickhouse-connect
# trino
# via trino
You are viewing a condensed version of this merge commit. You can view the full changes here.