Skip to content

two containers and connect to kafka #21

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 19 commits into
base: main
Choose a base branch
from
Open

two containers and connect to kafka #21

Changes from 1 commit
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
43f0449
two containers
womullan Aug 19, 2024
409ffea
docker build paramter name change to file
womullan Aug 19, 2024
50127cf
smaller image for docker
womullan Aug 20, 2024
08065e4
remove dash from comsume-kafka
womullan Sep 2, 2024
210ad74
change weekly on the Docker file
womullan Feb 27, 2025
e8b15d7
simplify consume, py 3.13
womullan Mar 19, 2025
e240f70
Test for 24h schedule format - includes insert but not replace
womullan Mar 28, 2025
1429534
pkl test file
womullan Apr 1, 2025
ebfa127
kafkit
womullan Apr 1, 2025
2a5f6f2
Fix kafkit call to use AIOkafkaConsuer, sqlite directly for 24h
womullan Apr 2, 2025
033f10b
no sasl_jaas_config
womullan Apr 4, 2025
09e2d52
with gcc in consumekafka because rubin-sim needs it, fix for async t…
womullan Apr 7, 2025
99c7cf7
set up logers
womullan Apr 23, 2025
c1f614f
with code to update schedule
womullan Apr 29, 2025
120de56
quotes
womullan May 6, 2025
ec21f0e
better queries
womullan May 7, 2025
c8dabb3
Floats for t_min and t_max
womullan May 7, 2025
7a1c79e
Tests using async sqllite - ocassional infinte loop removed
womullan Jun 4, 2025
5ec0a16
Fix times in client
womullan Jun 11, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
smaller image for docker
  • Loading branch information
@womullan
womullan committed Aug 20, 2024
commit 50127cf29b9c694b12a5f2303c798c4ce577a2ab
4 changes: 2 additions & 2 deletions Dockerfile.consume-kafka
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
ENV OBS_LSST_VERSION=${OBS_LSST_VERSION:-w_2024_06}
FROM FROM lsstsqre/centos:7-stack-lsst_distrib-${OBS_LSST_VERSION}
ARG OBS_LSST_VERSION=w_2024_21
FROM lsstsqre/centos:7-stack-lsst_distrib-${OBS_LSST_VERSION}
USER lsst

RUN source loadLSST.bash && mamba install aiokafka httpx
Expand Down
Loading