Mercurial > code > home > repos > sco-bot
comparison scobot/index/build_index_flow.py @ 15:6ed25bcaaf1f
add prefect and rebuild flow to k8s
| author | drewp@bigasterisk.com |
|---|---|
| date | Fri, 19 Jul 2024 00:30:47 -0700 |
| parents | b9c2b7fedbcd |
| children | 7a87ba2f00d9 |
comparison
equal
deleted
inserted
replaced
| 14:b9c2b7fedbcd | 15:6ed25bcaaf1f |
|---|---|
| 89 def buildIndex(): | 89 def buildIndex(): |
| 90 global log | 90 global log |
| 91 log = get_run_logger() | 91 log = get_run_logger() |
| 92 scobot.index.access.log = log | 92 scobot.index.access.log = log |
| 93 | 93 |
| 94 index = SearchIndex(Path('data/index')) | 94 index = SearchIndex(Path('data/build/index0')) |
| 95 for url in meetingListUrls(): | 95 for url in meetingListUrls(): |
| 96 mtgs = cast(list[MeetingRow], getCityMutableJson(url)) | 96 mtgs = cast(list[MeetingRow], getCityMutableJson(url)) |
| 97 log.info(f'got {len(mtgs)=}') | 97 log.info(f'got {len(mtgs)=}') |
| 98 | 98 |
| 99 for mtg in mtgs: | 99 for mtg in mtgs: |