overdrives/chambersbr
1
0
Fork 0
Code Issues 51 Pull requests 1 Projects 1 Releases Packages Wiki Activity Actions

Split syncer from web app #139

New issue
Closed
opened 2026-09-12 19:46:32 +00:00 by aniram · 1 comment
aniram commented 2026-09-12 19:46:32 +00:00
Owner
Copy link

Right now the web app's main.go is polluted with flags for the syncer.
The syncer should be a separate project, maybe a module inside the web app or ideally have its own repository.
The models must be exported and utils like exponentialBackoff and currentLegislature too. CurrentLegislature and exponentialBackoff are needed in the chamber's poll parser also.

Right now the web app's main.go is polluted with flags for the syncer. The syncer should be a separate project, maybe a module inside the web app or ideally have its own repository. The models must be exported and utils like exponentialBackoff and currentLegislature too. CurrentLegislature and exponentialBackoff are needed in the chamber's poll parser also.
aniram added this to the 2027.1 milestone 2026-09-12 20:21:04 +00:00
aniram changed title from Split syncer from the web app to Split syncer from web app 2026-10-07 10:48:24 +00:00
aniram commented 2026-10-07 11:54:02 +00:00
Author
Owner
Copy link

Migration path

  1. Move current main.go to cmd/web/main.go (strip the sync code).
  2. Create cmd/syncer/ and move the flag logic there, converting one flag at a time into a command.
  3. Update your Dockerfile/Makefile/CI to build both binaries.
  4. Update whatever invokes the syncer (cron, systemd, scripts) from ./app -syncPolls -year=2024 to ./syncer polls --year=2024.

TODOs

Migration path 1. Move current main.go to cmd/web/main.go (strip the sync code). 2. Create cmd/syncer/ and move the flag logic there, converting one flag at a time into a command. 3. Update your Dockerfile/Makefile/CI to build both binaries. 4. Update whatever invokes the syncer (cron, systemd, scripts) from ./app -syncPolls -year=2024 to ./syncer polls --year=2024. TODOs - [x] Extract Config into internal/config (overdrives/chambersbr#157) - [x] Move the web server into cmd/web and remove all sync code from it (overdrives/chambersbr#158) - [x] Move template FuncMap and date helpers out of main into a dedicated package (overdrives/chambersbr#159) - [x] Extract route registration and dependency wiring into internal/server (overdrives/chambersbr#160) - [x] Use http.Server with timeouts, handle ListenAndServe errors, and shut down gracefully (overdrives/chambersbr#161) - [x] Create cmd/syncer entrypoint with a single shared setup (DB, log file, logger, syncer) (overdrives/chambersbr#162) - [x] Implement the subcommand dispatcher (overdrives/chambersbr#163) - [x] Port sync commands to the new CLI, grouped by domain (overdrives/chambersbr#164) - [x] Make sync failures return a non-zero exit code (overdrives/chambersbr#165) - [x] Pass context.Context through syncer methods and HTTP calls to government APIs (overdrives/chambersbr#166) - [x] Update scripts and cron/systemd to use the two binaries and the new syncer commands (overdrives/chambersbr#167) - [ ] Add tests for syncer command parsing and dispatch (overdrives/chambersbr#168)
aniram added reference feat/split-syncer-from-main-app 2026-10-12 15:38:35 +00:00
Sign in to join this conversation.
feat/split-syncer-from-main-app
Branches Tags
Clear current reference
main
feat/split-syncer-from-main-app
feat/sync-quota-exp-through-etag
feat/add-sync-of-deputies-from-JSON-API
fix/show-amendments-sum-in-detail-page
fix/refine-amendment-author-match
fix/amendments-csv-changes-unpredictably
feature/deputy-page
feature/search-proposition-with-filters
feature/design-system
fix/sync-propositions-with-dates-from-future
fix/show-history-with-db-data
fix/history-sync-http-errors
feature/sync-history
feature/cache-system
feature/refactor-dialog-background-and-go-variable-names
feature/create-acceptance-tests
feature/change-navigation-icons-and-titles
fix/project-was-associated-to-wrong-author
feature/redesign-ui
feature/add-template-blocks
feature/add-template-subfolders
feature/add-template-end-tags
feature/validate-html
feature/create-html-verification-server
feature/show-project-detail
backup/feature/show-project-detail
feat/use-virtual-keyboard-api
fix/browser-issues-input-field
feature/loading-spinner-htmx
feature/projects-pagination
feature/change-license
feature/project-pdf-link
feature/author-avatar-cached
feature/fetch-projects-by-keyword
fix/slow-page-load-due-to-authors-info-requests
fix/author-name-party-not-displayed
Clear current reference
No results found.
Labels
Clear labels
  
Agent/Chrome-Android

   
Agent/Chrome-Desktop

   
Agent/Chrome-iOS

   
Agent/Firefox-Android

   
Agent/Firefox-Desktop

   
Agent/Firefox-iOS

   
Agent/Safari-Desktop

   
Agent/Safari-iOS

   
Code/Backend

   
Code/DB

   
Code/DevOps

   
Code/Frontend

   
Compat/Breaking
Breaking change that won't be backward compatible

  
Kind/Bug
Something is not working

  
Kind/Documentation
Documentation changes

  
Kind/Enhancement
Improve existing functionality

  
Kind/Feature
New functionality

  
Kind/Security
This is security issue

  
Kind/Testing
Issue or pull request related to testing

  
Priority
Critical
 The priority is critical

  
Priority
High
 The priority is high

  
Priority
Low
 The priority is low

  
Priority
Medium
 The priority is medium

  
Reviewed
Confirmed
 Issue has been confirmed

  
Reviewed
Duplicate
 This issue or pull request already exists

  
Reviewed
Invalid
 Invalid issue

  
Reviewed
Won't Fix
 This issue won't be fixed

  
Status
Abandoned
 Somebody has started to work on this but abandoned work

  
Status
Blocked
 Something is blocking this issue or pull request

  
Status
Need More Info
 Feedback is required to reproduce issue or to continue work

No labels
Agent/Chrome-Android
Agent/Chrome-Desktop
Agent/Chrome-iOS
Agent/Firefox-Android
Agent/Firefox-Desktop
Agent/Firefox-iOS
Agent/Safari-Desktop
Agent/Safari-iOS
Code/Backend
Code/DB
Code/DevOps
Code/Frontend
Compat/Breaking
Kind/Bug
Kind/Documentation
Kind/Enhancement
Kind/Feature
Kind/Security
Kind/Testing
Priority
Critical
Priority
High
Priority
Low
Priority
Medium
Reviewed
Confirmed
Reviewed
Duplicate
Reviewed
Invalid
Reviewed
Won't Fix
Status
Abandoned
Status
Blocked
Status
Need More Info
Milestone
Clear milestone
No items
No milestone
2027.1
Projects
Clear projects
No items
No project
Release 2027.1
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
overdrives/chambersbr#139
No description provided.