Polling-based agent-server architecture #301

Merged

Jef Roosens merged 22 commits from Chewing_Bever/vieter:agent-server-polling into dev 2022-12-14 17:34:48 +01:00

Conversation 1 Commits 22 Files changed 26 +874 -68

Jef Roosens commented 2022-12-13 14:04:26 +01:00

Owner

Copy link

This PR converts Vieter into a server-agent architecture, with each agent periodically polling the server for jobs using HTTP requests.

I don't feel like diving into persistent connections between servers and agents right now, but I feel this system is a good compromise between simplicity and versatility.

The goal is to fully replace the old cron-based system.

Closes #300

This PR converts Vieter into a server-agent architecture, with each agent periodically polling the server for jobs using HTTP requests. I don't feel like diving into persistent connections between servers and agents right now, but I feel this system is a good compromise between simplicity and versatility. The goal is to fully replace the old cron-based system. Closes #300

Jef Roosens added the

enhancement

label 2022-12-13 14:04:26 +01:00

Jef Roosens added 12 commits 2022-12-13 14:04:27 +01:00

feat: start of agent code 6281ef7607

feat(build): start of server-side job queue 9a49d96e20

feat(server): initialize job queue on start; api endpoint for polling ... c57de4d8ee

jobs

feat(server): properly reschedule jobs after polling 0a5c4295e0

feat(agent): begin reforming for new api 5bab1f77f0

feat(agent): wrote ImageManager 7ef8d4b846

feat(agent): partially wrote daemon code 6f23d690a7

feat(agent): initial working version 3611123f45

feat(build): allowed invalidating entries in build queue 882a9a60a9

fix(build): change tests to use BuildConfig instead b6168a3060

fix(db): return correct id when adding targets e742d3de6d

feat(server): update job queue when adding, removing or updating targets 6342789921

Jef Roosens added 1 commit 2022-12-13 17:43:18 +01:00

feat(agent): clean up code a bit; add frequent polling when active 5cbfc0ebcb

Jef Roosens added 1 commit 2022-12-13 17:52:32 +01:00

chore: please the linter 03f2240ff6

Jef Roosens added 2 commits 2022-12-13 19:33:42 +01:00

refactor(build): remove some code duplication from queue d3151863ee

docs(agent): added agent configuration docs 8a2f720bdf

Jef Roosens added 3 commits 2022-12-13 22:03:27 +01:00

feat: add option to force-build package f6c5e7c246

feat: allow queueing one-time builds 6a208dbe6c

feat: queue one-time builds from CLI b3e26e5ffe

Jef Roosens force-pushed agent-server-polling from b3e26e5ffe to 2cc3e8404e 2022-12-13 23:32:02 +01:00 Compare

Jef Roosens added this to the 0.5.0 milestone 2022-12-14 15:18:38 +01:00

Jef Roosens changed title from WIP: polling-based agent-server architecture to Polling-based agent-server architecture 2022-12-14 15:57:50 +01:00

Jef Roosens added 1 commit 2022-12-14 16:04:15 +01:00

chore: please the great lint d7a04c6ebf

Jef Roosens commented 2022-12-14 16:04:50 +01:00

Author

Owner

Copy link

Gonna merge this PR prematurely. It's big enough already, and I need to test it in production anyways.

Gonna merge this PR prematurely. It's big enough already, and I need to test it in production anyways.

Jef Roosens added 1 commit 2022-12-14 16:33:58 +01:00

agent: some better logging 51df1874f5

Jef Roosens added 1 commit 2022-12-14 17:24:11 +01:00

chore: final read before merging 60cb91c18c

Jef Roosens merged commit bfe1aafcf1 into dev 2022-12-14 17:34:48 +01:00

Jef Roosens referenced this pull request from a commit 2022-12-14 17:34:49 +01:00

Merge pull request 'Polling-based agent-server architecture' (#301) from Chewing_Bever/vieter:agent-server-polling into dev

This repository is archived. You cannot comment on pull requests.

Reviewers

No reviewers

Labels

Clear labels   

Roadmap

Tracking issue for a larger task

  

V

This issue is blocked by a V issue

  

bug

Something is not working

  

docs

Something to add to the documentation

  

duplicate

This issue or pull request already exists

  

enhancement

New feature

  

good first issue

A good issue to start out with as a new contributor

  

help wanted

Need some help

  

idea

Issue for brainstorming a new idea

  

invalid

Something is wrong

  

question

More information is needed

  

wontfix

This won't be fixed

  

Idea

Issue for brainstorming a new idea

  

Roadmap

Tracking issue for a larger task

  

bug

Something is not working

  

duplicate

This issue or pull request already exists

  

enhancement

New feature

  

help wanted

Need some help

  

invalid

Something is wrong

  

question

More information is needed

  

wontfix

This won't be fixed

No labels

Roadmap

V

bug

docs

duplicate

enhancement

good first issue

help wanted

idea

invalid

question

wontfix

Idea

Roadmap

bug

duplicate

enhancement

help wanted

invalid

question

wontfix

Milestone

Clear milestone

No items

No milestone

0.5.0

Projects

Clear projects

No items

No project

Assignees

Clear assignees

No assignees

1 participant

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: vieter-v/vieter#301

No description provided.