Mirroring repos/proxy server #67

New Issue

Jef Roosens · 2022-02-04T17:43:32+01:00

Jef Roosens commented

2022-02-04 17:43:32 +01:00

The option to mirror a repo, optionally while specifying a regex expression that matches package names or architectures, might be useful to implement. A periodic re-sync might allow us to install a vieter server in our local netwokr & use it as a proxy or something.

Jef Roosens added the

enhancement

label 2022-02-04 17:43:32 +01:00

Jef Roosens added

idea

and removed

enhancement

labels 2022-02-04 23:42:45 +01:00

Jef Roosens commented

2022-12-28 23:41:49 +01:00

Poster

I've brainstormed this a bit just now.

The mirroring server could simply poll the main Vieter server every n minutes, just like the agents. The Vieter server could expose an endpoint that lists what packages in specific repositories/arch-repositories have changed since a given timestamp. The mirroring server would then only have to pull down these packages.

The mirror server implementation itself could simply use the existing repo implementation. The only complexity would be implementing streaming downloads, as vlib does not currently support this.

I've brainstormed this a bit just now. The mirroring server could simply poll the main Vieter server every n minutes, just like the agents. The Vieter server could expose an endpoint that lists what packages in specific repositories/arch-repositories have changed since a given timestamp. The mirroring server would then only have to pull down these packages. The mirror server implementation itself could simply use the existing repo implementation. The only complexity would be implementing streaming downloads, as vlib does not currently support this.

Sign in to join this conversation.