Ivago: make populate_ivago remove deleted entries #34

New Issue

Open

opened 2021-04-17 23:09:37 +02:00 by Jef Roosens · 1 comment

Jef Roosens commented

2021-04-17 23:09:37 +02:00

Owner

The scraper currently constantly adds new entries, but doesn't remove old ones. This should be fixed.

The scraper currently constantly adds new entries, but doesn't remove old ones. This should be fixed.

Jef Roosens added the

label 2021-04-17 23:09:37 +02:00

Jef Roosens self-assigned this 2021-04-17 23:09:37 +02:00

Jef Roosens added a new dependency 2021-04-22 12:48:59 +02:00

#27 Ivago: scraper to populate search cache

Jef Roosens added this to the Fej 1.1.0 - The Calm before the Storm milestone 2021-04-22 12:49:43 +02:00

Jef Roosens added this to the Fej 1.1.0 project 2021-04-22 12:49:45 +02:00

Jef Roosens referenced this issue

2021-04-22 18:49:10 +02:00

Ivago: scraper to populate search cache #27

Jef Roosens commented

2021-04-22 18:49:48 +02:00

Poster

Owner

The best method will probably be to keep track of the last time a street name was inserted/update:

Auto-refresh the timestamp column when inserting/updating the table using a trigger
Each time the scraper is run, we delete any entries that are too old after the refresh

The best method will probably be to keep track of the last time a street name was inserted/update: * Auto-refresh the timestamp column when inserting/updating the table using a trigger * Each time the scraper is run, we delete any entries that are too old after the refresh

Jef Roosens added the

project/backend

label 2021-04-29 09:28:52 +02:00

Sign in to join this conversation.

No Label

project/backend

project/frontend

No Milestone

No project

No Assignees

1 Participants

Notifications

Due Date

The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Blocks

#27 Ivago: scraper to populate search cache

Chewing_Bever/fej

Reference: Chewing_Bever/fej#34

There is no content yet.