Added category selection
parent
2518a0dfc2
commit
97778df3f8
13
README.md
13
README.md
|
@ -3,7 +3,12 @@
|
||||||
A Python script to scrape wallpapers from https://4kwallpapers.com/.
|
A Python script to scrape wallpapers from https://4kwallpapers.com/.
|
||||||
|
|
||||||
## Usage
|
## Usage
|
||||||
The program takes a single command line argument, namely the root folder of
|
The program takes one or more arguments. The first argument is the path to the
|
||||||
whre you want all the pictures to go. It'll create sub-folders for all the
|
download directory; this is where the pictures will end up. Each category
|
||||||
categories, and download all pictures in one go. Yes, this can take a while
|
creates a subdirectory for itself.
|
||||||
(15m in my case, with a fast internet connection).
|
|
||||||
|
Any arguments following the path correspond to category names. This allows you
|
||||||
|
to only download certain categories.
|
||||||
|
|
||||||
|
Do note that a full download can take a while: upwards of 15 minutes on a fast
|
||||||
|
internet connection.
|
||||||
|
|
11
scraper.py
11
scraper.py
|
@ -68,8 +68,9 @@ class Scraper(PageHandler):
|
||||||
def images(self):
|
def images(self):
|
||||||
return sum([cat.images for cat in self.categories], [])
|
return sum([cat.images for cat in self.categories], [])
|
||||||
|
|
||||||
def download(self, dir_path):
|
def download(self, dir_path, cats=None):
|
||||||
for cat in self.categories:
|
for cat in self.categories:
|
||||||
|
if cats and cat.name in cats:
|
||||||
cat.download(dir_path)
|
cat.download(dir_path)
|
||||||
|
|
||||||
|
|
||||||
|
@ -155,4 +156,12 @@ class Image(PageHandler):
|
||||||
|
|
||||||
if __name__ == "__main__":
|
if __name__ == "__main__":
|
||||||
scraper = Scraper()
|
scraper = Scraper()
|
||||||
|
|
||||||
|
if len(sys.argv) == 1:
|
||||||
|
print("No path provided.")
|
||||||
|
|
||||||
|
elif len(sys.argv) == 2:
|
||||||
scraper.download(sys.argv[1])
|
scraper.download(sys.argv[1])
|
||||||
|
|
||||||
|
else:
|
||||||
|
scraper.download(sys.argv[1], sys.argv[2:])
|
||||||
|
|
Loading…
Reference in New Issue