Skip to content

Latest commit

 

History

History
34 lines (25 loc) · 922 Bytes

README.md

File metadata and controls

34 lines (25 loc) · 922 Bytes
Raw

web-archiver

A tiny Python clone of https://archive.org/web/ for your own personal websites.

To use simply install

$ pip install -r requirements.txt

and then add your sites into the file sites. Then to run just used

$ python run.py

To check out your files, goto the output directory and use

$ python3 -m http.server

To-do

  • Archive site with wget --recursive --no-clobber --page-requisites --html-extension --convert-links --restrict-file-names=windows --domains DOMAIN.COM http://DOMAIN.COM/ with date
  • Take screenshot with
from selenium import webdriver

browser = webdriver.Firefox()
browser.get('http://www.google.com/')
browser.save_screenshot('screenshot.png')
browser.quit()
  • Generate site to be able to traverse the sites easily. Index page for all pages. One index page for each web archive with screenshots/dates that take you to the actual page.