- https://inveniosoftware.org/gettingstarted/
- apt install cookiecutter pipenv docker-compose python3.6
- in /etc/sysctl.conf: vm.max_map_count=262144
- or: sysctl -w vm.max_map_count=262144
- apt install mkdocs
- mkdocs new lh92-index
- vi lh92-index/mkdocs.yml
- vi lh92-index/docs/index.md
- export collection in zotero as csv file
- python script generates sites with markdown syntax
- convert tif files in jpg
- text recognition for all images
- mkdocs serve #for tesing purpose
- mkdocs build
- copy static html files to webserver
pip3 search mkdocs | grep theme
or build your own: https://www.mkdocs.org/user-guide/styling-your-docs/
apt install python3-venv
python3 -m venv lh-py3env
git clone https://github.com/davidswelt/zot_bib_web.git
cd zot_bib_web
cp settings_example.py settings.py ## adapt to your needs
source lh-py3nv/bin/activate
pip3 install pyzotero
- collect content in Zotero
- generate index for content:
source lh-py3nv/bin/activate
cd zot_bib_web
./zot.py
- take a look at the generated html file
- https://systemausfall.org/wikis/howto/DigitaleArchive -- development notes (in German)
- collect content in Zotero
- export Zotero content in csv format
- convert tif files in jpg
- text recognition for all images
- generate index for content
- import index in Drupal
- on Debian9 you'll need tesseract, imagemagick (convert), rsync, screen
- sync Zotero database
- export the library to /data/zotero/lichtenhagen.csv
cd /data/archiv-lichtenhagen-1992
git pull
cd helper-scripts
./file-count.sh
./file-convert.sh (takes approx. 1h)
./file-ocr.sh (can start while conversion is still running; takes approx. 12h)
rsync -avz --delete --delete-excluded --exclude='*.tif' --bwlimit=2M /data/zotero/ archive-server:/data/zotero-export/ (takes approx. 1h)
- https://www.drupal.org/docs/develop/using-composer/using-composer-to-manage-drupal-site-dependencies
- https://www.lullabot.com/articles/drupal-8-composer-best-practices
aptitude install php7.0 php7.0-fpm php7.0-gd php7.0-mysql php7.0-mbstring phpunit
su webuser
wget https://getcomposer.org/installer
php installer
php composer.phar
composer create-project drupal-composer/drupal-project:8.x-dev archiv.lichtenhagen-1992.de --stability dev
composer require drupal/ctools
composer update drupal/core --with-dependencies
- create database & set password for db user
- configure DNS an point your browser to new domain
- fill out forms
- for composer to work fine set higher php memory_limit
- install drush:
composer require drush/drush
../vendor/bin/drush
- install theme: https://www.drupal.org/project/magazine_lite
-
create new content type
-
add fields
-
create taxonomie
-
install restui: composer require drupal/restui
-
activate rest + restui modules
-
import content via script
-
https://www.drupal.org/docs/8/core/modules/rest/3-post-for-creating-content-entities
-
https://github.com/flesheater/python_drupal8_rest/blob/master/drupal8.py
-
import csv with python to elasticsearch: https://elasticsearch-py.readthedocs.io/en/master/
curl -X PUT 'localhost:9200/foo/bar/2' -d '{ "titel": "hahu", "autor": "bla" }' curl -X GET 'localhost:9200/_search' -d '{ "query": { "match_all": {} }}' curl -X GET 'localhost:9200/_aliases?pretty=1' curl -X GET 'localhost:9200/_stats?pretty=1'
- restlet REST client: https://restlet.com/modules/client/?utm_source=DHC
- web front-end: https://github.com/mobz/elasticsearch-head