On Debian/Ubuntu systems install required packages:

apt install -y advancecomp optipng pngcrush jpegoptim

Create a bash File in

nano /usr/local/bin/optimizeImages

and paste:

#!/bin/bash

find . -type f -iname "*.png" -exec optipng -nb -nc {} \;
find . -type f -iname "*.png" -exec advpng -z4 {} \;
find . -type f -iname "*.png" -exec pngcrush -rem gAMA -rem alla -rem cHRM -rem iCCP -rem sRGB -rem time -ow {} \;
find . -type f \( -iname "*.jpg" -o -iname "*.jpeg" \) -exec jpegoptim -f --strip-all {} \;

Save the file (press F2 in nano). Then make the script executable:

chmod a+x /usr/local/bin/optimizeImages

The running time will be depending on the folder size. Go to your image Folder, for example

cd /var/www/myproject/web/images/

and run

optimizeImages

Now it can take a long time. Stand by … thats all!

To get started easily, the following lines may help:

cd /opt
apt update
apt install -y git cmake libhwloc-dev libuv1-dev libuvc-dev librust-openssl-dev
git clone https://github.com/xmrig/xmrig.git
mkdir xmrig/build
cd xmrig/build
cmake ..
make -jxx   # xx = Your CPU thread count
ln -s /opt/xmrig/build/xmrig /usr/local/bin/

Now we can just run xmrig. As an an example:

xmrig \
-a cryptonight \
-o stratum+tcp://randomxmonero.eu.nicehash.com:3380 \
-u <YourHolyWalletHash> \
-p <YourHolyPassword> \
--donate-level=5 \
--threads=4

example config File – breit_work.py:

# -*- coding: utf-8 -*-
import scrapy


class BreitWorkSpider(scrapy.Spider):
    name = 'breit.work'
    allowed_domains = ['breit.work']
    start_urls = ['https://breit.work/']

    def parse(self, response):
        for title in response.css('h3'):
            yield {'title 1': title.css('a ::text').get()}

        for title in response.css('h2'):
            yield {'title 2': title.css('a ::text').get()}

        for next_page in response.css('a.next-posts-link'):
            yield response.follow(next_page, self.parse)

run with:

scrapy runspider breit_work.py

example output:

2020-10-13 11:05:26 [scrapy.utils.log] INFO: Scrapy 1.8.0 started (bot: scrapybot)
2020-10-13 11:05:26 [scrapy.utils.log] INFO: Versions: lxml 4.5.2.0, libxml2 2.9.10, cssselect 1.1.0, parsel 1.6.0, w3lib 1.22.0, Twisted 20.3.0, Python 2.7.16 (default, Oct 10 2019, 22:02:15) - [GCC 8.3.0], pyOpenSSL 19.1.0 (OpenSSL 1.1.1d  10 Sep 2019), cryptography 2.6.1, Platform Linux-4.19.0-10-amd64-x86_64-with-debian-10.5
2020-10-13 11:05:26 [scrapy.crawler] INFO: Overridden settings: {'SPIDER_LOADER_WARN_ONLY': True}
2020-10-13 11:05:26 [scrapy.extensions.telnet] INFO: Telnet Password: ~not4YouNoob*
2020-10-13 11:05:26 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.corestats.CoreStats']
2020-10-13 11:05:26 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2020-10-13 11:05:26 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware']
2020-10-13 11:05:26 [scrapy.middleware] INFO: Enabled item pipelines:
[]
2020-10-13 11:05:26 [scrapy.core.engine] INFO: Spider opened
2020-10-13 11:05:26 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2020-10-13 11:05:26 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2020-10-13 11:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (301) to <GET https://www.breit.work/> from <GET https://breit.work/>
2020-10-13 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.breit.work/> (referer: None)
2020-10-13 11:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.breit.work/>
{'title 1': u'Impress'}
2020-10-13 11:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.breit.work/>
{'title 2': u'Boston Dynamics spielt mit dem Krieg'}
2020-10-13 11:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.breit.work/>
{'title 2': u'It\u2019s done \u2026 Bye bye Britain !'}
2020-10-13 11:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.breit.work/>
{'title 2': u'Play with redis-server'}
2020-10-13 11:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.breit.work/>
{'title 2': u'dd with a nice progress indicator'}
2020-10-13 11:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.breit.work/>
{'title 2': u'XEN 4.11 on Debian 10'}
2020-10-13 11:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.breit.work/>
{'title 2': u'Redis 6.0 is out'}
2020-10-13 11:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.breit.work/>
{'title 2': u'Setup Pageflow Storytelling with NGINX & Lets Encrypt'}
2020-10-13 11:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.breit.work/>
{'title 2': u'MySQL 8 \u2013 create Database with own user'}
2020-10-13 11:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.breit.work/>
{'title 2': u'Schade REAL, das war es leider'}
2020-10-13 11:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.breit.work/>
{'title 2': u't\xe4gliche Mysql-Backups'}
2020-10-13 11:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.breit.work/>
{'title 2': u'Setup Redis-Server 6.0.0 Beta'}
2020-10-13 11:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.breit.work/>
{'title 2': u'Lustiges beim Server Einrichten'}
2020-10-13 11:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.breit.work/>
{'title 2': None}
2020-10-13 11:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.breit.work/>
{'title 2': None}
2020-10-13 11:05:27 [scrapy.core.engine] INFO: Closing spider (finished)
2020-10-13 11:05:27 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 422,
 'downloader/request_count': 2,
 'downloader/request_method_count/GET': 2,
 'downloader/response_bytes': 26080,
 'downloader/response_count': 2,
 'downloader/response_status_count/200': 1,
 'downloader/response_status_count/301': 1,
 'elapsed_time_seconds': 0.361133,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2020, 10, 13, 11, 5, 27, 61229),
 'item_scraped_count': 15,
 'log_count/DEBUG': 17,
 'log_count/INFO': 10,
 'memusage/max': 51576832,
 'memusage/startup': 51576832,
 'response_received_count': 1,
 'scheduler/dequeued': 2,
 'scheduler/dequeued/memory': 2,
 'scheduler/enqueued': 2,
 'scheduler/enqueued/memory': 2,
 'start_time': datetime.datetime(2020, 10, 13, 11, 5, 26, 700096)}
2020-10-13 11:05:27 [scrapy.core.engine] INFO: Spider closed (finished)

Example for Blockdevices:

You may need the following additional packages: sudo pv

DISKSIZE=`sudo blockdev --getsize64 /dev/vol0/target-disk` && sudo dd bs=4096 if=/dev/vol0/target-disk | pv -s $DISKSIZE | sudo gzip -9 > target-disk.img.gz

Example Result:

Extended Setup with additional bpo linux-image

Setup for Hetzner dedicated Servers

In order to set up the XEN hypervisor on a newly set up Hetzner server, the following actions must be carried out. First edit /etc/apt/sources.list and add:

# buster backports
deb http://http.debian.net/debian buster-backports main

then:

apt update  
apt -y dist-upgrade
apt -y install htop mc rsync screen nload net-tools locate aptitude linux-headers-5.4.0-0.bpo.2-amd64 linux-support-5.4.0-0.bpo.2 linux-image-5.4.0-0.bpo.2-amd64 bash-completion xenstore-utils xen-utils-common xen-utils-4.11 xen-tools xen-hypervisor-4.11-amd64 libxenstore3.0 grub-xen-bin

adjust bootloader:

mv /etc/grub.d/10_linux /etc/grub.d/20_linux && mv /etc/grub.d/20_linux_xen /etc/grub.d/10_linux_xen

Edit the file /etc/default/grub and replace the lines:

GRUB_CMDLINE_LINUX_DEFAULT="nomodeset consoleblank=0"  
GRUB_CMDLINE_LINUX=""

with:

GRUB_CMDLINE_LINUX_DEFAULT="console=tty0 acpi=ht"  
GRUB_CMDLINE_XEN_DEFAULT="dom0_mem=512M dom0_max_vcpus=1"  
GRUB_CMDLINE_LINUX=""

This gives Dom0 a vCPU and 512m RAM. These settings are sufficient for normal operation.
Finally, edit the file /etc/default/grub.d/xen.cfg and change the line:

# XEN_OVERRIDE_GRUB_DEFAULT=0

to

XEN_OVERRIDE_GRUB_DEFAULT=1

Now udate the Bootloader with new configuration:

update-grub2

Setup a networkbridge

An example standard configuration file from Hetzner can look like this:

### Hetzner Online GmbH installimage  

source /etc/network/interfaces.d/*  

auto lo  
iface lo inet loopback  
iface lo inet6 loopback  

auto enp34s0
iface enp34s0 inet static  
address 135.181.x.x  
netmask 255.255.255.192  
gateway 135.181.x.x

# route 135.181.3.0/26 via 135.181.3.1  
up route add -net 135.181.3.0 netmask 255.255.255.192 gw 135.181.3.1 dev enp34s0  

iface enp34s0 inet6 static  
address 2a01:4f9:4b:4fe6::2  
netmask 64

and should be changed according to this example as follows

### Hetzner Online GmbH installimage  

source /etc/network/interfaces.d/*  

auto lo  
iface lo inet loopback  
iface lo inet6 loopback  

allow-hotplug enp34s0  
iface enp34s0 inet manual  
iface enp34s0 inet6 manual  

auto br0  
iface br0 inet static  
address 135.181.3.25  
netmask 255.255.255.192  
gateway 135.181.3.1  
bridge_ports enp34s0  
bridge_stp off  

# route 135.181.3.0/26 via 135.181.3.1  
# up route add -net 135.181.3.0 netmask 255.255.255.192 gw 135.181.3.1 dev enp34s0  

iface br0 inet6 static  
address 2a01:4f9:4b:4fe6::2  
netmask 64

Thats all. Now reboot the server

reboot && exit

Es war nicht unbedingt einfach, aber nicht unmöglich. Da die Dokumentionen nicht besten sind, die man findet, oder teilweise auch unvollständig, habe ich hier meine eigene Anleitung für einen eigenen Pageflow-Server:

[protectedContentOpen][/protectedContentOpen]

# SETUP PAGEFLOW - Debian 10
#
# Um pageflow auf einem frisch installierten Debian 10 sind folgende Schritte durchzuführen: 
#
apt update
apt install sudo lsb-release bash-completion htop net-tools aptitude mc rsync screen nload locate wget git build-essential ruby2.5-dev ruby-rails rails redis-server imagemagick imagemagick-common imagemagick-doc libsqlite3-dev libodb-sqlite-dev zlib1g-dev zlibc libghc-bzlib-dev libcrypto++-dev libssl-dev nginx -y
cd /tmp
wget https://dev.mysql.com/get/mysql-apt-config_0.8.13-1_all.deb
dpkg -i mysql-apt-config_0.8.13-1_all.deb
apt update
apt install mysql-server default-libmysqlclient-dev default-libmysqld-dev -y
git clone https://github.com/codevise/pageflow.git
mkdir /opt/pageflow
rsync -av pageflow/ /opt/pageflow/
cd /opt/pageflow/

mysql -p

create database ownpageflow;
create user 'ownpageflow'@'localhost' IDENTIFIED BY 'My$secRetPassw0rd';
grant all on *.* TO 'ownpageflow'@'localhost';
flush privileges;
quit;

sudo gem install mysql2 -v '0.5.3'
sudo gem install rake
sudo gem install rainbow -v '2.2.2'
sudo gem install listen
sudo bundle install

# RAILS Starter vorbereiten

echo "cd /opt/pageflow/ownpageflow/ && foreman start" > .foreman.start
echo "cat /opt/pageflow/ownpageflow/tmp/pids/server.pid | xargs kill -9  > /dev/null && rm -rf /opt/pageflow/ownpageflow/tmp/pids/server.pid  > /dev/null" > .foreman.stop
chmod a+x .foreman*

echo '#!/bin/bash

screen -d -m -S pageflow bash /opt/pageflow/ownpageflow/.foreman.start &> /dev/null' > /usr/local/bin/pageflow.start

echo '#!/bin/bash

/opt/pageflow/ownpageflow/.foreman.stop' > /usr/local/bin/pageflow.stop

chmod a+x /usr/local/bin/pageflow*

echo '[Unit]
Description=Advanced key-value store
After=network.target
Documentation=http://redis.io/documentation, man:redis-server(1)

[Service]
Type=forking
ExecStart=/usr/local/bin/pageflow.start
ExecStop=/bin/kill -s TERM $MAINPID
PIDFile=/opt/pageflow/ownpageflow/tmp/pids/server.pid
TimeoutStopSec=0
Restart=always
User=root
Group=root
RuntimeDirectory=redis
RuntimeDirectoryMode=2755

UMask=007
PrivateTmp=yes
LimitNOFILE=65535

[Install]
WantedBy=multi-user.target
Alias=pageflow.service' > /lib/systemd/system/pageflow.service

systemctl enable pageflow.service

systemctl start pageflow.service

# NGINX Configuration erstellen

echo 'server {
  listen 80 deferred;
  server_name myhost.de;
  root /opt/pageflow/ownpageflow;

  location / {
    try_files $uri/index.html $uri.html $uri @app;
  }

  location @app {
    proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
    proxy_set_header X-Forwarded-Proto $scheme;
    proxy_set_header Host $http_host;
    proxy_redirect off;
    proxy_pass http://localhost:5000;
  }
}' > /etc/nginx/sites-available/myhost.cfg

ln -s /etc/nginx/sites-available/myhost.cfg /etc/nginx/sites-enabled

service restart nginx

# Setup LETS ENCRYPT

cd /usr/local/bin
wget https://dl.eff.org/certbot-auto
chmod a+x certbot-auto
./certbot-auto --install-only

# cerbot nun nochmal ausführen und Anweisungen durchlaufen um myhost.de mit lets-encrypt zu verifizieren und anschliessend den Web-Server neu starten

certbot-auto

service nginx restart

# Damit sollte pageflow nun zunächst im Browser unter der eingerichteten Domain myhost.de erreichbar


##############################################
# PERSONALISIERUNG AWS / S3 / Amazon Services
##############################################
#
# Um AWS / S3 / Amazon Services benutzen zu können muss die Datei
#
# ./config/initializers/pageflow.rb
#
# angepasst werden. 
#
# Anschliessend sollte der Pageflow-Service neu gestartet werden.
#
# Wenn alles richtig eingerichtet wurde, kann man nun Medien via Pageflow organisieren. 

[protectedContentClose][/protectedContentClose]