Skip to content

maxking/docker-mailman

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

43 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

permalink
/

GNU Mailman 3 Deployment with Docker

This repository hosts code for two docker images maxking/mailman-core and maxking/mailman-web both of which are meant to deploy GNU Mailman 3 in a production environment.

Docker is a container ecosystem which can run containers on several platforms. It consists of a tool called docker-compose which can be used to run multi-container applications. This repository consists of a docker-compose.yaml file which is a set of configurations that can be used to deploy the Mailman 3 Suite.

While is not official way to deploy Mailman 3, I will try my best to help if you encounter problems.

For now, both mailman-core and mailman-web images are built from latest git branches for all the proejcts, but in future when Mailman 3.1 is released, I will have seperate images for latest and stable versions of the containers.

Dependencies

  • Docker
  • Docker-compose

To run this you first need to download docker for whichever operating system you are using. You can find documentation about how to install. It is recomended to use these instead of the one from your package managers. After you have downloaded and installed docker, install docker-compose from here.

Configuration

Most of the configuraiton is supposed to be handled through environment variables in the docker-compose.yaml.

Mailman-web

These are the settings that you MUST change before deploying:

  • SERVE_FROM_DOMAIN: The domain name from which Django will be served. To be added to ALLOWED_HOSTS in django settings. Default value is not set.

  • HYPERKITT_API_KEY: Hyperkitty's API Key, should be set to the same value as set for the mailman-core.

For more detauls on how to configura this image, please look at Mailman-web's Readme

Mailman-Core

These are the variables that you MUST change before deploying:

  • HYPERKITT_API_KEY: Hyperkitty's API Key, should be set to the same value as set for the mailman-core.

  • DATABASE_URL: URL of the type driver://user:password@hostname:port/databasename for the django to use. If not set, the default is set to sqlite:///opt/mailman-web-data/mailmanweb.db. The standard docker-compose.yaml comes with it set to a postgres database. It is not must to change this if you are happy with postgresql.

  • DATABASE_TYPE: It's value can be one of sqlite, postgres or mysql as these are the only three database types that Mailman 3 supports. It's defualt value is set to sqlite along with the default database class and default database url above.

  • DATABASE_CLASS: Default value is mailman.database.sqlite.SQLiteDatabase. The values for this can be found in the mailman's documentation here.

For more details on how to configure this image, please look Mailman-core's Readme

Running

To run the containers, simply run:

$ mkdir -p /opt/mailman/core
$ mkdir -p /opt/mailman/web
$ git clone https://github.com/maxking/docker-mailman
$ cd docker-mailman
# Change some configuration variables as mentioned above.
$ docker-compose start

This command will do several things, most importantly:

Some more details about what the above system achives is mentioned below. If you are only going to deploy a simple configuration, you don't need to read this. However, these are very easy to understand if you know how docker works.

  • First create a bridge network called mailman in the docker-compose.yaml. It will probably be named something else in your machine, but it will use the 172.19.199.0/24 as subnet. All the containers mentioned (mailman-core, mailman-web, database) will join this network and are assigned static IPs. The host operating system is available at 172.19.199.1 from within these containers.

  • Spin off mailman-core container which has a static IP address of 172.19.199.2 in the mailman bridge network created above. It has GNU Mailman 3 core running inside it. Mailman core's REST API is available at port 8000 and LMTP server listens at port 8024.

  • Spin off mailman-web container which has a django application running with both Mailman's web frontend Portorius and Mailman's Web based Archiver running. Uwsgi server is used to run a web server with the configuration provided in this repository here. You may want to change the setting ALLOWED_HOSTS in the settings before deploying the application in production.

  • Spin off a postgresql database container which is used by both mailman-core and mailman-web as their primary database.

  • mailman-core mounts /opt/mailman/core from host OS at /opt/mailman in the container. Mailman's var directory is stored there so that it is accesible from the host operating system. Mailman's configuration file is also expected to be present there. A production level configuration is provided, but please do not change anything there without the complete knowledge. Mailman also needs another configuration file called mailman-hyperkitty.cfg and is also expected to be at /opt/mailman/core/ on the host OS.

  • mailman-web mounts /opt/mailman/web from the host OS to /opt/mailman-web-data in the container. It consists of the logs and settings.py file for Django.

  • database mounts /opt/mailman/database at /var/lib/postgresql/data so that postgresql can persists its data even if the database containers are updated/changed/removed.

Setting up your MTA

This setup assumes that the MTA is actually present on the host. In future it is possible to provide a way to actually expect nothing from the host and have everything running inside containers.

It is recomended to use Exim4 along with this setup. Technically, it possible to use any other MTA like postfix too, but I haven't yet been able to figure out a clean way to communicate with postfix on the host.

Exim should be setup to relay emails from 172.19.199.3 and 172.19.199.2. The mailman specific configuration is provided in the repository at core/assets/exim. There are three files

  • 25_mm_macros to be placed at /etc/exim4/conf.d/main/25_mm3_macros in a typical debian instal of exim4. Please change MY_DOMAIN_NAME to the domain name that will be used to serve mailman. Multi-domains setups will be added later.

  • 455_mm3_router to be placed at /etc/exim4/conf.d/main/455_mm3_router in a typical debian instal of exim4.

  • 55_mm3_transport to be placed at /etc/exim4/conf.d/main/55_mm3_transport in a typical debian instal of exim4.

Setting up your web server

Although mailman-web runs uwsgi which can be used a full fledged web server, it is recomended to run it behind a webserver like apache or nginx. I have included setup instructions for nginx, but it is not difficult to find setup instructios for Apache and Django.

Add the following to your nging's /etc/nginx/site-available/default

server {

        listen 443 ssl default_server;
        listen [::]:443 ssl default_server;

        server_name MY_SERVER_NAME;
        location /static/ {
             alias /opt/mailman/web/static/;
        }
        ssl_certificate /etc/letsencrypt/live/MY_DOMAIN_NAME/fullchain.pem;
        ssl_certificate_key /etc/letsencrypt/live/MY_DOMAIN_NAME/privkey.pem;

        location / {
                # First attempt to serve request as file, then
        proxy_set_header X-Real-IP  $remote_addr;
        proxy_set_header X-Forwarded-For $remote_addr;
        proxy_set_header Host $host;
        proxy_pass http://172.19.199.3:8000;

        }

}

Please change MY_SERVER_NAME above to the domain name you will be serving the Web UI from. It doesn't have to be same as the one used for Exim(or any MTA).

Also, change ssl_certificate and ssl_certificate_key options to point at your SSL certificate and ceritfiicate keys. If you don't happen to have one, you can get one for free from Lets Encrypt. They have a very nifty tool called certbot that can be used to obtain the SSL certificates (typically stored in the location mentioned above in the configuraiton if you replace MY_DOMAIN_NAME with your domain name).

SSL Certificates from Lets Encrypt need to be renewed every 90 days. You can setup a cron job to do the job. I have this small shell script(certbot-renew.sh) that you can put up in /etc/cron.monthly to get the job done.

#! /bin/bash

cd /opt/letsencrypt/
./certbot-auto --config /etc/letsencrypt/renewal/MY_DOMAIN_NAME.conf certonly

if [ $? -ne 0 ]
 then
        ERRORLOG=`tail /var/log/letsencrypt/letsencrypt.log`
        echo -e "The Let's Encrypt cert has not been renewed! \n \n" \
                 $ERRORLOG
 else
        nginx -s reload
fi

exit 0

Please do not forget to make the script executable (chmod +x certbot-renew.sh).

LICENSE

This repository is licensed under MIT License. Please see the LICENSE file for more details.