Offline mode strategies

This is in connection with the Working offline page. See that resource for background information.

This page provides an overview of various types of services that can be implemented in order for Juju to live happily in an internet-deprived environment. Common tools that can be used to achieve such services are also listed.

The services of concern here are:

• HTTP/S proxy
• APT proxy
• FTP proxy
• APT mirror
• Juju agent mirror
• Cloud image mirror

HTTP/S proxy

The purpose of a forward HTTP/S proxy is to act as an intermediary for a client making any HTTP or HTTPS request. For our purposes, the client is a Juju machine.

Most such proxies include a caching ability. That is, the proxy will store the resulting data locally so that any subsequent request can be quickly satisfied.

The de-facto forward proxy solution on Ubuntu is squid.

Juju uses options http-proxy and https-proxy to denote these proxies.

No HTTP/S proxy

When an HTTP/S proxy is configured there may be destinations that should be excluded from using it.

Juju uses option no-proxy to represent these destinations.

In general, all instances within a cloud should be able to communicate directly with one another. It may, or it may not, be necessary to express this via the no-proxy variable. This is because the latter is limited to the HTTP and HTTPS protocols, which may not apply in every case. Nevertheless, it is often done out of simplicity.

No proxy and the localhost cloud

This "no proxy" idea is often used extensively with the localhost cloud at both the (shell) environment level and at the Juju level. The purpose being to ensure the client can connect with the local controller and that the local machines can inter-communicate, all without going through a proxy.

Hosts to exclude from the proxy include:

• localhost & 127.0.0.1 (standard 'no proxy' settings)
• the address assigned to the regular Ethernet device
• the address assigned to the host's LXD bridge (to talk to the controller via its API)
• the entire subnet dedicated to the particular LXD installation

APT proxy

An HTTP/S or FTP proxy may not be configured to accept requests for APT packages. An APT proxy is identical to that of an HTTP/S or FTP proxy except that it applies specifically to APT package requests.

Some common implementations include:

• APT-cacher
• Apt-Cacher NG
• squid
• squid-deb-proxy (based on squid)

Juju uses options apt-ftp-proxy, apt-http-proxy, and apt-https-proxy to set these proxies, depending on the protocol involved (i.e. FTP, HTTP, or HTTPS).

FTP proxy

A standard FTP proxy. Juju uses the ftp-proxy option for this type of proxy.

APT mirror

Instead of proxying client requests to an internet-based repository it is possible to maintain the repository internally. That is, you can have a copy or mirror of an Ubuntu package repository. This option has a large storage requirement and the initial setup/download time is considerable. Regular mirror synchronization will also be needed.

Here are some popular mirroring solutions:

• apt-mirror
• debmirror
• aptly

Juju uses the apt-mirror option for this.

HTTP/S server

For any sort of mirror, an HTTP/S server (i.e. a web server) will be required to respond to the actual client requests. These are the most common ones:

• Apache
• nginx
• lighttpd

Juju agent mirror

An agent that gets installed onto a Juju machine is proxied through the controller. If the latter cannot satisfy the request via its cache it will download the agent from the official agent site, and then pass it on to the machine. It is possible, however, to set up an agent mirror so the remote site is not solicited by the controller. Download the latest few agents and configure one of the aforementioned web servers accordingly. Updates to the mirrored agents will be needed as new versions of Juju itself become available.

Agent downloads can be performed manually from the above site where, for example, the file juju-2.3.1-ubuntu-amd64.tgz is the 2.3.1 agent for all Ubuntu releases for the AMD64 architecture.

Downloads can also be made with the juju sync-agent-binaries command. Note that this method results in a larger download as only the major and minor version numbers can be specified (e.g. 2.3 and not 2.3.1) and all architectures are retrieved. Additionally, there will be a file for every Ubuntu release even though they are all identical (e.g. juju-2.3.1-xenial-amd64.tgz == juju-2.3.1-bionic-amd64.tgz). Each one of these files is approximately 27 MiB in size.

Below, all 2.3 agents are retrieved and placed into a local directory:

mkdir -p /home/ubuntu/tmp/agents
juju sync-agent-binaries --version 2.3 --local-dir=/home/ubuntu/tmp/agents-2.3

Cloud images mirror

A mirror can be made of the official cloud images (http://cloud-images.ubuntu.com). This will primarily be useful for a localhost cloud (LXD) but a local OpenStack installation can also make use of such a mirror if LXD containers are put on its instances.