Starting with version 5.2.0 Tigase introduces a load balancing functionality allowing users to be redirected to the most suitable cluster node. Functionality relies on a see-other-host XMPP stream error message. The basic principle behind the mechanism is that user will get redirect if the host returned by the implementation differ from the host to which user currently tries to connect. It is required that the user JID to be known for the redirection to work correctly.
Tigase implementation is, as usual, extensible and allows for different, pluggable redirection strategies that implement the SeeOtherHostIfc
interface.
Currently there are three strategies available:
SeeOtherHost
- most basic implementation returning either single host configured in init.properties file or name of the current host;SeeOtherHostHashed
(default) - default implementation for cluster environment of SeeOtherHostIfc returning redirect host based on the hash value of the user’s JID; list of the available nodes from which a selection would be made is by default composed and reflects all connected nodes, alternatively hosts list can be configured in the init.properties;SeeOtherHostDB
- extended implementation of SeeOtherHost using redirect information from database in the form of pairs user_id and node_id to which given user should be redirected.The most basic configuration is related to the choice of actual redirection implementation:
--cm-see-other-host=
Possible values are:
tigase.server.xmppclient.SeeOtherHost
tigase.server.xmppclient.SeeOtherHostHashed
tigase.server.xmppclient.SeeOtherHostDB
tigase.server.xmppclient.SeeOtherHostDualIP
none
- disables redirectionAll the remaining options are configured on a per-connection-manager basis, thus all options need to be prefixed with the corresponding connection manager ID, i.e. c2s, bosh or ws; we will use c2s in the examples:
c2s/cm-see-other-host/default-host=host1;host2;host3
- a semicolon separated list of hosts to be used for redirection;c2s/cm-see-other-host/active=OPEN;LOGIN
- a semicolon separated list of phases in which redirection should be active, currently possible values are:
OPEN
which enables redirection during opening of the XMPP stream;LOGIN
which enables redirection upon authenticating user session;By default redirection is currently enabled only in the OPEN
phase.
For SeeOtherHostDB
implementation there are additional options:
c2s/cm-see-other-host/db-url
- a JDBC connection URI which should be used to query redirect information; if not configured --user-db-uri will be used;c2s/cm-see-other-host/get-host-query
- a SQL query which should return redirection hostname;c2s/cm-see-other-host/get-all-data-query
- a SQL helper query which should return all redirection data from database;c2s/cm-see-other-host/get-all-query-timeout
- allows to set timeout for executed queries.This mechanisms matches internal Tigase cluster nodes with against the lookup table to provide matching and relevant redirection hostname/IP. By default internal Tigase cluster_nodes
table will be used (and appropriate repository implementation will be used).
To enable this redirection mechanism following configuration / class should be used:
--cm-see-other-host=tigase.server.xmppclient.SeeOtherHostDualIP
It’s possible to configure it on per-connection-manager basis
<connector>/cm-see-other-host[S]=tigase.server.xmppclient.SeeOtherHostDualIP
It offers following configuration options:
data-source
- configuration of the source of redirection information - by default internal Tigase cluster_nodes
table will be used (and appropriate repository implementation will be used); alternatively it’s possible to use eventbus
source;db-url
- a JDBC connection URI which should be used to query redirect information; if not configured --user-db-uri
will be used;get-all-data-query
- a SQL helper query which should return all redirection data from database;get-all-query-timeout
- allows to set timeout for executed queries;fallback-redirection-host
- if there is no redirection information present (i.e. secondary hostname is not configured for the particular node) redirection won’t be generated; with this it’s possible to configure fallback redirection address.All options can be configured either globally (without providing type parameter)
--cm-see-other-host/db-url=jdbc:<database>://<uri> --cm-see-other-host/data-source=<class implementing tigase.server.xmppclient.SeeOtherHostDualIP.DualIPRepository> --cm-see-other-host/get-all-data-query=select * from cluster_nodes --cm-see-other-host/get-all-query-timeout=10 --cm-see-other-host/fallback-redirection-host=<hostname>
or on per-component basis
<connector>/cm-see-other-host/db-url[S]=jdbc:<database>://<uri> <connector>/cm-see-other-host/data-source[S]=<class implementing tigase.server.xmppclient.SeeOtherHostDualIP.DualIPRepository> <connector>/cm-see-other-host/get-all-data-query[S]=select * from cluster_nodes <connector>/cm-see-other-host/get-all-query-timeout[I]=10 <connector>/cm-see-other-host/fallback-redirection-host[S]=<hostname>
It’s possible to utilize EventBus and internal Tigase events as a source of redirection data. In order to do that eventbus
should be used as a value of data-source
configuration option. In addition, EventBus events needs to be enabled in ClusterConnectionManager. Example configuration:
cl-comp/eventbus-repository-notifications[B]=true --cm-see-other-host/data-source=eventbus
or on per-component basis:
cl-comp/eventbus-repository-notifications[B]=true <connector>/cm-see-other-host/data-source[S]=eventbus
It’s possible to enforce redirection of connections on the particular port of connection manager with force-redirect-to
set to Integer with the following general setting option:
<connection_manager>/connections/<listening_port>/force-redirect-to[I]=<destination_port>
for example, enable additional port 5322
for c2s
connection manager and enforce all connections to be redirected to port 5222
(it will utilize hostname retrieved from SeeOtherHost
implementation and will be only used when such value is returned):
c2s/connections/ports[i]=5222,5322 c2s/connections/5322/type[S]=accept c2s/connections/5322/socket[S]=plain c2s/connections/5322/force-redirect-to[I]=5222
To fully utilize SeeOtherHostDualIP
setup in automated fashion it’s now possible to provide both primary (internal) and secondary (external) hostname/IP (they need to be correct, InetAddress.getByName( property );
will be used to verify correctnes). It can be done via JVM properties tigase-primary-address
and tigase-secondary-address
. You can also utilize different implementation of DNS resolver by providing class implementing tigase.util.DNSResolverIfc
interface as value to resolver-class
property.
Those properties can be set via etc/tigase.conf
(uncommenting following lines, or manually exposing in environment):
DNS_RESOLVER=" -Dresolver-class=tigase.util.DNSResolverDefault " INTERNAL_IP=" -Dtigase-primary-address=hostname.local " EXTERNAL_IP=" -Dtigase-secondary-address=hostname "
or in the etc/init.properties
(they will be converted to JVM properties):
--tigase-resolver-class=tigase.util.DNSResolverDefault --tigase-primary-address=hostname.local --tigase-secondary-address=hostname