Tested on *nix and MacOS - (probably will work on Windows, but not tested on Windows).
Tested and proven on Node.js versions >= 8.0.0.
$ npm i live-mutex
$ npm i -g live-mutex
docker pull 'oresoftware/live-mutex-broker:0.2.24' docker run --rm -d -p 6970:6970 --name lmx-broker 'oresoftware/live-mutex-broker:0.2.24' docker logs -f lmx-broker
- Written in TypeScript for maintainability and ease of use.
- Live-Mutex is a non-distributed networked mutex/semaphore for synchronization across multiple processes/threads.
- Non-distributed means no failover if the broker goes down, but the upside is higher-performance.
- By default, a binary semaphore, but can be used to create a non-binary semaphore, where multiple lockholders can hold a lock, for example, to do some form of rate limiting.
- Live-Mutex can use either TCP or Unix Domain Sockets (UDS) to create an evented (non-polling) networked mutex API.
- Live-Mutex is significantly (orders of magnitude) more performant than Lockfile and Warlock for high-concurrency locking requests.
- When Warlock and Lockfile are not finely/expertly tuned, 5x more performant becomes more like 30x or 40x.
- Live-Mutex should also be much less memory and CPU intensive than Lockfile and Warlock, because Live-Mutex is fully evented, and Lockfile and Warlock use a polling implementation by nature.
This library is ideal for use cases where a more robust distributed locking mechanism is out-of-reach or otherwise inconvenient. You can easily Dockerize the Live-Mutex broker using: https://github.com/ORESoftware/dockerize-lmx-broker
On a single machine, use Unix Domain Sockets for max performance. On a network, use TCP. To use UDS, pass in "udsPath" to the client and broker constructors. Otherwise for TCP, pass a host/port combo to both.
On Linux/Ubuntu, if we feed live-mutex 10,000 lock requests, 20 concurrently, LMX can go through all 10,000 lock/unlock cycles in less than 2 seconds, which means at least 5 lock/unlock cycles per millisecond. That's with TCP. Using Unix Domain Sockets (for use on a single machine), LMX can reach at least 8.5 lock/unlock cycles per millisecond, about 30% more performant than TCP.
I used a couple of other libraries and they required manual retry logic and they used polling under the hood to acquire locks.
It was difficult to finetune those libraries and they were extremely slow for high lock request concurrency.
Other libraries are stuck with polling for simple reasons - the filesystem is dumb, and so is Redis (unless you write some
Lua scripts that can run on there - I don't know of any libraries that do that).
If we create an intelligent broker that can enqueue locking requests, then we can create something that's both more performant and more developer friendly. Enter live-mutex.
In more detail:
See: docs/detailed-explanation.md and docs/about.md
Locking down a particular route in an Express server:
import {LMXClient} from 'live-mutex';
const client = new LMXClient();
const app = express();
app.use((req,res,next) => {
if(req.url !== '/xyz'){
return next();
}
// the lock will be automatically unlocked after 8 seconds
client.lock('foo', {ttl: 8000, retries: 2}, (err, unlock) => {
if(err){
return next(err);
}
res.once('finish', () => {
unlock();
});
next();
});
});The Live-Mutex API is completely asynchronous and requires usage of async initialization for both the client and broker instances. It should be apparent by now that this library requires a Node.js process to run a server, and that server stores the locking info, as a single source of truth. The broker can be within one of your existing Node.js processes, or more likely launched separately. In other words, a live-mutex client could also be the broker, there is nothing wrong with that. For any given key there should be only one broker. For absolute speed, you could use separate brokers (in separate Node.js processes) for separate keys, but that's not really very necessary. Unix Domain Sockets are about 10-50% faster than TCP, depending on how well-tuned TCP is on your system.
Things to keep in mind:
- You need to initialize a broker before connecting any clients, otherwise your clients will pass back an error upon calling
connect(). - You need to call
ensure()/connect()on a client or use the asynchronous callback passed to the constructor, before callingclient.lock()orclient.unlock(). - Live-Mutex clients and brokers are not event emitters.
The two classes wrap Node.js sockets, but the socket connections are not exposed. - To use TCP and host/port use
{port: <number>, host: <string>}, to use Unix Domain Sockets, use{udsPath: <absoluteFilePath>}. - If there is an error or Promise rejection, the lock was not acquired, otherwise the lock was acquired. This is nicer than other libraries that ask that you check the type of the second argument, instead of just checking for the presence of an error.
- The same process that is a client can also be a broker. Live-Mutex is designed for this. You probably only need one broker for any given host, and probably only need one broker if you use multiple keys, but you can always use more than one broker per host, and use different ports. Obviously, it would not work to use multiple brokers for the same key, that is the one thing you should not do.
Example
(First, make sure you install the library as a global package with NPM). The real power of this library comes with usage with Node.js, but we can use this functionality at the command line too:
# in shell 1, we launch a live-mutex server/broker
$ lmx start # 6970 is the default port
# in shell 2, we acquire/release locks on key "foo"
$ lmx acquire foo # 6970 is the default port
$ lmx release foo # 6970 is the default port
To set a port / host / uds-path in the current shell, use
$ lmx set host localhost
$ lmx set port 6982
$ lmx set uds_path "$PWD/zoom"If uds_path is set, it will override host/port. You must use $ lmx set a b, to change settings. You can elect to use these environment variables
in Node.js, by using {env: true} in your Node.js code.
// alternatively you can import all of these directly
import {Client, Broker} from 'live-mutex';
// aliases of the above;
import {LMXClient, LMXBroker} from 'live-mutex';To see a complete and simple example of using a broker and client in the same process, see: => docs/examples/simple.md
By default, a lock request will retry 3 times, on an interval defined by opts.lockRequestTimeout, which defaults to 3 seconds.
That would mean that the a lock request may fail with a timeout error after 9 seconds. To change the number of retries:
to use zero retries, use either {retry: false} or {maxRetries: 0}.
There is a built-in retry mechanism for locking requests. On the other hand for unlock requests - there is no built-in retry functionality.
If you absolutely need an unlock request to succeed, use opts.force = true. Otherwise, implement your own retry mechanism for unlocking. If you want the library
to implement automatic retries for unlocking, please file an ticket.
As explained in a later section, by default this library uses binary semaphores, which means only one lockholder per key at a time.
If you want more than one lockholder to be able hold the lock for a certain key at time, use {max:x} where x is an integer greater than 1.
Example
const opts = {port: '<port>' , host: '<host>'};
// check to see if the websocket broker is already running, if not, launch one in this process
const client = new Client(opts);
// calling ensure before each critical section means that we ensure we have a connected client
// for shorter lived applications, calling ensure more than once is not as important
return client.ensure().then(c => { // (c is the same object as client)
return c.acquire('<key>').then(({key,id}) => {
return c.release('<key>', id);
});
});Example
const times = 10000;
const start = Date.now();
async.timesLimit(times, 25, async n => {
const {id, key} = await c.acquire('foo');
// do your thing here
return await c.release(key, id); // or just return w/o await, since await is redundant in the return statement
}, err => {
if (err) {
throw err;
}
const diff = Date.now() - start;
console.log('Time required for live-mutex:', diff);
console.log('Lock/unlock cycles per millisecond:', Number(times / diff).toFixed(3));
process.exit(0);
});client.ensure(err => {
client.lock('<key>', (err, unlock) => {
unlock(err => { // unlock is a convenience function, bound to the correct key + request uuid
});
});
});client.ensure(err => {
client.lock('<key>', (err, {id, key}) => {
client.unlock(key, id, err => {
// note that if we don't use the unlock convenience callback,
// that we should definitely pass the id of the original request.
// this is for safety - we only want to unlock the corresponding lock,
// which is defined not just by the right key, but also the right request id.
});
});
});note: using the id ensures that the unlock call corresponds with the original corresponding lock call otherwise what could happen in your program is that you could call unlock() for a key/id that was not supposed to be unlocked by your current call.
We use a utility method on Client to promisify and run the unlock convenience callback.
return client.ensure().then(c => { // (c is the same object as client)
return c.acquire('<key>').then(unlock => {
return c.execUnlock(unlock);
});
});As you can see, before any client.lock() call, we call client.ensure()...this is not imperative, but it is a best practice.
client.ensure() only needs to be called once before any subsequent client.lock() call. However, the benefit of calling it before every time,
is that it will allow a new connection to be made if the existing one has a bad state.
Any locking errors will mostly be due to the failure to acquire a lock before timing out, and should very rarely happen if you understand your system and provide good settings/options to live-mutex.
Unlocking errors should be very rare, and most likely will happen if the process running the broker goes down or is overwhelmed. You can simply log unlocking errors, and otherwise ignore them.
You must either pass the lock id, or use force, to unlock a lock:
works:
return client.ensure().then(c => { // (c is the same object as client)
return c.acquire('<key>').then(({key,id}) => {
return c.release(key, id);
});
});works:
return client.ensure().then(c => { // (c is the same object as client)
return c.acquire('<key>').then(({key,id}) => {
return c.release(key, {force:true});
});
});will not work:
return client.ensure().then(c => { // (c is the same object as client)
return c.acquire('<key>').then(({key,id}) => {
return c.release(key);
});
});If it's not clear, the lock id is the id of the lock, which is unique for each and every critical section.
Although using the lock id is preferred, {force:true} is acceptable, and imperative if you need to unlock from a different process,
where you won't easily have access to the lock id from another process.
lock() method options
There are some important options. Most options can be passed to the client constructor instead of the client lock method, which is more convenient and performant:const c = new Client({port: 3999, ttl: 11000, lockRequestTimeout: 2000, maxRetries: 5});
c.ensure().then(c => {
// lock will retry a maximum of 5 times, with 2 seconds between each retry
return c.acquire(key);
})
.then(({key, id, unlock}) => {
// we have acquired a lock on the key, if we don't release the lock after 11 seconds
// it will be unlocked for us.
// note that if we want to use the unlock convenience function, it's available here
// runUnlock/execUnlock will return a promise, and execute the unlock convenience function for us
return c.execUnlock(unlock);
});env=>false, if you setenvto true, then Node.js lib will default to settings set from process.env (when you called:$ lmx set port 5000);port=>6970host=>localhostttl=>4000ms. If 4000ms elapses, if the lock still exists, the lock will be automatically released by the broker.maxRetries=>3. A lock request will be sent to the broker 3 times before an error is called back.lockRequestTimeout=>3000ms. For each lock request, it will timeout after 3 seconds. Upon timeout, it will retry until maxRetries is reached.keepLocksOnExit=>false. If true, locks will not be deleted if a connection is closed.noDelay=> true. By default true, if true, will use the TCP_NODELAY setting (this option is for both broker constructor and client constructor).
As already stated, unless you are using different options for different lock requests for the same client,
simply pass these options to the client constructor which allows you to avoid passing an options object for each
client.lock/unlock call.
This library conciously uses a CPS interface as this is the most primitive and performant async interface. You can always wrap client.lock and client.unlock to use Promises or Observables etc. In the docs directory, I've demonstrated how to use live-mutex with ES6 Promises and RxJS5 Observables. Releasing the lock can be implemented with (1) the unlock() convenience callback or with (2) both the lockName and the uuid of the lock request.
With regard to the Observables implementation, notice that we just pass errors to sub.next() instead of sub.error(), but that's just a design decision.
see:
docs/examples/promises.md
see:
docs/examples/observables.md
By default, only one lockholder can hold a lock at any moment, and that means {max:1}.
To change a particular key to allow more than one lockholder, use {max:x}, like so:
c.lock('<key>', {max:12}, (err,val) => {
// using the max option like so, now as many as 12 lockholders can hold the lock for key '<key>'
});Non-binary semaphores are well-supported by live-mutex and are a primary feature.
Use lmx utils to your advantage
To launch a broker process using Node.js:const {lmUtils} = require('live-mutex');
lmUtils.conditionallyLaunchSocketServer(opts, function(err){
if(err) throw err;
// either this process now owns the broker, or it's already running in a different process
// either way, we are good to go
// you don't need to use this utility method, you can easily write your own
// * the following is our recommended usage* =>
// for convenience and safety, you can use the unlock callback, which is bound
// to the right key and internal call-id
});To see examples of launching a broker using Node.js code, see:
src/lm-start-server.ts
To check if there is already a broker running in your system on the desired port, you can use a tcp ping utility to see if the web-socket server is running somewhere. I have had a lot of luck with tcp-ping, like so:
const ping = require('tcp-ping');
ping.probe(host, port, function (err, available) {
if (err) {
// handle it
}
else if (available) {
// tcp server is already listening on the given host/port
}
else {
// nothing is listening so you should launch a new server/broker, as stated above
// the broker can run in the same process as a client, or a separate process, either way
}
});
To see more, see: docs/examples/domains.md
Example
In most cases, a single client is sufficient, and this is true many types of networked clients using async I/O. You almost certainly do not need more than one client. However, if you do some empirical test, and find a client pool might be beneficial/faster, etc. Try this:const {Client} = require('live-mutex');
exports.createPool = function(opts){
return Promise.all([
new Client(opts).connect(),
new Client(opts).connect(),
new Client(opts).connect(),
new Client(opts).connect()
]);
}- if the major or minor version differs between client and broker, an error will be thrown in the client process.
Look at test/readme.md
In short, you almost certainly can't do this, because apparently sockets cannot be shared between host and container. Meaning if your client is running on the host machine (or other container), but your broker is running in a container, it will likely not be possible, but that's ok, since you can just use TCP/ports.
Example of an attempt
You almost certainly don't want to do this, as using UDS is for one machine only, and this technique only works on Linux it does not work on MacOS (sharing sockets between host and container).
When running on a single machine, here's how you do use UDS with Docker:
my_sock="$(pwd)/foo/uds.sock";
rm -f "$my_sock"
docker run -d -v "$(pwd)/foo":/uds 'oresoftware/live-mutex-broker:latest' --use-uds
The above passed the --use-uds boolean flag to the launch process, which tells the broker to use UDS instead of listening on a port.
The -v option allows the host and container to share a portion of the filesystem. You should probably just delete the socket file
before starting the container, in case the file already exists. '/uds/uds.sock' is the path in the container that points to the socket file,
it's a hardcoded fixed path.
When connecting to the broker with the Node.js client, you would use:
const client = new Client({udsPath: 'foo/uds.sock'});