Questions tagged [nsq]

NSQ is a realtime message processing system designed to operate at bitly’s scale, handling billions of messages per day.

NSQ is a realtime message processing system designed to operate at bitly’s scale, handling billions of messages per day.

It promotes distributed and decentralized topologies without single points of failure, enabling fault tolerance and high availability coupled with a reliable message delivery guarantee.

Operationally, NSQ is easy to configure and deploy (all parameters are specified on the command line and compiled binaries have no runtime dependencies). For maximum flexibility, it is agnostic to data format (messages can be JSON, MsgPack, Protocol Buffers, or anything else). Go and Python libraries are available out of the box.

Questions can also be posted to the nsq-users Google group.

Bugs can be filed on GitHub.


55 questions
0
votes
1 answer

Is Nsqjs really slow compared to Pynsq?

I have the following code in javascript var nsq = require('nsqjs'); var reader = new nsq.Reader('output', 'out', { lookupdHTTPAddresses: '172.32.10.224:4161' }); reader.connect(); reader.on('message', function (msg) { console.log('Received…
user1870400
  • 4,540
  • 11
  • 41
  • 87
0
votes
1 answer

how to implement a nsq writer which can fetch messages from a queue and push them?

What I want is just run a ioloop in a thread, and write message to nsqd. Here is a try: #!/usr/bin/env python2 # coding=utf-8 import tornado import time from nsq.writer import Writer w = Writer(["bj1:4150", "bj2:4150"],…
Peng Qu
  • 349
  • 3
  • 11
0
votes
1 answer

NSQ vb.net MessageHandler

I am trying to use this package in vb.net NsqSharp There is a good code for it in C# but i need it in vb.net. I got it to send a message to my NSQ server, but the problem is to get it. But i get a error on consumer.AddHandler(New HandleMessage())…
Krister Johansson
  • 693
  • 2
  • 8
  • 29
0
votes
1 answer

Running NSQ in Docker

I am trying to spin up NSQ using docker-compose. nsqlookupd: image: nsqio/nsqlookupd ports: - "4160:4160" - "4161:4161" nsqd: image: nsqio/nsqd ports: - "4150" - "4151" links: - nsqlookupd:nsqlookupd command:…
if __name__ is None
  • 9,863
  • 15
  • 48
  • 68
0
votes
1 answer

not insert data to rethinkdb

i am trying to create NSQ topic and insert data at rethinkdb but i am unable to insert the data into rethinkdb. Can anyone help me. **var nsq = require('nsqjs'); var r = require('rethinkdb'); var nsqdd = (process.env.NSQD_RETH ||…
Istiak Mahmood
  • 2,401
  • 7
  • 17
  • 46
0
votes
1 answer

defer log.SetOutput(os.Stdout) after log.SetOutput(ioutil.Discard)

In go-nsq library (https://github.com/bitly/go-nsq/blob/master/writer_test.go#L38), I found the following code: log.SetOutput(ioutil.Discard) defer log.SetOutput(os.Stdout) Why does the author defer logging to stdout after discard the log?
Mingyu
  • 26,145
  • 13
  • 50
  • 58
0
votes
1 answer

pynsq: Reader object has no attribute 'finish'

This error occurs on pynsq 0.4.2 STACKTRACE 2013-07-30 15:03:43,205 ERROR [ip-10-114-195-89:4150:nsq_msg_handler] failed to handle_message() Traceback (most recent call last): File "/usr/local/lib/python2.7/dist-packages/nsq/Reader.py", line…
Sagar Hatekar
  • 8,348
  • 14
  • 52
  • 72
0
votes
1 answer

pynsq: backing off for 'n' seconds

WHAT I am consuming messages from a NSQ server using 4 consumers. I am trying to debug the reason why I see the backing off logs as my consumers slow down when this happens. I am logging exceptions and that's when I return a False to requeue the…
Sagar Hatekar
  • 8,348
  • 14
  • 52
  • 72
-1
votes
1 answer

After nsq.run() my python script is not executing block of code in "pynsq" package

I am trying to use "pynsq" package (message broker service) to my django project. but when i run the Asynchronous consumer request using nsq.Reader() class by using nsq.run() command it takes my main thread and my code after this command is not…
-1
votes
2 answers

How can I review the nsq source code in intellij?

I download and build up the nsq src code and i wanna to navigate the src code by intellij 14.0 golang plugin. How can I import the whole nsq project into intellij without errors?
uuball
  • 321
  • 2
  • 5
  • 11
1 2 3
4