Questions tagged [fiware-cygnus]

fiware-cygnus tag refers to the Cygnus connector implementation (FIWARE platform), allowing for Orion context data persistence in an historical way in several different storages such as HDFS, MySQL or CKAN

Cygnus is a data connector within FIWARE platform allowing for Orion context data persistence in an historical way in several different storages such as HDFS, MySQL or CKAN. Cygnus characteristics are:

  • It is based in Apache Flume, expanding the core elements with custom sinks, http handlers, channel selectors and interceptors among others.
  • Smart destination (HDFS file, MySQL table or CKAN resource) extraction based on data properties.
  • Automatic Hive tables creation when using HDFS sinks.
  • Support for multiple persistence models (json-row, json-column, ...)

Home Page: http://catalogue.fiware.org/enablers/publishsubscribe-context-broker-orion-context-broker/documentation (within the Orion Context Broker catalogue entry)

GitHub Page: https://github.com/telefonicaid/fiware-connectors/tree/master/flume

269 questions
5
votes
2 answers

How to scale Orion GE?

I have deployed an Orion instance in FILAB and I have configured the Cygnus inyector in order to store information in Cosmos. But...let us imagine a scenario in which the number of entities increases drastically. In this hypothetical scenario one…
4
votes
2 answers

Unable to run Cygnus with MySQL agent

I am trying to setup and understand Cygnus. But I am facing issue during installation. I followed below given steps. Install Cygnus using Docker (docker run -d -p 5050:5050 -p 8081:8081 fiware/cygnus-common) Executed version command (curl…
Krishan Babbar
  • 666
  • 1
  • 6
  • 16
4
votes
1 answer

Cygnus Java heap space

We have problems in cygnus. It is appearing this error in the log. java.lang.OutOfMemoryError: Java heap space We have changed the memory assigned to cygnus but we do not know if it is correct. The file modifcated is…
urkosimon
  • 81
  • 4
4
votes
1 answer

how to combine multiple orion entities to one ckan dataset using cygnus?

Right now I'm trying to create a dataset for my orion data with all the entitys info. I set up all correctly and when some data changes orion send a notification to cygnus and then, cygnus will add the data to ckan. As seen in this image. The…
Mario Corral
  • 357
  • 3
  • 12
4
votes
1 answer

Fiware - Cygnus: Issue with collection's names

I have encountered a strange behaviour on the Cygnus module. I’m using Context Broker version 0.28 and Cygnus version 0.13. Let’s suppose that I have loaded on the CB (Context Broker) some entities similars to this one: (curl…
Julen
  • 263
  • 1
  • 9
4
votes
1 answer

How to properly set up column mode in cygnus?

I have cygnus working automatically just fine in row mode. But I want to switch to column mode, this means that I now have to manually set up my tables with appropriate column types (right?). I figured that the column type of the attributes should…
Vrankela
  • 1,070
  • 2
  • 14
  • 36
4
votes
1 answer

Insert sequence of values for the same entity

I have Orion working seamlessly, saving entities and retrieving them. But I'd like to know which is the recommended way to insert (and/or retrieving) a sequence of values for an entity, not updating its value, but adding a new value to the entity,…
medaqueno
  • 73
  • 6
4
votes
1 answer

Fiware Context Broker: can we subscribe to all the context updates?

I am using Fiware cygnus to subscribe to orion context broker entities. Is it possible to subscribe to all the context updates with one script? I dont want to do it one by one. Here is an example of subscription: (curl…
sabrina2020
  • 1,833
  • 1
  • 20
  • 43
4
votes
1 answer

Posting historical data into Orion Contex Broker with a different date

We have found an issue that is important for us and we need to solve before proceeding with Orion Contex Broker. In our distributed network we cannot assume links are allways up and sometimes we have historic values probed in past time that we want…
4
votes
1 answer

Fiware - Cygnus to Cosmos, I can not upload data to HDFS

I've got an Orion instance with Cygnus, subcription and notify work fine but I can not send files to cosmos.lab.fi-ware.org from my instance. [ERROR - es.tid.fiware.orionco nnectors.cosmosinjector.OrionHDFSSink.start(OrionHDFSSink.java:108)]…
Maxime
  • 68
  • 6
3
votes
0 answers

Cygnus subscription ngsi_version=2 not implemented

I install the followin docker image of cygnus this. And when i try to make a subscription like the tutorial example i got the following error: POST /v1/subscriptions&ngsi_version=2 not implemented This is my POST request: { "subscription":{ …
Efeyabel
  • 487
  • 3
  • 17
3
votes
2 answers

Fiware cygnus build failure

I wanted to use Fiware cygnus to persist data from the context broker into a CKAN instance. I've already created an orion context broker vm which is orion-psb-image-R5.4 version 1.7.0 and a ckan VM on Fiware cloud. I began to install fiware cygnus…
ahmad
  • 175
  • 9
3
votes
1 answer

cygnus in Docker: How to fixe the OutOfMemoryError?

I got this error on cygnus instance in Docker: java.lang.OutOfMemoryError: GC overhead limit exceeded How can I fix it?
sabrina2020
  • 1,833
  • 1
  • 20
  • 43
3
votes
1 answer

Subscription status change after post

After successfully installed Cygnus connector and testing the creation of subscriptions. With bellow files: agent_1.conf cygnus-ngsi.sources = http-source cygnus-ngsi.sinks = hdfs-sink cygnus-ngsi.channels =…
netzahdzc
  • 237
  • 1
  • 10
3
votes
2 answers

How to connect Orion with the public cosmos.lab.fi-ware.org instance using Cygnus

I am trying to persist my Orion data into the public cosmos.lab.fi-ware.org instance using Cygnus. Cygnus is up and running and the HDFSSink part of my /usr/cygnus/conf/agent_1.conf looks like this: # OrionHDFSSink configuration …
José Castillo Lema
  • 307
  • 1
  • 2
  • 16
1
2 3
17 18