The code for the extensions can be found on GitHub. (module streampipes-extensions)
Install:
In this setup we will start extensions such as pipeline elements in your IDE. The backend, UI and all the other services run in docker.
Clone Project [Link]
# SSH git clone git@github.com:apache/incubator-streampipes.git # HTTPS git clone https://github.com/apache/incubator-streampipes.git # switch to development branch git checkout dev |
Open CLI directory
cd incubator-streampipes/installer/cli/ |
Configure StreamPipes for backend development
./streampipes env --set pipeline-element # Updates the file 'pipeline-element'. All StreamPipes services required for development are selected |
Start third party services (e.g. CouchDB, Kafka, ... in docker)
./streampipes up -d |
We provide an environment file for each service in the folder development. This contains the environment variables that must be set to run the service.
For IntelliJ users: we ship run configurations with the repo located at .idea/runConfigurations
For other IDE users: You need to manually set environment variables for the corresponding service according to the specification found in the run configurations for IntelliJ
This is a service that wraps all pipeline elements written with the standard Java wrapper, hence the the notion of "jvm-all".
You can start writing own pipeline elements, that means adapters, processors, sinks.
For example, see the example of a Greeter processor https://github.com/wipatrick/apachecon-demo-processor
We also do provide maven archetypes to easily setup a Maven project skeleton for you, see https://streampipes.apache.org/docs/docs/dev-guide-archetype/