Controller Server Configuration

blur-site.properties

These are the default settings for the shard server that can be overridden in the blur-site.properties file. Consider increasing the various thread pool counts (*.thread.count). The blur.controller.server.remote.thread.count is very important to increase for larger clusters, basically one thread is used per shard server per query. Some production cluster have used set this thread pool to 2000 or more threads.

blur.controller.hostname=
blur.controller.bind.address=0.0.0.0
blur.controller.bind.port=40010
blur.controller.server.thrift.thread.count=32
blur.controller.server.remote.thread.count=64
blur.controller.remote.fetch.count=100

blur.controller.retry.max.fetch.retries=3
blur.controller.retry.max.mutate.retries=3
blur.controller.retry.max.default.retries=3
blur.controller.retry.fetch.delay=500
blur.controller.retry.mutate.delay=500
blur.controller.retry.default.delay=500
blur.controller.retry.max.fetch.delay=2000
blur.controller.retry.max.mutate.delay=2000
blur.controller.retry.max.default.delay=2000

blur.query.max.results.fetch=1000
blur.query.max.row.fetch=100
blur.query.max.record.fetch=1000

blur.gui.controller.port=40080

blur.metrics.reporters=

blur-env.sh

# JAVA JVM OPTIONS for the controller servers, jvm tuning parameters are placed here.
# Consider adding the -XX:OnOutOfMemoryError="kill -9 %p" option to kill jvms that are failing due to memory issues.
export BLUR_CONTROLLER_JVM_OPTIONS="-Xmx1024m -Djava.net.preferIPv4Stack=true "

# Time to sleep between controller server commands.
export BLUR_CONTROLLER_SLEEP=0.1

# The of controller servers to spawn per machine.
export BLUR_NUMBER_OF_CONTROLLER_SERVER_INSTANCES_PER_MACHINE=1

ControllerServer (last edited 2013-06-14 01:28:42 by AaronMcCurry)