The SWC-DB Hadoop Filesystem - Configuration Properties

The SWC-DB Hadoop Filesystem Library can be configured with these configuration properties.

The full use of SWC-DB FileSystemHadoop(Native C++) - state depends on progress of libhdfscpp.

  • swc.fs.hadoop.cfg.dyn

    TYPE_STRINGS The Dynamic cfg-file to use. Config Handler will check & reload this cfg-file by swc.cfg.dyn.period
    default swc.fs.hadoop.cfg.dyn=

  • swc.fs.hadoop.path.root

    TYPE_STRING The Hadoop FileSystem's base root path.
    default swc.fs.hadoop.path.root=

  • swc.fs.hadoop.metrics.enabled

    TYPE_BOOL Enable or Disable Metrics tracking.
    default swc.fs.hadoop.metrics.enabled=true

  • swc.fs.hadoop.namenode

    TYPE_STRINGS The Namenode Host + optionally the :Port, many key=value allowed.

    The hadoop .xml confgiurations are used, if not set.

    default swc.fs.hadoop.namenode=

  • swc.fs.hadoop.namenode.port

    TYPE_UINT16 The Namenode Port, usefull if many namenodes and port is the same.
    default swc.fs.hadoop.namenode.port=

  • swc.fs.hadoop.user

    TYPE_STRING Use Hadoop under this username.
    default swc.fs.hadoop.user=

  • swc.fs.hadoop.concurrency.relative

    TYPE_BOOL Whether HW-Concurrency base is used with the Applicable cfg properties.
    default swc.fs.hadoop.concurrency.relative=true

  • swc.fs.hadoop.handlers

    TYPE_INT32 The Number or HW-Concurrency base of Handlers for hadoop tasks.
    default swc.fs.hadoop.handlers=6

The configuration properties applicable for dynamic reloading

  • swc.fs.hadoop.fds.max

    TYPE_INT32_G The Max Open File Descriptors for the option of not closing, Condition dependable by the Program using the filesystem.
    default swc.fs.hadoop.fds.max=256