Forge Home

Modules

Resources

PuppetEcosystemPuppet CommunityUpdates

xtreemfs

The XtreemFS module allows you to easily manage XtreemFS installation, volumes and mounts
Project URLRSS FeedReport issues

9,490 downloads

9,490 latest version

2.6 quality score

We run a couple of automated
scans to help you access a
module's quality. Each module is
given a score based on how well
the author has formatted their
code and documentation and
modules are also checked for
malware using VirusTotal.

Please note, the information below
is for guidance only and neither of
these methods should be considered
an endorsement by Puppet.

Version information

  • 0.6.0 (latest)
released Dec 10th 2014
This version is compatible with:
  • Puppet Enterprise >=2.8.0 <4.0.0
  • Puppet >=2.7.0 <4.0.0
  • , , , , ,

Start using this module

  • r10k or Code Manager
  • Bolt
  • Manual installation
  • Direct download

Add this module to your Puppetfile:

mod 'wavesoftware-xtreemfs', '0.6.0'
Learn more about managing modules with a Puppetfile

Add this module to your Bolt project:

bolt module add wavesoftware-xtreemfs
Learn more about using this module with an existing project

Manually install this module globally with Puppet module tool:

puppet module install wavesoftware-xtreemfs --version 0.6.0

Direct download is not typically how you would use a Puppet module to manage your infrastructure, but you may want to download the module in order to inspect the code.

Download

Documentation

wavesoftware/xtreemfs — version 0.6.0 Dec 10th 2014

xtreemfs

Status Info

GitHub Issues Puppet Forge GitHub Release Apache 2.0 License

Master (stable) branch

Build Status Build Status Coverage Status Code Climate Inline docs

Development branch

Build Status Build Status Dependency Status Coverage Status Code Climate Inline docs

Table of Contents

  1. Overview - What is the XtreemFS module?
  2. Module Description - What does the module do?
  3. Setup - The basics of getting started with XtreemFS module
  4. Usage - How to use the module for various tasks
  5. Tests - how to perform unit and acceptance tests
  6. Contributing - how to send your work?

Overview

The XtreemFS module allows you to easily manage XtreemFS installation, volumes and mounts with Puppet.

Module Description

XtreemFS is a fault-tolerant distributed file system for all storage needs. The xtreemfs module allows you to manage XtreemFS packages and services on several operating systems, while also supporting basic management of XtreemFS volumes and mounts. The module offers support for basic management of replication settings.

Setup

What wavesoftware/xtreemfs affects:

  • package/service/configuration files for XtreemFS
  • listened-to ports

###Configuring the installation

The main configuration you'll need to do will be around the xtreemfs::role::directory, xtreemfs::role::metadata and xtreemfs::role::storage classes. The default parameters are reasonable.

####To manage a XtreemFS with sane defaults on one server:

include xtreemfs::role::directory
include xtreemfs::role::metadata
include xtreemfs::role::storage

####Hiera configuration

  • xtreemfs::settings::dir_host
    • Provide an host to where metadata and storage nodes will be connecting, defaults: $::fqdn
  • xtreemfs::settings::dir_port
    • A port for directory service connection
  • xtreemfs::settings::dir_protocol
    • A protocol for directory service connection
  • xtreemfs::settings::object_dir
    • A direcory where storage nodes will hold their replicated data. Good idea is to provide a directory on secure RAID drive, defaults: /var/lib/xtreemfs
  • xtreemfs::settings::install_packages
    • If set to true will install packages of XtreemFS, defaults: truedi
  • xtreemfs::settings::add_repo
    • If set to true will add to system repository for XtreemFS, defaults: true
  • xtreemfs::settings::properties

####For distributed without hiera

Directory service

# In this example fqdn is dir.vagrant.dev
include xtreemfs::role::directory

Metadata server

class { 'xtreemfs::role::metadata':
  dir_host => 'dir.vagrant.dev',
}

Storage node(s)

class { 'xtreemfs::role::storage':
  dir_host   => 'dir.vagrant.dev',
  object_dir => '/mnt/sdb1/xtreem', # actual object will be in: /mnt/sdb1/xtreem/objs 
}

Client(s)

Described in usage section.

Usage

###Creating a volume

There are many ways to set up a XtreemFS volume using the xtreemfs::volume definition. For instance, to set up simple volume on default parameters:

xtreemfs::volume { 'myVolume':
  ensure   => 'present',
  dir_host => 'dir.vagrant.dev',
}

In this example, you would create volume with default parameters.

###Managing mounts

To manage mount point:

xtreemfs::mount { '/mnt/xtreemfs':
  ensure   => 'mounted',
  volume   => 'myVolume',
  dir_host => 'dir.vagrant.dev',
}

In this example, you would mount an existing volume into /mnt/xtreemfs directory that already exists.

###Replication

To replicate an existing file for ex.: /mnt/xtreemfs/centos7.iso inside the XtreemFS mount point, use:

xtreemfs::replicate { '/mnt/xtreemfs/centos7.iso':
  policy  => 'WqRq',
  factor  => 2,      # Required storage nodes
}

###Automatic replication

To automatically replicate new files in XtreemFS mount point you can set a policy for directory. This will not affect existing files. Take a look at example usage:

xtreemfs::policy { '/mnt/xtreemfs':
  policy  => 'WqRq',
  factor  => 2,      # Required storage nodes
}

Tests

There are two types of tests distributed with the module. Unit tests with rspec-puppet and system tests using rspec-system.

For unit testing, make sure you have:

  • rake
  • bundler

Install the necessary gems (gems will be downloaded to private .vendor directory):

bundle install --path .vendor

And then run the unit tests:

bundle exec rake spec

The unit tests are ran in Travis-CI as well, if you want to see the results of your own tests register the service hook through Travis-CI via the accounts section for your Github clone of this project.

If you want to run the system acceptance tests, make sure you also have:

  • vagrant > 1.2.x
  • Virtualbox > 4.2.10

Then run the tests using:

bundle exec rake acceptance

To run the tests on different operating system, see the sets available in spec/acceptance/nodesets/ and run the specific set with the following syntax:

bundle exec rake acceptance RS_SET=debian-76-x64

You can also run system acceptance tests against Docker containers. If you want to do this, make sure you also have:

  • docker > 1.0.0

To run the the test on docker container use:

bundle exec rake acceptance RS_SET=centos-65-x64-docker

###Contributing

Contributions are welcome!

To contribute, follow the standard git flow of:

  1. Fork it
  2. Create your feature branch (git checkout -b feature/my-new-feature)
  3. Commit your changes (git commit -am 'Add some feature')
  4. Push to the branch (git push origin feature/my-new-feature)
  5. Create new Pull Request

Even if you can't contribute code, if you have an idea for an improvement please open an issue.