ceph nautilus - all new [wip]

Posted on Wed 02 January 2019 in Ceph • Tagged with ceph, notepad, nautilus • 1 min read

The Nautilus (14.x.x) release is scheduled for Feb 2019! 9 months after Mimic (13.x.x)

So what's new in ceph nautilus?

There are some new feature and updates:


Continue reading

ceph - sort osds by utilisation

Posted on Thu 20 September 2018 in Ceph • Tagged with ceph, crush, linux, notepad, code • 1 min read

Version 1: keep it simple

$ ceph osd df  | awk '{ print "osd."$1, "size: "$5, "usage: " $8 }' | sort -nk5

OSDs can be listed twice - depends on the crushmap.

Version 2: json + python

$ ceph osd df tree -f json | python sort_hdd_osds.py
osd.28  utilization: 15.278888
osd.15  utilization: 19.700484 …

Continue reading

ceph - wrong osd id with lvm+filestore

Posted on Wed 04 July 2018 in Ceph • Tagged with bluestore, ceph, ceph-ansible, LVM, linux, notepad, howto • 2 min read

Not sure why...but i've found a strange ceph-volume behavior with lvm and filestore.

ceph-volume lvm list shows the wrong osd id while the affected osd is online with a another id.

$ mount | grep ceph-2
/dev/mapper/vg00-datalv1 on /var/lib/ceph/osd/ceph-2 type xfs (rw,relatime,seclabel,attr2 …

Continue reading

ceph-ansible: minimal containerized deployment (docker)

Posted on Wed 28 February 2018 in Ceph • Tagged with ansible, ceph, Linux, Openstack • 1 min read

tested with v3.0.26

group_vars/all.yml

monitor_interface: eth1
radosgw_interface: eth1
public_network: 10.20.30.0/24
cluster_network: 192.168.121.0/24
ceph_conf_overrides:
    osd:
        osd scrub during recovery: false
ceph_docker_image: "ceph/daemon"
ceph_docker_image_tag: latest
ceph_docker_registry: 10.20.30.1:5000
containerized_deployment: true

group_vars/osds.yml

crush_location: true
osd_crush_location …

Continue reading

SUSE Cloud – missing cinder key on computes - part2

Posted on Thu 07 December 2017 in openstack • Tagged with ceph, Openstack, suse cloud, SUSE Linux Enterprise Server, cinder, notepad, linux • 1 min read

I've found the root cause for the missing cinder key on the computes.

chef-client output - without any files:

[2017-11-30T09:37:33+01:00] INFO: Processing package[ceph-common] action install (nova::ceph line 50)
[2017-11-30T09:37:33+01:00] INFO: Ceph configuration file is …

Continue reading

SUSE Cloud - missing cinder key on computes

Posted on Fri 17 November 2017 in openstack • Tagged with ceph, Openstack, suse cloud, SUSE Linux Enterprise Server, cinder, notepad, linux • 1 min read

2017-11-01 14:30:53.970 27835 ERROR nova.virt.libvirt.driver [instance: c5618826-98cb-4fd6-9d6f-b8899bd320b7] libvirtError: Secret not found: no secret with matching uuid '5b7c1b36-
9093-4a13-b14d-da8b8cbdd8a6'
2017-11-01 14:30:53.970 27835 ERROR nova.virt.libvirt …

Continue reading

ceph metasearch – elasticsearch backend - part 2

Posted on Thu 27 April 2017 in Ceph • Tagged with ceph, elasticsearch, radosgw, howto, linux, notepad, work • 2 min read

ceph-kraken

requirements

  • ceph cluster (kraken release)
  • elasticsearch

The rgw syncer is only used/triggered in multisite configurations - so we need to setup a second zone for the metasearch.

environment / settings
export rgwhost="192.168.122.80"
export elastichost="192.168.122.71"
export realm="demo"
export zonegrp="zone-1"
export 1zone="zone1-a …

Continue reading

ceph radosgw (set)lifecycle - AWS v4 is broken

Posted on Wed 26 April 2017 in Ceph • Tagged with ceph, elasticsearch, radosgw, howto, linux, notepad, work • 1 min read

First - s3cmd config
Setting signature_v2 = true is not enough! You have to set --signature-v2 as a parameter.

Second - 'Prefix' tag
You have specify a Prefix tag - and yes with a captial P!

without prefix tag
<LifecycleConfiguration>
    <Rule>
        <ID>ExampleRule</ID>
    <Status>Enabled</Status>
        <Expiration>
             <Days>1</Days>
        </Expiration>
    </Rule>
</LifecycleConfiguration …

Continue reading

ceph metasearch - elasticsearch backend

Posted on Fri 21 April 2017 in Ceph • Tagged with ceph, elasticsearch, radosgw, howto, linux, notepad, work • 1 min read

ceph-kraken

Fetch zonegroup configuration (json struct)
# radosgw-admin zonegroup get > /tmp/zonegroup.json

change the tier_type to elasticsearch

Import the configuration
# radosgw-admin zonegroup set --infile /tmp/zonegroup.json
Fetch zone configuration (json struct)
# radosgw-admin zone get > /tmp/zone.json

Add the following parameter endpoint & {url} for the section tier_config

    "tier_config": [
        {
            "key": "endpoint …

Continue reading

Fixing ceph partition uuid or OSD data dir is not mounted

Posted on Mon 06 February 2017 in Ceph • Tagged with ceph, linux, notepad, work • 1 min read

OSD_UUID

4fbd7e29-9d25-41b8-afd0-062c0ceff05d

JOURNAL_UUID

45b0969e-9b03-4f30-b4c6-b4b80ceff106

To fix the partition uuid

sgdisk --info=##partnr## -t ##partnr##:##part-uuid## /dev/##disk##

eg.
sgdisk --info=1 -t 1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d /dev/sda1

Ref: /lib/udev/rules.d/95-ceph-osd.rules