ceph/rgw metasearch with elasticsearch 6.x

Posted on Tue 29 January 2019 in Ceph • Tagged with ceph, elasticsearch, radosgw, howto, linux, notepad, work • 1 min read

Houston, we have a problem

Since elasticsearch 6.x requires to provide the correct content-type for a request and the elastic sync module has no option for the content-type....we stucked at elastic 5.x

Error message

{"error":"Content-Type header [] is not supported","status":406}

strace log

strace -e network …

Continue reading

ceph metasearch – elasticsearch backend - part 2

Posted on Thu 27 April 2017 in Ceph • Tagged with ceph, elasticsearch, radosgw, howto, linux, notepad, work • 2 min read

ceph-kraken

requirements

  • ceph cluster (kraken release)
  • elasticsearch

The rgw syncer is only used/triggered in multisite configurations - so we need to setup a second zone for the metasearch.

environment / settings
export rgwhost="192.168.122.80"
export elastichost="192.168.122.71"
export realm="demo"
export zonegrp="zone-1"
export 1zone="zone1-a …

Continue reading

ceph radosgw (set)lifecycle - AWS v4 is broken

Posted on Wed 26 April 2017 in Ceph • Tagged with ceph, elasticsearch, radosgw, howto, linux, notepad, work • 1 min read

First - s3cmd config
Setting signature_v2 = true is not enough! You have to set --signature-v2 as a parameter.

Second - 'Prefix' tag
You have specify a Prefix tag - and yes with a captial P!

without prefix tag
<LifecycleConfiguration>
    <Rule>
        <ID>ExampleRule</ID>
    <Status>Enabled</Status>
        <Expiration>
             <Days>1</Days>
        </Expiration>
    </Rule>
</LifecycleConfiguration …

Continue reading

ceph metasearch - elasticsearch backend

Posted on Fri 21 April 2017 in Ceph • Tagged with ceph, elasticsearch, radosgw, howto, linux, notepad, work • 1 min read

ceph-kraken

Fetch zonegroup configuration (json struct)
# radosgw-admin zonegroup get > /tmp/zonegroup.json

change the tier_type to elasticsearch

Import the configuration
# radosgw-admin zonegroup set --infile /tmp/zonegroup.json
Fetch zone configuration (json struct)
# radosgw-admin zone get > /tmp/zone.json

Add the following parameter endpoint & {url} for the section tier_config

    "tier_config": [
        {
            "key": "endpoint …

Continue reading