Commit Graph

58844 Commits

Author SHA1 Message Date
Casey Bodley
b2cc1d9ad6 rgw: implement ClientIO interface for asio + beast
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:16 +02:00
Casey Bodley
0dff37419e rgw: asio frontend calls process_request
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-10-21 22:57:16 +02:00
Casey Bodley
52d511ef41 rgw: RGWEnv::set takes boost::string_ref
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-10-21 22:57:16 +02:00
Casey Bodley
c50bdf3915 rgw: implement Frontend interface for asio
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-10-21 22:57:16 +02:00
Casey Bodley
2c48dc669b vstart: add --rgw_frontend option
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-10-21 22:57:16 +02:00
Casey Bodley
c5543a4951 rgw: add skeleton for boost::asio frontend
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:16 +02:00
Casey Bodley
273e5407a4 rgw: add submodule for Beast header-only library
Beast is a c++ http protocol library build on top of boost::asio

Signed-off-by: Casey Bodley <cbodley@redhat.com>
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-10-21 22:57:08 +02:00
Kefu Chai
4d9ce9e9a5 Merge pull request #11534 from ceph/wip-17607-ceph-disk
tests: ceph-disk: force debug monc = 0

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-10-19 15:29:58 +08:00
Kefu Chai
78f298df05 Merge pull request #11512 from wjwithagen/wip-wjw-freebsd-depends
FreeBSD: update require packages

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-10-19 11:32:59 +08:00
Sage Weil
5f07ecbfb8 Merge pull request #11204 from liewegas/wip-rados-ack
librados: do not request osd ack if no completed completion is set

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-10-18 21:40:44 -05:00
Sage Weil
20ee727792 Merge pull request #11213 from liewegas/wip-osd-fastinfo
osd: add a pg _fastinfo attribute to reduce per-io metadata updates

Reviewed-by: Samuel Just <sjust@redhat.com>
2016-10-18 21:39:58 -05:00
Sage Weil
0aeea8941b Merge pull request #11354 from liewegas/wip-rocksdb
rocksdb: update to latest, and make it the default for the mons
2016-10-18 21:38:53 -05:00
Sage Weil
d30ee64fc7 Merge pull request #11500 from liewegas/wip-lttng
CMakeLists.txt: enable LTTNG by default

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-10-18 21:38:40 -05:00
Sage Weil
ad2dde108b Merge pull request #11540 from liewegas/wip-bluestore-cow
os/bluestore: default bluestore_clone_cow=true
2016-10-18 15:53:37 -05:00
Sage Weil
dcbe9f05d4 Merge pull request #11539 from liewegas/wip-bluestore-gc
os/bluestore: no garbage collection for uncompressed blobs

Reviewed-by: Sage Weil <sage@redhat.com>
2016-10-18 15:53:25 -05:00
Sage Weil
369244314d os/bluestore: default bluestore_clone_cow=true
This has been stable for a long time.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-18 16:53:09 -04:00
Sage Weil
108724b7eb Revert "ceph_test_objecstore: use 1TB block device"
This reverts commit 5389133ff9.

This is too slow with the bitmap allocator.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-18 16:50:28 -04:00
Roushan Ali
ef8989ce74 os/bluestore: No garbage collection for uncompressed blobs
Signed-off-by: Roushan Ali<roushan.ali@sandisk.com>
2016-10-18 16:49:50 -04:00
Sage Weil
d9baaa1d6b Merge pull request #11536 from liewegas/wip-fullbit-dump
mds: fix EMetaBlob::fullbit xattr dump

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-18 13:43:17 -05:00
Sage Weil
15acca0bc5 Merge pull request #11533 from ifed01/wip-kstore-rmcoll-fix
os/kstore: rmcoll fix to satisfy store_test

Reviewed-by: Sage Weil <sage@redhat.com>
2016-10-18 13:22:11 -05:00
Sage Weil
325aff551c mds: fix EMetaBlob::fullbit xattr dump
- show xattr names!
- bound the values

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-18 14:03:17 -04:00
Loic Dachary
469a53a4ad tests: ceph-disk: force debug monc = 0
The sh function will collect both stderr and stdout and debug
will mess the json parsing.

Fixes: http://tracker.ceph.com/issues/17607

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2016-10-18 17:33:23 +02:00
Sage Weil
e234d8bec3 Merge pull request #11525 from wjwithagen/wip-wjw-freebsd-getopt
tools/ceph-monstore-update-crush.sh: FreeBSD getopt is not compatible…

Reviewed-by: Sage Weil <sage@redhat.com>
2016-10-18 09:45:24 -05:00
Sage Weil
c65f8d8d83 Merge pull request #11524 from wjin/filestore_perfcounter
os/filestore: clean filestore perfcounters

Reviewed-by: Sage Weil <sage@redhat.com>
2016-10-18 09:41:54 -05:00
Sage Weil
c4d774003f Merge pull request #11518 from umullan/uday
doc: fix broken links
2016-10-18 09:31:54 -05:00
Sage Weil
2a8ee42023 Merge pull request #11522 from wjwithagen/wip-wjw-freebsd-readable.sh
FreeBSD:test/encoding/readable.sh": fix nproc and ls -v calls

Reviewed-by: Sage Weil <sage@redhat.com>
2016-10-18 09:30:06 -05:00
Sage Weil
c82f30d823 Merge pull request #11528 from jcsp/wip-vstart-1osd
vstart: decrease pool size if <3 OSDs

Reviewed-by: Sage Weil <sage@redhat.com>
2016-10-18 09:28:26 -05:00
Sage Weil
bd407ce81f osd/PG: add perfcounters for pg info updates
Note info updates (of any kind), fastinfo updates,
and biginfo updates.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-18 10:16:13 -04:00
Igor Fedotov
ebf81e3039 os/bluestore: proper set resulting pnext to avoid returning local var
Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>
2016-10-18 13:50:17 +00:00
Igor Fedotov
5b36a93fd7 os/kstore: fix KStore rm_coll handler to behave similar to bluestore one
Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>
2016-10-18 13:47:00 +00:00
Sage Weil
d698ab3e34 ceph-objectstore-tool: relax cur_struct_v checks
All compat pg formats can handle past interval removal
and mark-complete.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-18 09:26:31 -04:00
Sage Weil
8e86de6078 osd: make fastinfo apply conditionally
This way we don't have to bother deleting the fastinfo
attr, which will reduce the amount of work the
underlying store has to do.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-18 09:26:31 -04:00
Sage Weil
1d5dc29a13 osd: add _fastinfo PG attr for common pg_info_t updates
For most IO operations we only update a handful of fields
in the pg_info_t structure.  However, the full struct,
when encoded, is on the order of 800 bytes.

This adds a new attribute, _fastinfo, which contains only
the most commonly updated fields.  When present, the
fastinfo fields should be overlayed on top of the full
info struct contained in the existing info attr.  If
a field outside of the "fast" set is updated, we clear
the fastinfo attribute and update the full info attr.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-18 09:26:31 -04:00
Sage Weil
203a721298 osd/PG: pass last_writen_info to _prepare_write_info
We'll use this shortly.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-18 09:26:30 -04:00
Sage Weil
1a7b13db36 osd/osd_types: operator== for pg hit sets, history, info
Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-18 09:26:30 -04:00
Sage Weil
f0cd1fe2d9 osd/PG: drop unused args to _prepare_write_info
Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-18 09:26:30 -04:00
Sage Weil
655a3d74b3 osd/PG: pg_stat_t ondisk_log_size == log_size
Signed-off-by: Sage Weil <sage@redhat.com>
2016-10-18 09:26:30 -04:00
Orit Wasserman
e92757eb8e Merge pull request #10325 from snakeAngel2015/rgw-support-s3subuser
rgw: add suport for creating S3 type subuser of admin rest api
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-10-18 15:15:13 +02:00
Igor Fedotov
4a9c8e07b5 os/kstore: uniform Collection implementation with BlueStore one
Signed-off-by:Igor Fedotov <ifedotov@mirantis.com>
2016-10-18 13:04:43 +00:00
Kefu Chai
7661da65bf Merge pull request #11481 from ddiss/cmake_rgw_deps
cmake: check WITH_RADOSGW for fcgi and expat dependencies

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-10-18 20:40:59 +08:00
John Spray
095c271d26 vstart: decrease pool size if <3 OSDs
Makes it easy to do OSD=1 for e.g. doing cephfs
stuff where we don't care much about the OSDs
behaviour.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-10-18 11:59:41 +01:00
Orit Wasserman
55844b2492 Merge pull request #10239 from weiqiaomiao/wqm-wip-setolh
rgw: should assign 'olh_bl" to state.attrset[RGW_ATTR_OLH_ID_TAG] instead of 'bl'
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-10-18 12:20:16 +02:00
Orit Wasserman
36adaab7b5 Merge pull request #11324 from yehudasa/wip-14589
rgw: dump objects in RGWBucket::check_object_index()
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-10-18 11:40:34 +02:00
Willem Jan Withagen
3c8cd0ffd8 tools/ceph-monstore-update-crush.sh: FreeBSD getopt is not compatible, use the one from packages
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2016-10-18 11:40:28 +02:00
Kefu Chai
c5ee3b5274 Merge pull request #11432 from hansbogert/patch-3
doc: Update install-ceph-gateway.rst

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-10-18 17:19:15 +08:00
Uday Mullangi
2393f9e4ba Fixes: #17587
doc: Fixing the broken link which was refactored for authentication as part of other PR
Signed-off-by: uday udaymjl@gmail.com
2016-10-18 11:51:58 +05:30
Wei Jin
6385546826 os/filestore: clean filestore perfcounters
Move filestore perfcounters from objectstore to filestore itself
and change internal index name.

Signed-off-by: Wei Jin <wjin.cn@gmail.com>
2016-10-18 11:53:04 +08:00
Sage Weil
29119aaff3 Merge pull request #11027 from liewegas/wip-denc
fast denc encoding

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Allen Samuels <allen.samuels@sandisk.com>
2016-10-17 21:21:20 -05:00
Sage Weil
9a8bcf8fbf Merge remote-tracking branch 'gh/kraken' 2016-10-17 13:35:45 -04:00
Ali Maredia
eab4664287 cmake: find GIT_VER variables if there is no .git dir
find CEPH_GIT_VER & CEPH_GIT_NICE_VER if there is no
ceph/.git dir by parsing ceph/src/.git_version.

scenario is for building from source tarballs generated
by make-dist, since make-dist generates .git_version
by running make_version, and then packs .git_version
into the tarball.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
(cherry picked from commit c5c6b59f29)
2016-10-17 11:47:32 -04:00