Commit Graph

103031 Commits

Author SHA1 Message Date
Tatjana Dehler
4dd83fd6aa mgr/dashboard: check for correct DashboardException error codes
We need to check for the correct error codes.
Otherwise the integration tests are going to fail.

Fixes: https://tracker.ceph.com/issues/42222
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2019-10-11 10:46:26 +02:00
Matt Benjamin
d7ac40e55d
Merge pull request #26524 from linuxbox2/wip-lc-days-0
rgw: lifecycle days may be 0
2019-10-10 10:27:23 -04:00
Yuval Lifshitz
c286238c71
Merge pull request #30735 from yuvalif/fix_race_condition_in_amqp_test
rgw/amqp: fix race condition in AMQP unit test
2019-10-10 16:35:28 +03:00
Nathan Cutler
bcdf11a0ce
Merge pull request #30725 from smithfarm/wip-more-cbs-2
ceph-backport.sh: automate setting of milestone and component label, implement --version option

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2019-10-10 14:25:43 +02:00
Nathan Cutler
a2515ec5cd ceph-backport.sh: do not say "1 commits"
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-10-10 14:22:28 +02:00
Nathan Cutler
d6bad1d186 ceph-backport.sh: correctly add note to backport tracker
Before this commit, the JSON was wrong and Redmine silently ignored the note.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-10-10 14:22:28 +02:00
Nathan Cutler
549b82c11f ceph-backport.sh: set SCRIPT_VERSION using --update-version
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-10-10 14:22:28 +02:00
Nathan Cutler
4866621bca ceph-backport.sh: implement --update-version and --version options
--update-version (intended for use by script maintainer only) will derive
version number from the output of "git describe" and set the SCRIPT_VERSION
variable inside the script.

--version will display a version number message and exit immediately thereafter.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-10-10 14:22:28 +02:00
Nathan Cutler
ea97a5a02b ceph-backport.sh: guess component label
If component label is not provided explicitly on the command line, attempt to
guess it.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-10-10 14:22:25 +02:00
Tatjana Dehler
3126702c5d
Merge pull request #29447 from rafaelquint/osdtest2
mgr/dashboard: Verify fields on OSDs page

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-10-10 13:05:16 +02:00
Ricardo Marques
d611a6abc3
Merge pull request #30400 from rhcs-dashboard/fix-41867-master
mgr: change perf-counter precision to float

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2019-10-10 11:45:13 +01:00
Tatjana Dehler
844a080985
Merge pull request #30814 from Devp00l/wip-42077
mgr/dashboard: Fixes random cephfs tab test failure

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-10-10 12:15:49 +02:00
Kefu Chai
9a0818cd25
Merge pull request #30834 from tchaikov/wip-crimson/pg-lease
crimson/osd: should handle pg_lease messages

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-10-10 17:28:52 +08:00
Stephan Müller
250d055f07 mgr/dashboard: Fixes random cephfs tab test failure
Fixes: https://tracker.ceph.com/issues/42077
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-10-10 10:36:47 +02:00
Yuval Lifshitz
5934ef5071 rgw/amqp: fix race condition in AMQP unit test
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
2019-10-10 11:05:05 +03:00
Kefu Chai
bea807ff32 crimson/osd: always init BufferedRecoveryMessages w/ octopus
we don't need to be compatible with pre-octopus releases

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-10-10 15:03:00 +08:00
Kefu Chai
3ddc63b7d3 crimson/osd: use in-class initialization to init member variables
for better readability

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-10-10 15:02:06 +08:00
Kefu Chai
9cc9529e57 crimson/osd: should handle pg_lease and pg_lease_ack
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-10-10 14:50:58 +08:00
Kefu Chai
202b4d3359
Merge pull request #30787 from zhangdaolong/master
doc, qa: remove invalid option mon_pg_warn_max_per_osd

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-10-10 14:04:56 +08:00
Sage Weil
c9bfbb7a47 Merge PR #30724 into master
* refs/pull/30724/head:
	mgr/telemetry: bump content revision and add a release note
	telemetry/server: add device report endpoint
	mgr/telemetry: include device telemetry
	mgr/devicehealth: factor _get_device_metrics out of show_device_metrics
	mgr/devicehealth: pull out MAX_SAMPLES

Reviewed-by: Dan Mick <dmick@redhat.com>
2019-10-09 21:30:44 -05:00
Sage Weil
47d3406fb2 mgr/telemetry: bump content revision and add a release note
Signed-off-by: Sage Weil <sage@redhat.com>
2019-10-09 21:30:13 -05:00
Sage Weil
877183f642 telemetry/server: add device report endpoint
Add a standalone endpoint to report device telemetry.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-10-09 21:30:13 -05:00
Sage Weil
eff32aab97 mgr/telemetry: include device telemetry
- anonymize device id
- anonymize host names
- strip out the serial number

Signed-off-by: Sage Weil <sage@redhat.com>
2019-10-09 21:30:13 -05:00
Patrick Donnelly
43ff0204d4
Merge PR #30809 into master
* refs/pull/30809/head:
	qa: tolerate ECONNRESET errcode during logrotate

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-10-09 13:30:20 -07:00
Sage Weil
5f15829174 Merge PR #30738 into master
* refs/pull/30738/head:
	mgr/alerts: raise health alert if smtplib has a problem
	mgr/alerts: simple module to send health alerts

Reviewed-by: Tim Serong <tserong@suse.com>
2019-10-09 14:13:40 -05:00
Jason Dillaman
bde5df98f4
Merge pull request #30793 from ricardoasmarques/rbd-parent-namespace
pybind/rbd: parent_info should return pool namespace

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-10-09 15:04:40 -04:00
Jason Dillaman
d0d32ac751
Merge pull request #30800 from liewegas/wip-container-image
common: rename 'image' to 'container_image'

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-10-09 13:05:26 -04:00
Daniel Gryniewicz
e373be8493
Merge pull request #30619 from dang/wip-dang-zipper-2
rgw: Project Zipper - Bucketlist
2019-10-09 12:38:27 -04:00
Kefu Chai
5791034e2a
Merge pull request #30811 from rzarzynski/wip-script-run-cbt-on-classical
script/run-cbt.sh: add support for ceph-osd testing.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-10-09 23:01:39 +08:00
Radoslaw Zarzynski
a1954fe397 script/run-cbt.sh: add support for ceph-osd testing.
The patch brings `--classical` switch to the `run-cbt.sh`
script. Its purpose is to automate the apple-to-apple
comparison between OSD implementations. In both cases
memstore is selected and the same benchmarks are used.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-10-09 15:34:03 +02:00
Kefu Chai
663d21e3a9
Merge pull request #30747 from rjfd/wip-dashboard-task-controller-race
mgr/dashboard: tasks: only unblock controller thread after TaskManager thread

Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2019-10-09 20:53:35 +08:00
Venky Shankar
e646524567 qa: tolerate ECONNRESET errcode during logrotate
Fixes: http://tracker.ceph.com/issues/41800
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2019-10-09 08:46:35 -04:00
Ricardo Marques
a1aaa89774 pybind/rbd: deprecate parent_info
`parent_info` is not returning the parent pool namespace
so `get_parent_image_spec` should be used instead.

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2019-10-09 10:51:21 +01:00
zhangdaolong
e5d91c9872 doc, qa:remove invalid option mon_pg_warn_max_per_osd
The older mon_pg_warn_max_per_osd option has been removed in v12.2.1 Luminous
https://ceph.com/releases/v12-2-1-luminous-released/

Fixes: https://tracker.ceph.com/issues/42221

Signed-off-by: zhang daolong <zhangdaolong@fiberhome.com>
2019-10-09 16:09:18 +08:00
Brad Hubbard
47b7e8cfbf
Merge pull request #30682 from badone/wip-bz1749874-pid-in-large-omap-log
osd/PG: Add PG to large omap log message

Reviewed-by: Vikhyat Umrao <vikhyat@redhat.com>
2019-10-09 17:31:24 +10:00
Kefu Chai
2ce2a3d62a
Merge pull request #30645 from tchaikov/wip-doc/man/ceph/config
doc/man/ceph: document 'ceph config'

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-10-09 15:20:25 +08:00
Kefu Chai
39990505a8
Merge pull request #30250 from tchaikov/wip-do-cmake.sh
do_cmake.sh: remove -DCMAKE_BUILD_TYPE=Debug from cmake options

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-10-09 14:52:44 +08:00
Kefu Chai
39235dfd29
Merge pull request #30799 from badone/wip-change-cmake-to-debug-default
cmake: Do a debug build by default

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-10-09 14:43:24 +08:00
Kefu Chai
d5d055ce98
Merge pull request #30794 from rzarzynski/wip-test-cbt-randread
test/crimson: cbt test does rand-reads instead of seq-reads.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-10-09 14:40:41 +08:00
Kefu Chai
31c541232b
Merge pull request #30726 from tchaikov/wip-musl-alphine
test: define ALLPERMS if not yet

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2019-10-09 12:46:26 +08:00
Kefu Chai
4ea4ddc482 do_cmake.sh: remove -DCMAKE_BUILD_TYPE=Debug from cmake options
so we can use do_cmake.sh for building release builds, which are
required for performance tests.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-10-09 12:26:17 +08:00
Brad Hubbard
310a959023 cmake: Do a debug build by default
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2019-10-09 13:55:26 +10:00
Sage Weil
05fdb72037 common: rename 'image' to 'container_image'
This conflicted with the rbd CLI --image argument.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-10-08 21:59:07 -05:00
Patrick Donnelly
e748f5b0f3
Merge PR #30752 into master
* refs/pull/30752/head:
	backport-create-issue: resolve parent if all backports resolved/rejected

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-10-08 13:31:57 -07:00
Radoslaw Zarzynski
02ce12c2c4 test/crimson: cbt test does rand-reads instead of seq-reads.
The rationale behind the change is not only that random
read performance tends to be more important and meaningful.
Actually, the current procedure is broken because of how
`rados bench` internally operates: the number of seq read
operations is limited by the number of write ops used to
create the data set (`write` with the `--no-cleanup` option):

  ```cpp
  int ObjBencher::write_bench(/* ... */) {
    // ...
    //write object size/number data for read benchmarks
    encode(data.object_size, b_write);
    encode(data.finished, b_write);

    //...

  int ObjBencher::fetch_bench_metadata(// ...
                                       int* num_ops, /* ... */) {
    // ...
    decode(*object_size, p);
    decode(*num_ops, p);

  int ObjBencher::seq_read_bench(
    int seconds_to_run, int num_ops, int num_objects,
    int concurrentios, int pid, bool no_verify) {

    // ...

    //start initial reads
    for (int i = 0; i < concurrentios; ++i) {
      // ...
      ++data.started;
    }

    // ...

    while ((seconds_to_run && mono_clock::now() < finish_time) &&
           num_ops > data.started) {
  ```

This makes significant problem as the cbt test uses short (3 sec.)
period of prefill. In the consequence, the sequential read testing
takes around half-second.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-10-08 21:48:17 +02:00
Patrick Donnelly
559032d7b3
Merge PR #30476 into master
* refs/pull/30476/head:
	doc: list FS subvolumes, subvolume groups and their snapshots
	qa/tasks: tests for ls
	mgr/volumes: list FS subvolumes, subvolume groups and their snapshots

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-10-08 11:43:24 -07:00
Sage Weil
37e2e76fa8 Merge PR #30788 into master
* refs/pull/30788/head:
	Revert "ceph-volume: accept --no-tmpfs argument for bluestore"
	Revert "ceph-volume: no_tmpfs -> tmpfs"

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
2019-10-08 10:11:56 -05:00
Jan Fajerski
a73c238a8f
Merge pull request #30707 from rishabh-d-dave/cv-remove-purge-from-vg-filter
ceph-volume: VolumeGroups.filter shouldn't purge itself
2019-10-08 16:42:26 +02:00
Jan Fajerski
40ba67050f
Merge pull request #30703 from rishabh-d-dave/cv-remove-purge-from-pvolumes-filter
ceph-volume: PVolumes.filter shouldn't purge itself
2019-10-08 16:41:39 +02:00
Sage Weil
a7ff510c18 Revert "ceph-volume: accept --no-tmpfs argument for bluestore"
This reverts commit e6c578a2bc.

It turns out this change isn't actually needed to make ceph-daemon do its thing, since
ceph-volume alrady skips doing anything with tmpfs if the data dir already exists.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-10-08 07:53:35 -05:00