Commit Graph

75354 Commits

Author SHA1 Message Date
Jenkins Build Slave User
f3e663a190 12.1.1 2017-07-17 16:56:02 +00:00
Yuri Weinstein
a6adc6cf3d Merge pull request #15667 from rzarzynski/wip-rgw-fix-nullptrderef-in-rgw-admin
rgw: fix potential null pointer dereference in rgw_admin.

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-07-17 08:09:43 -07:00
Yuri Weinstein
d02b00c792 Merge pull request #16251 from linuxbox2/wip-mgr-nfs-svcmap
rgw_file:  add service map registration

Reviewed-by: Sage Weil <sage@redhat.com>
2017-07-17 08:08:04 -07:00
Sage Weil
b8737fa07e Merge pull request #16341 from liewegas/wip-20631
osd: restart boot process if waiting for luminous mons

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-07-17 10:04:49 -05:00
Yuri Weinstein
eb26360b45 Merge pull request #15807 from zhangsw/feature-lifecycle-date
rgw: S3 lifecycle now supports expiration date

Reviewed-by: Daniel Gryniewicz <dang@fprintf.net>
2017-07-17 07:59:39 -07:00
Kefu Chai
7aabdc01eb Merge pull request #16339 from majianpeng/test-fio-print-more-perfcounter
test/fio: print all perfcounters rather than objectstore itself.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-07-17 20:33:21 +08:00
Kefu Chai
c142f25a60 Merge pull request #16346 from liewegas/wip-20602
mon: skip crush smoke test when running under valgrind

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-07-17 20:15:24 +08:00
Kefu Chai
2b3adf71c8 Merge pull request #16302 from liewegas/wip-mds-dup-alerts
mon/MDSMonitor: fix segv when multiple MDSs raise same alert

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-07-17 19:46:24 +08:00
Sage Weil
dd61a7f737 Merge pull request #16189 from bassam/pr-msgr-bind-addr
mon: add support public_bind_addr option

Reviewed-by: Sage Weil <sage@redhat.com>
2017-07-16 21:26:23 -05:00
Sage Weil
6e33ba0183 Merge pull request #16349 from liewegas/wip-vstart-bind
vstart.sh: bind restful, dashboard to ::, not 127.0.0.1

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-07-16 21:24:53 -05:00
Sage Weil
0be22af9e6 Merge pull request #16329 from joscollin/wip-cleanup-crush-warning
crush: silence warning from -Woverflow

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-07-16 21:24:36 -05:00
Sage Weil
d659266c76 Merge pull request #16345 from jcsp/wip-watch-channel
ceph.in: filter out audit from ceph -w

Reviewed-by: Sage Weil <sage@redhat.com>
2017-07-16 21:16:59 -05:00
Sage Weil
1a0d645b1c Merge pull request #16315 from majianpeng/bluestore-misc-fix
os/bluestore: misc fix and cleanups

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-07-16 21:11:11 -05:00
Sage Weil
6b5b15d921 Merge pull request #16351 from liewegas/wip-mgr-init-debug
mgr,mon: debug init and mgrdigest subscriptions
2017-07-16 21:08:50 -05:00
Haomai Wang
eab1c25f1f Merge pull request #16358 from liupan1111/wip-fix-client
test/msgr: fixed the hang issue for perf_msg_client

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-07-17 09:49:23 +08:00
Pan Liu
78c6b480fa test/msgr: fixed the hang issue for perf_msg_client
Signed-off-by: Pan Liu <wanjun.lp@alibaba-inc.com>
2017-07-17 09:42:04 +08:00
Sage Weil
f9433e488b qa/suites/rados/rest/mgr-restful: simplify
Use default port; don't bother setting bind addr.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-07-16 21:28:03 -04:00
Kefu Chai
171104cb93 Merge pull request #15587 from wjwithagen/wip-wjw-ceph-disk-is_diskdevice
ceph-disk/ceph_disk/main.py: Replace ST_ISBLK() test by is_diskdevice()

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-07-15 16:31:35 +08:00
Kefu Chai
742a117728 Merge pull request #16347 from tchaikov/wip-test-ceph-disk
tests: ceph-disk: use communicate() instead of wait() for output

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-07-15 16:24:23 +08:00
Jos Collin
9f6806559d Merge pull request #16334 from wjwithagen/wjw-bug-stringyfy
core:" Stringify needs access to << before reference" src/include/stringify.h

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-07-15 05:21:23 +00:00
Kefu Chai
c596bff584 qa/suites/ceph-disk: whitelist health warnings
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-07-15 11:27:02 +08:00
Kefu Chai
73c0740b08 tests: ceph-disk: use communicate() instead of wait() for output
to avoid possible deadlock. quote from doc of Popen.wait()

> This will deadlock when using stdout=PIPE and/or stderr=PIPE and the
child process generates enough output to a pipe such that it blocks
waiting for the OS pipe buffer to accept more data. Use communicate() to
avoid that.

and print out the stdout and stderr using LOG.warn() if the command
fails.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-07-15 11:27:02 +08:00
Kefu Chai
0cc65197d6 Merge pull request #16045 from Liuchang0812/wip-compact-osd-feature
osd: compact osd feature

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-07-15 10:57:13 +08:00
Jianpeng Ma
9ab14d1df7 test/fio: print all perfcounters rather than objectstore itself.
Need bluefs,rocksdb perfcounters.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-07-15 06:15:53 +08:00
Sage Weil
d52763c2cc Merge pull request #16221 from liewegas/wip-20546
crush/CrushWrapper: make get_immediate_parent[_id] ignore per-class shadow hierarchy

Reviewed-by: Neha Ojha <nojha@redhat.com>
2017-07-14 15:09:22 -05:00
Sage Weil
110e60f4e3 mgr/Mgr: debug init a bit more
Signed-off-by: Sage Weil <sage@redhat.com>
2017-07-14 16:07:28 -04:00
Sage Weil
73a5e078cb mon/MgrMonitor: debug mgrdigest subscriptions a bit
Signed-off-by: Sage Weil <sage@redhat.com>
2017-07-14 16:06:22 -04:00
Sage Weil
a88194093c vstart.sh: bind restful, dashboard to ::, not 127.0.0.1
Signed-off-by: Sage Weil <sage@redhat.com>
2017-07-14 14:34:06 -04:00
Bassam Tabbara
c0dc20533b docs: add docs for public_bind_addr
Signed-off-by: Bassam Tabbara <bassam.tabbara@quantum.com>
2017-07-14 10:41:49 -07:00
Bassam Tabbara
a8da9fd077 test,qa/workunits: add tests for public_bind_addr
Add a set of new tests for the case when public_addr and public_bind_addr
are different for a mon. In order to test this properly I had to employ
port forwarding with socat. This helps simulate what would happen in a
environment like Kubernetes. socat is now a build dependency.

Also, moved jq_success to ceph-helpers.sh and refactored run_mon to enable
creating the mons without creating the rbd pool immediately.

Signed-off-by: Bassam Tabbara <bassam.tabbara@quantum.com>
2017-07-14 10:41:49 -07:00
Bassam Tabbara
bf49385679 mon: add support public_bind_addr option
To support running in dynamic enviornments (like Kubernetes) the mon needs
to be able to advertise and ip address that is different from the ip address
that it listens on locally.

Added a new config option "public_bind_addr" which if set becomes the address
that the mon will bind to locally. If empty (the default) the public_addr
will be used to bind locally.

added a new function on Messenger to set_addr which is called by ceph-mon to set
the advertised address after doing the bind.

also relaxed the "wrong node!" errors in AsyncMessenger and SimpleMessenger as
its now valid to talk to a peer whose peer_addr_of_me is different from what
we expect.

Signed-off-by: Bassam Tabbara <bassam.tabbara@quantum.com>
2017-07-14 10:41:49 -07:00
Yehuda Sadeh
b3404bd841 Merge pull request #12139 from tianshan/fix_zone_set_realm_id
rgw: fix zone did't update realm_id when added to zonegroup

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-07-14 09:13:10 -07:00
Yuri Weinstein
34fcd223c5 Merge pull request #14915 from cbodley/wip-19817
rgw: add missing RGWPeriod::reflect() based on new atomic update_latest_epoch()

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-07-14 08:52:52 -07:00
Sage Weil
960f00071f qa/suites: disable mon crush smoke test with valgrind
Valgrind runs itself on forked children, and does its cleanup when they
complete, and this is slow... slow enough that it frequently makes the
test time out.

Valgrind let's you ignore child *processes* that you exec, but I can't
find a way to skip forked children in the same address space.

Work around this by skip this validation when running under valgrind.

Fixes: http://tracker.ceph.com/issues/20602
Signed-off-by: Sage Weil <sage@redhat.com>
2017-07-14 11:51:47 -04:00
Sage Weil
75c923e7a0 mon: add mon_osd_crush_smoke_test=true
This option allows us to disable the crush smoke test when creating pools,
injecting crush maps, or making other changes.  DANGER DANGER.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-07-14 11:51:47 -04:00
Yuri Weinstein
267b115c1f Merge pull request #15953 from rzarzynski/wip-rgw-20418
rgw: reject request if decoded URI contains \0 in the middle.

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-07-14 08:51:42 -07:00
John Spray
1486397f31 ceph.in: filter out audit from ceph -w
...and add an optional --watch-channel argument.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-07-14 11:35:18 -04:00
Sage Weil
6a0c3b45b9 Merge pull request #16340 from dillaman/wip-20630
qa/tasks: rbd-mirror daemon not properly run in foreground mode

Reviewed-by: Sage Weil <sage@redhat.com>
2017-07-14 10:19:25 -05:00
Casey Bodley
a5e7e00756 Merge pull request #16331 from zhangsw/cleanup-zonegroup-list
rgw: remove the useless output when listing zonegroups.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-07-14 11:12:57 -04:00
Sage Weil
7ec43396a2 osd: restart boot process if waiting for luminous mons
If we start_boot and see that we don't have luminous mons, we will stop.
But we don't currently reliably notice when the luminous upgrade completes.
If we happen to be connected to the last mon we will start_boot() because
of the trigger in ms_handle_connect(), but if we are not connected to the
last mon we'll eventually get a monmap update but not restart booting.

Fix by setting a flag if we are waiting, and restart boot if the flag is
set, we are in preboot, and we see we now have luminous mons.

Fixes: http://tracker.ceph.com/issues/20631
Signed-off-by: Sage Weil <sage@redhat.com>
2017-07-14 10:53:14 -04:00
Jason Dillaman
4fa1918717 qa/tasks: rbd-mirror daemon not properly run in foreground mode
Fixes: http://tracker.ceph.com/issues/20630
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-07-14 10:32:28 -04:00
Sage Weil
1ac23e7893 Merge pull request #16043 from jcsp/wip-dashboard-updates
mgr: dashboard improvements

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-07-14 09:16:33 -05:00
John Spray
2cd8c5c64c mgr/dashboard: update health display
This takes account of the new health format, also
expands and visually cleans up the frontpage
where we put the health information.

Dark backgrounds make it much easier to use
red/amber/green colours to grab attention.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-07-14 10:05:54 -04:00
John Spray
62935db879 mgr: expose a MgrMap in PyModules
Signed-off-by: John Spray <john.spray@redhat.com>
2017-07-14 10:05:54 -04:00
Sage Weil
7e142534bc Merge pull request #16020 from jcsp/wip-20383
mgr: clean up daemon start process

Reviewed-by: Sage Weil <sage@redhat.com>
2017-07-14 09:04:16 -05:00
Jos Collin
48ce73722e Merge pull request #16338 from scienceluo/wip-doc-branch
doc/release-notes: Luminous release notes typo fixes

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-07-14 13:58:15 +00:00
Luo Kexue
0fe816fcdd doc/release-notes: Luminous release notes typo fixes "systemctl ceph-osd.target"->"systemctl restart ceph-osd.target" and "systemctl ceph-mgr.target"->"systemctl restart ceph-mgr.target"
Signed-off-by: Luo Kexue <luo.kexue@zte.com.cn>
2017-07-14 20:26:05 +08:00
Nathan Cutler
9cce67765a Merge pull request #16318 from smithfarm/wip-jewel-10-2-9
doc: Jewel v10.2.9 release notes

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-07-14 12:07:18 +02:00
Willem Jan Withagen
f7330a5a02 ceph_disk/main.py: fixed bugs from theutology report
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2017-07-14 10:54:32 +02:00
Willem Jan Withagen
85d7f8817e ceph-disk/main.py: Replace ST_ISBLK() test by is_diskdevice()
- FreeBSD does not have blockdevices any more (since 2002)
   So disk are just Character special devices, so test on ISCHR

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2017-07-14 10:48:34 +02:00