Commit Graph

70895 Commits

Author SHA1 Message Date
John Spray
a762ad4d7f Merge pull request #14104 from jcsp/wip-18509
mds: include advisory `path` field in damage

Reviewed-by: Yan, Zheng <zyan@redhat.com>
2017-04-18 12:48:52 +01:00
John Spray
c4f8f61816 Merge pull request #14164 from jcsp/wip-16842-mitigation
Mitigation for #16842, validate sessions after load

Reviewed-by: Yan, Zheng <zyan@redhat.com>
2017-04-18 12:48:20 +01:00
Haomai Wang
5737edfa46 Merge pull request #14585 from optimistyzy/414
bluestore/NVMEDEVICE: update SPDK to version 17.03

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-04-18 19:23:30 +08:00
Orit Wasserman
cb94e5ad3f Merge pull request #12535 from ceph/wip-rgw-multisite-teuthology
rgw: multisite enabled over multiple clusters
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-18 11:47:48 +03:00
Kefu Chai
b973be63fe Merge pull request #14555 from yaozongyou/fix-readme-notconsistent
README.md: fix build instructions inconsistent.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-18 15:59:23 +08:00
optimistyzy
bc7c6b3fc0 bluestore/NVMEDEVICE: update SPDK to version 17.03
Do some minor changes:

1 Restrict the total DPDK memory used by an osd instance.
change the name from bluestore_spdk_socket_mem to
bluestore_spdk_mem.

2 use spdk_env_init instead of rte_eal_init. The reason is that
SPDK lib invokes rte_eal_init which reduces the initilization
paramter conversion and check, also spdk 17.03 invokes
spdk_vtophys_register_dpdk_mem() (which is an internal function)
in spdk_env_init, and this func must be called.

Signed-off-by: optimistyzy <optimistyzy@gmail.com>
2017-04-18 09:44:47 +08:00
Sage Weil
48074a96ec Merge pull request #14591 from tchaikov/wip-readme-headings
README.md: use github heading syntax to mark the headings

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2017-04-17 16:43:43 -05:00
Sage Weil
37e9a874af Merge pull request #13968 from dzafman/wip-15912-followon
osd,mon: misc full fixes and cleanups

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-17 16:42:13 -05:00
Yuri Weinstein
287f94d0c0 Merge pull request #14440 from liewegas/wip-status-flags
osd/OSDMap: hide require_*_osd and sortbitwise flags


Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-04-17 13:34:37 -07:00
David Zafman
3becdd3138 test: Test health check output for full ratios
Test out of order ratios summary and details
Test various full osd conditions summary and details

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 13:02:57 -07:00
Matt Benjamin
b01bf489ad Merge pull request #14561 from linuxbox2/wip-rgw-reread-dir
rgw_file: fix readdir after dirent-change
2017-04-17 14:58:35 -04:00
Kefu Chai
472626b4ec README.md: use github heading syntax to mark the headings
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-04-17 23:49:32 +08:00
Casey Bodley
7e19db2c2f Merge pull request #14466 from fangyuxiangGL/bi
rgw: bucket stats display bucket index type

Reviewed-by: liuchang0812 <liuchang0812@gmail.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-17 11:04:02 -04:00
David Zafman
2522307865 mon, osd: Add detailed full information for now in the mon
Show ceph health doc output in the correct order

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 08:02:50 -07:00
David Zafman
e4cf10d3d8 mon: Issue warning or error if a full ratio out of order
The full ratios should be in this order: nearfull, backfillfull, full, failsafe full

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 08:02:50 -07:00
David Zafman
c83f11de00 mon: Always fix-up full ratios when specified incorrectly in config
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 08:02:50 -07:00
David Zafman
afd739bed6 mon: Use currently configure full ratio to determine available space
This is a bug that would not adjust available space based on the
currently configured full ratio, but rather the mon_osd_full_ratio
default initial value.

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 08:00:24 -07:00
David Zafman
1fafec2175 osd: check_full_status() remove bogus comment and use equivalent computation
We actually compute kb_used as the kb - kb_avail.  We don't have the
statfs() system call issue of non-privileged f_bavail vs f_bfree.  It
was assumed that used was really like (blocks - f_bfree).  It is not.

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 08:00:24 -07:00
David Zafman
84088568b5 osd: Check whether any OSD is full before starting recovery
Add event RecoveryTooFull to move to NotRecovering state

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 08:00:24 -07:00
David Zafman
27e14504f6 osd: Add PG state and flag for too full for recovery
New state machine state NotRecovering
New PG state PG_STATE_RECOVERY_TOOFULL

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 08:00:24 -07:00
David Zafman
c7e8dcad34 osd: Add check_osdmap_full() to check for shard OSD fullness
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 08:00:24 -07:00
David Zafman
94e253ce37 osd: Rename backfill_request_* to recovery_request_*
To be used by both recovery and backfill

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 08:00:24 -07:00
David Zafman
1711ccdec7 osd: Check failsafe full and crash on push/pull
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 08:00:24 -07:00
David Zafman
1e2fde1012 osd: Revamp injectfull op to support all full states
Use check_* for injectable full checks
Use is_* to just test simple cur_state

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 08:00:24 -07:00
David Zafman
a5731076ad osd: Handle backfillfull_ratio just like nearfull and full
Add BACKFILLFULL as a local OSD cur_state
Notify monitor of this new fullness state

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 08:00:24 -07:00
David Zafman
0264bbddb7 osd: For testing full disks add injectfull socket command
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 07:58:30 -07:00
David Zafman
9dd6952999 common: Bump ratio for backfillfull from 85% to 90%
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 07:58:30 -07:00
David Zafman
79a4ac41c5 common: Remove unused config option osd_recovery_threads
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 07:58:30 -07:00
David Zafman
79124330c7 osd: too_full_for_backfill() returns ostream for reason
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 07:58:30 -07:00
David Zafman
5baf7abfa3 osd: Fail-safe full is a hard stop even for mds
We can't allow OSD to become non-startable even if mds
could be writing as part of file removals.

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 07:58:30 -07:00
David Zafman
e927cd2cf2 test: Fix intended test flow and restore nearfull-ratio
This is inconsequential but seems to have always been wrong since original
commit 6cafb0e3e0

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 07:58:30 -07:00
David Zafman
811f89a682 test: Switch from pg to osd for set-*-ratio commands
Testing of 6422e0a220

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 07:58:30 -07:00
David Zafman
d024ab0504 osd: Remove unused argument to clear_queued_recovery
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 07:58:30 -07:00
David Zafman
6c930f7e66 osd: Increase osd_backfill_retry_interval to 30 seconds
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 07:58:30 -07:00
David Zafman
3a66f1fbf6 ceph-objectstore-tool: cleanup comment
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 07:58:30 -07:00
David Zafman
1e7d227bfc osd: Fix log message
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-04-17 07:58:30 -07:00
Casey Bodley
ac77cadc8d Merge pull request #12536 from ilc/cls_rgw_minor_refactor
cls/rgw: Clean up the "magic string" usage in the cls layer for RGW.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2017-04-17 09:40:47 -04:00
John Spray
1247119ca8 Merge pull request #14046 from songbaisen/m7
mgr: optimization some judgment and adjust the debug remove value in register_new_pgs

Reviewed-by: John Spray <john.spray@redhat.com>
2017-04-17 11:23:22 +01:00
songbaisen
3da07ea0a5 mgr: optimization some judgment and adjust the debug remove value in register_new_pgs
Signed-off-by: song baisen <song.baisen@zte.com.cn>
2017-04-17 06:53:26 +00:00
John Spray
4314e3d1c5 Merge pull request #14267 from yunfeiguan/master
cephfs: fix mount point break off problem after mds switch occured 

Reviewed-by: Yan, Zheng <zyan@redhat.com>
2017-04-15 19:46:53 +01:00
John Spray
c65e4fbf8e Merge pull request #13587 from yanghonggang/master
cephfs: fix write_buf's _len overflow problem

Reviewed-by: John Spray <john.spray@redhat.com>
2017-04-15 19:45:54 +01:00
John Spray
177699981e Merge pull request #13522 from singler/wip-reconnect-client
client/Client.cc: after reset session from MDS - reconnect

Reviewed-by: Yan, Zheng <zyan@redhat.com>
2017-04-15 19:44:53 +01:00
John Spray
0cb0c494d9 Merge pull request #13466 from jcsp/wip-cephfs-ecoverwrites
Add test for is_hacky_ecoverwrites in cephfs pool checks

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-15 19:44:00 +01:00
John Spray
f412345590 Merge pull request #14207 from jcsp/wip-19401
mds: ignore ENOENT on writing backtrace

Reviewed-by: Yan, Zheng <zyan@redhat.com>
2017-04-15 19:40:59 +01:00
Matt Benjamin
e0f80266ec rgw_file: fix readdir after dirent-change
Also, fixes link count computation off-by-one, update of state.nlink
after computation, link computation reset at start, and a time print
in debug log.

Fixes: http://tracker.ceph.com/issues/19634

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>

link count

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-04-15 10:05:24 -04:00
John Spray
39bd183349 Merge pull request #13579 from ukernel/wip-19022
client: drop cap snaps when auth mds session gets closed

Reviewed-by: John Spray <john.spray@redhat.com>
2017-04-15 12:15:04 +01:00
Sage Weil
d82ac99d70 Merge pull request #14490 from liewegas/wip-no-luminous
mon: add mon_debug_no_require_luminous

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-14 20:05:45 -05:00
Matt Benjamin
260de938f0 Merge pull request #14553 from guihecheng/rgw_file-revert
rgw_file: fix up potential race condition

verified f23
2017-04-14 14:30:38 -04:00
Kefu Chai
43a2f3ed33 Merge pull request #14546 from dachary/wip-19628-directory-boot
ceph-disk: enable directory backed OSD at boot time

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-15 00:06:50 +08:00
Sage Weil
8c6820a433 qa/suites/rados/thrash: do not thrash cluster full without luminous flag
The interface changes with the luminous flag; this will fail.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-14 12:04:47 -04:00