Commit Graph

107090 Commits

Author SHA1 Message Date
Yehuda Sadeh
cb55d8ada1 rgw-admin: sync group pipe create and remove
also rename sync group flow add to sync group flow create.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:37 -08:00
Yehuda Sadeh
e163cd0565 rgw-admin: sync group get command
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:37 -08:00
Yehuda Sadeh
3c5f4bc073 rgw-admin: sync group flow remove command
and also some code cleanup.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:37 -08:00
Yehuda Sadeh
ba563aebbe rgw-admin: sync group flow add command
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:37 -08:00
Yehuda Sadeh
c65e9d7ac4 rgw: bucket sync, change "target" to "dest"
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:37 -08:00
Yehuda Sadeh
30882796af rgw: json dump sync groups map as vector
looks nicer

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:37 -08:00
Yehuda Sadeh
7fcf0f5d03 rgw-admin: sync group create/remove commands
Still incomplete

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:37 -08:00
Yehuda Sadeh
d675cc4111 rgw: sync policy logic
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:36 -08:00
Yehuda Sadeh
67e32650c1 rgw: redo policy definitions
Still incomplete

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:36 -08:00
Yehuda Sadeh
66ea7bcc04 rgw: compilation fixes
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:36 -08:00
Yehuda Sadeh
58d7dfc994 rgw-admin: sync policy related commands
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:36 -08:00
Yehuda Sadeh
1ca8ec9852 rgw: add sync policy to zonegroup
and move code around

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:36 -08:00
Yehuda Sadeh
90f892aea6 rgw-admin: bucket sync info command
Dumps bucket sources

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:36 -08:00
Yehuda Sadeh
9ce54d0781 rgw: pass through bucket sync pairs
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:36 -08:00
Yehuda Sadeh
a0a68effe4 rgw: define bucket sync pipes
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:36 -08:00
Yehuda Sadeh
3bc7ca6d8b rgw: bucket sync: read local bucket sources
And also add functionality to get bucket sync policy handler (in cr).
Next we'll need to compare local bucket sources with what policy
handler defines, and act if it's different.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:36 -08:00
Yehuda Sadeh
41b14af332 rgw: defined bucket sync sources manager
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:36 -08:00
Yehuda Sadeh
9db06e677d rgw: data sync: split RGWDataSyncEnv
Keep only the environment related fields in there, and have the
sync info related stuff in the containing RGWDataSyncCtx.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:36 -08:00
Yehuda Sadeh
4a2b12a6d6 rgw: reduce use of sync_env->store
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:36 -08:00
Yehuda Sadeh
339687f6e8 rgw: data sync: rename current bucket sync crs
Add the 'pipe' term as bucket can be synced on multiple pipes.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:36 -08:00
Yehuda Sadeh
9b06d22098 rgw: ctl.bucket: add bucket sync related methods
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:36 -08:00
Yehuda Sadeh
53b1eac8bc rgw: svc.bucket_sync: add new svc for dealing with bucket sync policy
svc.bucket_sync_sobj keeps a cache of bucket sync policies (per bucket
instance), and chains to the metadata cache.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:36 -08:00
Yehuda Sadeh
6310a6837c rgw: rework sync policy
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:36 -08:00
Yehuda Sadeh
b4c2a29082 rgw: define sync policy structures
Defines sync policy for both zones and buckets.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:36 -08:00
Yehuda Sadeh
0a306290ee rgw: remove unused variable
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:36 -08:00
Yehuda Sadeh
56b5cc1bdb rgw: sync: separate source and dest bucket
This is still incomplete. The idea is that source bucket and destination
bucket do not need to reflect the same entity.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:36 -08:00
Yehuda Sadeh
79802837cf rgw: bucket sync: integrate bucket sync decisions
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:36 -08:00
Yehuda Sadeh
f05d85342c rgw: store data log entry if bucket sync policy not empty
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:36 -08:00
Yehuda Sadeh
7303c4d72c rgw: bucket-granularity sync: define policy structure
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:35 -08:00
Yehuda Sadeh
ca4b319bcf rgw: test-multi: craft admin command line options differently
The problem was specifically with the "--rgw-cache-enabled false" param. This
doesn't work like that anymore, need to either pass --rgw-cache-enabled=false,
or --no-rgw-cache-enabled.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:35 -08:00
Yehuda Sadeh
f8c4d1fb73 rgw-admin: dump command if not found
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:35 -08:00
Yehuda Sadeh
5f19c937dd rgw-admin: split remove and delete aliases
Since "zonegroup remove" and "zonegroup delete" are different commands,
don't have them share the same aliases.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:35 -08:00
Yehuda Sadeh
0eb950059a rgw-admin: add "zonegroup remove zone" command
Does the same as "zonegroup remove", but should be used instead of it
as we also have a different "zonegroup delete" command.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:35 -08:00
Yehuda Sadeh
cc840de22c rgw-admin: cmdline, dump expected commands on error
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:35 -08:00
Yehuda Sadeh
23d182cedd rgw-admin: adjust commands
Add missing definitions needed for backward compatibility.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:35 -08:00
Yehuda Sadeh
6304121e64 rgw-admin: use strongly typed enum for cmdline options
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:35 -08:00
Yehuda Sadeh
e9301577ee rgw-admin: cmdline, use generic std::any to hold value
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:35 -08:00
Yehuda Sadeh
505e200693 rgw-admin: put cmd parser in its own class
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:35 -08:00
Yehuda Sadeh
4bf994f685 rgw-admin: command line aliases
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:35 -08:00
Yehuda Sadeh
78f47f7a01 rgw-admin: remove old manual command parsing code
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:35 -08:00
Yehuda Sadeh
4034137a41 rgw-admin: new command parsing
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:35 -08:00
Sage Weil
b44f165107 mgr/cephadm: fix detection of just-created OSDs
Only match OSDs we see that didn't exist before we ran c-v prepare.
This might include other OSDs created by a racing c-v incantation, but (1)
we shouldn't have any of those, and (2) even if they were, the OSD is new
and should be added.

Signed-off-by: Sage Weil <sage@redhat.com>

# Conflicts:
#	src/pybind/mgr/cephadm/module.py
2020-01-28 10:09:57 -06:00
Joshua Schmid
7320d2b502 mgr/cephadm: properly indent raise conditions
Signed-off-by: Joshua Schmid <jschmid@suse.de>
Co-Authored-By: Kiefer Chang <1691518+bk201@users.noreply.github.com>
2020-01-28 10:09:38 -06:00
Joshua Schmid
9d42b1ce97 mgr/cephadm: add warning to other orchestrators
the extended drivegroup approach is not fully supported
with the other orchestrators and probably need to get reworked.

Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-01-28 10:09:38 -06:00
Joshua Schmid
6774a8d03c mgr/cephadm: separate acceptance criterias for Devices
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-01-28 10:09:38 -06:00
Joshua Schmid
42ebc186ad mgr/cephadm: fix typos
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-01-28 10:09:38 -06:00
Joshua Schmid
38f6a6a708 mgr/cephadm: move utils in test/utils.py
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-01-28 10:09:38 -06:00
Joshua Schmid
3a0fbbeddb mgr/ssh: increase disk size to 20G
ceph-volume will only take disks > 5G

Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-01-28 10:09:38 -06:00
Joshua Schmid
ec1a2674a0 drivegroups: add support for drivegroups + tests
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-01-28 10:09:33 -06:00
Mykola Golub
756cd77dec librbd: make build on freebsd
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-01-28 17:55:31 +02:00