Commit Graph

76 Commits

Author SHA1 Message Date
Thomas Schoebel-Theuer 7cc5c12436 light: offload trans_logger from symlink update (deadlock prevention) 2013-01-23 20:06:59 +01:00
Thomas Schoebel-Theuer 899b0a5743 trans_logger: fix potential race on old versionlink computation 2013-01-23 20:06:59 +01:00
Thomas Schoebel-Theuer 2a809fddfd trans_logger: fix start_pos on log replay 2013-01-23 20:06:59 +01:00
Thomas Schoebel-Theuer 146101d034 lib_log: use standard chunk_size in log_read() 2013-01-23 20:06:59 +01:00
Thomas Schoebel-Theuer f8496d2392 trans_logger: report pos_count specificly for input 2013-01-23 20:06:58 +01:00
Thomas Schoebel-Theuer b5488cbea4 trans_logger: count flying logger requests separately 2013-01-23 20:06:58 +01:00
Thomas Schoebel-Theuer 71429b5bee trans_logger: never collect non-persistent data for writeback 2013-01-23 20:06:58 +01:00
Thomas Schoebel-Theuer df950fe505 trans_logger: disallow KEEP_UNIQUE data buffer modification after IO has started 2013-01-23 20:06:57 +01:00
Thomas Schoebel-Theuer 28d433cc81 trans_logger: fix potential race on log_input
During logrotate, there may exist writeback clusters
with mixed log_inputs. Each sub_mref now gets its individual
log_input inherited from the orig_mref. Add ref counting
to ensure that cleanup can never occur on an active log_input.
2013-01-23 20:06:57 +01:00
Thomas Schoebel-Theuer 51fe58aeac trans_logger: fix races on _inf_callback() 2013-01-23 20:06:57 +01:00
Thomas Schoebel-Theuer ec69356a14 trans_logger: make completion_semantics configurable 2013-01-23 20:06:57 +01:00
Thomas Schoebel-Theuer 7b905f93ad trans_logger: limit q0 length 2013-01-23 20:06:57 +01:00
Thomas Schoebel-Theuer 8a7d86e73b trans_logger: avoid CPU consumption upon untreatable queues 2013-01-23 20:06:56 +01:00
Thomas Schoebel-Theuer 37fdd05899 trans_logger: report #pushbacks and no_progress 2013-01-23 20:06:56 +01:00
Thomas Schoebel-Theuer fa12becf00 trans_logger: add CRC checksumming of data
Off by default, since it may hurt performance.
2013-01-23 20:06:56 +01:00
Thomas Schoebel-Theuer 7a01e6a5a8 trans_logger: update symlinks via callback 2013-01-23 20:06:54 +01:00
Thomas Schoebel-Theuer 569e70eb90 light: delay shutdown if buffer memory is in use 2013-01-23 20:06:49 +01:00
Thomas Schoebel-Theuer c319230fa1 all: IO scheduling improvements, tuning
Dastically boost random write performance on RAID controllers with BBUs.
Writeback is only performed when there is no IO contention / starvation.
The old IO contention controller was suited to workstations.
Now server loads are well-controlled even when BBUs are present.
2013-01-23 20:06:49 +01:00
Thomas Schoebel-Theuer 9016c81057 light: report timestamp of replay in actual-* 2013-01-20 23:24:30 +01:00
Thomas Schoebel-Theuer 23c8af994c proc: show actual mem usage in /proc/sys/mars/ 2013-01-20 23:24:30 +01:00
Thomas Schoebel-Theuer 261fc98d4a light: use limiter for display of rates 2013-01-20 23:24:30 +01:00
Thomas Schoebel-Theuer c1ba96f0a0 all: fix race on close of transaction log 2013-01-20 23:24:29 +01:00
Thomas Schoebel-Theuer 2897ddf812 light: emergency stop logging on filesystem full 2013-01-20 23:24:24 +01:00
Thomas Schoebel-Theuer 6071c49db9 all: rename some variables 2013-01-20 23:24:22 +01:00
schoebel 847f2a416f trans_logger: new IO scheduling 2013-01-20 23:24:22 +01:00
schoebel 2c5fcccc4e trans_logger: replace single queues by array 2013-01-20 23:24:21 +01:00
schoebel 63c3bf0f49 trans_logger: renumber queues from 0 to 3
Conflicts:

	mars_trans_logger.c
2013-01-20 23:24:21 +01:00
Thomas Schoebel-Theuer 548976cdde trans_logger: simplify writeback code 2013-01-20 23:24:21 +01:00
schoebel baf5ea99da improve trans_logger replay speed, better statistics 2013-01-20 23:24:18 +01:00
schoebel cd78a933a4 trans_logger: improve statistics
Conflicts:

	mars_trans_logger.c
2013-01-20 23:24:13 +01:00
Thomas Schoebel-Theuer 4f2057bdca fix pos_complete(), move to __trans_logger_ref_put()
unsure whether needed.

probably MANDATORY to avoid that replay symlinks could go ahead?
2013-01-20 23:24:11 +01:00
Thomas Schoebel-Theuer 22cc0f8fef ensure that ref_rw cannot change underneath 2013-01-20 23:24:11 +01:00
Thomas Schoebel-Theuer 91f262b72b improve detection of memleaks 2013-01-20 23:23:49 +01:00
Thomas Schoebel-Theuer 281c371d49 make mem allocation more robust 2013-01-20 23:23:46 +01:00
Thomas Schoebel-Theuer f3274dda5b improved logger statistics (show delay count) 2013-01-20 23:23:30 +01:00
Thomas Schoebel-Theuer 227d9061fb fix minor race in logrotate 2013-01-20 23:23:30 +01:00
Thomas Schoebel-Theuer 77ac60b93a fix logrotate 2013-01-20 23:23:30 +01:00
Thomas Schoebel-Theuer fffc77a705 allow global limitation of mrefs in trans_logger (not yet activated) 2013-01-13 12:12:06 +01:00
Thomas Schoebel-Theuer d4f6d3f6a4 added feature log-rotate (while the system is loaded) 2013-01-13 12:12:06 +01:00
Thomas Schoebel-Theuer 16c4314409 removed alias symlinks to logfiles 2013-01-13 12:12:04 +01:00
schoebel f2d1033f5f infrastructure: use bricks instead of outputs for aspects, remove hidden
outputs
2013-01-13 12:12:03 +01:00
Thomas Schoebel-Theuer 60f17b2db8 import mars-112.tgz 2013-01-08 15:54:34 +01:00
Thomas Schoebel-Theuer 9e6af72a34 import mars-110.tgz 2013-01-08 15:54:33 +01:00
Thomas Schoebel-Theuer 4c6369d65d import mars-107.tgz 2013-01-08 15:54:32 +01:00
Thomas Schoebel-Theuer 4e6527b5cf import mars-106.tgz 2013-01-08 15:54:31 +01:00
Thomas Schoebel-Theuer b01cfa51e2 import mars-105.tgz 2013-01-08 15:54:31 +01:00
Thomas Schoebel-Theuer cabe994815 import mars-103.tgz 2013-01-08 15:54:30 +01:00
Thomas Schoebel-Theuer 3245a9ea55 import mars-100.tgz 2013-01-08 15:54:28 +01:00
Thomas Schoebel-Theuer a6d10aaa72 import mars-99.tgz 2013-01-08 15:54:28 +01:00
Thomas Schoebel-Theuer 356b102142 import mars-98.tgz 2013-01-08 15:54:27 +01:00